Nov 03 18:16:51 devstack cinder-volume[75075]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Nov 03 18:16:51 devstack cinder-volume[75075]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Nov 03 18:16:51 devstack cinder-volume[75075]: we strongly recommend against using it for new projects.
Nov 03 18:16:51 devstack cinder-volume[75075]: If you are already using Eventlet, we recommend migrating to a different
Nov 03 18:16:51 devstack cinder-volume[75075]: framework.  For more detail see
Nov 03 18:16:51 devstack cinder-volume[75075]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Nov 03 18:16:51 devstack cinder-volume[75075]:   import eventlet  # noqa
Nov 03 18:16:54 devstack cinder-volume[75075]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75075) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Nov 03 18:16:54 devstack cinder-volume[75075]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75075) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Nov 03 18:16:54 devstack cinder-volume[75075]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75075) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Nov 03 18:16:55 devstack cinder-volume[75075]: INFO dbcounter [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] Registered counter for database cinder
Nov 03 18:16:55 devstack cinder-volume[75075]: DEBUG oslo_db.sqlalchemy.engines [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75075) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 03 18:16:55 devstack cinder-volume[75075]: DEBUG dbcounter [-] [75075] Writer thread running {{(pid=75075) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Nov 03 18:16:55 devstack cinder-volume[75075]: INFO cinder.rpc [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Nov 03 18:16:55 devstack cinder-volume[75075]: INFO cinder.rpc [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Nov 03 18:16:55 devstack cinder-volume[75075]: DEBUG oslo_db.sqlalchemy.engines [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75075) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 03 18:16:55 devstack cinder-volume[75075]: INFO cinder.volume.manager [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] Determined volume DB was empty at startup.
Nov 03 18:16:55 devstack cinder-volume[75075]: DEBUG cinder.volume.manager [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75075) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Nov 03 18:16:55 devstack cinder-volume[75075]: INFO cinder.volume.manager [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] Service not found for updating active_backend_id, assuming default for driver init.
Nov 03 18:16:55 devstack cinder-volume[75075]: WARNING stevedore.named [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Nov 03 18:16:55 devstack cinder-volume[75075]: WARNING castellan.key_manager [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 03 18:16:55 devstack cinder-volume[75075]: WARNING cinder.keymgr.conf_key_mgr [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 03 18:16:55 devstack cinder-volume[75075]: DEBUG cinder.volume.drivers.lvm [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75075) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}}
Nov 03 18:16:55 devstack cinder-volume[75075]: DEBUG oslo_concurrency.processutils [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75075) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_concurrency.processutils [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] CMD "cinder-rtstool verify" returned: 0 in 0.423s {{(pid=75075) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_db.sqlalchemy.engines [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75075) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 03 18:16:56 devstack cinder-volume[75075]: INFO cinder.rpc [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Nov 03 18:16:56 devstack cinder-volume[75075]: INFO cinder.rpc [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version.
Nov 03 18:16:56 devstack cinder-volume[75075]: WARNING stevedore.named [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Nov 03 18:16:56 devstack cinder-volume[75075]: WARNING castellan.key_manager [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 03 18:16:56 devstack cinder-volume[75075]: INFO cinder.volume.manager [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] Image-volume cache enabled for host devstack@lvmdriver-1.
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_db.sqlalchemy.engines [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75075) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 03 18:16:56 devstack cinder-volume[75075]: INFO oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] Starting 1 workers
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] Started child 75223 {{(pid=75075) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] Full set of CONF: {{(pid=75075) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] ******************************************************************************** {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] Configuration options gathered from: {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] ================================================================================ {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] allow_availability_zone_fallback = False {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] allow_compression_on_image_upload = False {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] allowed_direct_url_schemes     = [] {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] api_rate_limit                 = True {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] auth_strategy                  = keystone {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] az_cache_duration              = 3600 {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] backend_availability_zone      = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] backend_host                   = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75223]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.1)
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] backend_name                   = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] backend_stats_polling_interval = 60 {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] backup_api_class               = cinder.backup.api.API {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] backup_name_template           = backup-%s {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] backup_use_same_host           = False {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] backup_use_temp_snapshot       = False {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] chap_password                  = **** {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] chap_username                  =  {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] cinder_internal_tenant_project_id = 341d02d0729f4a74bd8fb9c16479dd9a {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] cinder_internal_tenant_user_id = be9589133df04355a6d5941d30adc163 {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] cloned_volume_same_az          = True {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] cluster                        = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] compression_format             = gzip {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] compute_api_class              = cinder.compute.nova.API {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] config_dir                     = [] {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] config_source                  = [] {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] control_exchange               = openstack {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] debug                          = True {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] default_availability_zone      = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] default_group_type             = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] default_volume_type            = lvmdriver-1 {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] disk_geometry                  = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] driver_client_cert             = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] driver_client_cert_key         = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] driver_data_namespace          = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] driver_ssl_cert_path           = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] driver_ssl_cert_verify         = False {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] driver_use_ssl                 = False {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] enable_force_upload            = False {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] enable_new_services            = True {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] enable_unsupported_driver      = False {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] enabled_backends               = ['lvmdriver-1'] {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] enforce_multipath_for_image_xfer = False {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] filter_function                = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] glance_api_insecure            = False {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] glance_api_servers             = ['http://192.168.122.243/image'] {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] glance_api_ssl_compression     = False {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] glance_ca_certificates_file    = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] glance_catalog_info            = image:glance:publicURL {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] glance_certfile                = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] glance_keyfile                 = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] glance_num_retries             = 3 {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] glance_request_timeout         = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] goodness_function              = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] graceful_shutdown_timeout      = 5 {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] group_api_class                = cinder.group.api.API {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] host                           = devstack {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] image_compress_on_upload       = True {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] image_conversion_address_space_limit = 1 {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] image_conversion_cpu_limit     = 60 {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] image_conversion_disable       = False {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] image_introspection_address_space_limit = 1 {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] image_introspection_cpu_limit  = 60 {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] image_upload_use_cinder_backend = False {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] image_upload_use_internal_tenant = False {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] image_volume_cache_enabled     = False {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] image_volume_cache_max_count   = 0 {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] image_volume_cache_max_size_gb = 0 {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] init_host_max_objects_retrieval = 0 {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] instance_format                = [instance: %(uuid)s]  {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] iscsi_target_flags             =  {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] iscsi_write_cache              = on {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] iser_helper                    = tgtadm {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75223]: INFO cinder.volume.manager [None req-5460b051-2c1b-4403-a07c-187479adce81 None None] Starting volume driver LVMVolumeDriver (3.0.0)
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] iser_ip_address                = 192.168.122.243 {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] iser_port                      = 3260 {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75223]: DEBUG oslo_concurrency.processutils [None req-5460b051-2c1b-4403-a07c-187479adce81 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75223) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] log_color                      = False {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] log_config_append              = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] log_dir                        = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] log_file                       = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] log_options                    = True {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] log_rotate_interval            = 1 {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] log_rotate_interval_type       = days {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] log_rotation_type              = none {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] max_age                        = 0 {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] max_logfile_count              = 30 {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] max_logfile_size_mb            = 200 {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] max_over_subscription_ratio    = 20.0 {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] message_reap_interval          = 86400 {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] message_ttl                    = 2592000 {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] migration_create_volume_timeout_secs = 300 {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] monkey_patch                   = False {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] monkey_patch_modules           = [] {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] my_ip                          = 192.168.122.243 {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] no_snapshot_gb_quota           = False {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] num_iser_scan_tries            = 3 {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] num_shell_tries                = 3 {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] num_volume_device_scan_tries   = 3 {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] nvmeof_conn_info_version       = 1 {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] nvmet_ns_id                    = 10 {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] nvmet_port_id                  = 1 {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] osapi_max_limit                = 1000 {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] osapi_volume_ext_list          = [] {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] osapi_volume_listen_port       = 8776 {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] osapi_volume_use_ssl           = False {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] osapi_volume_workers           = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] per_volume_size_limit          = -1 {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] periodic_fuzzy_delay           = 60 {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] periodic_interval              = 60 {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] public_endpoint                = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] publish_errors                 = False {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] quota_backup_gigabytes         = 1000 {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] quota_backups                  = 10 {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] quota_gigabytes                = 1000 {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] quota_groups                   = 10 {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] quota_snapshots                = 10 {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] quota_volumes                  = 10 {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] rate_limit_burst               = 0 {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] rate_limit_except_level        = CRITICAL {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] rate_limit_interval            = 0 {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] reinit_driver_count            = 3 {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] replication_device             = **** {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] report_discard_supported       = False {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] report_interval                = 120 {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] reservation_clean_interval     = 86400 {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] reservation_expire             = 86400 {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] reserved_image_namespaces      = [] {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] reserved_percentage            = 0 {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] rpc_response_timeout           = 120 {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] run_external_periodic_tasks    = True {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] scst_target_driver             = iscsi {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] scst_target_iqn_name           = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] service_down_time              = 720 {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] shell_completion               = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] snapshot_name_template         = snapshot-%s {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] snapshot_same_host             = True {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] split_loggers                  = False {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] state_path                     = /opt/stack/data/cinder {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] storage_availability_zone      = nova {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75223]: DEBUG oslo_concurrency.processutils [None req-5460b051-2c1b-4403-a07c-187479adce81 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.029s {{(pid=75223) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] storage_protocol               = iSCSI {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] syslog_log_facility            = LOG_USER {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] target_helper                  = lioadm {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] target_ip_address              = 192.168.122.243 {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] target_port                    = 3260 {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75223]: DEBUG oslo_concurrency.processutils [None req-5460b051-2c1b-4403-a07c-187479adce81 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75223) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] target_protocol                = iscsi {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] target_secondary_ip_addresses  = [] {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] trace_flags                    = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] transport_url                  = **** {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] until_refresh                  = 0 {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] use_chap_auth                  = False {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] use_default_quota_class        = True {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] use_journal                    = False {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] use_json                       = False {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] use_multipath_for_image_xfer   = False {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] use_stderr                     = False {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] use_syslog                     = False {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] verify_glance_signatures       = enabled {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] volume_api_class               = cinder.volume.api.API {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] volume_backend_name            = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] volume_clear                   = zero {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] volume_clear_ionice            = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] volume_clear_size              = 0 {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] volume_copy_bps_limit          = 0 {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] volume_dd_blocksize            = 1M {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] volume_name_template           = volume-%s {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] volume_service_inithost_offload = False {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] volume_usage_audit_period      = month {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] zoning_mode                    = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] oslo_concurrency.disable_process_locking = False {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] keystone_authtoken.auth_section = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] keystone_authtoken.auth_type   = password {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] keystone_authtoken.auth_version = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] keystone_authtoken.cache       = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] keystone_authtoken.certfile    = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] keystone_authtoken.include_service_catalog = True {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75223]: DEBUG oslo_concurrency.processutils [None req-5460b051-2c1b-4403-a07c-187479adce81 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.027s {{(pid=75223) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] keystone_authtoken.insecure    = False {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75223]: DEBUG oslo_concurrency.processutils [None req-5460b051-2c1b-4403-a07c-187479adce81 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75223) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] keystone_authtoken.interface   = public {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] keystone_authtoken.keyfile     = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] keystone_authtoken.memcache_password = **** {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack sudo[75227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] keystone_authtoken.memcache_username = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack sudo[75227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] keystone_authtoken.region_name = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] keystone_authtoken.service_token_roles_required = True {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] keystone_authtoken.service_type = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.243/identity {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] cache.backend                  = dogpile.cache.null {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] cache.backend_argument         = **** {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] cache.backend_expiration_time  = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] cache.config_prefix            = cache.oslo {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] cache.debug_cache_backend      = False {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] cache.enable_retry_client      = False {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] cache.enable_socket_keepalive  = False {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] cache.enabled                  = False {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] cache.expiration_time          = 600 {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] cache.hashclient_retry_attempts = 2 {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] cache.memcache_dead_retry      = 300 {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75223]: DEBUG oslo_concurrency.processutils [None req-5460b051-2c1b-4403-a07c-187479adce81 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=75223) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] cache.memcache_pool_maxsize    = 10 {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75223]: DEBUG oslo_concurrency.processutils [None req-5460b051-2c1b-4403-a07c-187479adce81 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75223) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] cache.memcache_sasl_enabled    = False {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] cache.password                 = **** {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] cache.proxies                  = [] {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] cache.redis_db                 = 0 {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] cache.redis_server             = localhost:6379 {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] cache.retry_attempts           = 2 {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] cache.retry_delay              = 0.0 {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] cache.socket_keepalive_count   = 1 {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] cache.socket_keepalive_idle    = 1 {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] cache.socket_keepalive_interval = 1 {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] cache.socket_timeout           = 1.0 {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] cache.tls_allowed_ciphers      = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] cache.tls_cafile               = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] cache.tls_certfile             = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] cache.tls_enabled              = False {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] cache.tls_keyfile              = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] cache.username                 = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] coordination.backend_url       = **** {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] database.asyncio_connection    = **** {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] database.asyncio_slave_connection = **** {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] database.backend               = sqlalchemy {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] database.connection            = **** {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] database.connection_debug      = 0 {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] database.connection_parameters =  {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] database.connection_recycle_time = 3600 {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] database.connection_trace      = False {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] database.db_inc_retry_interval = True {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] database.db_max_retries        = 20 {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] database.db_max_retry_interval = 10 {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] database.db_retry_interval     = 1 {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] database.max_overflow          = 50 {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] database.max_pool_size         = 5 {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] database.max_retries           = 10 {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] database.mysql_wsrep_sync_wait = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] database.pool_timeout          = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] database.retry_interval        = 10 {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] database.slave_connection      = **** {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] database.sqlite_synchronous    = True {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] database.synchronous_reader    = True {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] database.use_db_reconnect      = False {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] oslo_messaging_tracing.insecure = False {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] profiler.connection_string     = messaging:// {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] profiler.enabled               = False {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] profiler.es_doc_type           = notification {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] profiler.es_scroll_size        = 10000 {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] profiler.es_scroll_time        = 2m {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] profiler.filter_error_trace    = False {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] profiler.hmac_keys             = **** {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] profiler.sentinel_service_name = mymaster {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] profiler.socket_timeout        = 0.1 {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] profiler.trace_requests        = False {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] profiler.trace_sqlalchemy      = False {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] profiler_jaeger.process_tags   = {} {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] profiler_jaeger.service_name_prefix = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] profiler_otlp.service_name_prefix = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] oslo_policy.enforce_new_defaults = True {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] oslo_policy.policy_default_rule = default {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] oslo_policy.policy_file        = policy.yaml {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] privsep_osbrick.group          = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] privsep_osbrick.helper_command = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] privsep_osbrick.user           = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] cinder_sys_admin.group         = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] cinder_sys_admin.helper_command = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] cinder_sys_admin.user          = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] service_user.auth_section      = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] service_user.auth_type         = password {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] service_user.cafile            = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] service_user.certfile          = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] service_user.collect_timing    = False {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] service_user.insecure          = False {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] service_user.keyfile           = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] service_user.send_service_user_token = True {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] service_user.split_loggers     = False {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] service_user.timeout           = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] service_user.tls_ciphers       = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] service_user.tls_min_version   = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] glance.auth_section            = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] glance.auth_type               = password {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] glance.certfile                = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] glance.collect_timing          = False {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] glance.insecure                = False {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] glance.keyfile                 = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] glance.region_name             = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] glance.split_loggers           = False {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] glance.timeout                 = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] glance.tls_ciphers             = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] glance.tls_min_version         = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] backend_defaults.backend_availability_zone = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] backend_defaults.chap_password = **** {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] backend_defaults.chap_username =  {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] backend_defaults.disk_geometry = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] backend_defaults.driver_client_cert = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] backend_defaults.driver_client_cert_key = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] backend_defaults.driver_data_namespace = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] backend_defaults.driver_use_ssl = False {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] backend_defaults.extra_capabilities = {} {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] backend_defaults.filter_function = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] backend_defaults.goodness_function = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] backend_defaults.iscsi_target_flags =  {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] backend_defaults.iscsi_write_cache = on {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] backend_defaults.iser_helper   = tgtadm {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] backend_defaults.iser_ip_address = 192.168.122.243 {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] backend_defaults.iser_port     = 3260 {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] backend_defaults.lvm_mirrors   = 0 {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] backend_defaults.lvm_share_target = False {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] backend_defaults.lvm_type      = auto {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] backend_defaults.num_shell_tries = 3 {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] backend_defaults.replication_device = **** {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] backend_defaults.report_discard_supported = False {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] backend_defaults.reserved_percentage = 0 {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] backend_defaults.target_helper = tgtadm {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] backend_defaults.target_ip_address = 192.168.122.243 {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] backend_defaults.target_port   = 3260 {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] backend_defaults.target_protocol = iscsi {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] backend_defaults.trace_flags   = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] backend_defaults.unique_fqdn_network = True {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] backend_defaults.use_chap_auth = False {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] backend_defaults.volume_backend_name = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] backend_defaults.volume_clear  = zero {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] backend_defaults.volume_clear_ionice = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] backend_defaults.volume_clear_size = 0 {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] backend_defaults.volume_group  = cinder-volumes {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] oslo_reports.file_event_handler = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] oslo_reports.log_dir           = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] lvmdriver-1.backend_host       = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] lvmdriver-1.chap_password      = **** {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] lvmdriver-1.chap_username      = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] lvmdriver-1.chiscsi_conf       = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] lvmdriver-1.disk_geometry      = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] lvmdriver-1.driver_client_cert = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] lvmdriver-1.driver_use_ssl     = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] lvmdriver-1.extra_capabilities = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] lvmdriver-1.filter_function    = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] lvmdriver-1.goodness_function  = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] lvmdriver-1.iscsi_write_cache  = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] lvmdriver-1.iser_helper        = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] lvmdriver-1.iser_ip_address    = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] lvmdriver-1.iser_port          = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] lvmdriver-1.lvm_conf_file      = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] lvmdriver-1.lvm_mirrors        = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] lvmdriver-1.lvm_share_target   = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] lvmdriver-1.lvm_type           = auto {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] lvmdriver-1.num_shell_tries    = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] lvmdriver-1.nvmet_ns_id        = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] lvmdriver-1.nvmet_port_id      = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] lvmdriver-1.replication_device = **** {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] lvmdriver-1.report_discard_supported = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] lvmdriver-1.reserved_percentage = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] lvmdriver-1.scst_target_driver = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] lvmdriver-1.storage_protocol   = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] lvmdriver-1.target_helper      = lioadm {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] lvmdriver-1.target_ip_address  = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] lvmdriver-1.target_port        = 3260 {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] lvmdriver-1.target_prefix      = iqn.2010-10.org.openstack: {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] lvmdriver-1.target_protocol    = iscsi {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] lvmdriver-1.trace_flags        = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] lvmdriver-1.use_chap_auth      = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] lvmdriver-1.volume_clear       = zero {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] lvmdriver-1.volume_clear_size  = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] lvmdriver-1.volume_driver      = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] lvmdriver-1.volume_group       = stack-volumes-lvmdriver-1 {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] lvmdriver-1.volumes_dir        = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] oslo_messaging_rabbit.ssl      = False {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] oslo_messaging_notifications.driver = [] {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] oslo_messaging_notifications.retry = -1 {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] key_manager.fixed_key          = **** {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] barbican.barbican_api_version  = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] barbican.barbican_endpoint     = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] barbican.barbican_endpoint_type = public {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] barbican.barbican_region_name  = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] barbican.cafile                = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] barbican.certfile              = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] barbican.collect_timing        = False {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] barbican.insecure              = False {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] barbican.keyfile               = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] barbican.number_of_retries     = 60 {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] barbican.retry_delay           = 1 {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] barbican.send_service_user_token = False {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] barbican.split_loggers         = False {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] barbican.timeout               = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] barbican.tls_ciphers           = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] barbican.tls_min_version       = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] barbican.verify_ssl            = True {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] barbican.verify_ssl_path       = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] barbican_service_user.auth_section = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] barbican_service_user.auth_type = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] barbican_service_user.cafile   = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] barbican_service_user.certfile = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] barbican_service_user.collect_timing = False {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] barbican_service_user.insecure = False {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] barbican_service_user.keyfile  = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] barbican_service_user.split_loggers = False {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] barbican_service_user.timeout  = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] barbican_service_user.tls_ciphers = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] barbican_service_user.tls_min_version = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] vault.approle_role_id          = **** {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] vault.approle_secret_id        = **** {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] vault.auth_method              = approle {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] vault.auth_path                = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] vault.kv_mountpoint            = secret {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] vault.kv_path                  = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] vault.kv_version               = 2 {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] vault.namespace                = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] vault.root_token_id            = **** {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] vault.ssl_ca_crt_file          = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] vault.timeout                  = 60.0 {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] vault.token_file               = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] vault.token_role               = None {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] vault.use_ssl                  = False {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:16:56 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] ******************************************************************************** {{(pid=75075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}}
Nov 03 18:16:56 devstack sudo[75227]: pam_unix(sudo:session): session closed for user root
Nov 03 18:16:56 devstack cinder-volume[75223]: DEBUG oslo_concurrency.processutils [None req-5460b051-2c1b-4403-a07c-187479adce81 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.375s {{(pid=75223) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:16:56 devstack cinder-volume[75223]: DEBUG oslo_concurrency.processutils [None req-5460b051-2c1b-4403-a07c-187479adce81 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75223) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:16:56 devstack sudo[75233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 03 18:16:56 devstack sudo[75233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:16:57 devstack sudo[75233]: pam_unix(sudo:session): session closed for user root
Nov 03 18:16:57 devstack cinder-volume[75223]: DEBUG oslo_concurrency.processutils [None req-5460b051-2c1b-4403-a07c-187479adce81 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.318s {{(pid=75223) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:16:57 devstack cinder-volume[75223]: DEBUG oslo_concurrency.processutils [None req-5460b051-2c1b-4403-a07c-187479adce81 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75223) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 03 18:16:57 devstack cinder-volume[75223]: INFO cinder.brick.local_dev.lvm [None req-5460b051-2c1b-4403-a07c-187479adce81 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool
Nov 03 18:16:57 devstack cinder-volume[75223]: DEBUG oslo_concurrency.processutils [None req-5460b051-2c1b-4403-a07c-187479adce81 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75223) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:16:57 devstack cinder-volume[75223]: DEBUG oslo_concurrency.processutils [None req-5460b051-2c1b-4403-a07c-187479adce81 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=75223) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:16:57 devstack cinder-volume[75223]: DEBUG oslo_concurrency.processutils [None req-5460b051-2c1b-4403-a07c-187479adce81 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75223) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:16:57 devstack sudo[75323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 03 18:16:57 devstack sudo[75323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:16:57 devstack sudo[75323]: pam_unix(sudo:session): session closed for user root
Nov 03 18:16:57 devstack cinder-volume[75223]: DEBUG oslo_concurrency.processutils [None req-5460b051-2c1b-4403-a07c-187479adce81 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.271s {{(pid=75223) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:16:57 devstack cinder-volume[75223]: DEBUG cinder.brick.local_dev.lvm [None req-5460b051-2c1b-4403-a07c-187479adce81 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75223) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}}
Nov 03 18:16:57 devstack cinder-volume[75223]: DEBUG oslo_concurrency.processutils [None req-5460b051-2c1b-4403-a07c-187479adce81 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75223) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:16:57 devstack sudo[75436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 03 18:16:57 devstack sudo[75436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:16:58 devstack sudo[75436]: pam_unix(sudo:session): session closed for user root
Nov 03 18:16:58 devstack cinder-volume[75223]: DEBUG oslo_concurrency.processutils [None req-5460b051-2c1b-4403-a07c-187479adce81 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.504s {{(pid=75223) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:16:58 devstack cinder-volume[75223]: DEBUG oslo_concurrency.processutils [None req-5460b051-2c1b-4403-a07c-187479adce81 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75223) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:16:58 devstack cinder-volume[75223]: DEBUG oslo_concurrency.processutils [None req-5460b051-2c1b-4403-a07c-187479adce81 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=75223) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:16:58 devstack cinder-volume[75223]: DEBUG oslo_concurrency.processutils [None req-5460b051-2c1b-4403-a07c-187479adce81 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75223) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:16:58 devstack sudo[75613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 03 18:16:58 devstack sudo[75613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:16:58 devstack sudo[75613]: pam_unix(sudo:session): session closed for user root
Nov 03 18:16:58 devstack cinder-volume[75223]: DEBUG oslo_concurrency.processutils [None req-5460b051-2c1b-4403-a07c-187479adce81 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.258s {{(pid=75223) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:16:58 devstack cinder-volume[75223]: DEBUG oslo_concurrency.processutils [None req-5460b051-2c1b-4403-a07c-187479adce81 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75223) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:16:58 devstack cinder-volume[75223]: DEBUG oslo_concurrency.processutils [None req-5460b051-2c1b-4403-a07c-187479adce81 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=75223) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:16:58 devstack cinder-volume[75223]: DEBUG oslo_concurrency.processutils [None req-5460b051-2c1b-4403-a07c-187479adce81 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75223) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:16:58 devstack sudo[75710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster
Nov 03 18:16:58 devstack sudo[75710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:16:58 devstack sudo[75710]: pam_unix(sudo:session): session closed for user root
Nov 03 18:16:58 devstack cinder-volume[75223]: DEBUG oslo_concurrency.processutils [None req-5460b051-2c1b-4403-a07c-187479adce81 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.283s {{(pid=75223) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:16:58 devstack cinder-volume[75223]: DEBUG oslo_concurrency.processutils [None req-5460b051-2c1b-4403-a07c-187479adce81 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75223) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:16:58 devstack sudo[75790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 03 18:16:58 devstack sudo[75790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:16:58 devstack sudo[75790]: pam_unix(sudo:session): session closed for user root
Nov 03 18:16:58 devstack cinder-volume[75223]: DEBUG oslo_concurrency.processutils [None req-5460b051-2c1b-4403-a07c-187479adce81 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.289s {{(pid=75223) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:16:58 devstack cinder-volume[75223]: DEBUG oslo_concurrency.processutils [None req-5460b051-2c1b-4403-a07c-187479adce81 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75223) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:16:58 devstack sudo[75846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 03 18:16:58 devstack sudo[75846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:16:59 devstack sudo[75846]: pam_unix(sudo:session): session closed for user root
Nov 03 18:16:59 devstack cinder-volume[75223]: DEBUG oslo_concurrency.processutils [None req-5460b051-2c1b-4403-a07c-187479adce81 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.341s {{(pid=75223) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:16:59 devstack cinder-volume[75223]: DEBUG oslo_concurrency.processutils [None req-5460b051-2c1b-4403-a07c-187479adce81 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75223) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:16:59 devstack sudo[75926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 03 18:16:59 devstack sudo[75926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:16:59 devstack sudo[75926]: pam_unix(sudo:session): session closed for user root
Nov 03 18:16:59 devstack cinder-volume[75223]: DEBUG oslo_concurrency.processutils [None req-5460b051-2c1b-4403-a07c-187479adce81 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=75223) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:16:59 devstack cinder-volume[75223]: DEBUG oslo_concurrency.processutils [None req-5460b051-2c1b-4403-a07c-187479adce81 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75223) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:16:59 devstack sudo[75933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 03 18:16:59 devstack sudo[75933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:16:59 devstack sudo[75933]: pam_unix(sudo:session): session closed for user root
Nov 03 18:16:59 devstack cinder-volume[75223]: DEBUG oslo_concurrency.processutils [None req-5460b051-2c1b-4403-a07c-187479adce81 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.289s {{(pid=75223) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:16:59 devstack cinder-volume[75223]: DEBUG oslo_concurrency.processutils [None req-5460b051-2c1b-4403-a07c-187479adce81 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75223) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:16:59 devstack cinder-volume[75223]: DEBUG oslo_concurrency.processutils [None req-5460b051-2c1b-4403-a07c-187479adce81 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=75223) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:16:59 devstack cinder-volume[75223]: DEBUG oslo_concurrency.processutils [None req-5460b051-2c1b-4403-a07c-187479adce81 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75223) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:16:59 devstack sudo[75943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 03 18:16:59 devstack sudo[75943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:17:00 devstack sudo[75943]: pam_unix(sudo:session): session closed for user root
Nov 03 18:17:00 devstack cinder-volume[75223]: DEBUG oslo_concurrency.processutils [None req-5460b051-2c1b-4403-a07c-187479adce81 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.351s {{(pid=75223) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:17:00 devstack cinder-volume[75223]: INFO cinder.volume.drivers.lvm [None req-5460b051-2c1b-4403-a07c-187479adce81 None None] Enabling LVM thin provisioning by default because a thin pool exists.
Nov 03 18:17:00 devstack cinder-volume[75223]: DEBUG oslo_concurrency.processutils [None req-5460b051-2c1b-4403-a07c-187479adce81 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75223) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:17:00 devstack cinder-volume[75223]: DEBUG oslo_concurrency.processutils [None req-5460b051-2c1b-4403-a07c-187479adce81 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=75223) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:17:00 devstack cinder-volume[75223]: DEBUG oslo_concurrency.processutils [None req-5460b051-2c1b-4403-a07c-187479adce81 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75223) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:17:00 devstack sudo[76033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 03 18:17:00 devstack sudo[76033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:17:00 devstack sudo[76033]: pam_unix(sudo:session): session closed for user root
Nov 03 18:17:00 devstack cinder-volume[75223]: DEBUG oslo_concurrency.processutils [None req-5460b051-2c1b-4403-a07c-187479adce81 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.260s {{(pid=75223) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:17:00 devstack cinder-volume[75223]: DEBUG cinder.volume.drivers.lvm [None req-5460b051-2c1b-4403-a07c-187479adce81 None None] Updating volume stats {{(pid=75223) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Nov 03 18:17:00 devstack cinder-volume[75223]: DEBUG oslo_concurrency.processutils [None req-5460b051-2c1b-4403-a07c-187479adce81 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75223) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:17:00 devstack sudo[76036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 03 18:17:00 devstack sudo[76036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:17:00 devstack sudo[76036]: pam_unix(sudo:session): session closed for user root
Nov 03 18:17:00 devstack cinder-volume[75223]: DEBUG oslo_concurrency.processutils [None req-5460b051-2c1b-4403-a07c-187479adce81 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=75223) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:17:00 devstack cinder-volume[75223]: DEBUG oslo_concurrency.processutils [None req-5460b051-2c1b-4403-a07c-187479adce81 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75223) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:17:00 devstack sudo[76039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 03 18:17:00 devstack sudo[76039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:17:00 devstack sudo[76039]: pam_unix(sudo:session): session closed for user root
Nov 03 18:17:00 devstack cinder-volume[75223]: DEBUG oslo_concurrency.processutils [None req-5460b051-2c1b-4403-a07c-187479adce81 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.241s {{(pid=75223) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:17:00 devstack cinder-volume[75223]: DEBUG oslo_concurrency.processutils [None req-5460b051-2c1b-4403-a07c-187479adce81 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75223) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:17:00 devstack sudo[76042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 03 18:17:00 devstack sudo[76042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:17:01 devstack sudo[76042]: pam_unix(sudo:session): session closed for user root
Nov 03 18:17:01 devstack cinder-volume[75223]: DEBUG oslo_concurrency.processutils [None req-5460b051-2c1b-4403-a07c-187479adce81 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.246s {{(pid=75223) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:17:01 devstack cinder-volume[75223]: DEBUG oslo_concurrency.processutils [None req-5460b051-2c1b-4403-a07c-187479adce81 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75223) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:17:01 devstack sudo[76045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 03 18:17:01 devstack sudo[76045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:17:01 devstack sudo[76045]: pam_unix(sudo:session): session closed for user root
Nov 03 18:17:01 devstack cinder-volume[75223]: DEBUG oslo_concurrency.processutils [None req-5460b051-2c1b-4403-a07c-187479adce81 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=75223) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:17:01 devstack cinder-volume[75223]: INFO cinder.volume.driver [None req-5460b051-2c1b-4403-a07c-187479adce81 None None] Driver hasn't implemented _init_vendor_properties()
Nov 03 18:17:01 devstack cinder-volume[75223]: DEBUG cinder.volume.driver [None req-5460b051-2c1b-4403-a07c-187479adce81 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75223) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Nov 03 18:17:01 devstack cinder-volume[75223]: DEBUG oslo_db.sqlalchemy.engines [None req-5460b051-2c1b-4403-a07c-187479adce81 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75223) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 03 18:17:01 devstack cinder-volume[75223]: DEBUG dbcounter [-] [75223] Writer thread running {{(pid=75223) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Nov 03 18:17:01 devstack cinder-volume[75223]: DEBUG cinder.db.api [None req-5460b051-2c1b-4403-a07c-187479adce81 None None] Building query based on filter {{(pid=75223) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Nov 03 18:17:01 devstack cinder-volume[75223]: DEBUG cinder.image.image_utils [None req-5460b051-2c1b-4403-a07c-187479adce81 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75223) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}}
Nov 03 18:17:01 devstack cinder-volume[75223]: INFO cinder.keymgr.migration [None req-a29ed46b-8e0c-444d-8330-aea7cb0dd039 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Nov 03 18:17:01 devstack cinder-volume[75223]: DEBUG cinder.volume.drivers.lvm [None req-5460b051-2c1b-4403-a07c-187479adce81 None None] Updating volume stats {{(pid=75223) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Nov 03 18:17:01 devstack cinder-volume[75223]: DEBUG oslo_concurrency.processutils [None req-5460b051-2c1b-4403-a07c-187479adce81 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75223) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:17:01 devstack sudo[76049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 03 18:17:01 devstack sudo[76049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:17:01 devstack sudo[76049]: pam_unix(sudo:session): session closed for user root
Nov 03 18:17:01 devstack cinder-volume[75223]: DEBUG oslo_concurrency.processutils [None req-5460b051-2c1b-4403-a07c-187479adce81 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=75223) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:17:01 devstack cinder-volume[75223]: DEBUG oslo_concurrency.processutils [None req-5460b051-2c1b-4403-a07c-187479adce81 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75223) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:17:01 devstack sudo[76052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 03 18:17:01 devstack sudo[76052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:17:02 devstack sudo[76052]: pam_unix(sudo:session): session closed for user root
Nov 03 18:17:02 devstack cinder-volume[75223]: DEBUG oslo_concurrency.processutils [None req-5460b051-2c1b-4403-a07c-187479adce81 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=75223) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:17:02 devstack cinder-volume[75223]: DEBUG oslo_concurrency.processutils [None req-5460b051-2c1b-4403-a07c-187479adce81 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75223) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:17:02 devstack sudo[76058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 03 18:17:02 devstack sudo[76058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:17:02 devstack sudo[76058]: pam_unix(sudo:session): session closed for user root
Nov 03 18:17:02 devstack cinder-volume[75223]: DEBUG oslo_concurrency.processutils [None req-5460b051-2c1b-4403-a07c-187479adce81 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.270s {{(pid=75223) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:17:02 devstack cinder-volume[75223]: DEBUG oslo_concurrency.processutils [None req-5460b051-2c1b-4403-a07c-187479adce81 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75223) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:17:02 devstack sudo[76064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 03 18:17:02 devstack sudo[76064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:17:02 devstack sudo[76064]: pam_unix(sudo:session): session closed for user root
Nov 03 18:17:02 devstack cinder-volume[75223]: DEBUG oslo_concurrency.processutils [None req-5460b051-2c1b-4403-a07c-187479adce81 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.272s {{(pid=75223) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:17:02 devstack cinder-volume[75223]: DEBUG cinder.manager [None req-5460b051-2c1b-4403-a07c-187479adce81 None None] Notifying Schedulers of capabilities ... {{(pid=75223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:17:02 devstack cinder-volume[75223]: INFO cinder.volume.manager [None req-5460b051-2c1b-4403-a07c-187479adce81 None None] Driver initialization completed successfully.
Nov 03 18:17:02 devstack cinder-volume[75223]: INFO cinder.manager [None req-5460b051-2c1b-4403-a07c-187479adce81 None None] Initiating service 2 cleanup
Nov 03 18:17:02 devstack cinder-volume[75223]: INFO cinder.manager [None req-5460b051-2c1b-4403-a07c-187479adce81 None None] Service 2 cleanup completed.
Nov 03 18:17:02 devstack cinder-volume[75223]: DEBUG cinder.service [None req-5460b051-2c1b-4403-a07c-187479adce81 None None] Creating RPC server for service cinder-volume {{(pid=75223) start /opt/stack/cinder/cinder/service.py:231}}
Nov 03 18:17:02 devstack cinder-volume[75223]: DEBUG cinder.service [None req-5460b051-2c1b-4403-a07c-187479adce81 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75223) start /opt/stack/cinder/cinder/service.py:237}}
Nov 03 18:17:02 devstack cinder-volume[75223]: INFO cinder.volume.manager [None req-5460b051-2c1b-4403-a07c-187479adce81 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0)
Nov 03 18:17:02 devstack cinder-volume[75223]: DEBUG cinder.volume.drivers.lvm [None req-5460b051-2c1b-4403-a07c-187479adce81 None None] Updating volume stats {{(pid=75223) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Nov 03 18:17:02 devstack cinder-volume[75223]: DEBUG oslo_concurrency.processutils [None req-5460b051-2c1b-4403-a07c-187479adce81 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75223) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:17:02 devstack sudo[76067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 03 18:17:02 devstack sudo[76067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:17:03 devstack sudo[76067]: pam_unix(sudo:session): session closed for user root
Nov 03 18:17:03 devstack cinder-volume[75223]: DEBUG oslo_concurrency.processutils [None req-5460b051-2c1b-4403-a07c-187479adce81 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=75223) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:17:03 devstack cinder-volume[75223]: DEBUG oslo_concurrency.processutils [None req-5460b051-2c1b-4403-a07c-187479adce81 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75223) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:17:03 devstack sudo[76070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 03 18:17:03 devstack sudo[76070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:17:03 devstack sudo[76070]: pam_unix(sudo:session): session closed for user root
Nov 03 18:17:03 devstack cinder-volume[75223]: DEBUG oslo_concurrency.processutils [None req-5460b051-2c1b-4403-a07c-187479adce81 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=75223) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:17:03 devstack cinder-volume[75223]: DEBUG oslo_concurrency.processutils [None req-5460b051-2c1b-4403-a07c-187479adce81 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75223) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:17:03 devstack sudo[76076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 03 18:17:03 devstack sudo[76076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:17:03 devstack sudo[76076]: pam_unix(sudo:session): session closed for user root
Nov 03 18:17:03 devstack cinder-volume[75223]: DEBUG oslo_concurrency.processutils [None req-5460b051-2c1b-4403-a07c-187479adce81 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.242s {{(pid=75223) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:17:03 devstack cinder-volume[75223]: DEBUG oslo_concurrency.processutils [None req-5460b051-2c1b-4403-a07c-187479adce81 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75223) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:17:03 devstack sudo[76081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 03 18:17:03 devstack sudo[76081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:17:03 devstack sudo[76081]: pam_unix(sudo:session): session closed for user root
Nov 03 18:17:03 devstack cinder-volume[75223]: DEBUG oslo_concurrency.processutils [None req-5460b051-2c1b-4403-a07c-187479adce81 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=75223) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:17:03 devstack cinder-volume[75223]: INFO cinder.volume.manager [None req-5460b051-2c1b-4403-a07c-187479adce81 None None] Driver post RPC initialization completed successfully.
Nov 03 18:17:06 devstack cinder-volume[75075]: DEBUG dbcounter [-] [75075] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75075) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 18:17:11 devstack cinder-volume[75223]: DEBUG dbcounter [-] [75223] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75223) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 18:17:13 devstack cinder-volume[75223]: DEBUG dbcounter [-] [75223] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=75223) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 18:17:36 devstack cinder-volume[75223]: DEBUG oslo_service.periodic_task [None req-d6b7e92a-486a-4aea-ad91-a9bb9f6ebf7b None None] Running periodic task VolumeManager._thread_info {{(pid=75223) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 18:17:36 devstack cinder-volume[75223]: DEBUG cinder.volume.manager [None req-d6b7e92a-486a-4aea-ad91-a9bb9f6ebf7b None None] thread count: 6 {{(pid=75223) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 03 18:17:36 devstack cinder-volume[75223]: DEBUG cinder.volume.manager [None req-d6b7e92a-486a-4aea-ad91-a9bb9f6ebf7b None None] thread info: [<_MainThread(MainThread, started 126942564409472)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 126942463809792)>, <Thread(Thread-3 (stat_writer), started daemon 126942450902912)>, <Thread(Rabbit-heartbeat, started daemon 126942447701440)>, <Thread(Thread-5 (_runner), started daemon 126942447751872)>, <Thread(Thread-7 (_runner), started daemon 126942447897408)>] {{(pid=75223) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 03 18:18:36 devstack cinder-volume[75223]: DEBUG oslo_service.periodic_task [None req-d6b7e92a-486a-4aea-ad91-a9bb9f6ebf7b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75223) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 18:18:36 devstack cinder-volume[75223]: DEBUG cinder.volume.drivers.lvm [None req-d6b7e92a-486a-4aea-ad91-a9bb9f6ebf7b None None] Updating volume stats {{(pid=75223) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Nov 03 18:18:36 devstack cinder-volume[75223]: DEBUG oslo_concurrency.processutils [None req-d6b7e92a-486a-4aea-ad91-a9bb9f6ebf7b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75223) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:18:36 devstack sudo[81191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 03 18:18:36 devstack sudo[81191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:18:37 devstack sudo[81191]: pam_unix(sudo:session): session closed for user root
Nov 03 18:18:37 devstack cinder-volume[75223]: DEBUG oslo_concurrency.processutils [None req-d6b7e92a-486a-4aea-ad91-a9bb9f6ebf7b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=75223) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:18:37 devstack cinder-volume[75223]: DEBUG oslo_concurrency.processutils [None req-d6b7e92a-486a-4aea-ad91-a9bb9f6ebf7b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75223) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:18:37 devstack sudo[81194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 03 18:18:37 devstack sudo[81194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:18:37 devstack sudo[81194]: pam_unix(sudo:session): session closed for user root
Nov 03 18:18:37 devstack cinder-volume[75223]: DEBUG oslo_concurrency.processutils [None req-d6b7e92a-486a-4aea-ad91-a9bb9f6ebf7b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.242s {{(pid=75223) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:18:37 devstack cinder-volume[75223]: DEBUG oslo_concurrency.processutils [None req-d6b7e92a-486a-4aea-ad91-a9bb9f6ebf7b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75223) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:18:37 devstack sudo[81197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 03 18:18:37 devstack sudo[81197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:18:37 devstack sudo[81197]: pam_unix(sudo:session): session closed for user root
Nov 03 18:18:37 devstack cinder-volume[75223]: DEBUG oslo_concurrency.processutils [None req-d6b7e92a-486a-4aea-ad91-a9bb9f6ebf7b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.253s {{(pid=75223) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:18:37 devstack cinder-volume[75223]: DEBUG oslo_concurrency.processutils [None req-d6b7e92a-486a-4aea-ad91-a9bb9f6ebf7b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75223) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:18:37 devstack sudo[81200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 03 18:18:37 devstack sudo[81200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:18:37 devstack sudo[81200]: pam_unix(sudo:session): session closed for user root
Nov 03 18:18:37 devstack cinder-volume[75223]: DEBUG oslo_concurrency.processutils [None req-d6b7e92a-486a-4aea-ad91-a9bb9f6ebf7b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=75223) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:18:37 devstack cinder-volume[75223]: DEBUG cinder.manager [None req-d6b7e92a-486a-4aea-ad91-a9bb9f6ebf7b None None] Notifying Schedulers of capabilities ... {{(pid=75223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:18:37 devstack cinder-volume[75223]: DEBUG oslo_service.periodic_task [None req-d6b7e92a-486a-4aea-ad91-a9bb9f6ebf7b None None] Running periodic task VolumeManager._thread_info {{(pid=75223) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 18:18:37 devstack cinder-volume[75223]: DEBUG cinder.volume.manager [None req-d6b7e92a-486a-4aea-ad91-a9bb9f6ebf7b None None] thread count: 6 {{(pid=75223) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 03 18:18:37 devstack cinder-volume[75223]: DEBUG cinder.volume.manager [None req-d6b7e92a-486a-4aea-ad91-a9bb9f6ebf7b None None] thread info: [<_MainThread(MainThread, started 126942564409472)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 126942463809792)>, <Thread(Thread-3 (stat_writer), started daemon 126942450902912)>, <Thread(Rabbit-heartbeat, started daemon 126942447701440)>, <Thread(Thread-5 (_runner), started daemon 126942447751872)>, <Thread(Thread-7 (_runner), started daemon 126942447897408)>] {{(pid=75223) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 03 18:19:13 devstack cinder-volume[75223]: DEBUG dbcounter [-] [75223] Writing DB stats cinder:SELECT=1 {{(pid=75223) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 18:19:13 devstack cinder-volume[75223]: DEBUG dbcounter [-] [75223] Writing DB stats cinder:UPDATE=1 {{(pid=75223) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 18:19:36 devstack cinder-volume[75223]: DEBUG oslo_service.periodic_task [None req-d6b7e92a-486a-4aea-ad91-a9bb9f6ebf7b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75223) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 18:19:36 devstack cinder-volume[75223]: DEBUG cinder.volume.drivers.lvm [None req-d6b7e92a-486a-4aea-ad91-a9bb9f6ebf7b None None] Updating volume stats {{(pid=75223) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Nov 03 18:19:36 devstack cinder-volume[75223]: DEBUG oslo_concurrency.processutils [None req-d6b7e92a-486a-4aea-ad91-a9bb9f6ebf7b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75223) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:19:36 devstack sudo[82823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 03 18:19:36 devstack sudo[82823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:19:37 devstack sudo[82823]: pam_unix(sudo:session): session closed for user root
Nov 03 18:19:37 devstack cinder-volume[75223]: DEBUG oslo_concurrency.processutils [None req-d6b7e92a-486a-4aea-ad91-a9bb9f6ebf7b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.265s {{(pid=75223) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:19:37 devstack cinder-volume[75223]: DEBUG oslo_concurrency.processutils [None req-d6b7e92a-486a-4aea-ad91-a9bb9f6ebf7b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75223) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:19:37 devstack sudo[82826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 03 18:19:37 devstack sudo[82826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:19:37 devstack sudo[82826]: pam_unix(sudo:session): session closed for user root
Nov 03 18:19:37 devstack cinder-volume[75223]: DEBUG oslo_concurrency.processutils [None req-d6b7e92a-486a-4aea-ad91-a9bb9f6ebf7b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=75223) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:19:37 devstack cinder-volume[75223]: DEBUG oslo_concurrency.processutils [None req-d6b7e92a-486a-4aea-ad91-a9bb9f6ebf7b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75223) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:19:37 devstack sudo[82829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 03 18:19:37 devstack sudo[82829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:19:37 devstack sudo[82829]: pam_unix(sudo:session): session closed for user root
Nov 03 18:19:37 devstack cinder-volume[75223]: DEBUG oslo_concurrency.processutils [None req-d6b7e92a-486a-4aea-ad91-a9bb9f6ebf7b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.270s {{(pid=75223) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:19:37 devstack cinder-volume[75223]: DEBUG oslo_concurrency.processutils [None req-d6b7e92a-486a-4aea-ad91-a9bb9f6ebf7b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75223) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:19:37 devstack sudo[82832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 03 18:19:37 devstack sudo[82832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:19:38 devstack sudo[82832]: pam_unix(sudo:session): session closed for user root
Nov 03 18:19:38 devstack cinder-volume[75223]: DEBUG oslo_concurrency.processutils [None req-d6b7e92a-486a-4aea-ad91-a9bb9f6ebf7b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.296s {{(pid=75223) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:19:38 devstack cinder-volume[75223]: DEBUG cinder.manager [None req-d6b7e92a-486a-4aea-ad91-a9bb9f6ebf7b None None] Notifying Schedulers of capabilities ... {{(pid=75223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:20:36 devstack cinder-volume[75223]: DEBUG oslo_service.periodic_task [None req-d6b7e92a-486a-4aea-ad91-a9bb9f6ebf7b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75223) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 18:20:36 devstack cinder-volume[75223]: DEBUG cinder.volume.drivers.lvm [None req-d6b7e92a-486a-4aea-ad91-a9bb9f6ebf7b None None] Updating volume stats {{(pid=75223) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Nov 03 18:20:36 devstack cinder-volume[75223]: DEBUG oslo_concurrency.processutils [None req-d6b7e92a-486a-4aea-ad91-a9bb9f6ebf7b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75223) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:20:36 devstack sudo[84311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 03 18:20:36 devstack sudo[84311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:20:37 devstack sudo[84311]: pam_unix(sudo:session): session closed for user root
Nov 03 18:20:37 devstack cinder-volume[75223]: DEBUG oslo_concurrency.processutils [None req-d6b7e92a-486a-4aea-ad91-a9bb9f6ebf7b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=75223) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:20:37 devstack cinder-volume[75223]: DEBUG oslo_concurrency.processutils [None req-d6b7e92a-486a-4aea-ad91-a9bb9f6ebf7b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75223) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:20:37 devstack sudo[84318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 03 18:20:37 devstack sudo[84318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:20:37 devstack sudo[84318]: pam_unix(sudo:session): session closed for user root
Nov 03 18:20:37 devstack cinder-volume[75223]: DEBUG oslo_concurrency.processutils [None req-d6b7e92a-486a-4aea-ad91-a9bb9f6ebf7b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=75223) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:20:37 devstack cinder-volume[75223]: DEBUG oslo_concurrency.processutils [None req-d6b7e92a-486a-4aea-ad91-a9bb9f6ebf7b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75223) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:20:37 devstack sudo[84324]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 03 18:20:37 devstack sudo[84324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:20:37 devstack sudo[84324]: pam_unix(sudo:session): session closed for user root
Nov 03 18:20:37 devstack cinder-volume[75223]: DEBUG oslo_concurrency.processutils [None req-d6b7e92a-486a-4aea-ad91-a9bb9f6ebf7b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.249s {{(pid=75223) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:20:37 devstack cinder-volume[75223]: DEBUG oslo_concurrency.processutils [None req-d6b7e92a-486a-4aea-ad91-a9bb9f6ebf7b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75223) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:20:37 devstack sudo[84346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 03 18:20:37 devstack sudo[84346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:20:37 devstack sudo[84346]: pam_unix(sudo:session): session closed for user root
Nov 03 18:20:37 devstack cinder-volume[75223]: DEBUG oslo_concurrency.processutils [None req-d6b7e92a-486a-4aea-ad91-a9bb9f6ebf7b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=75223) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:20:37 devstack cinder-volume[75223]: DEBUG cinder.manager [None req-d6b7e92a-486a-4aea-ad91-a9bb9f6ebf7b None None] Notifying Schedulers of capabilities ... {{(pid=75223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:20:37 devstack cinder-volume[75223]: DEBUG oslo_service.periodic_task [None req-d6b7e92a-486a-4aea-ad91-a9bb9f6ebf7b None None] Running periodic task VolumeManager._thread_info {{(pid=75223) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 18:20:37 devstack cinder-volume[75223]: DEBUG cinder.volume.manager [None req-d6b7e92a-486a-4aea-ad91-a9bb9f6ebf7b None None] thread count: 6 {{(pid=75223) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 03 18:20:37 devstack cinder-volume[75223]: DEBUG cinder.volume.manager [None req-d6b7e92a-486a-4aea-ad91-a9bb9f6ebf7b None None] thread info: [<_MainThread(MainThread, started 126942564409472)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 126942463809792)>, <Thread(Thread-3 (stat_writer), started daemon 126942450902912)>, <Thread(Rabbit-heartbeat, started daemon 126942447701440)>, <Thread(Thread-5 (_runner), started daemon 126942447751872)>, <Thread(Thread-7 (_runner), started daemon 126942447897408)>] {{(pid=75223) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 03 18:21:13 devstack cinder-volume[75223]: DEBUG dbcounter [-] [75223] Writing DB stats cinder:SELECT=1 {{(pid=75223) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 18:21:13 devstack cinder-volume[75223]: DEBUG dbcounter [-] [75223] Writing DB stats cinder:UPDATE=1 {{(pid=75223) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 18:21:23 devstack cinder-volume[75075]: INFO oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] Caught SIGTERM, stopping children
Nov 03 18:21:23 devstack cinder-volume[75075]: DEBUG oslo_concurrency.lockutils [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] Acquiring lock "singleton_lock" {{(pid=75075) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Nov 03 18:21:23 devstack cinder-volume[75075]: DEBUG oslo_concurrency.lockutils [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] Acquired lock "singleton_lock" {{(pid=75075) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Nov 03 18:21:23 devstack cinder-volume[75075]: DEBUG oslo_concurrency.lockutils [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] Releasing lock "singleton_lock" {{(pid=75075) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Nov 03 18:21:23 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] Stop services. {{(pid=75075) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Nov 03 18:21:23 devstack cinder-volume[75075]: DEBUG oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] Killing children. {{(pid=75075) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Nov 03 18:21:23 devstack cinder-volume[75075]: INFO oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] Waiting on 1 children to exit
Nov 03 18:21:27 devstack cinder-volume[75223]: DEBUG oslo_concurrency.lockutils [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] Acquiring lock "singleton_lock" {{(pid=75223) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Nov 03 18:21:27 devstack cinder-volume[75223]: DEBUG oslo_concurrency.lockutils [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] Acquired lock "singleton_lock" {{(pid=75223) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Nov 03 18:21:27 devstack cinder-volume[75223]: DEBUG oslo_concurrency.lockutils [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] Releasing lock "singleton_lock" {{(pid=75223) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Nov 03 18:21:27 devstack cinder-volume[75223]: WARNING amqp [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Nov 03 18:21:27 devstack cinder-volume[75223]: WARNING amqp [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Nov 03 18:21:27 devstack cinder-volume[75075]: INFO oslo_service.backend._eventlet.service [None req-3f234295-4f81-4d45-a976-a08779bf2ce9 None None] Child 75223 exited with status 0
Nov 03 18:21:28 devstack cinder-volume[85285]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Nov 03 18:21:28 devstack cinder-volume[85285]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Nov 03 18:21:28 devstack cinder-volume[85285]: we strongly recommend against using it for new projects.
Nov 03 18:21:28 devstack cinder-volume[85285]: If you are already using Eventlet, we recommend migrating to a different
Nov 03 18:21:28 devstack cinder-volume[85285]: framework.  For more detail see
Nov 03 18:21:28 devstack cinder-volume[85285]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Nov 03 18:21:28 devstack cinder-volume[85285]:   import eventlet  # noqa
Nov 03 18:21:30 devstack cinder-volume[85285]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85285) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Nov 03 18:21:30 devstack cinder-volume[85285]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85285) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Nov 03 18:21:30 devstack cinder-volume[85285]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85285) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Nov 03 18:21:30 devstack cinder-volume[85285]: INFO dbcounter [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] Registered counter for database cinder
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_db.sqlalchemy.engines [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85285) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG dbcounter [-] [85285] Writer thread running {{(pid=85285) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Nov 03 18:21:31 devstack cinder-volume[85285]: INFO cinder.rpc [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Nov 03 18:21:31 devstack cinder-volume[85285]: INFO cinder.rpc [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_db.sqlalchemy.engines [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85285) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 03 18:21:31 devstack cinder-volume[85285]: INFO cinder.volume.manager [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] Determined volume DB was empty at startup.
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG cinder.volume.manager [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85285) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Nov 03 18:21:31 devstack cinder-volume[85285]: INFO cinder.volume.manager [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] Service not found for updating active_backend_id, assuming default for driver init.
Nov 03 18:21:31 devstack cinder-volume[85285]: WARNING stevedore.named [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Nov 03 18:21:31 devstack cinder-volume[85285]: WARNING castellan.key_manager [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 03 18:21:31 devstack cinder-volume[85285]: WARNING cinder.keymgr.conf_key_mgr [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 03 18:21:31 devstack cinder-volume[85285]: INFO cinder.volume.manager [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] Image-volume cache disabled for host devstack@QuobyteHD.
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_db.sqlalchemy.engines [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85285) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 03 18:21:31 devstack cinder-volume[85285]: INFO oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] Starting 1 workers
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] Started child 85501 {{(pid=85285) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] Full set of CONF: {{(pid=85285) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] ******************************************************************************** {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] Configuration options gathered from: {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] ================================================================================ {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] allow_availability_zone_fallback = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] allow_compression_on_image_upload = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] allowed_direct_url_schemes     = [] {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] api_rate_limit                 = True {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] auth_strategy                  = keystone {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] backend_availability_zone      = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] backend_host                   = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] backend_name                   = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] backend_stats_polling_interval = 60 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] backup_api_class               = cinder.backup.api.API {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] backup_name_template           = backup-%s {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] backup_use_same_host           = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] backup_use_temp_snapshot       = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] chap_password                  = **** {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] chap_username                  =  {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] cinder_internal_tenant_project_id = 341d02d0729f4a74bd8fb9c16479dd9a {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] cinder_internal_tenant_user_id = be9589133df04355a6d5941d30adc163 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85501]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.1)
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] cluster                        = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] compression_format             = gzip {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] compute_api_class              = cinder.compute.nova.API {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] config_dir                     = [] {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] config_source                  = [] {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] control_exchange               = openstack {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] debug                          = True {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] default_availability_zone      = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] default_group_type             = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] default_volume_type            = QuobyteHD {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] disk_geometry                  = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] driver_client_cert             = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] driver_client_cert_key         = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] driver_data_namespace          = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] driver_ssl_cert_path           = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] driver_ssl_cert_verify         = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] driver_use_ssl                 = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] enable_new_services            = True {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] enable_unsupported_driver      = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] enabled_backends               = ['QuobyteHD'] {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] enforce_multipath_for_image_xfer = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] filter_function                = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] glance_api_insecure            = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] glance_api_servers             = ['http://192.168.122.243/image'] {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] glance_api_ssl_compression     = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] glance_ca_certificates_file    = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] glance_catalog_info            = image:glance:publicURL {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] glance_certfile                = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] glance_keyfile                 = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] glance_num_retries             = 3 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] glance_request_timeout         = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] goodness_function              = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] graceful_shutdown_timeout      = 5 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] group_api_class                = cinder.group.api.API {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] host                           = devstack {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] image_compress_on_upload       = True {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] image_conversion_address_space_limit = 1 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] image_conversion_cpu_limit     = 60 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] image_conversion_disable       = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] image_introspection_address_space_limit = 1 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] image_introspection_cpu_limit  = 60 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] image_upload_use_cinder_backend = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] image_upload_use_internal_tenant = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] image_volume_cache_enabled     = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] image_volume_cache_max_count   = 0 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] image_volume_cache_max_size_gb = 0 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] init_host_max_objects_retrieval = 0 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] instance_format                = [instance: %(uuid)s]  {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] iscsi_target_flags             =  {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] iscsi_write_cache              = on {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] iser_helper                    = tgtadm {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] iser_ip_address                = 192.168.122.243 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] iser_port                      = 3260 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] log_color                      = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] log_config_append              = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] log_dir                        = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] log_file                       = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] log_options                    = True {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] log_rotate_interval            = 1 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] log_rotate_interval_type       = days {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] log_rotation_type              = none {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] max_age                        = 0 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] max_logfile_count              = 30 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] max_logfile_size_mb            = 200 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] max_over_subscription_ratio    = 20.0 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] message_reap_interval          = 86400 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] message_ttl                    = 2592000 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] migration_create_volume_timeout_secs = 300 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] monkey_patch                   = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] monkey_patch_modules           = [] {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] my_ip                          = 192.168.122.243 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] no_snapshot_gb_quota           = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] num_iser_scan_tries            = 3 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] num_shell_tries                = 3 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] num_volume_device_scan_tries   = 3 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] nvmeof_conn_info_version       = 1 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] nvmet_ns_id                    = 10 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] nvmet_port_id                  = 1 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] osapi_max_limit                = 1000 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] osapi_volume_ext_list          = [] {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] osapi_volume_listen            = 0.0.0.0 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] osapi_volume_listen_port       = 8776 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] osapi_volume_use_ssl           = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] osapi_volume_workers           = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] per_volume_size_limit          = -1 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] periodic_fuzzy_delay           = 60 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] periodic_interval              = 60 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] project_id_regex               = [0-9a-f\-]+ {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] public_endpoint                = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] publish_errors                 = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] quota_backup_gigabytes         = 1000 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] quota_backups                  = 10 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] quota_gigabytes                = 1000 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] quota_groups                   = 10 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] quota_snapshots                = 10 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] quota_volumes                  = 10 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] rate_limit_burst               = 0 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] rate_limit_except_level        = CRITICAL {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] rate_limit_interval            = 0 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] reinit_driver_count            = 3 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] replication_device             = **** {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] report_discard_supported       = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] report_interval                = 120 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] reservation_clean_interval     = 86400 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] reservation_expire             = 86400 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] reserved_image_namespaces      = [] {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] reserved_percentage            = 0 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] rpc_response_timeout           = 120 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] run_external_periodic_tasks    = True {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] scst_target_driver             = iscsi {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] scst_target_iqn_name           = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] service_down_time              = 720 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] shell_completion               = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] snapshot_name_template         = snapshot-%s {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] split_loggers                  = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] state_path                     = /opt/stack/data/cinder {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] storage_availability_zone      = nova {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] storage_protocol               = iSCSI {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] syslog_log_facility            = LOG_USER {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] target_helper                  = lioadm {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] target_ip_address              = 192.168.122.243 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] target_port                    = 3260 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] target_protocol                = iscsi {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] target_secondary_ip_addresses  = [] {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] trace_flags                    = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] transfer_api_class             = cinder.transfer.api.API {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] transport_url                  = **** {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] until_refresh                  = 0 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] use_chap_auth                  = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] use_default_quota_class        = True {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] use_journal                    = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] use_json                       = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] use_multipath_for_image_xfer   = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] use_stderr                     = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] use_syslog                     = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] verify_glance_signatures       = enabled {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] volume_api_class               = cinder.volume.api.API {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] volume_backend_name            = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] volume_clear                   = zero {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] volume_clear_ionice            = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] volume_clear_size              = 0 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85501]: INFO cinder.volume.manager [None req-81134f5b-a060-4516-a1fe-dedfa54dd949 None None] Starting volume driver QuobyteDriver (1.2.1)
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] volume_copy_bps_limit          = 0 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85501]: DEBUG cinder.volume.drivers.remotefs [None req-81134f5b-a060-4516-a1fe-dedfa54dd949 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=85501) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] volume_dd_blocksize            = 1M {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] volume_name_template           = volume-%s {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] volume_service_inithost_offload = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] volume_usage_audit_period      = month {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] zoning_mode                    = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] oslo_concurrency.disable_process_locking = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] keystone_authtoken.auth_section = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] keystone_authtoken.auth_type   = password {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] keystone_authtoken.auth_version = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] keystone_authtoken.cache       = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] keystone_authtoken.certfile    = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] keystone_authtoken.delay_auth_decision = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] keystone_authtoken.http_connect_timeout = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] keystone_authtoken.include_service_catalog = True {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] keystone_authtoken.insecure    = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] keystone_authtoken.interface   = public {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] keystone_authtoken.keyfile     = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] keystone_authtoken.memcache_password = **** {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] keystone_authtoken.memcache_username = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] keystone_authtoken.region_name = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] keystone_authtoken.service_token_roles_required = True {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] keystone_authtoken.service_type = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] keystone_authtoken.token_cache_time = 300 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.243/identity {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] cache.backend                  = dogpile.cache.null {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] cache.backend_argument         = **** {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] cache.backend_expiration_time  = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] cache.config_prefix            = cache.oslo {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] cache.debug_cache_backend      = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] cache.enable_retry_client      = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] cache.enable_socket_keepalive  = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] cache.enabled                  = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] cache.expiration_time          = 600 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] cache.hashclient_retry_attempts = 2 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] cache.memcache_dead_retry      = 300 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] cache.memcache_pool_maxsize    = 10 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] cache.memcache_sasl_enabled    = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] cache.password                 = **** {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] cache.proxies                  = [] {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] cache.redis_db                 = 0 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] cache.redis_sentinel_service_name = mymaster {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] cache.redis_server             = localhost:6379 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] cache.retry_attempts           = 2 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] cache.retry_delay              = 0.0 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] cache.socket_keepalive_count   = 1 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] cache.socket_keepalive_idle    = 1 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] cache.socket_keepalive_interval = 1 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] cache.socket_timeout           = 1.0 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] cache.tls_allowed_ciphers      = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] cache.tls_cafile               = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] cache.tls_certfile             = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] cache.tls_enabled              = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] cache.tls_keyfile              = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] cache.username                 = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] coordination.backend_url       = **** {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] database.asyncio_connection    = **** {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] database.asyncio_slave_connection = **** {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] database.backend               = sqlalchemy {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] database.connection            = **** {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] database.connection_debug      = 0 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] database.connection_parameters =  {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] database.connection_recycle_time = 3600 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] database.connection_trace      = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] database.db_inc_retry_interval = True {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] database.db_max_retries        = 20 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] database.db_max_retry_interval = 10 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] database.db_retry_interval     = 1 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] database.max_overflow          = 50 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] database.max_pool_size         = 5 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] database.max_retries           = 10 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] database.mysql_wsrep_sync_wait = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] database.pool_timeout          = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] database.retry_interval        = 10 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] database.slave_connection      = **** {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] database.sqlite_synchronous    = True {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] database.synchronous_reader    = True {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] database.use_db_reconnect      = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] oslo_messaging_tracing.insecure = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] profiler.connection_string     = messaging:// {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] profiler.enabled               = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] profiler.es_doc_type           = notification {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] profiler.es_scroll_size        = 10000 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] profiler.es_scroll_time        = 2m {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] profiler.filter_error_trace    = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] profiler.hmac_keys             = **** {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] profiler.sentinel_service_name = mymaster {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] profiler.socket_timeout        = 0.1 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] profiler.trace_requests        = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] profiler.trace_sqlalchemy      = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] profiler_jaeger.process_tags   = {} {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] profiler_jaeger.service_name_prefix = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] profiler_otlp.service_name_prefix = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] oslo_policy.enforce_new_defaults = True {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] oslo_policy.policy_default_rule = default {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] oslo_policy.policy_file        = policy.yaml {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] oslo_policy.remote_timeout     = 60.0 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] privsep_osbrick.group          = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] privsep_osbrick.helper_command = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] privsep_osbrick.user           = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] cinder_sys_admin.group         = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] cinder_sys_admin.helper_command = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] cinder_sys_admin.user          = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] service_user.auth_section      = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] service_user.auth_type         = password {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] service_user.cafile            = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] service_user.certfile          = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] service_user.collect_timing    = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] service_user.insecure          = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] service_user.keyfile           = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] service_user.send_service_user_token = True {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] service_user.split_loggers     = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] service_user.timeout           = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] service_user.tls_ciphers       = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] service_user.tls_min_version   = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] glance.auth_section            = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] glance.auth_type               = password {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] glance.certfile                = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] glance.collect_timing          = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] glance.insecure                = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] glance.keyfile                 = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] glance.region_name             = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] glance.split_loggers           = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] glance.timeout                 = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] glance.tls_ciphers             = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] glance.tls_min_version         = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] backend_defaults.backend_availability_zone = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] backend_defaults.chap_password = **** {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] backend_defaults.chap_username =  {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] backend_defaults.disk_geometry = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] backend_defaults.driver_client_cert = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] backend_defaults.driver_client_cert_key = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] backend_defaults.driver_data_namespace = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] backend_defaults.driver_use_ssl = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] backend_defaults.enable_unsupported_driver = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] backend_defaults.extra_capabilities = {} {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] backend_defaults.filter_function = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] backend_defaults.goodness_function = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] backend_defaults.iscsi_target_flags =  {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] backend_defaults.iscsi_write_cache = on {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] backend_defaults.iser_helper   = tgtadm {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] backend_defaults.iser_ip_address = 192.168.122.243 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] backend_defaults.iser_port     = 3260 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] backend_defaults.nas_host      =  {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] backend_defaults.nas_login     = admin {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] backend_defaults.nas_mount_options = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] backend_defaults.nas_password  = **** {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] backend_defaults.nas_private_key =  {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] backend_defaults.nas_share_path =  {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] backend_defaults.nas_ssh_port  = 22 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] backend_defaults.num_shell_tries = 3 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] backend_defaults.nvmet_port_id = 1 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] backend_defaults.quobyte_client_cfg = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] backend_defaults.quobyte_volume_url = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] backend_defaults.replication_device = **** {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] backend_defaults.report_discard_supported = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] backend_defaults.reserved_percentage = 0 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] backend_defaults.scst_target_driver = iscsi {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] backend_defaults.scst_target_iqn_name = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] backend_defaults.storage_protocol = iSCSI {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85501]: DEBUG cinder.volume.drivers.quobyte [None req-81134f5b-a060-4516-a1fe-dedfa54dd949 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=85501) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] backend_defaults.target_helper = tgtadm {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] backend_defaults.target_ip_address = 192.168.122.243 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] backend_defaults.target_port   = 3260 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] backend_defaults.target_protocol = iscsi {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] backend_defaults.trace_flags   = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] backend_defaults.unique_fqdn_network = True {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] backend_defaults.use_chap_auth = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] backend_defaults.volume_backend_name = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85501]: WARNING cinder.volume.drivers.quobyte [None req-81134f5b-a060-4516-a1fe-dedfa54dd949 None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] backend_defaults.volume_clear  = zero {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] backend_defaults.volume_clear_ionice = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] backend_defaults.volume_clear_size = 0 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] oslo_reports.file_event_handler = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] oslo_reports.log_dir           = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] QuobyteHD.backend_availability_zone = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] QuobyteHD.backend_host         = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] QuobyteHD.chap_password        = **** {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] QuobyteHD.chap_username        = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] QuobyteHD.chiscsi_conf         = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] QuobyteHD.disk_geometry        = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] QuobyteHD.driver_client_cert   = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] QuobyteHD.driver_client_cert_key = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] QuobyteHD.driver_data_namespace = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] QuobyteHD.driver_use_ssl       = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85501]: WARNING cinder.volume.drivers.quobyte [None req-81134f5b-a060-4516-a1fe-dedfa54dd949 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] QuobyteHD.enable_unsupported_driver = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] QuobyteHD.extra_capabilities   = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] QuobyteHD.filter_function      = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] QuobyteHD.goodness_function    = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85501]: DEBUG oslo_concurrency.processutils [None req-81134f5b-a060-4516-a1fe-dedfa54dd949 None None] Running cmd (subprocess): mount.quobyte {{(pid=85501) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] QuobyteHD.iscsi_target_flags   = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] QuobyteHD.iscsi_write_cache    = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] QuobyteHD.iser_helper          = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] QuobyteHD.iser_ip_address      = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] QuobyteHD.iser_port            = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] QuobyteHD.iser_target_prefix   = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] QuobyteHD.nas_host             = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] QuobyteHD.nas_login            = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] QuobyteHD.nas_mount_options    = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] QuobyteHD.nas_password         = **** {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] QuobyteHD.nas_private_key      = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] QuobyteHD.nas_share_path       = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] QuobyteHD.nas_ssh_port         = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] QuobyteHD.num_shell_tries      = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] QuobyteHD.nvmet_ns_id          = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] QuobyteHD.nvmet_port_id        = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:32 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] QuobyteHD.replication_device   = **** {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:32 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] QuobyteHD.report_discard_supported = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:32 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] QuobyteHD.reserved_percentage  = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:32 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] QuobyteHD.scst_target_driver   = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:32 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:32 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] QuobyteHD.storage_protocol     = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:32 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:32 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] QuobyteHD.target_helper        = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:32 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] QuobyteHD.target_ip_address    = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:32 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] QuobyteHD.target_port          = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:32 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] QuobyteHD.target_prefix        = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:32 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] QuobyteHD.target_protocol      = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:32 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:32 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] QuobyteHD.trace_flags          = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:32 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] QuobyteHD.unique_fqdn_network  = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:32 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] QuobyteHD.use_chap_auth        = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:32 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:32 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:32 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] QuobyteHD.volume_clear         = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:32 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] QuobyteHD.volume_clear_ionice  = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:32 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] QuobyteHD.volume_clear_size    = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:32 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:32 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:32 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:32 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:32 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] QuobyteHD.volumes_dir          = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:32 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:32 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:32 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:32 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:32 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:32 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:32 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:32 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:32 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:32 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:32 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:32 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:32 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:32 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:32 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:32 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:32 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:32 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:32 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:32 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:32 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:32 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:32 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:32 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:32 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:32 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:32 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:32 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:32 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:32 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] oslo_messaging_rabbit.ssl      = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:32 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:32 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:32 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:32 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:32 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:32 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] oslo_messaging_rabbit.ssl_version =  {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:32 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:32 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] oslo_messaging_notifications.driver = [] {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:32 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] oslo_messaging_notifications.retry = -1 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:32 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:32 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] oslo_messaging_notifications.transport_url = **** {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:32 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:32 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] key_manager.fixed_key          = **** {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:32 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:32 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] barbican.barbican_api_version  = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:32 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] barbican.barbican_endpoint     = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:32 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] barbican.barbican_endpoint_type = public {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:32 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] barbican.barbican_region_name  = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:32 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] barbican.cafile                = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:32 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] barbican.certfile              = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:32 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] barbican.collect_timing        = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:32 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] barbican.insecure              = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:32 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] barbican.keyfile               = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:32 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] barbican.number_of_retries     = 60 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:32 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] barbican.retry_delay           = 1 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:32 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] barbican.send_service_user_token = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:32 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] barbican.split_loggers         = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:32 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] barbican.timeout               = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:32 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] barbican.tls_ciphers           = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:32 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] barbican.tls_min_version       = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:32 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] barbican.verify_ssl            = True {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:32 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] barbican.verify_ssl_path       = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:32 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] barbican_service_user.auth_section = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:32 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] barbican_service_user.auth_type = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:32 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] barbican_service_user.cafile   = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:32 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] barbican_service_user.certfile = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:32 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] barbican_service_user.collect_timing = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:32 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] barbican_service_user.insecure = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:32 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] barbican_service_user.keyfile  = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:32 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] barbican_service_user.split_loggers = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:32 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] barbican_service_user.timeout  = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:32 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] barbican_service_user.tls_ciphers = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:32 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] barbican_service_user.tls_min_version = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:32 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] vault.approle_role_id          = **** {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:32 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] vault.approle_secret_id        = **** {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:32 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] vault.auth_method              = approle {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:32 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] vault.auth_path                = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:32 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] vault.kv_mountpoint            = secret {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:32 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] vault.kv_path                  = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:32 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] vault.kv_version               = 2 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:32 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] vault.namespace                = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:32 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] vault.root_token_id            = **** {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:32 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] vault.ssl_ca_crt_file          = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:32 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] vault.timeout                  = 60.0 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:32 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] vault.token_file               = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:32 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] vault.token_role               = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:32 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] vault.use_ssl                  = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:32 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:32 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] ******************************************************************************** {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}}
Nov 03 18:21:32 devstack quobyte-client[85505]: Reading configuration file: /etc/quobyte/client.cfg
Nov 03 18:21:32 devstack quobyte-client[85505]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Nov 03 18:21:32 devstack cinder-volume[85501]: DEBUG oslo_concurrency.processutils [None req-81134f5b-a060-4516-a1fe-dedfa54dd949 None None] CMD "mount.quobyte" returned: 1 in 0.105s {{(pid=85501) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:21:32 devstack cinder-volume[85501]: DEBUG oslo_concurrency.lockutils [None req-81134f5b-a060-4516-a1fe-dedfa54dd949 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85501) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:21:32 devstack cinder-volume[85501]: DEBUG oslo_concurrency.lockutils [None req-81134f5b-a060-4516-a1fe-dedfa54dd949 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=85501) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:21:32 devstack cinder-volume[85501]: DEBUG cinder.volume.drivers.quobyte [None req-81134f5b-a060-4516-a1fe-dedfa54dd949 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=85501) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:21:32 devstack cinder-volume[85501]: INFO cinder.volume.drivers.quobyte [None req-81134f5b-a060-4516-a1fe-dedfa54dd949 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c ...
Nov 03 18:21:32 devstack cinder-volume[85501]: DEBUG oslo_concurrency.processutils [None req-81134f5b-a060-4516-a1fe-dedfa54dd949 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f -c /etc/quobyte/client-cinder.cfg {{(pid=85501) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:21:32 devstack sudo[85507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f -c /etc/quobyte/client-cinder.cfg
Nov 03 18:21:32 devstack sudo[85507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:21:32 devstack sudo[85507]: pam_unix(sudo:session): session closed for user root
Nov 03 18:21:32 devstack cinder-volume[85501]: DEBUG oslo_concurrency.processutils [None req-81134f5b-a060-4516-a1fe-dedfa54dd949 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.424s {{(pid=85501) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:21:32 devstack cinder-volume[85501]: INFO cinder.volume.drivers.quobyte [None req-81134f5b-a060-4516-a1fe-dedfa54dd949 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c succeeded
Nov 03 18:21:32 devstack cinder-volume[85501]: DEBUG cinder.volume.drivers.quobyte [None req-81134f5b-a060-4516-a1fe-dedfa54dd949 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=85501) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:21:32 devstack cinder-volume[85501]: DEBUG oslo_concurrency.lockutils [None req-81134f5b-a060-4516-a1fe-dedfa54dd949 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.434s {{(pid=85501) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:21:32 devstack cinder-volume[85501]: DEBUG oslo_concurrency.processutils [None req-81134f5b-a060-4516-a1fe-dedfa54dd949 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=85501) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:21:32 devstack sudo[85609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:21:32 devstack sudo[85609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:21:32 devstack sudo[85609]: pam_unix(sudo:session): session closed for user root
Nov 03 18:21:32 devstack cinder-volume[85501]: DEBUG oslo_concurrency.processutils [None req-81134f5b-a060-4516-a1fe-dedfa54dd949 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.239s {{(pid=85501) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:21:32 devstack cinder-volume[85501]: INFO cinder.volume.driver [None req-81134f5b-a060-4516-a1fe-dedfa54dd949 None None] Driver hasn't implemented _init_vendor_properties()
Nov 03 18:21:32 devstack cinder-volume[85501]: DEBUG cinder.volume.driver [None req-81134f5b-a060-4516-a1fe-dedfa54dd949 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.6699981689453, 'free_capacity_gb': 1773.6699981689453, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=85501) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Nov 03 18:21:32 devstack cinder-volume[85501]: DEBUG oslo_db.sqlalchemy.engines [None req-81134f5b-a060-4516-a1fe-dedfa54dd949 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85501) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 03 18:21:32 devstack cinder-volume[85501]: DEBUG dbcounter [-] [85501] Writer thread running {{(pid=85501) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Nov 03 18:21:32 devstack cinder-volume[85501]: DEBUG cinder.db.api [None req-81134f5b-a060-4516-a1fe-dedfa54dd949 None None] Building query based on filter {{(pid=85501) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Nov 03 18:21:32 devstack cinder-volume[85501]: DEBUG cinder.image.image_utils [None req-81134f5b-a060-4516-a1fe-dedfa54dd949 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=85501) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}}
Nov 03 18:21:32 devstack cinder-volume[85501]: INFO cinder.keymgr.migration [None req-48d8e86c-2cf7-485b-8b38-1a8d6e9904c6 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Nov 03 18:21:32 devstack cinder-volume[85501]: DEBUG oslo_concurrency.lockutils [None req-81134f5b-a060-4516-a1fe-dedfa54dd949 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85501) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:21:32 devstack cinder-volume[85501]: DEBUG oslo_concurrency.lockutils [None req-81134f5b-a060-4516-a1fe-dedfa54dd949 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85501) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:21:32 devstack cinder-volume[85501]: DEBUG cinder.volume.drivers.quobyte [None req-81134f5b-a060-4516-a1fe-dedfa54dd949 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=85501) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:21:32 devstack cinder-volume[85501]: DEBUG cinder.volume.drivers.quobyte [None req-81134f5b-a060-4516-a1fe-dedfa54dd949 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=85501) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:21:32 devstack cinder-volume[85501]: DEBUG oslo_concurrency.lockutils [None req-81134f5b-a060-4516-a1fe-dedfa54dd949 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85501) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:21:32 devstack cinder-volume[85501]: DEBUG oslo_concurrency.processutils [None req-81134f5b-a060-4516-a1fe-dedfa54dd949 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=85501) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:21:32 devstack sudo[85612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:21:32 devstack sudo[85612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:21:33 devstack sudo[85612]: pam_unix(sudo:session): session closed for user root
Nov 03 18:21:33 devstack cinder-volume[85501]: DEBUG oslo_concurrency.processutils [None req-81134f5b-a060-4516-a1fe-dedfa54dd949 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.231s {{(pid=85501) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:21:33 devstack cinder-volume[85501]: DEBUG cinder.manager [None req-81134f5b-a060-4516-a1fe-dedfa54dd949 None None] Notifying Schedulers of capabilities ... {{(pid=85501) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:21:33 devstack cinder-volume[85501]: INFO cinder.volume.manager [None req-81134f5b-a060-4516-a1fe-dedfa54dd949 None None] Driver initialization completed successfully.
Nov 03 18:21:33 devstack cinder-volume[85501]: INFO cinder.manager [None req-81134f5b-a060-4516-a1fe-dedfa54dd949 None None] Initiating service 3 cleanup
Nov 03 18:21:33 devstack cinder-volume[85501]: INFO cinder.manager [None req-81134f5b-a060-4516-a1fe-dedfa54dd949 None None] Service 3 cleanup completed.
Nov 03 18:21:33 devstack cinder-volume[85501]: DEBUG cinder.service [None req-81134f5b-a060-4516-a1fe-dedfa54dd949 None None] Creating RPC server for service cinder-volume {{(pid=85501) start /opt/stack/cinder/cinder/service.py:231}}
Nov 03 18:21:33 devstack cinder-volume[85501]: DEBUG cinder.service [None req-81134f5b-a060-4516-a1fe-dedfa54dd949 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=85501) start /opt/stack/cinder/cinder/service.py:237}}
Nov 03 18:21:33 devstack cinder-volume[85501]: INFO cinder.volume.manager [None req-81134f5b-a060-4516-a1fe-dedfa54dd949 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1)
Nov 03 18:21:33 devstack cinder-volume[85501]: DEBUG oslo_concurrency.lockutils [None req-81134f5b-a060-4516-a1fe-dedfa54dd949 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85501) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:21:33 devstack cinder-volume[85501]: DEBUG oslo_concurrency.lockutils [None req-81134f5b-a060-4516-a1fe-dedfa54dd949 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85501) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:21:33 devstack cinder-volume[85501]: DEBUG cinder.volume.drivers.quobyte [None req-81134f5b-a060-4516-a1fe-dedfa54dd949 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=85501) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:21:33 devstack cinder-volume[85501]: DEBUG cinder.volume.drivers.quobyte [None req-81134f5b-a060-4516-a1fe-dedfa54dd949 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=85501) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:21:33 devstack cinder-volume[85501]: DEBUG oslo_concurrency.lockutils [None req-81134f5b-a060-4516-a1fe-dedfa54dd949 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85501) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:21:33 devstack cinder-volume[85501]: DEBUG oslo_concurrency.processutils [None req-81134f5b-a060-4516-a1fe-dedfa54dd949 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=85501) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:21:33 devstack sudo[85615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:21:33 devstack sudo[85615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:21:33 devstack sudo[85615]: pam_unix(sudo:session): session closed for user root
Nov 03 18:21:33 devstack cinder-volume[85501]: DEBUG oslo_concurrency.processutils [None req-81134f5b-a060-4516-a1fe-dedfa54dd949 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.253s {{(pid=85501) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:21:33 devstack cinder-volume[85501]: INFO cinder.volume.manager [None req-81134f5b-a060-4516-a1fe-dedfa54dd949 None None] Driver post RPC initialization completed successfully.
Nov 03 18:21:35 devstack cinder-volume[85501]: DEBUG oslo_service.periodic_task [None req-b1b73123-2a49-4035-bd39-1d228e0d2428 None None] Running periodic task VolumeManager._thread_info {{(pid=85501) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 18:21:35 devstack cinder-volume[85501]: DEBUG cinder.volume.manager [None req-b1b73123-2a49-4035-bd39-1d228e0d2428 None None] thread count: 6 {{(pid=85501) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 03 18:21:35 devstack cinder-volume[85501]: DEBUG cinder.volume.manager [None req-b1b73123-2a49-4035-bd39-1d228e0d2428 None None] thread info: [<_MainThread(MainThread, started 138079496618112)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 138079382386368)>, <Thread(Thread-3 (stat_writer), started daemon 138079382985536)>, <Thread(Rabbit-heartbeat, started daemon 138079380299584)>, <Thread(Thread-5 (_runner), started daemon 138079380401408)>, <Thread(Thread-7 (_runner), started daemon 138079380416448)>] {{(pid=85501) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 03 18:21:37 devstack cinder-volume[85501]: DEBUG oslo_concurrency.lockutils [None req-0e0696a9-c87c-49bd-afb6-736b063f1108 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85501) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:21:37 devstack cinder-volume[85501]: DEBUG oslo_concurrency.lockutils [None req-0e0696a9-c87c-49bd-afb6-736b063f1108 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85501) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:21:37 devstack cinder-volume[85501]: DEBUG cinder.volume.drivers.quobyte [None req-0e0696a9-c87c-49bd-afb6-736b063f1108 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=85501) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:21:38 devstack cinder-volume[85501]: DEBUG cinder.volume.drivers.quobyte [None req-0e0696a9-c87c-49bd-afb6-736b063f1108 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=85501) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:21:38 devstack cinder-volume[85501]: DEBUG oslo_concurrency.lockutils [None req-0e0696a9-c87c-49bd-afb6-736b063f1108 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85501) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:21:38 devstack cinder-volume[85501]: DEBUG oslo_concurrency.processutils [None req-0e0696a9-c87c-49bd-afb6-736b063f1108 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=85501) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:21:38 devstack sudo[85765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:21:38 devstack sudo[85765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:21:38 devstack sudo[85765]: pam_unix(sudo:session): session closed for user root
Nov 03 18:21:38 devstack cinder-volume[85501]: DEBUG oslo_concurrency.processutils [None req-0e0696a9-c87c-49bd-afb6-736b063f1108 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.237s {{(pid=85501) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:21:38 devstack cinder-volume[85501]: DEBUG cinder.manager [None req-0e0696a9-c87c-49bd-afb6-736b063f1108 None None] Notifying Schedulers of capabilities ... {{(pid=85501) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:21:38 devstack cinder-volume[85285]: INFO oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] Caught SIGTERM, stopping children
Nov 03 18:21:38 devstack cinder-volume[85285]: DEBUG oslo_concurrency.lockutils [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] Acquiring lock "singleton_lock" {{(pid=85285) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Nov 03 18:21:38 devstack cinder-volume[85285]: DEBUG oslo_concurrency.lockutils [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] Acquired lock "singleton_lock" {{(pid=85285) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Nov 03 18:21:38 devstack cinder-volume[85285]: DEBUG oslo_concurrency.lockutils [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] Releasing lock "singleton_lock" {{(pid=85285) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Nov 03 18:21:38 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] Stop services. {{(pid=85285) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Nov 03 18:21:38 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] Killing children. {{(pid=85285) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Nov 03 18:21:38 devstack cinder-volume[85285]: INFO oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] Waiting on 1 children to exit
Nov 03 18:21:41 devstack cinder-volume[85501]: DEBUG oslo_concurrency.lockutils [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] Acquiring lock "singleton_lock" {{(pid=85501) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Nov 03 18:21:41 devstack cinder-volume[85501]: DEBUG oslo_concurrency.lockutils [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] Acquired lock "singleton_lock" {{(pid=85501) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Nov 03 18:21:41 devstack cinder-volume[85501]: DEBUG oslo_concurrency.lockutils [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] Releasing lock "singleton_lock" {{(pid=85501) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Nov 03 18:21:41 devstack cinder-volume[85501]: WARNING amqp [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] Received method (60, 30) during closing channel 1. This method will be ignored
Nov 03 18:21:41 devstack cinder-volume[85501]: WARNING amqp [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] Received method (60, 30) during closing channel 1. This method will be ignored
Nov 03 18:21:41 devstack cinder-volume[85285]: INFO oslo_service.backend._eventlet.service [None req-dc2d6248-c273-4fe5-9e99-09cf89e2002e None None] Child 85501 exited with status 0
Nov 03 18:21:42 devstack cinder-volume[85822]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Nov 03 18:21:42 devstack cinder-volume[85822]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Nov 03 18:21:42 devstack cinder-volume[85822]: we strongly recommend against using it for new projects.
Nov 03 18:21:42 devstack cinder-volume[85822]: If you are already using Eventlet, we recommend migrating to a different
Nov 03 18:21:42 devstack cinder-volume[85822]: framework.  For more detail see
Nov 03 18:21:42 devstack cinder-volume[85822]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Nov 03 18:21:42 devstack cinder-volume[85822]:   import eventlet  # noqa
Nov 03 18:21:45 devstack cinder-volume[85822]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85822) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Nov 03 18:21:45 devstack cinder-volume[85822]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85822) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Nov 03 18:21:45 devstack cinder-volume[85822]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85822) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Nov 03 18:21:46 devstack cinder-volume[85822]: INFO dbcounter [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] Registered counter for database cinder
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_db.sqlalchemy.engines [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85822) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG dbcounter [-] [85822] Writer thread running {{(pid=85822) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Nov 03 18:21:46 devstack cinder-volume[85822]: INFO cinder.rpc [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Nov 03 18:21:46 devstack cinder-volume[85822]: INFO cinder.rpc [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_db.sqlalchemy.engines [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85822) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 03 18:21:46 devstack cinder-volume[85822]: INFO cinder.volume.manager [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] Determined volume DB was empty at startup.
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG cinder.volume.manager [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85822) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Nov 03 18:21:46 devstack cinder-volume[85822]: WARNING stevedore.named [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Nov 03 18:21:46 devstack cinder-volume[85822]: WARNING castellan.key_manager [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 03 18:21:46 devstack cinder-volume[85822]: WARNING cinder.keymgr.conf_key_mgr [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 03 18:21:46 devstack cinder-volume[85822]: INFO cinder.volume.manager [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] Image-volume cache disabled for host devstack@QuobyteHD.
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_db.sqlalchemy.engines [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85822) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 03 18:21:46 devstack cinder-volume[85822]: INFO oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] Starting 1 workers
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] Started child 86120 {{(pid=85822) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] Full set of CONF: {{(pid=85822) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] ******************************************************************************** {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] Configuration options gathered from: {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] ================================================================================ {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}}
Nov 03 18:21:46 devstack cinder-volume[86120]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.1)
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] allow_availability_zone_fallback = False {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] allow_compression_on_image_upload = False {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] allowed_direct_url_schemes     = [] {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] api_rate_limit                 = True {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] auth_strategy                  = keystone {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] backend_availability_zone      = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] backend_host                   = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] backend_name                   = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] backend_stats_polling_interval = 60 {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] backup_api_class               = cinder.backup.api.API {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] backup_name_template           = backup-%s {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] backup_use_same_host           = False {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] backup_use_temp_snapshot       = False {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] chap_password                  = **** {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] chap_username                  =  {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] cinder_internal_tenant_project_id = 341d02d0729f4a74bd8fb9c16479dd9a {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] cinder_internal_tenant_user_id = be9589133df04355a6d5941d30adc163 {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] cluster                        = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] compression_format             = gzip {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] compute_api_class              = cinder.compute.nova.API {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] config_dir                     = [] {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] config_source                  = [] {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] control_exchange               = openstack {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] debug                          = True {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] default_availability_zone      = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] default_group_type             = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] default_volume_type            = QuobyteHD {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] disk_geometry                  = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] driver_client_cert             = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] driver_client_cert_key         = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] driver_data_namespace          = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] driver_ssl_cert_path           = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] driver_ssl_cert_verify         = False {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] driver_use_ssl                 = False {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] enable_new_services            = True {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] enable_unsupported_driver      = False {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] enabled_backends               = ['QuobyteHD'] {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] enforce_multipath_for_image_xfer = False {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] filter_function                = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] glance_api_insecure            = False {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] glance_api_servers             = ['http://192.168.122.243/image'] {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] glance_api_ssl_compression     = False {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] glance_ca_certificates_file    = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] glance_catalog_info            = image:glance:publicURL {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] glance_certfile                = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] glance_keyfile                 = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] glance_num_retries             = 3 {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] glance_request_timeout         = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] goodness_function              = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] graceful_shutdown_timeout      = 5 {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] group_api_class                = cinder.group.api.API {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] host                           = devstack {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] image_compress_on_upload       = True {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] image_conversion_address_space_limit = 1 {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] image_conversion_cpu_limit     = 60 {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] image_conversion_disable       = False {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] image_introspection_address_space_limit = 1 {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] image_introspection_cpu_limit  = 60 {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] image_upload_use_cinder_backend = False {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] image_upload_use_internal_tenant = False {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] image_volume_cache_enabled     = False {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] image_volume_cache_max_count   = 0 {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] image_volume_cache_max_size_gb = 0 {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] init_host_max_objects_retrieval = 0 {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] instance_format                = [instance: %(uuid)s]  {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] iscsi_target_flags             =  {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] iscsi_write_cache              = on {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] iser_helper                    = tgtadm {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] iser_ip_address                = 192.168.122.243 {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] iser_port                      = 3260 {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-ec2ca77a-1df2-4da7-9722-e9680a6dd617 None None] Starting volume driver QuobyteDriver (1.2.1)
Nov 03 18:21:46 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-ec2ca77a-1df2-4da7-9722-e9680a6dd617 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86120) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] log_color                      = False {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] log_config_append              = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] log_dir                        = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] log_file                       = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] log_options                    = True {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] log_rotate_interval            = 1 {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] log_rotate_interval_type       = days {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] log_rotation_type              = none {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] max_age                        = 0 {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] max_logfile_count              = 30 {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] max_logfile_size_mb            = 200 {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] max_over_subscription_ratio    = 20.0 {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] message_reap_interval          = 86400 {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] message_ttl                    = 2592000 {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] migration_create_volume_timeout_secs = 300 {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] monkey_patch                   = False {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] monkey_patch_modules           = [] {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] my_ip                          = 192.168.122.243 {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] no_snapshot_gb_quota           = False {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] num_iser_scan_tries            = 3 {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] num_shell_tries                = 3 {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] num_volume_device_scan_tries   = 3 {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] nvmeof_conn_info_version       = 1 {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] nvmet_ns_id                    = 10 {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] nvmet_port_id                  = 1 {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] osapi_max_limit                = 1000 {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] osapi_volume_ext_list          = [] {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] osapi_volume_listen_port       = 8776 {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] osapi_volume_use_ssl           = False {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] osapi_volume_workers           = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] per_volume_size_limit          = -1 {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] periodic_fuzzy_delay           = 60 {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] periodic_interval              = 60 {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] public_endpoint                = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] publish_errors                 = False {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] quota_backup_gigabytes         = 1000 {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] quota_backups                  = 10 {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] quota_gigabytes                = 1000 {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] quota_groups                   = 10 {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] quota_snapshots                = 10 {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] quota_volumes                  = 10 {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] rate_limit_burst               = 0 {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] rate_limit_except_level        = CRITICAL {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] rate_limit_interval            = 0 {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] reinit_driver_count            = 3 {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] replication_device             = **** {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] report_discard_supported       = False {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] report_interval                = 120 {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] reservation_clean_interval     = 86400 {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] reservation_expire             = 86400 {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] reserved_image_namespaces      = [] {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] reserved_percentage            = 0 {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] rpc_response_timeout           = 120 {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] run_external_periodic_tasks    = True {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] scst_target_driver             = iscsi {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] scst_target_iqn_name           = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] service_down_time              = 720 {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] shell_completion               = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] snapshot_name_template         = snapshot-%s {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] split_loggers                  = False {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] state_path                     = /opt/stack/data/cinder {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] storage_availability_zone      = nova {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] storage_protocol               = iSCSI {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] syslog_log_facility            = LOG_USER {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] target_helper                  = lioadm {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] target_ip_address              = 192.168.122.243 {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] target_port                    = 3260 {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] target_protocol                = iscsi {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] target_secondary_ip_addresses  = [] {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] trace_flags                    = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] transport_url                  = **** {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] until_refresh                  = 0 {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] use_chap_auth                  = False {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] use_default_quota_class        = True {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] use_journal                    = False {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] use_json                       = False {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] use_multipath_for_image_xfer   = False {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] use_stderr                     = False {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] use_syslog                     = False {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] verify_glance_signatures       = enabled {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] volume_api_class               = cinder.volume.api.API {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] volume_backend_name            = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] volume_clear                   = zero {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] volume_clear_ionice            = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] volume_clear_size              = 0 {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] volume_copy_bps_limit          = 0 {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] volume_dd_blocksize            = 1M {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] volume_name_template           = volume-%s {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] volume_service_inithost_offload = False {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] volume_usage_audit_period      = month {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] zoning_mode                    = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] oslo_concurrency.disable_process_locking = False {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] keystone_authtoken.auth_section = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] keystone_authtoken.auth_type   = password {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] keystone_authtoken.auth_version = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] keystone_authtoken.cache       = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] keystone_authtoken.certfile    = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] keystone_authtoken.delay_auth_decision = False {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-ec2ca77a-1df2-4da7-9722-e9680a6dd617 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86120) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] keystone_authtoken.http_connect_timeout = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[86120]: WARNING cinder.volume.drivers.quobyte [None req-ec2ca77a-1df2-4da7-9722-e9680a6dd617 None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[86120]: WARNING cinder.volume.drivers.quobyte [None req-ec2ca77a-1df2-4da7-9722-e9680a6dd617 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] keystone_authtoken.include_service_catalog = True {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] keystone_authtoken.insecure    = False {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] keystone_authtoken.interface   = public {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-ec2ca77a-1df2-4da7-9722-e9680a6dd617 None None] Running cmd (subprocess): mount.quobyte {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] keystone_authtoken.keyfile     = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] keystone_authtoken.memcache_password = **** {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] keystone_authtoken.memcache_username = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] keystone_authtoken.region_name = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] keystone_authtoken.service_token_roles_required = True {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] keystone_authtoken.service_type = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] keystone_authtoken.token_cache_time = 300 {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.243/identity {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] cache.backend                  = dogpile.cache.null {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] cache.backend_argument         = **** {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] cache.backend_expiration_time  = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] cache.config_prefix            = cache.oslo {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] cache.debug_cache_backend      = False {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] cache.enable_retry_client      = False {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] cache.enable_socket_keepalive  = False {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] cache.enabled                  = False {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] cache.expiration_time          = 600 {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] cache.hashclient_retry_attempts = 2 {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] cache.memcache_dead_retry      = 300 {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] cache.memcache_pool_maxsize    = 10 {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] cache.memcache_sasl_enabled    = False {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] cache.password                 = **** {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] cache.proxies                  = [] {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] cache.redis_db                 = 0 {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] cache.redis_sentinel_service_name = mymaster {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] cache.redis_server             = localhost:6379 {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] cache.retry_attempts           = 2 {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] cache.retry_delay              = 0.0 {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] cache.socket_keepalive_count   = 1 {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] cache.socket_keepalive_idle    = 1 {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] cache.socket_keepalive_interval = 1 {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] cache.socket_timeout           = 1.0 {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] cache.tls_allowed_ciphers      = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] cache.tls_cafile               = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] cache.tls_certfile             = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] cache.tls_enabled              = False {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] cache.tls_keyfile              = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] cache.username                 = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] coordination.backend_url       = **** {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] database.asyncio_connection    = **** {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] database.asyncio_slave_connection = **** {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] database.backend               = sqlalchemy {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] database.connection            = **** {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] database.connection_debug      = 0 {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] database.connection_parameters =  {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] database.connection_recycle_time = 3600 {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] database.connection_trace      = False {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] database.db_inc_retry_interval = True {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] database.db_max_retries        = 20 {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] database.db_max_retry_interval = 10 {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] database.db_retry_interval     = 1 {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] database.max_overflow          = 50 {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] database.max_pool_size         = 5 {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] database.max_retries           = 10 {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] database.mysql_wsrep_sync_wait = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] database.pool_timeout          = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] database.retry_interval        = 10 {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] database.slave_connection      = **** {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] database.sqlite_synchronous    = True {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] database.synchronous_reader    = True {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] database.use_db_reconnect      = False {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] oslo_messaging_tracing.insecure = False {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] profiler.connection_string     = messaging:// {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] profiler.enabled               = False {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] profiler.es_doc_type           = notification {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] profiler.es_scroll_size        = 10000 {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] profiler.es_scroll_time        = 2m {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] profiler.filter_error_trace    = False {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] profiler.hmac_keys             = **** {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] profiler.sentinel_service_name = mymaster {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] profiler.socket_timeout        = 0.1 {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] profiler.trace_requests        = False {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] profiler.trace_sqlalchemy      = False {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] profiler_jaeger.process_tags   = {} {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] profiler_jaeger.service_name_prefix = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] profiler_otlp.service_name_prefix = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] oslo_policy.enforce_new_defaults = True {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] oslo_policy.policy_default_rule = default {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] oslo_policy.policy_file        = policy.yaml {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] privsep_osbrick.group          = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] privsep_osbrick.helper_command = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] privsep_osbrick.user           = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] cinder_sys_admin.group         = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] cinder_sys_admin.helper_command = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] cinder_sys_admin.user          = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] service_user.auth_section      = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] service_user.auth_type         = password {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] service_user.cafile            = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] service_user.certfile          = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] service_user.collect_timing    = False {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] service_user.insecure          = False {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] service_user.keyfile           = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] service_user.send_service_user_token = True {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] service_user.split_loggers     = False {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] service_user.timeout           = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack quobyte-client[86121]: Reading configuration file: /etc/quobyte/client.cfg
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] service_user.tls_ciphers       = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] service_user.tls_min_version   = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] glance.auth_section            = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] glance.auth_type               = password {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack quobyte-client[86121]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] glance.certfile                = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] glance.collect_timing          = False {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] glance.insecure                = False {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] glance.keyfile                 = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] glance.region_name             = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] glance.split_loggers           = False {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] glance.timeout                 = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-ec2ca77a-1df2-4da7-9722-e9680a6dd617 None None] CMD "mount.quobyte" returned: 1 in 0.058s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] glance.tls_ciphers             = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] glance.tls_min_version         = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-ec2ca77a-1df2-4da7-9722-e9680a6dd617 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] backend_defaults.backend_availability_zone = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-ec2ca77a-1df2-4da7-9722-e9680a6dd617 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-ec2ca77a-1df2-4da7-9722-e9680a6dd617 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] backend_defaults.chap_password = **** {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] backend_defaults.chap_username =  {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] backend_defaults.disk_geometry = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] backend_defaults.driver_client_cert = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] backend_defaults.driver_client_cert_key = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] backend_defaults.driver_data_namespace = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] backend_defaults.driver_use_ssl = False {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] backend_defaults.enable_unsupported_driver = False {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] backend_defaults.extra_capabilities = {} {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] backend_defaults.filter_function = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] backend_defaults.goodness_function = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-ec2ca77a-1df2-4da7-9722-e9680a6dd617 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-ec2ca77a-1df2-4da7-9722-e9680a6dd617 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] backend_defaults.iscsi_target_flags =  {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-ec2ca77a-1df2-4da7-9722-e9680a6dd617 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] backend_defaults.iscsi_write_cache = on {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] backend_defaults.iser_helper   = tgtadm {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] backend_defaults.iser_ip_address = 192.168.122.243 {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] backend_defaults.iser_port     = 3260 {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] backend_defaults.nas_host      =  {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] backend_defaults.nas_login     = admin {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] backend_defaults.nas_mount_options = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] backend_defaults.nas_password  = **** {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] backend_defaults.nas_private_key =  {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] backend_defaults.nas_share_path =  {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] backend_defaults.nas_ssh_port  = 22 {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] backend_defaults.num_shell_tries = 3 {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] backend_defaults.nvmet_port_id = 1 {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] backend_defaults.quobyte_client_cfg = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] backend_defaults.quobyte_volume_url = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] backend_defaults.replication_device = **** {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] backend_defaults.report_discard_supported = False {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] backend_defaults.reserved_percentage = 0 {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] backend_defaults.scst_target_driver = iscsi {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] backend_defaults.scst_target_iqn_name = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] backend_defaults.storage_protocol = iSCSI {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] backend_defaults.target_helper = tgtadm {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] backend_defaults.target_ip_address = 192.168.122.243 {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] backend_defaults.target_port   = 3260 {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] backend_defaults.target_protocol = iscsi {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] backend_defaults.trace_flags   = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] backend_defaults.unique_fqdn_network = True {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] backend_defaults.use_chap_auth = False {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] backend_defaults.volume_backend_name = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] backend_defaults.volume_clear  = zero {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] backend_defaults.volume_clear_ionice = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] backend_defaults.volume_clear_size = 0 {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] oslo_reports.file_event_handler = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] oslo_reports.log_dir           = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] QuobyteHD.backend_availability_zone = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] QuobyteHD.backend_host         = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] QuobyteHD.chap_password        = **** {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] QuobyteHD.chap_username        = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] QuobyteHD.chiscsi_conf         = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] QuobyteHD.disk_geometry        = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] QuobyteHD.driver_client_cert   = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] QuobyteHD.driver_client_cert_key = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] QuobyteHD.driver_data_namespace = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack sudo[86122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:21:46 devstack sudo[86122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] QuobyteHD.driver_use_ssl       = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] QuobyteHD.extra_capabilities   = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] QuobyteHD.filter_function      = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] QuobyteHD.goodness_function    = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] QuobyteHD.iscsi_target_flags   = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] QuobyteHD.iscsi_write_cache    = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] QuobyteHD.iser_helper          = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] QuobyteHD.iser_ip_address      = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] QuobyteHD.iser_port            = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] QuobyteHD.iser_target_prefix   = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] QuobyteHD.nas_host             = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] QuobyteHD.nas_login            = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] QuobyteHD.nas_mount_options    = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] QuobyteHD.nas_password         = **** {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] QuobyteHD.nas_private_key      = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] QuobyteHD.nas_share_path       = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] QuobyteHD.nas_ssh_port         = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] QuobyteHD.num_shell_tries      = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] QuobyteHD.nvmet_ns_id          = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] QuobyteHD.nvmet_port_id        = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] QuobyteHD.replication_device   = **** {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] QuobyteHD.report_discard_supported = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] QuobyteHD.reserved_percentage  = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] QuobyteHD.scst_target_driver   = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] QuobyteHD.storage_protocol     = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] QuobyteHD.target_helper        = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] QuobyteHD.target_ip_address    = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] QuobyteHD.target_port          = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] QuobyteHD.target_prefix        = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] QuobyteHD.target_protocol      = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] QuobyteHD.trace_flags          = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] QuobyteHD.unique_fqdn_network  = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] QuobyteHD.use_chap_auth        = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] QuobyteHD.volume_clear         = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] QuobyteHD.volume_clear_ionice  = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] QuobyteHD.volume_clear_size    = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] QuobyteHD.volumes_dir          = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] oslo_messaging_rabbit.ssl      = False {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] oslo_messaging_notifications.driver = [] {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] oslo_messaging_notifications.retry = -1 {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] oslo_messaging_notifications.transport_url = **** {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] key_manager.fixed_key          = **** {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] barbican.barbican_api_version  = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] barbican.barbican_endpoint     = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] barbican.barbican_endpoint_type = public {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] barbican.barbican_region_name  = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] barbican.cafile                = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] barbican.certfile              = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] barbican.collect_timing        = False {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] barbican.insecure              = False {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] barbican.keyfile               = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] barbican.number_of_retries     = 60 {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] barbican.retry_delay           = 1 {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] barbican.send_service_user_token = False {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] barbican.split_loggers         = False {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] barbican.timeout               = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] barbican.tls_ciphers           = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] barbican.tls_min_version       = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] barbican.verify_ssl            = True {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] barbican.verify_ssl_path       = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] barbican_service_user.auth_section = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] barbican_service_user.auth_type = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] barbican_service_user.cafile   = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] barbican_service_user.certfile = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] barbican_service_user.collect_timing = False {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] barbican_service_user.insecure = False {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] barbican_service_user.keyfile  = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] barbican_service_user.split_loggers = False {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] barbican_service_user.timeout  = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] barbican_service_user.tls_ciphers = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] barbican_service_user.tls_min_version = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] vault.approle_role_id          = **** {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] vault.approle_secret_id        = **** {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] vault.auth_method              = approle {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] vault.auth_path                = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] vault.kv_mountpoint            = secret {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] vault.kv_path                  = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] vault.kv_version               = 2 {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] vault.namespace                = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] vault.root_token_id            = **** {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] vault.ssl_ca_crt_file          = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] vault.timeout                  = 60.0 {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] vault.token_file               = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] vault.token_role               = None {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] vault.use_ssl                  = False {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 03 18:21:46 devstack cinder-volume[85822]: DEBUG oslo_service.backend._eventlet.service [None req-6fdb28e3-7476-459a-808b-16e3896f7f64 None None] ******************************************************************************** {{(pid=85822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}}
Nov 03 18:21:47 devstack sudo[86122]: pam_unix(sudo:session): session closed for user root
Nov 03 18:21:47 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-ec2ca77a-1df2-4da7-9722-e9680a6dd617 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.242s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:21:47 devstack cinder-volume[86120]: INFO cinder.volume.driver [None req-ec2ca77a-1df2-4da7-9722-e9680a6dd617 None None] Driver hasn't implemented _init_vendor_properties()
Nov 03 18:21:47 devstack cinder-volume[86120]: DEBUG cinder.volume.driver [None req-ec2ca77a-1df2-4da7-9722-e9680a6dd617 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.6699981689453, 'free_capacity_gb': 1773.6699981689453, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86120) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Nov 03 18:21:47 devstack cinder-volume[86120]: DEBUG oslo_db.sqlalchemy.engines [None req-ec2ca77a-1df2-4da7-9722-e9680a6dd617 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86120) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 03 18:21:47 devstack cinder-volume[86120]: DEBUG dbcounter [-] [86120] Writer thread running {{(pid=86120) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Nov 03 18:21:47 devstack cinder-volume[86120]: DEBUG cinder.db.api [None req-ec2ca77a-1df2-4da7-9722-e9680a6dd617 None None] Building query based on filter {{(pid=86120) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Nov 03 18:21:47 devstack cinder-volume[86120]: DEBUG cinder.image.image_utils [None req-ec2ca77a-1df2-4da7-9722-e9680a6dd617 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86120) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}}
Nov 03 18:21:47 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-ec2ca77a-1df2-4da7-9722-e9680a6dd617 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:21:47 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-ec2ca77a-1df2-4da7-9722-e9680a6dd617 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:21:47 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-ec2ca77a-1df2-4da7-9722-e9680a6dd617 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:21:47 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-ec2ca77a-1df2-4da7-9722-e9680a6dd617 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:21:47 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-ec2ca77a-1df2-4da7-9722-e9680a6dd617 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:21:47 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-ec2ca77a-1df2-4da7-9722-e9680a6dd617 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:21:47 devstack cinder-volume[86120]: INFO cinder.keymgr.migration [None req-47c112a7-8b66-479f-a1e4-e7c691265641 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Nov 03 18:21:47 devstack sudo[86133]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:21:47 devstack sudo[86133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:21:47 devstack sudo[86133]: pam_unix(sudo:session): session closed for user root
Nov 03 18:21:47 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-ec2ca77a-1df2-4da7-9722-e9680a6dd617 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.236s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:21:47 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-ec2ca77a-1df2-4da7-9722-e9680a6dd617 None None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:21:47 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-ec2ca77a-1df2-4da7-9722-e9680a6dd617 None None] Driver initialization completed successfully.
Nov 03 18:21:47 devstack cinder-volume[86120]: INFO cinder.manager [None req-ec2ca77a-1df2-4da7-9722-e9680a6dd617 None None] Initiating service 3 cleanup
Nov 03 18:21:47 devstack cinder-volume[86120]: INFO cinder.manager [None req-ec2ca77a-1df2-4da7-9722-e9680a6dd617 None None] Service 3 cleanup completed.
Nov 03 18:21:47 devstack cinder-volume[86120]: DEBUG cinder.service [None req-ec2ca77a-1df2-4da7-9722-e9680a6dd617 None None] Creating RPC server for service cinder-volume {{(pid=86120) start /opt/stack/cinder/cinder/service.py:231}}
Nov 03 18:21:47 devstack cinder-volume[86120]: DEBUG cinder.service [None req-ec2ca77a-1df2-4da7-9722-e9680a6dd617 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86120) start /opt/stack/cinder/cinder/service.py:237}}
Nov 03 18:21:47 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-ec2ca77a-1df2-4da7-9722-e9680a6dd617 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1)
Nov 03 18:21:47 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-ec2ca77a-1df2-4da7-9722-e9680a6dd617 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:21:47 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-ec2ca77a-1df2-4da7-9722-e9680a6dd617 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:21:47 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-ec2ca77a-1df2-4da7-9722-e9680a6dd617 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:21:47 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-ec2ca77a-1df2-4da7-9722-e9680a6dd617 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:21:47 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-ec2ca77a-1df2-4da7-9722-e9680a6dd617 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:21:47 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-ec2ca77a-1df2-4da7-9722-e9680a6dd617 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:21:47 devstack sudo[86146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:21:47 devstack sudo[86146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:21:47 devstack sudo[86146]: pam_unix(sudo:session): session closed for user root
Nov 03 18:21:47 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-ec2ca77a-1df2-4da7-9722-e9680a6dd617 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.240s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:21:47 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-ec2ca77a-1df2-4da7-9722-e9680a6dd617 None None] Driver post RPC initialization completed successfully.
Nov 03 18:21:56 devstack cinder-volume[85822]: DEBUG dbcounter [-] [85822] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=85822) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 18:21:57 devstack cinder-volume[86120]: DEBUG dbcounter [-] [86120] Writing DB stats cinder:SELECT=3 {{(pid=86120) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 18:21:57 devstack cinder-volume[86120]: DEBUG dbcounter [-] [86120] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=86120) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 18:22:14 devstack cinder-volume[86120]: DEBUG oslo_service.periodic_task [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Running periodic task VolumeManager._thread_info {{(pid=86120) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 18:22:14 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] thread count: 6 {{(pid=86120) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 03 18:22:14 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] thread info: [<_MainThread(MainThread, started 134747145822336)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134747033686336)>, <Thread(Thread-3 (stat_writer), started daemon 134747030828736)>, <Thread(Rabbit-heartbeat, started daemon 134747035433408)>, <Thread(Thread-5 (_runner), started daemon 134747029587392)>, <Thread(Thread-7 (_runner), started daemon 134747029784256)>] {{(pid=86120) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 03 18:22:46 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-18bed1c6-08c5-4101-ab13-e78787edd964 tempest-DeleteServersTestJSON-617902827 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:22:46 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-18bed1c6-08c5-4101-ab13-e78787edd964 tempest-DeleteServersTestJSON-617902827 None] Flow 'volume_create_manager' (eb5b6ddb-b527-474a-bc28-b7caaedbe668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:22:46 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-18bed1c6-08c5-4101-ab13-e78787edd964 tempest-DeleteServersTestJSON-617902827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (302a1d75-79d6-4782-87d9-22e4e4626c6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:22:46 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-18bed1c6-08c5-4101-ab13-e78787edd964 tempest-DeleteServersTestJSON-617902827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (302a1d75-79d6-4782-87d9-22e4e4626c6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:22:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1663226622',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78f203ba-91e1-441b-ab59-48ac5b11134a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9647f59fde244a1822ab921fcc012aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:22:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:22:46Z,use_quota=True,user_id='405577b2c622460cb9b331dfec4397b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:22:46 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-18bed1c6-08c5-4101-ab13-e78787edd964 tempest-DeleteServersTestJSON-617902827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b7497ce-78ba-4cea-a937-a310f35257c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:22:46 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-18bed1c6-08c5-4101-ab13-e78787edd964 tempest-DeleteServersTestJSON-617902827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b7497ce-78ba-4cea-a937-a310f35257c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:22:46 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-18bed1c6-08c5-4101-ab13-e78787edd964 tempest-DeleteServersTestJSON-617902827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37af0ce6-37c4-4ce5-9c29-2703715f88cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:22:46 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-18bed1c6-08c5-4101-ab13-e78787edd964 tempest-DeleteServersTestJSON-617902827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37af0ce6-37c4-4ce5-9c29-2703715f88cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78f203ba-91e1-441b-ab59-48ac5b11134a', 'volume_name': 'volume-78f203ba-91e1-441b-ab59-48ac5b11134a', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:22:46 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-18bed1c6-08c5-4101-ab13-e78787edd964 tempest-DeleteServersTestJSON-617902827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90c9afed-0298-447a-8e4c-09f4bde46fc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:22:46 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-18bed1c6-08c5-4101-ab13-e78787edd964 tempest-DeleteServersTestJSON-617902827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90c9afed-0298-447a-8e4c-09f4bde46fc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:22:46 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-18bed1c6-08c5-4101-ab13-e78787edd964 tempest-DeleteServersTestJSON-617902827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1910979-d928-4b82-ba2b-a88d0a20eb57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:22:46 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-18bed1c6-08c5-4101-ab13-e78787edd964 tempest-DeleteServersTestJSON-617902827 None] Volume 78f203ba-91e1-441b-ab59-48ac5b11134a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78f203ba-91e1-441b-ab59-48ac5b11134a', 'volume_size': 1}
Nov 03 18:22:46 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-18bed1c6-08c5-4101-ab13-e78787edd964 tempest-DeleteServersTestJSON-617902827 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:22:46 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-18bed1c6-08c5-4101-ab13-e78787edd964 tempest-DeleteServersTestJSON-617902827 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:22:46 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-18bed1c6-08c5-4101-ab13-e78787edd964 tempest-DeleteServersTestJSON-617902827 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:22:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1663226622',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78f203ba-91e1-441b-ab59-48ac5b11134a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9647f59fde244a1822ab921fcc012aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:22:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:22:46Z,use_quota=True,user_id='405577b2c622460cb9b331dfec4397b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:22:46 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-18bed1c6-08c5-4101-ab13-e78787edd964 tempest-DeleteServersTestJSON-617902827 None] Creating volume 78f203ba-91e1-441b-ab59-48ac5b11134a {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:22:46 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-18bed1c6-08c5-4101-ab13-e78787edd964 tempest-DeleteServersTestJSON-617902827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:22:46 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-18bed1c6-08c5-4101-ab13-e78787edd964 tempest-DeleteServersTestJSON-617902827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:22:46 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-18bed1c6-08c5-4101-ab13-e78787edd964 tempest-DeleteServersTestJSON-617902827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:22:46 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-18bed1c6-08c5-4101-ab13-e78787edd964 tempest-DeleteServersTestJSON-617902827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:22:46 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-18bed1c6-08c5-4101-ab13-e78787edd964 tempest-DeleteServersTestJSON-617902827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:22:46 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-18bed1c6-08c5-4101-ab13-e78787edd964 tempest-DeleteServersTestJSON-617902827 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:22:46 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-18bed1c6-08c5-4101-ab13-e78787edd964 tempest-DeleteServersTestJSON-617902827 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:22:46 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-18bed1c6-08c5-4101-ab13-e78787edd964 tempest-DeleteServersTestJSON-617902827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-78f203ba-91e1-441b-ab59-48ac5b11134a 1073741824 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:22:46 devstack sudo[86809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-78f203ba-91e1-441b-ab59-48ac5b11134a 1073741824
Nov 03 18:22:46 devstack sudo[86809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:22:46 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-ae3ce3ea-ab88-4981-90f8-afe815306f38 tempest-GroupSnapshotsTest-870685421 None] Group tempest-GroupSnapshotsTest-Group-826460652: creating
Nov 03 18:22:46 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-ae3ce3ea-ab88-4981-90f8-afe815306f38 tempest-GroupSnapshotsTest-870685421 None] Group tempest-GroupSnapshotsTest-Group-826460652: created successfully
Nov 03 18:22:46 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-ae3ce3ea-ab88-4981-90f8-afe815306f38 tempest-GroupSnapshotsTest-870685421 None] Create group completed successfully.
Nov 03 18:22:46 devstack sudo[86809]: pam_unix(sudo:session): session closed for user root
Nov 03 18:22:46 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-18bed1c6-08c5-4101-ab13-e78787edd964 tempest-DeleteServersTestJSON-617902827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-78f203ba-91e1-441b-ab59-48ac5b11134a 1073741824" returned: 0 in 0.686s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:22:46 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-18bed1c6-08c5-4101-ab13-e78787edd964 tempest-DeleteServersTestJSON-617902827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-78f203ba-91e1-441b-ab59-48ac5b11134a {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:22:46 devstack sudo[87128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-78f203ba-91e1-441b-ab59-48ac5b11134a
Nov 03 18:22:46 devstack sudo[87128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:22:47 devstack sudo[87128]: pam_unix(sudo:session): session closed for user root
Nov 03 18:22:47 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-18bed1c6-08c5-4101-ab13-e78787edd964 tempest-DeleteServersTestJSON-617902827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-78f203ba-91e1-441b-ab59-48ac5b11134a" returned: 0 in 0.284s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:22:47 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-18bed1c6-08c5-4101-ab13-e78787edd964 tempest-DeleteServersTestJSON-617902827 None] <== create_volume: return (1040ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:22:47 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-18bed1c6-08c5-4101-ab13-e78787edd964 tempest-DeleteServersTestJSON-617902827 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.046s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:22:47 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-18bed1c6-08c5-4101-ab13-e78787edd964 tempest-DeleteServersTestJSON-617902827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1910979-d928-4b82-ba2b-a88d0a20eb57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78f203ba-91e1-441b-ab59-48ac5b11134a', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:22:47 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-18bed1c6-08c5-4101-ab13-e78787edd964 tempest-DeleteServersTestJSON-617902827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aeb84744-8296-46ff-bcb7-34a62d183c46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:22:47 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-18bed1c6-08c5-4101-ab13-e78787edd964 tempest-DeleteServersTestJSON-617902827 None] Volume volume-78f203ba-91e1-441b-ab59-48ac5b11134a (78f203ba-91e1-441b-ab59-48ac5b11134a): created successfully
Nov 03 18:22:47 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-18bed1c6-08c5-4101-ab13-e78787edd964 tempest-DeleteServersTestJSON-617902827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aeb84744-8296-46ff-bcb7-34a62d183c46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:22:47 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-18bed1c6-08c5-4101-ab13-e78787edd964 tempest-DeleteServersTestJSON-617902827 None] Flow 'volume_create_manager' (eb5b6ddb-b527-474a-bc28-b7caaedbe668) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:22:47 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-18bed1c6-08c5-4101-ab13-e78787edd964 tempest-DeleteServersTestJSON-617902827 None] Created volume successfully.
Nov 03 18:22:47 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-50570f77-e110-4566-bc08-f228e587be96 tempest-GroupSnapshotsTest-870685421 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:22:47 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-50570f77-e110-4566-bc08-f228e587be96 tempest-GroupSnapshotsTest-870685421 None] Flow 'volume_create_manager' (8fa19edc-5444-45df-a9e2-3d98b6c5bb38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:22:47 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-50570f77-e110-4566-bc08-f228e587be96 tempest-GroupSnapshotsTest-870685421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c275c4ad-7d94-4654-bd1a-6d96728250d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:22:47 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-50570f77-e110-4566-bc08-f228e587be96 tempest-GroupSnapshotsTest-870685421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c275c4ad-7d94-4654-bd1a-6d96728250d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:22:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1536979112',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=78aa3d81-392a-44d1-b1fc-e774e9b2348f,host='devstack@QuobyteHD#QuobyteHD',id=8dddeff8-bcaf-47b4-a4e1-ccdf2bc55e86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec4923426a2c48f8843125ecc43e5686',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:22:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:22:48Z,use_quota=True,user_id='05a831a8d48448f0bad34b8f768decd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(471e85ae-e03a-4928-adfd-210561b92c28),volume_type_id=471e85ae-e03a-4928-adfd-210561b92c28)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:22:47 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-50570f77-e110-4566-bc08-f228e587be96 tempest-GroupSnapshotsTest-870685421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (def7c694-1189-4859-aabd-d36f3765c158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:22:48 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-50570f77-e110-4566-bc08-f228e587be96 tempest-GroupSnapshotsTest-870685421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (def7c694-1189-4859-aabd-d36f3765c158) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:22:48 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-50570f77-e110-4566-bc08-f228e587be96 tempest-GroupSnapshotsTest-870685421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4752e82-6a87-421e-b2ce-527c8afb0a20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:22:48 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-50570f77-e110-4566-bc08-f228e587be96 tempest-GroupSnapshotsTest-870685421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4752e82-6a87-421e-b2ce-527c8afb0a20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8dddeff8-bcaf-47b4-a4e1-ccdf2bc55e86', 'volume_name': 'volume-8dddeff8-bcaf-47b4-a4e1-ccdf2bc55e86', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:22:48 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-50570f77-e110-4566-bc08-f228e587be96 tempest-GroupSnapshotsTest-870685421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bc9542b-e38b-49a1-8679-b5a1b3814563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:22:48 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-50570f77-e110-4566-bc08-f228e587be96 tempest-GroupSnapshotsTest-870685421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bc9542b-e38b-49a1-8679-b5a1b3814563) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:22:48 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-50570f77-e110-4566-bc08-f228e587be96 tempest-GroupSnapshotsTest-870685421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (827f3370-9184-4cf5-804b-449381260493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:22:48 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-50570f77-e110-4566-bc08-f228e587be96 tempest-GroupSnapshotsTest-870685421 None] Volume 8dddeff8-bcaf-47b4-a4e1-ccdf2bc55e86: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8dddeff8-bcaf-47b4-a4e1-ccdf2bc55e86', 'volume_size': 1}
Nov 03 18:22:48 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-50570f77-e110-4566-bc08-f228e587be96 tempest-GroupSnapshotsTest-870685421 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:22:48 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-50570f77-e110-4566-bc08-f228e587be96 tempest-GroupSnapshotsTest-870685421 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:22:48 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-50570f77-e110-4566-bc08-f228e587be96 tempest-GroupSnapshotsTest-870685421 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=78aa3d81-392a-44d1-b1fc-e774e9b2348f,created_at=2026-11-03T17:22:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1536979112',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=78aa3d81-392a-44d1-b1fc-e774e9b2348f,host='devstack@QuobyteHD#QuobyteHD',id=8dddeff8-bcaf-47b4-a4e1-ccdf2bc55e86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec4923426a2c48f8843125ecc43e5686',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:22:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:22:48Z,use_quota=True,user_id='05a831a8d48448f0bad34b8f768decd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(471e85ae-e03a-4928-adfd-210561b92c28),volume_type_id=471e85ae-e03a-4928-adfd-210561b92c28)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:22:48 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-50570f77-e110-4566-bc08-f228e587be96 tempest-GroupSnapshotsTest-870685421 None] Creating volume 8dddeff8-bcaf-47b4-a4e1-ccdf2bc55e86 {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:22:48 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-50570f77-e110-4566-bc08-f228e587be96 tempest-GroupSnapshotsTest-870685421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:22:48 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-50570f77-e110-4566-bc08-f228e587be96 tempest-GroupSnapshotsTest-870685421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:22:48 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-50570f77-e110-4566-bc08-f228e587be96 tempest-GroupSnapshotsTest-870685421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:22:48 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-50570f77-e110-4566-bc08-f228e587be96 tempest-GroupSnapshotsTest-870685421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:22:48 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-50570f77-e110-4566-bc08-f228e587be96 tempest-GroupSnapshotsTest-870685421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:22:48 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-50570f77-e110-4566-bc08-f228e587be96 tempest-GroupSnapshotsTest-870685421 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:22:48 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-50570f77-e110-4566-bc08-f228e587be96 tempest-GroupSnapshotsTest-870685421 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:22:48 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-50570f77-e110-4566-bc08-f228e587be96 tempest-GroupSnapshotsTest-870685421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8dddeff8-bcaf-47b4-a4e1-ccdf2bc55e86 1073741824 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:22:48 devstack sudo[87131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8dddeff8-bcaf-47b4-a4e1-ccdf2bc55e86 1073741824
Nov 03 18:22:48 devstack sudo[87131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:22:48 devstack sudo[87131]: pam_unix(sudo:session): session closed for user root
Nov 03 18:22:48 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-50570f77-e110-4566-bc08-f228e587be96 tempest-GroupSnapshotsTest-870685421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8dddeff8-bcaf-47b4-a4e1-ccdf2bc55e86 1073741824" returned: 0 in 0.787s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:22:48 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-50570f77-e110-4566-bc08-f228e587be96 tempest-GroupSnapshotsTest-870685421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8dddeff8-bcaf-47b4-a4e1-ccdf2bc55e86 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:22:48 devstack sudo[87143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8dddeff8-bcaf-47b4-a4e1-ccdf2bc55e86
Nov 03 18:22:48 devstack sudo[87143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:22:49 devstack sudo[87143]: pam_unix(sudo:session): session closed for user root
Nov 03 18:22:49 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-50570f77-e110-4566-bc08-f228e587be96 tempest-GroupSnapshotsTest-870685421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8dddeff8-bcaf-47b4-a4e1-ccdf2bc55e86" returned: 0 in 0.418s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:22:49 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-50570f77-e110-4566-bc08-f228e587be96 tempest-GroupSnapshotsTest-870685421 None] <== create_volume: return (1270ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:22:49 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-50570f77-e110-4566-bc08-f228e587be96 tempest-GroupSnapshotsTest-870685421 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.274s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:22:49 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-50570f77-e110-4566-bc08-f228e587be96 tempest-GroupSnapshotsTest-870685421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (827f3370-9184-4cf5-804b-449381260493) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8dddeff8-bcaf-47b4-a4e1-ccdf2bc55e86', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:22:49 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-50570f77-e110-4566-bc08-f228e587be96 tempest-GroupSnapshotsTest-870685421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf75d1a1-791b-41e6-831c-378888734902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:22:49 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-50570f77-e110-4566-bc08-f228e587be96 tempest-GroupSnapshotsTest-870685421 None] Volume volume-8dddeff8-bcaf-47b4-a4e1-ccdf2bc55e86 (8dddeff8-bcaf-47b4-a4e1-ccdf2bc55e86): created successfully
Nov 03 18:22:49 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-50570f77-e110-4566-bc08-f228e587be96 tempest-GroupSnapshotsTest-870685421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf75d1a1-791b-41e6-831c-378888734902) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:22:49 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-50570f77-e110-4566-bc08-f228e587be96 tempest-GroupSnapshotsTest-870685421 None] Flow 'volume_create_manager' (8fa19edc-5444-45df-a9e2-3d98b6c5bb38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:22:49 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-50570f77-e110-4566-bc08-f228e587be96 tempest-GroupSnapshotsTest-870685421 None] Created volume successfully.
Nov 03 18:22:51 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-dba227a5-b7b1-4cc0-8491-8865b08ca280 tempest-GroupSnapshotsTest-870685421 None] GroupSnapshot 4e50dced-6cc5-45f0-bd2a-f355b84fb68f: creating.
Nov 03 18:22:51 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-dba227a5-b7b1-4cc0-8491-8865b08ca280 tempest-GroupSnapshotsTest-870685421 None] Group snapshot 4e50dced-6cc5-45f0-bd2a-f355b84fb68f: creating. {{(pid=86120) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Nov 03 18:22:51 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-dba227a5-b7b1-4cc0-8491-8865b08ca280 tempest-GroupSnapshotsTest-870685421 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:22:51 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-dba227a5-b7b1-4cc0-8491-8865b08ca280 tempest-GroupSnapshotsTest-870685421 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:22:51 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-dba227a5-b7b1-4cc0-8491-8865b08ca280 tempest-GroupSnapshotsTest-870685421 None] Creating offline snapshot ca82d76f-d0a6-4cb3-9e79-a9d0b5c9f78a of volume 8dddeff8-bcaf-47b4-a4e1-ccdf2bc55e86 {{(pid=86120) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 18:22:51 devstack cinder-volume[86120]: INFO oslo.privsep.daemon [None req-dba227a5-b7b1-4cc0-8491-8865b08ca280 tempest-GroupSnapshotsTest-870685421 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpf8utw9ow/privsep.sock']
Nov 03 18:22:51 devstack sudo[87226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpf8utw9ow/privsep.sock
Nov 03 18:22:51 devstack sudo[87226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:22:52 devstack cinder-volume[86120]: WARNING py.warnings [req-a3808853-d424-4de0-bd4d-5ea98180e13e req-414ee226-5d1d-4e36-bbee-0b7950d21b9b tempest-DeleteServersTestJSON-617902827 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volume_attachment", "volumes_1" and FROM element "volumes".  Apply join condition(s) between each element to resolve.
Nov 03 18:22:52 devstack cinder-volume[86120]:   .first()
Nov 03 18:22:52 devstack cinder-volume[86120]: 
Nov 03 18:22:52 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [req-a3808853-d424-4de0-bd4d-5ea98180e13e req-414ee226-5d1d-4e36-bbee-0b7950d21b9b tempest-DeleteServersTestJSON-617902827 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:22:52 devstack cinder-volume[86120]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning:
Nov 03 18:22:52 devstack cinder-volume[86120]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Nov 03 18:22:52 devstack cinder-volume[86120]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Nov 03 18:22:52 devstack cinder-volume[86120]: WARNING oslo.privsep.daemon [-] privsep log: 
Nov 03 18:22:52 devstack cinder-volume[86120]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Nov 03 18:22:52 devstack cinder-volume[86120]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Nov 03 18:22:52 devstack cinder-volume[86120]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Nov 03 18:22:52 devstack cinder-volume[86120]: WARNING oslo.privsep.daemon [-] privsep log: 
Nov 03 18:22:52 devstack cinder-volume[86120]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet
Nov 03 18:22:52 devstack sudo[87226]: pam_unix(sudo:session): session closed for user root
Nov 03 18:22:53 devstack cinder-volume[86120]: INFO oslo.privsep.daemon [None req-dba227a5-b7b1-4cc0-8491-8865b08ca280 tempest-GroupSnapshotsTest-870685421 None] Spawned new privsep daemon via rootwrap
Nov 03 18:22:53 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [None req-dba227a5-b7b1-4cc0-8491-8865b08ca280 tempest-GroupSnapshotsTest-870685421 None] Accepted privsep connection to /tmp/tmpf8utw9ow/privsep.sock {{(pid=86120) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}}
Nov 03 18:22:53 devstack cinder-volume[86120]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 03 18:22:53 devstack cinder-volume[86120]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 03 18:22:53 devstack cinder-volume[86120]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Nov 03 18:22:53 devstack cinder-volume[86120]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 87242
Nov 03 18:22:53 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b928424-7b62-4e84-a8b1-dd13d8853f3a]: (2,) {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:22:53 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[67e91a6b-787c-4e5e-8d6f-ba9d48fe854e]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:22:53 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-dba227a5-b7b1-4cc0-8491-8865b08ca280 tempest-GroupSnapshotsTest-870685421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8dddeff8-bcaf-47b4-a4e1-ccdf2bc55e86 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:22:53 devstack sudo[87244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8dddeff8-bcaf-47b4-a4e1-ccdf2bc55e86
Nov 03 18:22:53 devstack sudo[87244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:22:53 devstack sudo[87244]: pam_unix(sudo:session): session closed for user root
Nov 03 18:22:53 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-dba227a5-b7b1-4cc0-8491-8865b08ca280 tempest-GroupSnapshotsTest-870685421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8dddeff8-bcaf-47b4-a4e1-ccdf2bc55e86" returned: 0 in 0.376s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:22:53 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-dba227a5-b7b1-4cc0-8491-8865b08ca280 tempest-GroupSnapshotsTest-870685421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8dddeff8-bcaf-47b4-a4e1-ccdf2bc55e86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8dddeff8-bcaf-47b4-a4e1-ccdf2bc55e86.ca82d76f-d0a6-4cb3-9e79-a9d0b5c9f78a 1G {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:22:53 devstack sudo[87249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8dddeff8-bcaf-47b4-a4e1-ccdf2bc55e86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8dddeff8-bcaf-47b4-a4e1-ccdf2bc55e86.ca82d76f-d0a6-4cb3-9e79-a9d0b5c9f78a 1G
Nov 03 18:22:53 devstack sudo[87249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:22:53 devstack sudo[87249]: pam_unix(sudo:session): session closed for user root
Nov 03 18:22:53 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-dba227a5-b7b1-4cc0-8491-8865b08ca280 tempest-GroupSnapshotsTest-870685421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8dddeff8-bcaf-47b4-a4e1-ccdf2bc55e86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8dddeff8-bcaf-47b4-a4e1-ccdf2bc55e86.ca82d76f-d0a6-4cb3-9e79-a9d0b5c9f78a 1G" returned: 0 in 0.397s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:22:53 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-dba227a5-b7b1-4cc0-8491-8865b08ca280 tempest-GroupSnapshotsTest-870685421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8dddeff8-bcaf-47b4-a4e1-ccdf2bc55e86 -F qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8dddeff8-bcaf-47b4-a4e1-ccdf2bc55e86.ca82d76f-d0a6-4cb3-9e79-a9d0b5c9f78a {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:22:53 devstack sudo[87255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8dddeff8-bcaf-47b4-a4e1-ccdf2bc55e86 -F qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8dddeff8-bcaf-47b4-a4e1-ccdf2bc55e86.ca82d76f-d0a6-4cb3-9e79-a9d0b5c9f78a
Nov 03 18:22:53 devstack sudo[87255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:22:54 devstack sudo[87255]: pam_unix(sudo:session): session closed for user root
Nov 03 18:22:54 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-dba227a5-b7b1-4cc0-8491-8865b08ca280 tempest-GroupSnapshotsTest-870685421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8dddeff8-bcaf-47b4-a4e1-ccdf2bc55e86 -F qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8dddeff8-bcaf-47b4-a4e1-ccdf2bc55e86.ca82d76f-d0a6-4cb3-9e79-a9d0b5c9f78a" returned: 0 in 0.304s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:22:54 devstack cinder-volume[86120]: WARNING cinder.volume.drivers.remotefs [None req-dba227a5-b7b1-4cc0-8491-8865b08ca280 tempest-GroupSnapshotsTest-870685421 None] /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8dddeff8-bcaf-47b4-a4e1-ccdf2bc55e86.ca82d76f-d0a6-4cb3-9e79-a9d0b5c9f78a is being set with open permissions: ugo+rw: NotImplementedError
Nov 03 18:22:54 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-dba227a5-b7b1-4cc0-8491-8865b08ca280 tempest-GroupSnapshotsTest-870685421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8dddeff8-bcaf-47b4-a4e1-ccdf2bc55e86.ca82d76f-d0a6-4cb3-9e79-a9d0b5c9f78a {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:22:54 devstack sudo[87261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8dddeff8-bcaf-47b4-a4e1-ccdf2bc55e86.ca82d76f-d0a6-4cb3-9e79-a9d0b5c9f78a
Nov 03 18:22:54 devstack sudo[87261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:22:54 devstack sudo[87261]: pam_unix(sudo:session): session closed for user root
Nov 03 18:22:54 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-dba227a5-b7b1-4cc0-8491-8865b08ca280 tempest-GroupSnapshotsTest-870685421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8dddeff8-bcaf-47b4-a4e1-ccdf2bc55e86.ca82d76f-d0a6-4cb3-9e79-a9d0b5c9f78a" returned: 0 in 0.280s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:22:54 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-dba227a5-b7b1-4cc0-8491-8865b08ca280 tempest-GroupSnapshotsTest-870685421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8dddeff8-bcaf-47b4-a4e1-ccdf2bc55e86.info {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:22:54 devstack sudo[87265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8dddeff8-bcaf-47b4-a4e1-ccdf2bc55e86.info
Nov 03 18:22:54 devstack sudo[87265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:22:54 devstack sudo[87265]: pam_unix(sudo:session): session closed for user root
Nov 03 18:22:54 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-dba227a5-b7b1-4cc0-8491-8865b08ca280 tempest-GroupSnapshotsTest-870685421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8dddeff8-bcaf-47b4-a4e1-ccdf2bc55e86.info" returned: 0 in 0.307s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:22:54 devstack cinder-volume[86120]: WARNING cinder.volume.drivers.remotefs [None req-dba227a5-b7b1-4cc0-8491-8865b08ca280 tempest-GroupSnapshotsTest-870685421 None] /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8dddeff8-bcaf-47b4-a4e1-ccdf2bc55e86.info is being set with open permissions: ugo+rw: NotImplementedError
Nov 03 18:22:54 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-dba227a5-b7b1-4cc0-8491-8865b08ca280 tempest-GroupSnapshotsTest-870685421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8dddeff8-bcaf-47b4-a4e1-ccdf2bc55e86.info {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:22:54 devstack sudo[87277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8dddeff8-bcaf-47b4-a4e1-ccdf2bc55e86.info
Nov 03 18:22:54 devstack sudo[87277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:22:55 devstack sudo[87277]: pam_unix(sudo:session): session closed for user root
Nov 03 18:22:55 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-dba227a5-b7b1-4cc0-8491-8865b08ca280 tempest-GroupSnapshotsTest-870685421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8dddeff8-bcaf-47b4-a4e1-ccdf2bc55e86.info" returned: 0 in 0.282s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:22:55 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-dba227a5-b7b1-4cc0-8491-8865b08ca280 tempest-GroupSnapshotsTest-870685421 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.462s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:22:55 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [req-a3808853-d424-4de0-bd4d-5ea98180e13e req-414ee226-5d1d-4e36-bbee-0b7950d21b9b tempest-DeleteServersTestJSON-617902827 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.295s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:22:55 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [req-a3808853-d424-4de0-bd4d-5ea98180e13e req-414ee226-5d1d-4e36-bbee-0b7950d21b9b tempest-DeleteServersTestJSON-617902827 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.095s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:22:55 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-dba227a5-b7b1-4cc0-8491-8865b08ca280 tempest-GroupSnapshotsTest-870685421 None] group_snapshot 4e50dced-6cc5-45f0-bd2a-f355b84fb68f: created successfully
Nov 03 18:22:55 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [req-a3808853-d424-4de0-bd4d-5ea98180e13e req-414ee226-5d1d-4e36-bbee-0b7950d21b9b tempest-DeleteServersTestJSON-617902827 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c', 'name': 'volume-78f203ba-91e1-441b-ab59-48ac5b11134a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bb598d69-4304-4700-9cab-932fb21243ec', 'enforce_multipath': True} {{(pid=86120) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 03 18:22:55 devstack cinder-volume[86120]: INFO cinder.volume.manager [req-a3808853-d424-4de0-bd4d-5ea98180e13e req-414ee226-5d1d-4e36-bbee-0b7950d21b9b tempest-DeleteServersTestJSON-617902827 None] attachment_update completed successfully.
Nov 03 18:22:56 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-82b0027c-cc88-4732-a63c-e074d0a5d9b4 tempest-GroupSnapshotsTest-870685421 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:22:56 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-82b0027c-cc88-4732-a63c-e074d0a5d9b4 tempest-GroupSnapshotsTest-870685421 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:22:56 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-82b0027c-cc88-4732-a63c-e074d0a5d9b4 tempest-GroupSnapshotsTest-870685421 None] Acquiring lock "cinder-quobyte-ca82d76f-d0a6-4cb3-9e79-a9d0b5c9f78a-915b3bfc-68f8-4889-85d4-4d208d0f2891" by "_create_volume_from_snapshot" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:22:56 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-82b0027c-cc88-4732-a63c-e074d0a5d9b4 tempest-GroupSnapshotsTest-870685421 None] Lock "cinder-quobyte-ca82d76f-d0a6-4cb3-9e79-a9d0b5c9f78a-915b3bfc-68f8-4889-85d4-4d208d0f2891" acquired by "_create_volume_from_snapshot" :: waited 0.030s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:22:56 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-82b0027c-cc88-4732-a63c-e074d0a5d9b4 tempest-GroupSnapshotsTest-870685421 None] Creating volume 915b3bfc-68f8-4889-85d4-4d208d0f2891 from snapshot ca82d76f-d0a6-4cb3-9e79-a9d0b5c9f78a {{(pid=86120) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 03 18:22:56 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-82b0027c-cc88-4732-a63c-e074d0a5d9b4 tempest-GroupSnapshotsTest-870685421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:22:56 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-82b0027c-cc88-4732-a63c-e074d0a5d9b4 tempest-GroupSnapshotsTest-870685421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:22:56 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-82b0027c-cc88-4732-a63c-e074d0a5d9b4 tempest-GroupSnapshotsTest-870685421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:22:56 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-82b0027c-cc88-4732-a63c-e074d0a5d9b4 tempest-GroupSnapshotsTest-870685421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:22:56 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-82b0027c-cc88-4732-a63c-e074d0a5d9b4 tempest-GroupSnapshotsTest-870685421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:22:56 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-82b0027c-cc88-4732-a63c-e074d0a5d9b4 tempest-GroupSnapshotsTest-870685421 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:22:56 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-82b0027c-cc88-4732-a63c-e074d0a5d9b4 tempest-GroupSnapshotsTest-870685421 None] Acquiring lock "cinder-quobyte-915b3bfc-68f8-4889-85d4-4d208d0f2891" by "_copy_volume_from_snapshot" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:22:57 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-82b0027c-cc88-4732-a63c-e074d0a5d9b4 tempest-GroupSnapshotsTest-870685421 None] Lock "cinder-quobyte-915b3bfc-68f8-4889-85d4-4d208d0f2891" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:22:57 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-82b0027c-cc88-4732-a63c-e074d0a5d9b4 tempest-GroupSnapshotsTest-870685421 None] snapshot: ca82d76f-d0a6-4cb3-9e79-a9d0b5c9f78a, volume: 915b3bfc-68f8-4889-85d4-4d208d0f2891,  {{(pid=86120) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 03 18:22:57 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-82b0027c-cc88-4732-a63c-e074d0a5d9b4 tempest-GroupSnapshotsTest-870685421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:22:57 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-82b0027c-cc88-4732-a63c-e074d0a5d9b4 tempest-GroupSnapshotsTest-870685421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:22:57 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-82b0027c-cc88-4732-a63c-e074d0a5d9b4 tempest-GroupSnapshotsTest-870685421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:22:57 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-82b0027c-cc88-4732-a63c-e074d0a5d9b4 tempest-GroupSnapshotsTest-870685421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:22:57 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-82b0027c-cc88-4732-a63c-e074d0a5d9b4 tempest-GroupSnapshotsTest-870685421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:22:57 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a0eec3b-591b-44cf-bd4a-93a581a927c7]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:22:57 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-82b0027c-cc88-4732-a63c-e074d0a5d9b4 tempest-GroupSnapshotsTest-870685421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8dddeff8-bcaf-47b4-a4e1-ccdf2bc55e86.ca82d76f-d0a6-4cb3-9e79-a9d0b5c9f78a {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:22:57 devstack sudo[87714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8dddeff8-bcaf-47b4-a4e1-ccdf2bc55e86.ca82d76f-d0a6-4cb3-9e79-a9d0b5c9f78a
Nov 03 18:22:57 devstack sudo[87714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:22:57 devstack sudo[87714]: pam_unix(sudo:session): session closed for user root
Nov 03 18:22:57 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-82b0027c-cc88-4732-a63c-e074d0a5d9b4 tempest-GroupSnapshotsTest-870685421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8dddeff8-bcaf-47b4-a4e1-ccdf2bc55e86.ca82d76f-d0a6-4cb3-9e79-a9d0b5c9f78a" returned: 0 in 0.632s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:22:57 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-82b0027c-cc88-4732-a63c-e074d0a5d9b4 tempest-GroupSnapshotsTest-870685421 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8dddeff8-bcaf-47b4-a4e1-ccdf2bc55e86(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86120) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 18:22:57 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[771e9f17-e6bd-4022-9aae-6e644b344704]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:22:57 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-82b0027c-cc88-4732-a63c-e074d0a5d9b4 tempest-GroupSnapshotsTest-870685421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8dddeff8-bcaf-47b4-a4e1-ccdf2bc55e86 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:22:57 devstack sudo[87723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8dddeff8-bcaf-47b4-a4e1-ccdf2bc55e86
Nov 03 18:22:57 devstack sudo[87723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:22:58 devstack sudo[87723]: pam_unix(sudo:session): session closed for user root
Nov 03 18:22:58 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-82b0027c-cc88-4732-a63c-e074d0a5d9b4 tempest-GroupSnapshotsTest-870685421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8dddeff8-bcaf-47b4-a4e1-ccdf2bc55e86" returned: 0 in 0.786s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:22:58 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-82b0027c-cc88-4732-a63c-e074d0a5d9b4 tempest-GroupSnapshotsTest-870685421 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8dddeff8-bcaf-47b4-a4e1-ccdf2bc55e86 {{(pid=86120) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 03 18:22:58 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-82b0027c-cc88-4732-a63c-e074d0a5d9b4 tempest-GroupSnapshotsTest-870685421 None] Creating direct copy from snapshot {{(pid=86120) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 03 18:22:58 devstack cinder-volume[86120]: DEBUG cinder.utils [None req-82b0027c-cc88-4732-a63c-e074d0a5d9b4 tempest-GroupSnapshotsTest-870685421 None] Path /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-915b3bfc-68f8-4889-85d4-4d208d0f2891 not found in is_blk_device check {{(pid=86120) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 03 18:22:58 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-82b0027c-cc88-4732-a63c-e074d0a5d9b4 tempest-GroupSnapshotsTest-870685421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8dddeff8-bcaf-47b4-a4e1-ccdf2bc55e86 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-915b3bfc-68f8-4889-85d4-4d208d0f2891 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:22:58 devstack sudo[87776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8dddeff8-bcaf-47b4-a4e1-ccdf2bc55e86 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-915b3bfc-68f8-4889-85d4-4d208d0f2891
Nov 03 18:22:58 devstack sudo[87776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:23:00 devstack cinder-volume[86120]: INFO cinder.volume.manager [req-6959fa73-7de7-489d-86d3-050f5e1245d7 req-59c3a8c9-78cf-441b-a968-bcd2e5652d51 tempest-DeleteServersTestJSON-617902827 None] Terminate volume connection completed successfully.
Nov 03 18:23:00 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [req-6959fa73-7de7-489d-86d3-050f5e1245d7 req-59c3a8c9-78cf-441b-a968-bcd2e5652d51 tempest-DeleteServersTestJSON-617902827 None] Deleting attachment bb598d69-4304-4700-9cab-932fb21243ec. {{(pid=86120) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 03 18:23:03 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-0703888a-d55b-4b5e-a459-2f6431eb0847 tempest-DeleteServersTestJSON-617902827 None] Acquiring lock "cinder-78f203ba-91e1-441b-ab59-48ac5b11134a-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:23:03 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-0703888a-d55b-4b5e-a459-2f6431eb0847 tempest-DeleteServersTestJSON-617902827 None] Lock "cinder-78f203ba-91e1-441b-ab59-48ac5b11134a-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:23:03 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-0703888a-d55b-4b5e-a459-2f6431eb0847 tempest-DeleteServersTestJSON-617902827 None] Acquiring lock "cinder-quobyte-78f203ba-91e1-441b-ab59-48ac5b11134a" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:23:03 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-0703888a-d55b-4b5e-a459-2f6431eb0847 tempest-DeleteServersTestJSON-617902827 None] Lock "cinder-quobyte-78f203ba-91e1-441b-ab59-48ac5b11134a" acquired by "delete_volume" :: waited 0.037s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:23:04 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[02cc8ce2-42ba-41c1-89b4-6e2bf938ae8a]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:23:04 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-0703888a-d55b-4b5e-a459-2f6431eb0847 tempest-DeleteServersTestJSON-617902827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-78f203ba-91e1-441b-ab59-48ac5b11134a {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:23:04 devstack sudo[87810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-78f203ba-91e1-441b-ab59-48ac5b11134a
Nov 03 18:23:04 devstack sudo[87810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:23:04 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-131ab00e-da78-470f-b131-2cb7e21c70d7 tempest-ServerActionsTestOtherA-913173699 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:23:04 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-131ab00e-da78-470f-b131-2cb7e21c70d7 tempest-ServerActionsTestOtherA-913173699 None] Flow 'volume_create_manager' (23f2e981-6e2b-44db-83de-14e573f29a5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:23:04 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-131ab00e-da78-470f-b131-2cb7e21c70d7 tempest-ServerActionsTestOtherA-913173699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3cbb77c-23b9-4600-8b0e-8a13588bceeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:23:04 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-131ab00e-da78-470f-b131-2cb7e21c70d7 tempest-ServerActionsTestOtherA-913173699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3cbb77c-23b9-4600-8b0e-8a13588bceeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:23:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-541528651',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=255042f8-8af6-4403-bed7-bea7fc953047,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f06860b9996343eca46639219b8b45a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:23:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:23:04Z,use_quota=True,user_id='b59dba7ab59a483096665c78481a0796',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:23:04 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-131ab00e-da78-470f-b131-2cb7e21c70d7 tempest-ServerActionsTestOtherA-913173699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3beed1e2-03f5-444b-a539-fb926f0e87a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:23:04 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-131ab00e-da78-470f-b131-2cb7e21c70d7 tempest-ServerActionsTestOtherA-913173699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3beed1e2-03f5-444b-a539-fb926f0e87a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:23:04 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-131ab00e-da78-470f-b131-2cb7e21c70d7 tempest-ServerActionsTestOtherA-913173699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55be2f64-b32c-4a49-84f8-5997d56a0860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:23:04 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-131ab00e-da78-470f-b131-2cb7e21c70d7 tempest-ServerActionsTestOtherA-913173699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55be2f64-b32c-4a49-84f8-5997d56a0860) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '255042f8-8af6-4403-bed7-bea7fc953047', 'volume_name': 'volume-255042f8-8af6-4403-bed7-bea7fc953047', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:23:04 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-131ab00e-da78-470f-b131-2cb7e21c70d7 tempest-ServerActionsTestOtherA-913173699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa51f34e-1eb4-4836-aa9d-345ff921882c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:23:04 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-131ab00e-da78-470f-b131-2cb7e21c70d7 tempest-ServerActionsTestOtherA-913173699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa51f34e-1eb4-4836-aa9d-345ff921882c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:23:04 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-131ab00e-da78-470f-b131-2cb7e21c70d7 tempest-ServerActionsTestOtherA-913173699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8c3cdd9-673a-472b-b592-7b547fb1bda0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:23:04 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-131ab00e-da78-470f-b131-2cb7e21c70d7 tempest-ServerActionsTestOtherA-913173699 None] Volume 255042f8-8af6-4403-bed7-bea7fc953047: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-255042f8-8af6-4403-bed7-bea7fc953047', 'volume_size': 1}
Nov 03 18:23:04 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-131ab00e-da78-470f-b131-2cb7e21c70d7 tempest-ServerActionsTestOtherA-913173699 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:23:04 devstack sudo[87810]: pam_unix(sudo:session): session closed for user root
Nov 03 18:23:04 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-0703888a-d55b-4b5e-a459-2f6431eb0847 tempest-DeleteServersTestJSON-617902827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-78f203ba-91e1-441b-ab59-48ac5b11134a" returned: 0 in 0.644s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:23:04 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-0703888a-d55b-4b5e-a459-2f6431eb0847 tempest-DeleteServersTestJSON-617902827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-78f203ba-91e1-441b-ab59-48ac5b11134a {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:23:04 devstack sudo[87816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-78f203ba-91e1-441b-ab59-48ac5b11134a
Nov 03 18:23:04 devstack sudo[87816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:23:05 devstack sudo[87816]: pam_unix(sudo:session): session closed for user root
Nov 03 18:23:05 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-0703888a-d55b-4b5e-a459-2f6431eb0847 tempest-DeleteServersTestJSON-617902827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-78f203ba-91e1-441b-ab59-48ac5b11134a" returned: 0 in 0.474s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:23:05 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-0703888a-d55b-4b5e-a459-2f6431eb0847 tempest-DeleteServersTestJSON-617902827 None] Lock "cinder-quobyte-78f203ba-91e1-441b-ab59-48ac5b11134a" released by "delete_volume" :: held 1.256s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:23:05 devstack cinder-volume[86120]: WARNING cinder.quota [None req-0703888a-d55b-4b5e-a459-2f6431eb0847 tempest-DeleteServersTestJSON-617902827 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Nov 03 18:23:05 devstack cinder-volume[86120]: WARNING cinder.quota [None req-0703888a-d55b-4b5e-a459-2f6431eb0847 tempest-DeleteServersTestJSON-617902827 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Nov 03 18:23:05 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-0703888a-d55b-4b5e-a459-2f6431eb0847 tempest-DeleteServersTestJSON-617902827 None] Created reservations ['190dbde0-9e61-4c3a-94c6-bcdb14dc5d89', '49a6c894-62be-403a-a377-c74d7ad3af4f', 'd9a1fd5e-daca-4d1c-9eae-5c26904b7376', 'f0d7a004-6f5f-4104-a919-541fa5d4ab41'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:23:05 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-0703888a-d55b-4b5e-a459-2f6431eb0847 tempest-DeleteServersTestJSON-617902827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:23:05 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-0703888a-d55b-4b5e-a459-2f6431eb0847 tempest-DeleteServersTestJSON-617902827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:23:05 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-0703888a-d55b-4b5e-a459-2f6431eb0847 tempest-DeleteServersTestJSON-617902827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:23:05 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-0703888a-d55b-4b5e-a459-2f6431eb0847 tempest-DeleteServersTestJSON-617902827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:23:05 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-0703888a-d55b-4b5e-a459-2f6431eb0847 tempest-DeleteServersTestJSON-617902827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:23:05 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-0703888a-d55b-4b5e-a459-2f6431eb0847 tempest-DeleteServersTestJSON-617902827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:23:05 devstack sudo[87819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:23:05 devstack sudo[87819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:23:06 devstack sudo[87819]: pam_unix(sudo:session): session closed for user root
Nov 03 18:23:06 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-0703888a-d55b-4b5e-a459-2f6431eb0847 tempest-DeleteServersTestJSON-617902827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.689s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:23:06 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-0703888a-d55b-4b5e-a459-2f6431eb0847 tempest-DeleteServersTestJSON-617902827 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:23:06 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-0703888a-d55b-4b5e-a459-2f6431eb0847 tempest-DeleteServersTestJSON-617902827 None] Deleted volume successfully.
Nov 03 18:23:06 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-0703888a-d55b-4b5e-a459-2f6431eb0847 tempest-DeleteServersTestJSON-617902827 None] Lock "cinder-78f203ba-91e1-441b-ab59-48ac5b11134a-delete_volume" released by "delete_volume" :: held 2.602s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:23:08 devstack sudo[87776]: pam_unix(sudo:session): session closed for user root
Nov 03 18:23:08 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-82b0027c-cc88-4732-a63c-e074d0a5d9b4 tempest-GroupSnapshotsTest-870685421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8dddeff8-bcaf-47b4-a4e1-ccdf2bc55e86 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-915b3bfc-68f8-4889-85d4-4d208d0f2891" returned: 0 in 9.506s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:23:08 devstack cinder-volume[86120]: DEBUG cinder.image.image_utils [None req-82b0027c-cc88-4732-a63c-e074d0a5d9b4 tempest-GroupSnapshotsTest-870685421 None] Image conversion details: src /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8dddeff8-bcaf-47b4-a4e1-ccdf2bc55e86, size 1024.00 MB, duration 9.51 sec, destination /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-915b3bfc-68f8-4889-85d4-4d208d0f2891 {{(pid=86120) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 03 18:23:08 devstack cinder-volume[86120]: INFO cinder.image.image_utils [None req-82b0027c-cc88-4732-a63c-e074d0a5d9b4 tempest-GroupSnapshotsTest-870685421 None] Converted 1024.00 MB image at 107.71 MB/s
Nov 03 18:23:08 devstack cinder-volume[86120]: WARNING cinder.volume.drivers.remotefs [None req-82b0027c-cc88-4732-a63c-e074d0a5d9b4 tempest-GroupSnapshotsTest-870685421 None] /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-915b3bfc-68f8-4889-85d4-4d208d0f2891 is being set with open permissions: ugo+rw: NotImplementedError
Nov 03 18:23:08 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-82b0027c-cc88-4732-a63c-e074d0a5d9b4 tempest-GroupSnapshotsTest-870685421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-915b3bfc-68f8-4889-85d4-4d208d0f2891 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:23:08 devstack sudo[87822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-915b3bfc-68f8-4889-85d4-4d208d0f2891
Nov 03 18:23:08 devstack sudo[87822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:23:08 devstack sudo[87822]: pam_unix(sudo:session): session closed for user root
Nov 03 18:23:08 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-82b0027c-cc88-4732-a63c-e074d0a5d9b4 tempest-GroupSnapshotsTest-870685421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-915b3bfc-68f8-4889-85d4-4d208d0f2891" returned: 0 in 0.255s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:23:08 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-82b0027c-cc88-4732-a63c-e074d0a5d9b4 tempest-GroupSnapshotsTest-870685421 None] Lock "cinder-quobyte-915b3bfc-68f8-4889-85d4-4d208d0f2891" released by "_copy_volume_from_snapshot" :: held 11.338s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:23:08 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-82b0027c-cc88-4732-a63c-e074d0a5d9b4 tempest-GroupSnapshotsTest-870685421 None] Lock "cinder-quobyte-ca82d76f-d0a6-4cb3-9e79-a9d0b5c9f78a-915b3bfc-68f8-4889-85d4-4d208d0f2891" released by "_create_volume_from_snapshot" :: held 11.424s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:23:08 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-82b0027c-cc88-4732-a63c-e074d0a5d9b4 tempest-GroupSnapshotsTest-870685421 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.456s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:23:08 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-131ab00e-da78-470f-b131-2cb7e21c70d7 tempest-ServerActionsTestOtherA-913173699 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.845s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:23:08 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-131ab00e-da78-470f-b131-2cb7e21c70d7 tempest-ServerActionsTestOtherA-913173699 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:23:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-541528651',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=255042f8-8af6-4403-bed7-bea7fc953047,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f06860b9996343eca46639219b8b45a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:23:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:23:04Z,use_quota=True,user_id='b59dba7ab59a483096665c78481a0796',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:23:08 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-131ab00e-da78-470f-b131-2cb7e21c70d7 tempest-ServerActionsTestOtherA-913173699 None] Creating volume 255042f8-8af6-4403-bed7-bea7fc953047 {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:23:08 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-131ab00e-da78-470f-b131-2cb7e21c70d7 tempest-ServerActionsTestOtherA-913173699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:23:08 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-131ab00e-da78-470f-b131-2cb7e21c70d7 tempest-ServerActionsTestOtherA-913173699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:23:08 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-131ab00e-da78-470f-b131-2cb7e21c70d7 tempest-ServerActionsTestOtherA-913173699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:23:08 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-131ab00e-da78-470f-b131-2cb7e21c70d7 tempest-ServerActionsTestOtherA-913173699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:23:08 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-131ab00e-da78-470f-b131-2cb7e21c70d7 tempest-ServerActionsTestOtherA-913173699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:23:08 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-131ab00e-da78-470f-b131-2cb7e21c70d7 tempest-ServerActionsTestOtherA-913173699 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:23:08 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-131ab00e-da78-470f-b131-2cb7e21c70d7 tempest-ServerActionsTestOtherA-913173699 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:23:08 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-131ab00e-da78-470f-b131-2cb7e21c70d7 tempest-ServerActionsTestOtherA-913173699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-255042f8-8af6-4403-bed7-bea7fc953047 1073741824 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:23:08 devstack sudo[87826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-255042f8-8af6-4403-bed7-bea7fc953047 1073741824
Nov 03 18:23:08 devstack sudo[87826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:23:08 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-82b0027c-cc88-4732-a63c-e074d0a5d9b4 tempest-GroupSnapshotsTest-870685421 None] Create group from source-snapshot-4e50dced-6cc5-45f0-bd2a-f355b84fb68f completed successfully.
Nov 03 18:23:09 devstack sudo[87826]: pam_unix(sudo:session): session closed for user root
Nov 03 18:23:09 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-131ab00e-da78-470f-b131-2cb7e21c70d7 tempest-ServerActionsTestOtherA-913173699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-255042f8-8af6-4403-bed7-bea7fc953047 1073741824" returned: 0 in 0.625s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:23:09 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-131ab00e-da78-470f-b131-2cb7e21c70d7 tempest-ServerActionsTestOtherA-913173699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-255042f8-8af6-4403-bed7-bea7fc953047 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:23:09 devstack sudo[87834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-255042f8-8af6-4403-bed7-bea7fc953047
Nov 03 18:23:09 devstack sudo[87834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:23:09 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-150ccba9-0e6e-4ac6-8e3a-d386e4de2756 tempest-GroupSnapshotsTest-870685421 None] Acquiring lock "cinder-quobyte-915b3bfc-68f8-4889-85d4-4d208d0f2891" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:23:09 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-150ccba9-0e6e-4ac6-8e3a-d386e4de2756 tempest-GroupSnapshotsTest-870685421 None] Lock "cinder-quobyte-915b3bfc-68f8-4889-85d4-4d208d0f2891" acquired by "delete_volume" :: waited 0.031s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:23:09 devstack sudo[87834]: pam_unix(sudo:session): session closed for user root
Nov 03 18:23:09 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-131ab00e-da78-470f-b131-2cb7e21c70d7 tempest-ServerActionsTestOtherA-913173699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-255042f8-8af6-4403-bed7-bea7fc953047" returned: 0 in 0.334s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:23:09 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-131ab00e-da78-470f-b131-2cb7e21c70d7 tempest-ServerActionsTestOtherA-913173699 None] <== create_volume: return (1005ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:23:09 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-131ab00e-da78-470f-b131-2cb7e21c70d7 tempest-ServerActionsTestOtherA-913173699 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.011s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:23:09 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ab6ea9c-aae0-4481-b0e4-2d773d14416d]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:23:09 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-150ccba9-0e6e-4ac6-8e3a-d386e4de2756 tempest-GroupSnapshotsTest-870685421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-915b3bfc-68f8-4889-85d4-4d208d0f2891 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:23:09 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-131ab00e-da78-470f-b131-2cb7e21c70d7 tempest-ServerActionsTestOtherA-913173699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8c3cdd9-673a-472b-b592-7b547fb1bda0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-255042f8-8af6-4403-bed7-bea7fc953047', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:23:09 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-131ab00e-da78-470f-b131-2cb7e21c70d7 tempest-ServerActionsTestOtherA-913173699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89fda7f7-8184-4796-8e8e-006ad3a0ed10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:23:09 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-131ab00e-da78-470f-b131-2cb7e21c70d7 tempest-ServerActionsTestOtherA-913173699 None] Volume volume-255042f8-8af6-4403-bed7-bea7fc953047 (255042f8-8af6-4403-bed7-bea7fc953047): created successfully
Nov 03 18:23:09 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-131ab00e-da78-470f-b131-2cb7e21c70d7 tempest-ServerActionsTestOtherA-913173699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89fda7f7-8184-4796-8e8e-006ad3a0ed10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:23:09 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-131ab00e-da78-470f-b131-2cb7e21c70d7 tempest-ServerActionsTestOtherA-913173699 None] Flow 'volume_create_manager' (23f2e981-6e2b-44db-83de-14e573f29a5e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:23:09 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-131ab00e-da78-470f-b131-2cb7e21c70d7 tempest-ServerActionsTestOtherA-913173699 None] Created volume successfully.
Nov 03 18:23:09 devstack sudo[87837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-915b3bfc-68f8-4889-85d4-4d208d0f2891
Nov 03 18:23:09 devstack sudo[87837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:23:09 devstack sudo[87837]: pam_unix(sudo:session): session closed for user root
Nov 03 18:23:09 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-150ccba9-0e6e-4ac6-8e3a-d386e4de2756 tempest-GroupSnapshotsTest-870685421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-915b3bfc-68f8-4889-85d4-4d208d0f2891" returned: 0 in 0.426s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:23:09 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-150ccba9-0e6e-4ac6-8e3a-d386e4de2756 tempest-GroupSnapshotsTest-870685421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-915b3bfc-68f8-4889-85d4-4d208d0f2891 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:23:09 devstack sudo[87842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-915b3bfc-68f8-4889-85d4-4d208d0f2891
Nov 03 18:23:09 devstack sudo[87842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:23:10 devstack sudo[87842]: pam_unix(sudo:session): session closed for user root
Nov 03 18:23:10 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-150ccba9-0e6e-4ac6-8e3a-d386e4de2756 tempest-GroupSnapshotsTest-870685421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-915b3bfc-68f8-4889-85d4-4d208d0f2891" returned: 0 in 0.308s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:23:10 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-150ccba9-0e6e-4ac6-8e3a-d386e4de2756 tempest-GroupSnapshotsTest-870685421 None] Lock "cinder-quobyte-915b3bfc-68f8-4889-85d4-4d208d0f2891" released by "delete_volume" :: held 0.816s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:23:10 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-150ccba9-0e6e-4ac6-8e3a-d386e4de2756 tempest-GroupSnapshotsTest-870685421 None] Created reservations ['a93196b3-abc6-47dd-ad77-bcad332d0d87'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:23:10 devstack cinder-volume[86120]: WARNING cinder.quota [None req-150ccba9-0e6e-4ac6-8e3a-d386e4de2756 tempest-GroupSnapshotsTest-870685421 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1564276042 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1564276042, it is now deprecated. Please use the default quota class for default quota.
Nov 03 18:23:10 devstack cinder-volume[86120]: WARNING cinder.quota [None req-150ccba9-0e6e-4ac6-8e3a-d386e4de2756 tempest-GroupSnapshotsTest-870685421 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1564276042 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1564276042, it is now deprecated. Please use the default quota class for default quota.
Nov 03 18:23:10 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-150ccba9-0e6e-4ac6-8e3a-d386e4de2756 tempest-GroupSnapshotsTest-870685421 None] Created reservations ['b1d35634-54f0-4347-a85f-cca4b0ba7b82', '34b72174-50d2-4d28-b710-8d5194a2eb67', 'ce5571eb-3927-434f-a7ca-6b359d898821', '7d7615c8-b4ec-4f5d-b160-4de6887e2755'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:23:10 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-150ccba9-0e6e-4ac6-8e3a-d386e4de2756 tempest-GroupSnapshotsTest-870685421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:23:10 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-150ccba9-0e6e-4ac6-8e3a-d386e4de2756 tempest-GroupSnapshotsTest-870685421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:23:10 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-150ccba9-0e6e-4ac6-8e3a-d386e4de2756 tempest-GroupSnapshotsTest-870685421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:23:10 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-150ccba9-0e6e-4ac6-8e3a-d386e4de2756 tempest-GroupSnapshotsTest-870685421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:23:10 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-150ccba9-0e6e-4ac6-8e3a-d386e4de2756 tempest-GroupSnapshotsTest-870685421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:23:10 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-150ccba9-0e6e-4ac6-8e3a-d386e4de2756 tempest-GroupSnapshotsTest-870685421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:23:10 devstack sudo[87845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:23:10 devstack sudo[87845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:23:10 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-e0321862-7402-4e34-adfb-e61d226371b6 tempest-GroupSnapshotsTest-870685421 None] group_snapshot 4e50dced-6cc5-45f0-bd2a-f355b84fb68f: deleting
Nov 03 18:23:10 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-e0321862-7402-4e34-adfb-e61d226371b6 tempest-GroupSnapshotsTest-870685421 None] group_snapshot 4e50dced-6cc5-45f0-bd2a-f355b84fb68f: deleting {{(pid=86120) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Nov 03 18:23:10 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-e0321862-7402-4e34-adfb-e61d226371b6 tempest-GroupSnapshotsTest-870685421 None] Acquiring lock "cinder-quobyte-8dddeff8-bcaf-47b4-a4e1-ccdf2bc55e86" by "delete_snapshot" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:23:10 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-e0321862-7402-4e34-adfb-e61d226371b6 tempest-GroupSnapshotsTest-870685421 None] Lock "cinder-quobyte-8dddeff8-bcaf-47b4-a4e1-ccdf2bc55e86" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:23:10 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-e0321862-7402-4e34-adfb-e61d226371b6 tempest-GroupSnapshotsTest-870685421 None] Acquiring lock "cinder-quobyte-ca82d76f-d0a6-4cb3-9e79-a9d0b5c9f78a" by "_delete_snapshot" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:23:10 devstack sudo[87845]: pam_unix(sudo:session): session closed for user root
Nov 03 18:23:10 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-150ccba9-0e6e-4ac6-8e3a-d386e4de2756 tempest-GroupSnapshotsTest-870685421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.280s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:23:10 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-150ccba9-0e6e-4ac6-8e3a-d386e4de2756 tempest-GroupSnapshotsTest-870685421 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:23:10 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-e0321862-7402-4e34-adfb-e61d226371b6 tempest-GroupSnapshotsTest-870685421 None] Lock "cinder-quobyte-ca82d76f-d0a6-4cb3-9e79-a9d0b5c9f78a" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:23:10 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-e0321862-7402-4e34-adfb-e61d226371b6 tempest-GroupSnapshotsTest-870685421 None] Deleting offline snapshot ca82d76f-d0a6-4cb3-9e79-a9d0b5c9f78a of volume 8dddeff8-bcaf-47b4-a4e1-ccdf2bc55e86 {{(pid=86120) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 18:23:10 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-e0321862-7402-4e34-adfb-e61d226371b6 tempest-GroupSnapshotsTest-870685421 None] snapshot_file for this snap is: volume-8dddeff8-bcaf-47b4-a4e1-ccdf2bc55e86.ca82d76f-d0a6-4cb3-9e79-a9d0b5c9f78a {{(pid=86120) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 18:23:10 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-150ccba9-0e6e-4ac6-8e3a-d386e4de2756 tempest-GroupSnapshotsTest-870685421 None] Delete group completed successfully.
Nov 03 18:23:10 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[59bc8ceb-1295-4682-82c2-b359f28d4377]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:23:10 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-e0321862-7402-4e34-adfb-e61d226371b6 tempest-GroupSnapshotsTest-870685421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8dddeff8-bcaf-47b4-a4e1-ccdf2bc55e86.ca82d76f-d0a6-4cb3-9e79-a9d0b5c9f78a {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:23:10 devstack sudo[87848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8dddeff8-bcaf-47b4-a4e1-ccdf2bc55e86.ca82d76f-d0a6-4cb3-9e79-a9d0b5c9f78a
Nov 03 18:23:10 devstack sudo[87848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:23:11 devstack sudo[87848]: pam_unix(sudo:session): session closed for user root
Nov 03 18:23:11 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-e0321862-7402-4e34-adfb-e61d226371b6 tempest-GroupSnapshotsTest-870685421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8dddeff8-bcaf-47b4-a4e1-ccdf2bc55e86.ca82d76f-d0a6-4cb3-9e79-a9d0b5c9f78a" returned: 0 in 0.431s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:23:11 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-e0321862-7402-4e34-adfb-e61d226371b6 tempest-GroupSnapshotsTest-870685421 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8dddeff8-bcaf-47b4-a4e1-ccdf2bc55e86(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86120) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 18:23:11 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf99490e-3243-4f83-8155-7bba6a2521e0]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:23:11 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-e0321862-7402-4e34-adfb-e61d226371b6 tempest-GroupSnapshotsTest-870685421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8dddeff8-bcaf-47b4-a4e1-ccdf2bc55e86 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:23:11 devstack sudo[87854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8dddeff8-bcaf-47b4-a4e1-ccdf2bc55e86
Nov 03 18:23:11 devstack sudo[87854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:23:11 devstack sudo[87854]: pam_unix(sudo:session): session closed for user root
Nov 03 18:23:11 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-e0321862-7402-4e34-adfb-e61d226371b6 tempest-GroupSnapshotsTest-870685421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8dddeff8-bcaf-47b4-a4e1-ccdf2bc55e86" returned: 0 in 0.646s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:23:11 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-e0321862-7402-4e34-adfb-e61d226371b6 tempest-GroupSnapshotsTest-870685421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8dddeff8-bcaf-47b4-a4e1-ccdf2bc55e86.ca82d76f-d0a6-4cb3-9e79-a9d0b5c9f78a {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:23:11 devstack sudo[87859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8dddeff8-bcaf-47b4-a4e1-ccdf2bc55e86.ca82d76f-d0a6-4cb3-9e79-a9d0b5c9f78a
Nov 03 18:23:11 devstack sudo[87859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:23:12 devstack sudo[87859]: pam_unix(sudo:session): session closed for user root
Nov 03 18:23:12 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-e0321862-7402-4e34-adfb-e61d226371b6 tempest-GroupSnapshotsTest-870685421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8dddeff8-bcaf-47b4-a4e1-ccdf2bc55e86.ca82d76f-d0a6-4cb3-9e79-a9d0b5c9f78a" returned: 0 in 0.414s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:23:12 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-e0321862-7402-4e34-adfb-e61d226371b6 tempest-GroupSnapshotsTest-870685421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8dddeff8-bcaf-47b4-a4e1-ccdf2bc55e86.ca82d76f-d0a6-4cb3-9e79-a9d0b5c9f78a {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:23:12 devstack sudo[87865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8dddeff8-bcaf-47b4-a4e1-ccdf2bc55e86.ca82d76f-d0a6-4cb3-9e79-a9d0b5c9f78a
Nov 03 18:23:12 devstack sudo[87865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:23:12 devstack sudo[87865]: pam_unix(sudo:session): session closed for user root
Nov 03 18:23:12 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-e0321862-7402-4e34-adfb-e61d226371b6 tempest-GroupSnapshotsTest-870685421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8dddeff8-bcaf-47b4-a4e1-ccdf2bc55e86.ca82d76f-d0a6-4cb3-9e79-a9d0b5c9f78a" returned: 0 in 0.378s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:23:12 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-e0321862-7402-4e34-adfb-e61d226371b6 tempest-GroupSnapshotsTest-870685421 None] Lock "cinder-quobyte-ca82d76f-d0a6-4cb3-9e79-a9d0b5c9f78a" released by "_delete_snapshot" :: held 2.015s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:23:12 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-e0321862-7402-4e34-adfb-e61d226371b6 tempest-GroupSnapshotsTest-870685421 None] Lock "cinder-quobyte-8dddeff8-bcaf-47b4-a4e1-ccdf2bc55e86" released by "delete_snapshot" :: held 2.047s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:23:12 devstack cinder-volume[86120]: WARNING cinder.quota [None req-e0321862-7402-4e34-adfb-e61d226371b6 tempest-GroupSnapshotsTest-870685421 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1564276042 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1564276042, it is now deprecated. Please use the default quota class for default quota.
Nov 03 18:23:12 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-e0321862-7402-4e34-adfb-e61d226371b6 tempest-GroupSnapshotsTest-870685421 None] Created reservations ['3c8bc0c0-b889-45f9-bbd5-05967311bc40', '1f1d6383-26ae-484a-bbb4-f2101a2e67c3', '8efaf635-7667-43bb-b36b-4a096a8f2f00', '07a1fe5a-6e92-4b91-8ea7-70cb31888e33'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:23:12 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-e0321862-7402-4e34-adfb-e61d226371b6 tempest-GroupSnapshotsTest-870685421 None] group_snapshot 4e50dced-6cc5-45f0-bd2a-f355b84fb68f: deleted successfully
Nov 03 18:23:13 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-1988dc80-000c-4368-94ac-3ec9911a1786 tempest-GroupSnapshotsTest-870685421 None] Acquiring lock "cinder-quobyte-8dddeff8-bcaf-47b4-a4e1-ccdf2bc55e86" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:23:13 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-1988dc80-000c-4368-94ac-3ec9911a1786 tempest-GroupSnapshotsTest-870685421 None] Lock "cinder-quobyte-8dddeff8-bcaf-47b4-a4e1-ccdf2bc55e86" acquired by "delete_volume" :: waited 0.025s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:23:13 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[7574fbac-822c-4910-a87a-4a63b3bc9698]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:23:13 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-1988dc80-000c-4368-94ac-3ec9911a1786 tempest-GroupSnapshotsTest-870685421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8dddeff8-bcaf-47b4-a4e1-ccdf2bc55e86 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:23:13 devstack sudo[87876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8dddeff8-bcaf-47b4-a4e1-ccdf2bc55e86
Nov 03 18:23:13 devstack sudo[87876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:23:13 devstack sudo[87876]: pam_unix(sudo:session): session closed for user root
Nov 03 18:23:13 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-1988dc80-000c-4368-94ac-3ec9911a1786 tempest-GroupSnapshotsTest-870685421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8dddeff8-bcaf-47b4-a4e1-ccdf2bc55e86" returned: 0 in 0.524s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:23:13 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-1988dc80-000c-4368-94ac-3ec9911a1786 tempest-GroupSnapshotsTest-870685421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8dddeff8-bcaf-47b4-a4e1-ccdf2bc55e86 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:23:14 devstack sudo[87887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8dddeff8-bcaf-47b4-a4e1-ccdf2bc55e86
Nov 03 18:23:14 devstack sudo[87887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:23:14 devstack sudo[87887]: pam_unix(sudo:session): session closed for user root
Nov 03 18:23:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-1988dc80-000c-4368-94ac-3ec9911a1786 tempest-GroupSnapshotsTest-870685421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8dddeff8-bcaf-47b4-a4e1-ccdf2bc55e86" returned: 0 in 0.378s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:23:14 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-1988dc80-000c-4368-94ac-3ec9911a1786 tempest-GroupSnapshotsTest-870685421 None] Lock "cinder-quobyte-8dddeff8-bcaf-47b4-a4e1-ccdf2bc55e86" released by "delete_volume" :: held 1.022s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:23:14 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-1988dc80-000c-4368-94ac-3ec9911a1786 tempest-GroupSnapshotsTest-870685421 None] Created reservations ['fa3dd924-3724-44bc-a8cd-6c0cbe408a6b'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:23:14 devstack cinder-volume[86120]: WARNING cinder.db.api [None req-1988dc80-000c-4368-94ac-3ec9911a1786 tempest-GroupSnapshotsTest-870685421 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1564276042']
Nov 03 18:23:14 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-1988dc80-000c-4368-94ac-3ec9911a1786 tempest-GroupSnapshotsTest-870685421 None] Created reservations ['f8318dae-caf6-4a73-9819-9f15c8df852e', '4c00cd73-9c1e-4cf7-861a-f4be6ddaab10', '21fe9eae-ce4e-42a0-a806-185a565cb71d', '42c8382d-eb28-4e3f-ad64-8679208c1904'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:23:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-1988dc80-000c-4368-94ac-3ec9911a1786 tempest-GroupSnapshotsTest-870685421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:23:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-1988dc80-000c-4368-94ac-3ec9911a1786 tempest-GroupSnapshotsTest-870685421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:23:14 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-1988dc80-000c-4368-94ac-3ec9911a1786 tempest-GroupSnapshotsTest-870685421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:23:14 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-1988dc80-000c-4368-94ac-3ec9911a1786 tempest-GroupSnapshotsTest-870685421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:23:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-1988dc80-000c-4368-94ac-3ec9911a1786 tempest-GroupSnapshotsTest-870685421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:23:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-1988dc80-000c-4368-94ac-3ec9911a1786 tempest-GroupSnapshotsTest-870685421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:23:14 devstack sudo[87891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:23:14 devstack sudo[87891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:23:14 devstack cinder-volume[86120]: DEBUG oslo_service.periodic_task [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86120) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 18:23:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:23:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:23:14 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:23:14 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:23:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:23:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:23:14 devstack sudo[87895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:23:14 devstack sudo[87895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:23:15 devstack sudo[87891]: pam_unix(sudo:session): session closed for user root
Nov 03 18:23:15 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-1988dc80-000c-4368-94ac-3ec9911a1786 tempest-GroupSnapshotsTest-870685421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.542s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:23:15 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-1988dc80-000c-4368-94ac-3ec9911a1786 tempest-GroupSnapshotsTest-870685421 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:23:15 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-1988dc80-000c-4368-94ac-3ec9911a1786 tempest-GroupSnapshotsTest-870685421 None] Delete group completed successfully.
Nov 03 18:23:15 devstack sudo[87895]: pam_unix(sudo:session): session closed for user root
Nov 03 18:23:15 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.322s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:23:15 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:23:15 devstack cinder-volume[86120]: DEBUG oslo_service.periodic_task [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Running periodic task VolumeManager._thread_info {{(pid=86120) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 18:23:15 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] thread count: 8 {{(pid=86120) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 03 18:23:15 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] thread info: [<_MainThread(MainThread, started 134747145822336)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134747033686336)>, <Thread(Thread-3 (stat_writer), started daemon 134747030828736)>, <Thread(Rabbit-heartbeat, started daemon 134747035433408)>, <Thread(Thread-5 (_runner), started daemon 134747029587392)>, <Thread(Thread-7 (_runner), started daemon 134747029784256)>, <Thread(fd_logger, started daemon 134747027909120)>, <Thread(privsep_reader, started daemon 134747027006592)>] {{(pid=86120) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 03 18:23:15 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-55cdb25c-f5ec-411a-88c8-6b2c3a2b4f72 tempest-GroupSnapshotsTest-870685421 None] Group tempest-GroupSnapshotsTest-Group-2088430510: creating
Nov 03 18:23:15 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-55cdb25c-f5ec-411a-88c8-6b2c3a2b4f72 tempest-GroupSnapshotsTest-870685421 None] Group tempest-GroupSnapshotsTest-Group-2088430510: created successfully
Nov 03 18:23:15 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-55cdb25c-f5ec-411a-88c8-6b2c3a2b4f72 tempest-GroupSnapshotsTest-870685421 None] Create group completed successfully.
Nov 03 18:23:17 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf5b3f39-5252-4bd3-b838-5434ff0b4bc4 tempest-GroupSnapshotsTest-870685421 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:23:17 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-cf5b3f39-5252-4bd3-b838-5434ff0b4bc4 tempest-GroupSnapshotsTest-870685421 None] Flow 'volume_create_manager' (4951df64-d46c-4f9a-97e1-fccf61a68c25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:23:17 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-cf5b3f39-5252-4bd3-b838-5434ff0b4bc4 tempest-GroupSnapshotsTest-870685421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f19d4b4-a811-40ac-9fd1-5244a12ef1e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:23:17 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-cf5b3f39-5252-4bd3-b838-5434ff0b4bc4 tempest-GroupSnapshotsTest-870685421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f19d4b4-a811-40ac-9fd1-5244a12ef1e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:23:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2075417554',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=ed5cc04d-1ebd-4a43-9090-9907c4e1ff47,host='devstack@QuobyteHD#QuobyteHD',id=95886be1-4d85-4eff-bda0-2d9f7964eed0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec4923426a2c48f8843125ecc43e5686',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:23:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:23:18Z,use_quota=True,user_id='05a831a8d48448f0bad34b8f768decd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fad9c95c-bd56-4e52-b77e-28d67d2e2535),volume_type_id=fad9c95c-bd56-4e52-b77e-28d67d2e2535)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:23:17 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-cf5b3f39-5252-4bd3-b838-5434ff0b4bc4 tempest-GroupSnapshotsTest-870685421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a68761f-3388-4abd-95ff-5ae0b42fa596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:23:17 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-cf5b3f39-5252-4bd3-b838-5434ff0b4bc4 tempest-GroupSnapshotsTest-870685421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a68761f-3388-4abd-95ff-5ae0b42fa596) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:23:17 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-cf5b3f39-5252-4bd3-b838-5434ff0b4bc4 tempest-GroupSnapshotsTest-870685421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a08783ae-6912-45ad-b06a-cb04cf335433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:23:17 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-cf5b3f39-5252-4bd3-b838-5434ff0b4bc4 tempest-GroupSnapshotsTest-870685421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a08783ae-6912-45ad-b06a-cb04cf335433) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95886be1-4d85-4eff-bda0-2d9f7964eed0', 'volume_name': 'volume-95886be1-4d85-4eff-bda0-2d9f7964eed0', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:23:17 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-cf5b3f39-5252-4bd3-b838-5434ff0b4bc4 tempest-GroupSnapshotsTest-870685421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b9a4e54-14bf-4ac3-9857-65e6f5a181a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:23:17 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-cf5b3f39-5252-4bd3-b838-5434ff0b4bc4 tempest-GroupSnapshotsTest-870685421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b9a4e54-14bf-4ac3-9857-65e6f5a181a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:23:17 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-cf5b3f39-5252-4bd3-b838-5434ff0b4bc4 tempest-GroupSnapshotsTest-870685421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01eedd5f-5b91-44e7-b779-9a64faf4a422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:23:17 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-cf5b3f39-5252-4bd3-b838-5434ff0b4bc4 tempest-GroupSnapshotsTest-870685421 None] Volume 95886be1-4d85-4eff-bda0-2d9f7964eed0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95886be1-4d85-4eff-bda0-2d9f7964eed0', 'volume_size': 1}
Nov 03 18:23:17 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-cf5b3f39-5252-4bd3-b838-5434ff0b4bc4 tempest-GroupSnapshotsTest-870685421 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:23:17 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-cf5b3f39-5252-4bd3-b838-5434ff0b4bc4 tempest-GroupSnapshotsTest-870685421 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:23:17 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-cf5b3f39-5252-4bd3-b838-5434ff0b4bc4 tempest-GroupSnapshotsTest-870685421 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=ed5cc04d-1ebd-4a43-9090-9907c4e1ff47,created_at=2026-11-03T17:23:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2075417554',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=ed5cc04d-1ebd-4a43-9090-9907c4e1ff47,host='devstack@QuobyteHD#QuobyteHD',id=95886be1-4d85-4eff-bda0-2d9f7964eed0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec4923426a2c48f8843125ecc43e5686',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:23:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:23:18Z,use_quota=True,user_id='05a831a8d48448f0bad34b8f768decd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fad9c95c-bd56-4e52-b77e-28d67d2e2535),volume_type_id=fad9c95c-bd56-4e52-b77e-28d67d2e2535)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:23:17 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-cf5b3f39-5252-4bd3-b838-5434ff0b4bc4 tempest-GroupSnapshotsTest-870685421 None] Creating volume 95886be1-4d85-4eff-bda0-2d9f7964eed0 {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:23:17 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-cf5b3f39-5252-4bd3-b838-5434ff0b4bc4 tempest-GroupSnapshotsTest-870685421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:23:17 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-cf5b3f39-5252-4bd3-b838-5434ff0b4bc4 tempest-GroupSnapshotsTest-870685421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:23:17 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-cf5b3f39-5252-4bd3-b838-5434ff0b4bc4 tempest-GroupSnapshotsTest-870685421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:23:17 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-cf5b3f39-5252-4bd3-b838-5434ff0b4bc4 tempest-GroupSnapshotsTest-870685421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:23:17 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-cf5b3f39-5252-4bd3-b838-5434ff0b4bc4 tempest-GroupSnapshotsTest-870685421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:23:17 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-cf5b3f39-5252-4bd3-b838-5434ff0b4bc4 tempest-GroupSnapshotsTest-870685421 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:23:17 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-cf5b3f39-5252-4bd3-b838-5434ff0b4bc4 tempest-GroupSnapshotsTest-870685421 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:23:17 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-cf5b3f39-5252-4bd3-b838-5434ff0b4bc4 tempest-GroupSnapshotsTest-870685421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-95886be1-4d85-4eff-bda0-2d9f7964eed0 1073741824 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:23:17 devstack sudo[87950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-95886be1-4d85-4eff-bda0-2d9f7964eed0 1073741824
Nov 03 18:23:17 devstack sudo[87950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:23:18 devstack sudo[87950]: pam_unix(sudo:session): session closed for user root
Nov 03 18:23:18 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-cf5b3f39-5252-4bd3-b838-5434ff0b4bc4 tempest-GroupSnapshotsTest-870685421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-95886be1-4d85-4eff-bda0-2d9f7964eed0 1073741824" returned: 0 in 0.605s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:23:18 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-cf5b3f39-5252-4bd3-b838-5434ff0b4bc4 tempest-GroupSnapshotsTest-870685421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-95886be1-4d85-4eff-bda0-2d9f7964eed0 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:23:18 devstack sudo[87960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-95886be1-4d85-4eff-bda0-2d9f7964eed0
Nov 03 18:23:18 devstack sudo[87960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:23:18 devstack sudo[87960]: pam_unix(sudo:session): session closed for user root
Nov 03 18:23:18 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-cf5b3f39-5252-4bd3-b838-5434ff0b4bc4 tempest-GroupSnapshotsTest-870685421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-95886be1-4d85-4eff-bda0-2d9f7964eed0" returned: 0 in 0.304s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:23:18 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-cf5b3f39-5252-4bd3-b838-5434ff0b4bc4 tempest-GroupSnapshotsTest-870685421 None] <== create_volume: return (985ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:23:18 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-cf5b3f39-5252-4bd3-b838-5434ff0b4bc4 tempest-GroupSnapshotsTest-870685421 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.992s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:23:18 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-cf5b3f39-5252-4bd3-b838-5434ff0b4bc4 tempest-GroupSnapshotsTest-870685421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01eedd5f-5b91-44e7-b779-9a64faf4a422) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95886be1-4d85-4eff-bda0-2d9f7964eed0', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:23:18 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-cf5b3f39-5252-4bd3-b838-5434ff0b4bc4 tempest-GroupSnapshotsTest-870685421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15157f5c-ae61-4b21-ac7c-3aca2b97a569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:23:18 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-cf5b3f39-5252-4bd3-b838-5434ff0b4bc4 tempest-GroupSnapshotsTest-870685421 None] Volume volume-95886be1-4d85-4eff-bda0-2d9f7964eed0 (95886be1-4d85-4eff-bda0-2d9f7964eed0): created successfully
Nov 03 18:23:18 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-cf5b3f39-5252-4bd3-b838-5434ff0b4bc4 tempest-GroupSnapshotsTest-870685421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15157f5c-ae61-4b21-ac7c-3aca2b97a569) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:23:18 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-cf5b3f39-5252-4bd3-b838-5434ff0b4bc4 tempest-GroupSnapshotsTest-870685421 None] Flow 'volume_create_manager' (4951df64-d46c-4f9a-97e1-fccf61a68c25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:23:18 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-cf5b3f39-5252-4bd3-b838-5434ff0b4bc4 tempest-GroupSnapshotsTest-870685421 None] Created volume successfully.
Nov 03 18:23:20 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8bd7f9b-d299-40e8-b58e-a29b4d83e142 tempest-GroupSnapshotsTest-870685421 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:23:20 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-f8bd7f9b-d299-40e8-b58e-a29b4d83e142 tempest-GroupSnapshotsTest-870685421 None] Flow 'volume_create_manager' (650a2a71-f0f0-4849-9259-7a2e77305318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:23:20 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-f8bd7f9b-d299-40e8-b58e-a29b4d83e142 tempest-GroupSnapshotsTest-870685421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ab059cf-3e85-4e35-a4d6-36f6f4c3bea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:23:20 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-f8bd7f9b-d299-40e8-b58e-a29b4d83e142 tempest-GroupSnapshotsTest-870685421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ab059cf-3e85-4e35-a4d6-36f6f4c3bea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:23:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-841800035',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=ed5cc04d-1ebd-4a43-9090-9907c4e1ff47,host='devstack@QuobyteHD#QuobyteHD',id=3ca68cd5-3abf-44ec-a7b5-8f03409dad03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec4923426a2c48f8843125ecc43e5686',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:23:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:23:21Z,use_quota=True,user_id='05a831a8d48448f0bad34b8f768decd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fad9c95c-bd56-4e52-b77e-28d67d2e2535),volume_type_id=fad9c95c-bd56-4e52-b77e-28d67d2e2535)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:23:20 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-f8bd7f9b-d299-40e8-b58e-a29b4d83e142 tempest-GroupSnapshotsTest-870685421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04248086-8972-4318-9f7b-9d1294c44127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:23:20 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-f8bd7f9b-d299-40e8-b58e-a29b4d83e142 tempest-GroupSnapshotsTest-870685421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04248086-8972-4318-9f7b-9d1294c44127) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:23:20 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-f8bd7f9b-d299-40e8-b58e-a29b4d83e142 tempest-GroupSnapshotsTest-870685421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4a541a6-7ab4-44fc-98df-d09d3acbfaf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:23:20 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-f8bd7f9b-d299-40e8-b58e-a29b4d83e142 tempest-GroupSnapshotsTest-870685421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4a541a6-7ab4-44fc-98df-d09d3acbfaf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ca68cd5-3abf-44ec-a7b5-8f03409dad03', 'volume_name': 'volume-3ca68cd5-3abf-44ec-a7b5-8f03409dad03', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:23:21 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-f8bd7f9b-d299-40e8-b58e-a29b4d83e142 tempest-GroupSnapshotsTest-870685421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fa10f6e-2956-4284-a106-26225bc69764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:23:21 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-f8bd7f9b-d299-40e8-b58e-a29b4d83e142 tempest-GroupSnapshotsTest-870685421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fa10f6e-2956-4284-a106-26225bc69764) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:23:21 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-f8bd7f9b-d299-40e8-b58e-a29b4d83e142 tempest-GroupSnapshotsTest-870685421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (153c0a02-61c6-4e1f-813f-ab0e12420020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:23:21 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-f8bd7f9b-d299-40e8-b58e-a29b4d83e142 tempest-GroupSnapshotsTest-870685421 None] Volume 3ca68cd5-3abf-44ec-a7b5-8f03409dad03: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ca68cd5-3abf-44ec-a7b5-8f03409dad03', 'volume_size': 1}
Nov 03 18:23:21 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-f8bd7f9b-d299-40e8-b58e-a29b4d83e142 tempest-GroupSnapshotsTest-870685421 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:23:21 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-f8bd7f9b-d299-40e8-b58e-a29b4d83e142 tempest-GroupSnapshotsTest-870685421 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:23:21 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-f8bd7f9b-d299-40e8-b58e-a29b4d83e142 tempest-GroupSnapshotsTest-870685421 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=ed5cc04d-1ebd-4a43-9090-9907c4e1ff47,created_at=2026-11-03T17:23:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-841800035',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=ed5cc04d-1ebd-4a43-9090-9907c4e1ff47,host='devstack@QuobyteHD#QuobyteHD',id=3ca68cd5-3abf-44ec-a7b5-8f03409dad03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec4923426a2c48f8843125ecc43e5686',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:23:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:23:21Z,use_quota=True,user_id='05a831a8d48448f0bad34b8f768decd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fad9c95c-bd56-4e52-b77e-28d67d2e2535),volume_type_id=fad9c95c-bd56-4e52-b77e-28d67d2e2535)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:23:21 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-f8bd7f9b-d299-40e8-b58e-a29b4d83e142 tempest-GroupSnapshotsTest-870685421 None] Creating volume 3ca68cd5-3abf-44ec-a7b5-8f03409dad03 {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:23:21 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-f8bd7f9b-d299-40e8-b58e-a29b4d83e142 tempest-GroupSnapshotsTest-870685421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:23:21 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-f8bd7f9b-d299-40e8-b58e-a29b4d83e142 tempest-GroupSnapshotsTest-870685421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:23:21 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-f8bd7f9b-d299-40e8-b58e-a29b4d83e142 tempest-GroupSnapshotsTest-870685421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:23:21 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-f8bd7f9b-d299-40e8-b58e-a29b4d83e142 tempest-GroupSnapshotsTest-870685421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:23:21 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-f8bd7f9b-d299-40e8-b58e-a29b4d83e142 tempest-GroupSnapshotsTest-870685421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:23:21 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-f8bd7f9b-d299-40e8-b58e-a29b4d83e142 tempest-GroupSnapshotsTest-870685421 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:23:21 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-f8bd7f9b-d299-40e8-b58e-a29b4d83e142 tempest-GroupSnapshotsTest-870685421 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:23:21 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-f8bd7f9b-d299-40e8-b58e-a29b4d83e142 tempest-GroupSnapshotsTest-870685421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3ca68cd5-3abf-44ec-a7b5-8f03409dad03 1073741824 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:23:21 devstack sudo[87963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3ca68cd5-3abf-44ec-a7b5-8f03409dad03 1073741824
Nov 03 18:23:21 devstack sudo[87963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:23:21 devstack sudo[87963]: pam_unix(sudo:session): session closed for user root
Nov 03 18:23:21 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-f8bd7f9b-d299-40e8-b58e-a29b4d83e142 tempest-GroupSnapshotsTest-870685421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3ca68cd5-3abf-44ec-a7b5-8f03409dad03 1073741824" returned: 0 in 0.501s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:23:21 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-f8bd7f9b-d299-40e8-b58e-a29b4d83e142 tempest-GroupSnapshotsTest-870685421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3ca68cd5-3abf-44ec-a7b5-8f03409dad03 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:23:21 devstack sudo[87970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3ca68cd5-3abf-44ec-a7b5-8f03409dad03
Nov 03 18:23:21 devstack sudo[87970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:23:21 devstack sudo[87970]: pam_unix(sudo:session): session closed for user root
Nov 03 18:23:21 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-f8bd7f9b-d299-40e8-b58e-a29b4d83e142 tempest-GroupSnapshotsTest-870685421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3ca68cd5-3abf-44ec-a7b5-8f03409dad03" returned: 0 in 0.315s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:23:21 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-f8bd7f9b-d299-40e8-b58e-a29b4d83e142 tempest-GroupSnapshotsTest-870685421 None] <== create_volume: return (875ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:23:21 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-f8bd7f9b-d299-40e8-b58e-a29b4d83e142 tempest-GroupSnapshotsTest-870685421 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.877s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:23:21 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-f8bd7f9b-d299-40e8-b58e-a29b4d83e142 tempest-GroupSnapshotsTest-870685421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (153c0a02-61c6-4e1f-813f-ab0e12420020) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ca68cd5-3abf-44ec-a7b5-8f03409dad03', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:23:21 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-f8bd7f9b-d299-40e8-b58e-a29b4d83e142 tempest-GroupSnapshotsTest-870685421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7fdf764-1e98-47e1-9351-8d415ba3a17c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:23:21 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-f8bd7f9b-d299-40e8-b58e-a29b4d83e142 tempest-GroupSnapshotsTest-870685421 None] Volume volume-3ca68cd5-3abf-44ec-a7b5-8f03409dad03 (3ca68cd5-3abf-44ec-a7b5-8f03409dad03): created successfully
Nov 03 18:23:21 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-f8bd7f9b-d299-40e8-b58e-a29b4d83e142 tempest-GroupSnapshotsTest-870685421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7fdf764-1e98-47e1-9351-8d415ba3a17c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:23:21 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-f8bd7f9b-d299-40e8-b58e-a29b4d83e142 tempest-GroupSnapshotsTest-870685421 None] Flow 'volume_create_manager' (650a2a71-f0f0-4849-9259-7a2e77305318) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:23:21 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-f8bd7f9b-d299-40e8-b58e-a29b4d83e142 tempest-GroupSnapshotsTest-870685421 None] Created volume successfully.
Nov 03 18:23:22 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-9017bc2c-098b-45e2-a696-f1f7a403365e tempest-GroupSnapshotsTest-870685421 None] Update group completed successfully.
Nov 03 18:23:23 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-7029537c-cb07-4e74-a270-583c03cb106d tempest-GroupSnapshotsTest-870685421 None] Update group completed successfully.
Nov 03 18:23:24 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-40e63919-4bca-43b8-9674-18ad938595da tempest-GroupSnapshotsTest-870685421 None] Update group completed successfully.
Nov 03 18:23:26 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-67d07bc8-d024-4e9f-859a-efb03d3241da tempest-GroupSnapshotsTest-870685421 None] Update group completed successfully.
Nov 03 18:23:27 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-41097cbd-2d33-4cd0-9fbd-3e805a18814d tempest-GroupSnapshotsTest-870685421 None] GroupSnapshot 0043842f-d7bf-406a-9d79-c0ff52688c15: creating.
Nov 03 18:23:27 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-41097cbd-2d33-4cd0-9fbd-3e805a18814d tempest-GroupSnapshotsTest-870685421 None] Group snapshot 0043842f-d7bf-406a-9d79-c0ff52688c15: creating. {{(pid=86120) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Nov 03 18:23:27 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-41097cbd-2d33-4cd0-9fbd-3e805a18814d tempest-GroupSnapshotsTest-870685421 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:23:27 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-41097cbd-2d33-4cd0-9fbd-3e805a18814d tempest-GroupSnapshotsTest-870685421 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:23:27 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-41097cbd-2d33-4cd0-9fbd-3e805a18814d tempest-GroupSnapshotsTest-870685421 None] Creating offline snapshot 792934b9-1c3d-42a6-b0ef-e82a852bfde1 of volume 95886be1-4d85-4eff-bda0-2d9f7964eed0 {{(pid=86120) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 18:23:27 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b751bf4-abf3-4977-a9a1-ec73fc161e67]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:23:27 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-41097cbd-2d33-4cd0-9fbd-3e805a18814d tempest-GroupSnapshotsTest-870685421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-95886be1-4d85-4eff-bda0-2d9f7964eed0 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:23:27 devstack sudo[87974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-95886be1-4d85-4eff-bda0-2d9f7964eed0
Nov 03 18:23:27 devstack sudo[87974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:23:28 devstack sudo[87974]: pam_unix(sudo:session): session closed for user root
Nov 03 18:23:28 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-41097cbd-2d33-4cd0-9fbd-3e805a18814d tempest-GroupSnapshotsTest-870685421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-95886be1-4d85-4eff-bda0-2d9f7964eed0" returned: 0 in 0.486s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:23:28 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-41097cbd-2d33-4cd0-9fbd-3e805a18814d tempest-GroupSnapshotsTest-870685421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-95886be1-4d85-4eff-bda0-2d9f7964eed0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-95886be1-4d85-4eff-bda0-2d9f7964eed0.792934b9-1c3d-42a6-b0ef-e82a852bfde1 1G {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:23:28 devstack sudo[87979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-95886be1-4d85-4eff-bda0-2d9f7964eed0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-95886be1-4d85-4eff-bda0-2d9f7964eed0.792934b9-1c3d-42a6-b0ef-e82a852bfde1 1G
Nov 03 18:23:28 devstack sudo[87979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:23:28 devstack sudo[87979]: pam_unix(sudo:session): session closed for user root
Nov 03 18:23:28 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-41097cbd-2d33-4cd0-9fbd-3e805a18814d tempest-GroupSnapshotsTest-870685421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-95886be1-4d85-4eff-bda0-2d9f7964eed0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-95886be1-4d85-4eff-bda0-2d9f7964eed0.792934b9-1c3d-42a6-b0ef-e82a852bfde1 1G" returned: 0 in 0.562s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:23:28 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-41097cbd-2d33-4cd0-9fbd-3e805a18814d tempest-GroupSnapshotsTest-870685421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95886be1-4d85-4eff-bda0-2d9f7964eed0 -F qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-95886be1-4d85-4eff-bda0-2d9f7964eed0.792934b9-1c3d-42a6-b0ef-e82a852bfde1 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:23:28 devstack sudo[87986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95886be1-4d85-4eff-bda0-2d9f7964eed0 -F qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-95886be1-4d85-4eff-bda0-2d9f7964eed0.792934b9-1c3d-42a6-b0ef-e82a852bfde1
Nov 03 18:23:28 devstack sudo[87986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:23:29 devstack sudo[87986]: pam_unix(sudo:session): session closed for user root
Nov 03 18:23:29 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-41097cbd-2d33-4cd0-9fbd-3e805a18814d tempest-GroupSnapshotsTest-870685421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95886be1-4d85-4eff-bda0-2d9f7964eed0 -F qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-95886be1-4d85-4eff-bda0-2d9f7964eed0.792934b9-1c3d-42a6-b0ef-e82a852bfde1" returned: 0 in 0.354s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:23:29 devstack cinder-volume[86120]: WARNING cinder.volume.drivers.remotefs [None req-41097cbd-2d33-4cd0-9fbd-3e805a18814d tempest-GroupSnapshotsTest-870685421 None] /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-95886be1-4d85-4eff-bda0-2d9f7964eed0.792934b9-1c3d-42a6-b0ef-e82a852bfde1 is being set with open permissions: ugo+rw: NotImplementedError
Nov 03 18:23:29 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-41097cbd-2d33-4cd0-9fbd-3e805a18814d tempest-GroupSnapshotsTest-870685421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-95886be1-4d85-4eff-bda0-2d9f7964eed0.792934b9-1c3d-42a6-b0ef-e82a852bfde1 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:23:29 devstack sudo[87992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-95886be1-4d85-4eff-bda0-2d9f7964eed0.792934b9-1c3d-42a6-b0ef-e82a852bfde1
Nov 03 18:23:29 devstack sudo[87992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:23:29 devstack sudo[87992]: pam_unix(sudo:session): session closed for user root
Nov 03 18:23:29 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-41097cbd-2d33-4cd0-9fbd-3e805a18814d tempest-GroupSnapshotsTest-870685421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-95886be1-4d85-4eff-bda0-2d9f7964eed0.792934b9-1c3d-42a6-b0ef-e82a852bfde1" returned: 0 in 0.338s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:23:29 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-41097cbd-2d33-4cd0-9fbd-3e805a18814d tempest-GroupSnapshotsTest-870685421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-95886be1-4d85-4eff-bda0-2d9f7964eed0.info {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:23:29 devstack sudo[87995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-95886be1-4d85-4eff-bda0-2d9f7964eed0.info
Nov 03 18:23:29 devstack sudo[87995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:23:29 devstack sudo[87995]: pam_unix(sudo:session): session closed for user root
Nov 03 18:23:29 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-41097cbd-2d33-4cd0-9fbd-3e805a18814d tempest-GroupSnapshotsTest-870685421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-95886be1-4d85-4eff-bda0-2d9f7964eed0.info" returned: 0 in 0.313s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:23:29 devstack cinder-volume[86120]: WARNING cinder.volume.drivers.remotefs [None req-41097cbd-2d33-4cd0-9fbd-3e805a18814d tempest-GroupSnapshotsTest-870685421 None] /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-95886be1-4d85-4eff-bda0-2d9f7964eed0.info is being set with open permissions: ugo+rw: NotImplementedError
Nov 03 18:23:29 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-41097cbd-2d33-4cd0-9fbd-3e805a18814d tempest-GroupSnapshotsTest-870685421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-95886be1-4d85-4eff-bda0-2d9f7964eed0.info {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:23:29 devstack sudo[87998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-95886be1-4d85-4eff-bda0-2d9f7964eed0.info
Nov 03 18:23:29 devstack sudo[87998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:23:30 devstack sudo[87998]: pam_unix(sudo:session): session closed for user root
Nov 03 18:23:30 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-41097cbd-2d33-4cd0-9fbd-3e805a18814d tempest-GroupSnapshotsTest-870685421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-95886be1-4d85-4eff-bda0-2d9f7964eed0.info" returned: 0 in 0.361s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:23:30 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-41097cbd-2d33-4cd0-9fbd-3e805a18814d tempest-GroupSnapshotsTest-870685421 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.530s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:23:30 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-41097cbd-2d33-4cd0-9fbd-3e805a18814d tempest-GroupSnapshotsTest-870685421 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:23:30 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-41097cbd-2d33-4cd0-9fbd-3e805a18814d tempest-GroupSnapshotsTest-870685421 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:23:30 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-41097cbd-2d33-4cd0-9fbd-3e805a18814d tempest-GroupSnapshotsTest-870685421 None] Creating offline snapshot dc443d8d-ed0e-42d3-a310-37592de96748 of volume 3ca68cd5-3abf-44ec-a7b5-8f03409dad03 {{(pid=86120) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 18:23:30 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[9abcf8b6-34b2-4faa-beb0-72144e27aa8a]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:23:30 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-41097cbd-2d33-4cd0-9fbd-3e805a18814d tempest-GroupSnapshotsTest-870685421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3ca68cd5-3abf-44ec-a7b5-8f03409dad03 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:23:30 devstack sudo[88001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3ca68cd5-3abf-44ec-a7b5-8f03409dad03
Nov 03 18:23:30 devstack sudo[88001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:23:30 devstack sudo[88001]: pam_unix(sudo:session): session closed for user root
Nov 03 18:23:30 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-41097cbd-2d33-4cd0-9fbd-3e805a18814d tempest-GroupSnapshotsTest-870685421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3ca68cd5-3abf-44ec-a7b5-8f03409dad03" returned: 0 in 0.692s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:23:30 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-41097cbd-2d33-4cd0-9fbd-3e805a18814d tempest-GroupSnapshotsTest-870685421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3ca68cd5-3abf-44ec-a7b5-8f03409dad03,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3ca68cd5-3abf-44ec-a7b5-8f03409dad03.dc443d8d-ed0e-42d3-a310-37592de96748 1G {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:23:30 devstack sudo[88020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3ca68cd5-3abf-44ec-a7b5-8f03409dad03,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3ca68cd5-3abf-44ec-a7b5-8f03409dad03.dc443d8d-ed0e-42d3-a310-37592de96748 1G
Nov 03 18:23:30 devstack sudo[88020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:23:31 devstack sudo[88020]: pam_unix(sudo:session): session closed for user root
Nov 03 18:23:31 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-41097cbd-2d33-4cd0-9fbd-3e805a18814d tempest-GroupSnapshotsTest-870685421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3ca68cd5-3abf-44ec-a7b5-8f03409dad03,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3ca68cd5-3abf-44ec-a7b5-8f03409dad03.dc443d8d-ed0e-42d3-a310-37592de96748 1G" returned: 0 in 0.928s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:23:31 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-41097cbd-2d33-4cd0-9fbd-3e805a18814d tempest-GroupSnapshotsTest-870685421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ca68cd5-3abf-44ec-a7b5-8f03409dad03 -F qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3ca68cd5-3abf-44ec-a7b5-8f03409dad03.dc443d8d-ed0e-42d3-a310-37592de96748 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:23:31 devstack sudo[88053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ca68cd5-3abf-44ec-a7b5-8f03409dad03 -F qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3ca68cd5-3abf-44ec-a7b5-8f03409dad03.dc443d8d-ed0e-42d3-a310-37592de96748
Nov 03 18:23:31 devstack sudo[88053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:23:32 devstack sudo[88053]: pam_unix(sudo:session): session closed for user root
Nov 03 18:23:32 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-41097cbd-2d33-4cd0-9fbd-3e805a18814d tempest-GroupSnapshotsTest-870685421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ca68cd5-3abf-44ec-a7b5-8f03409dad03 -F qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3ca68cd5-3abf-44ec-a7b5-8f03409dad03.dc443d8d-ed0e-42d3-a310-37592de96748" returned: 0 in 0.500s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:23:32 devstack cinder-volume[86120]: WARNING cinder.volume.drivers.remotefs [None req-41097cbd-2d33-4cd0-9fbd-3e805a18814d tempest-GroupSnapshotsTest-870685421 None] /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3ca68cd5-3abf-44ec-a7b5-8f03409dad03.dc443d8d-ed0e-42d3-a310-37592de96748 is being set with open permissions: ugo+rw: NotImplementedError
Nov 03 18:23:32 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-41097cbd-2d33-4cd0-9fbd-3e805a18814d tempest-GroupSnapshotsTest-870685421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3ca68cd5-3abf-44ec-a7b5-8f03409dad03.dc443d8d-ed0e-42d3-a310-37592de96748 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:23:32 devstack sudo[88058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3ca68cd5-3abf-44ec-a7b5-8f03409dad03.dc443d8d-ed0e-42d3-a310-37592de96748
Nov 03 18:23:32 devstack sudo[88058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:23:32 devstack sudo[88058]: pam_unix(sudo:session): session closed for user root
Nov 03 18:23:32 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-41097cbd-2d33-4cd0-9fbd-3e805a18814d tempest-GroupSnapshotsTest-870685421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3ca68cd5-3abf-44ec-a7b5-8f03409dad03.dc443d8d-ed0e-42d3-a310-37592de96748" returned: 0 in 0.554s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:23:32 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-41097cbd-2d33-4cd0-9fbd-3e805a18814d tempest-GroupSnapshotsTest-870685421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3ca68cd5-3abf-44ec-a7b5-8f03409dad03.info {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:23:33 devstack sudo[88064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3ca68cd5-3abf-44ec-a7b5-8f03409dad03.info
Nov 03 18:23:33 devstack sudo[88064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:23:33 devstack sudo[88064]: pam_unix(sudo:session): session closed for user root
Nov 03 18:23:33 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-41097cbd-2d33-4cd0-9fbd-3e805a18814d tempest-GroupSnapshotsTest-870685421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3ca68cd5-3abf-44ec-a7b5-8f03409dad03.info" returned: 0 in 0.407s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:23:33 devstack cinder-volume[86120]: WARNING cinder.volume.drivers.remotefs [None req-41097cbd-2d33-4cd0-9fbd-3e805a18814d tempest-GroupSnapshotsTest-870685421 None] /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3ca68cd5-3abf-44ec-a7b5-8f03409dad03.info is being set with open permissions: ugo+rw: NotImplementedError
Nov 03 18:23:33 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-41097cbd-2d33-4cd0-9fbd-3e805a18814d tempest-GroupSnapshotsTest-870685421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3ca68cd5-3abf-44ec-a7b5-8f03409dad03.info {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:23:33 devstack sudo[88067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3ca68cd5-3abf-44ec-a7b5-8f03409dad03.info
Nov 03 18:23:33 devstack sudo[88067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:23:33 devstack sudo[88067]: pam_unix(sudo:session): session closed for user root
Nov 03 18:23:33 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-41097cbd-2d33-4cd0-9fbd-3e805a18814d tempest-GroupSnapshotsTest-870685421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3ca68cd5-3abf-44ec-a7b5-8f03409dad03.info" returned: 0 in 0.421s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:23:33 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-41097cbd-2d33-4cd0-9fbd-3e805a18814d tempest-GroupSnapshotsTest-870685421 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.683s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:23:33 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-41097cbd-2d33-4cd0-9fbd-3e805a18814d tempest-GroupSnapshotsTest-870685421 None] group_snapshot 0043842f-d7bf-406a-9d79-c0ff52688c15: created successfully
Nov 03 18:23:34 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-ffc4c691-c41e-4e39-9451-71e89344591f tempest-GroupSnapshotsTest-870685421 None] group_snapshot 0043842f-d7bf-406a-9d79-c0ff52688c15: deleting
Nov 03 18:23:34 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-ffc4c691-c41e-4e39-9451-71e89344591f tempest-GroupSnapshotsTest-870685421 None] group_snapshot 0043842f-d7bf-406a-9d79-c0ff52688c15: deleting {{(pid=86120) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Nov 03 18:23:34 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-ffc4c691-c41e-4e39-9451-71e89344591f tempest-GroupSnapshotsTest-870685421 None] Acquiring lock "cinder-quobyte-95886be1-4d85-4eff-bda0-2d9f7964eed0" by "delete_snapshot" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:23:34 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-ffc4c691-c41e-4e39-9451-71e89344591f tempest-GroupSnapshotsTest-870685421 None] Lock "cinder-quobyte-95886be1-4d85-4eff-bda0-2d9f7964eed0" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:23:34 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-ffc4c691-c41e-4e39-9451-71e89344591f tempest-GroupSnapshotsTest-870685421 None] Acquiring lock "cinder-quobyte-792934b9-1c3d-42a6-b0ef-e82a852bfde1" by "_delete_snapshot" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:23:34 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-ffc4c691-c41e-4e39-9451-71e89344591f tempest-GroupSnapshotsTest-870685421 None] Lock "cinder-quobyte-792934b9-1c3d-42a6-b0ef-e82a852bfde1" acquired by "_delete_snapshot" :: waited 0.042s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:23:34 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-ffc4c691-c41e-4e39-9451-71e89344591f tempest-GroupSnapshotsTest-870685421 None] Deleting offline snapshot 792934b9-1c3d-42a6-b0ef-e82a852bfde1 of volume 95886be1-4d85-4eff-bda0-2d9f7964eed0 {{(pid=86120) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 18:23:34 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-ffc4c691-c41e-4e39-9451-71e89344591f tempest-GroupSnapshotsTest-870685421 None] snapshot_file for this snap is: volume-95886be1-4d85-4eff-bda0-2d9f7964eed0.792934b9-1c3d-42a6-b0ef-e82a852bfde1 {{(pid=86120) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 18:23:34 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbc4c166-b4f7-4c1c-af4e-ee917c90ac1e]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:23:34 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-ffc4c691-c41e-4e39-9451-71e89344591f tempest-GroupSnapshotsTest-870685421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-95886be1-4d85-4eff-bda0-2d9f7964eed0.792934b9-1c3d-42a6-b0ef-e82a852bfde1 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:23:34 devstack sudo[88071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-95886be1-4d85-4eff-bda0-2d9f7964eed0.792934b9-1c3d-42a6-b0ef-e82a852bfde1
Nov 03 18:23:34 devstack sudo[88071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:23:35 devstack sudo[88071]: pam_unix(sudo:session): session closed for user root
Nov 03 18:23:35 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-ffc4c691-c41e-4e39-9451-71e89344591f tempest-GroupSnapshotsTest-870685421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-95886be1-4d85-4eff-bda0-2d9f7964eed0.792934b9-1c3d-42a6-b0ef-e82a852bfde1" returned: 0 in 0.572s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:23:35 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-ffc4c691-c41e-4e39-9451-71e89344591f tempest-GroupSnapshotsTest-870685421 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-95886be1-4d85-4eff-bda0-2d9f7964eed0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86120) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 18:23:35 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a28c459-799b-47f4-adee-50058501e26c]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:23:35 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-ffc4c691-c41e-4e39-9451-71e89344591f tempest-GroupSnapshotsTest-870685421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-95886be1-4d85-4eff-bda0-2d9f7964eed0 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:23:35 devstack sudo[88076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-95886be1-4d85-4eff-bda0-2d9f7964eed0
Nov 03 18:23:35 devstack sudo[88076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:23:35 devstack sudo[88076]: pam_unix(sudo:session): session closed for user root
Nov 03 18:23:35 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-ffc4c691-c41e-4e39-9451-71e89344591f tempest-GroupSnapshotsTest-870685421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-95886be1-4d85-4eff-bda0-2d9f7964eed0" returned: 0 in 0.586s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:23:35 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-ffc4c691-c41e-4e39-9451-71e89344591f tempest-GroupSnapshotsTest-870685421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-95886be1-4d85-4eff-bda0-2d9f7964eed0.792934b9-1c3d-42a6-b0ef-e82a852bfde1 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:23:35 devstack sudo[88082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-95886be1-4d85-4eff-bda0-2d9f7964eed0.792934b9-1c3d-42a6-b0ef-e82a852bfde1
Nov 03 18:23:35 devstack sudo[88082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:23:36 devstack sudo[88082]: pam_unix(sudo:session): session closed for user root
Nov 03 18:23:36 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-ffc4c691-c41e-4e39-9451-71e89344591f tempest-GroupSnapshotsTest-870685421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-95886be1-4d85-4eff-bda0-2d9f7964eed0.792934b9-1c3d-42a6-b0ef-e82a852bfde1" returned: 0 in 0.400s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:23:36 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-ffc4c691-c41e-4e39-9451-71e89344591f tempest-GroupSnapshotsTest-870685421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-95886be1-4d85-4eff-bda0-2d9f7964eed0.792934b9-1c3d-42a6-b0ef-e82a852bfde1 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:23:36 devstack sudo[88087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-95886be1-4d85-4eff-bda0-2d9f7964eed0.792934b9-1c3d-42a6-b0ef-e82a852bfde1
Nov 03 18:23:36 devstack sudo[88087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:23:36 devstack sudo[88087]: pam_unix(sudo:session): session closed for user root
Nov 03 18:23:36 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-ffc4c691-c41e-4e39-9451-71e89344591f tempest-GroupSnapshotsTest-870685421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-95886be1-4d85-4eff-bda0-2d9f7964eed0.792934b9-1c3d-42a6-b0ef-e82a852bfde1" returned: 0 in 0.296s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:23:36 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-ffc4c691-c41e-4e39-9451-71e89344591f tempest-GroupSnapshotsTest-870685421 None] Lock "cinder-quobyte-792934b9-1c3d-42a6-b0ef-e82a852bfde1" released by "_delete_snapshot" :: held 2.065s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:23:36 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-ffc4c691-c41e-4e39-9451-71e89344591f tempest-GroupSnapshotsTest-870685421 None] Lock "cinder-quobyte-95886be1-4d85-4eff-bda0-2d9f7964eed0" released by "delete_snapshot" :: held 2.138s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:23:36 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-ffc4c691-c41e-4e39-9451-71e89344591f tempest-GroupSnapshotsTest-870685421 None] Acquiring lock "cinder-quobyte-3ca68cd5-3abf-44ec-a7b5-8f03409dad03" by "delete_snapshot" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:23:36 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-ffc4c691-c41e-4e39-9451-71e89344591f tempest-GroupSnapshotsTest-870685421 None] Lock "cinder-quobyte-3ca68cd5-3abf-44ec-a7b5-8f03409dad03" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:23:36 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-ffc4c691-c41e-4e39-9451-71e89344591f tempest-GroupSnapshotsTest-870685421 None] Acquiring lock "cinder-quobyte-dc443d8d-ed0e-42d3-a310-37592de96748" by "_delete_snapshot" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:23:36 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-ffc4c691-c41e-4e39-9451-71e89344591f tempest-GroupSnapshotsTest-870685421 None] Lock "cinder-quobyte-dc443d8d-ed0e-42d3-a310-37592de96748" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:23:36 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-ffc4c691-c41e-4e39-9451-71e89344591f tempest-GroupSnapshotsTest-870685421 None] Deleting offline snapshot dc443d8d-ed0e-42d3-a310-37592de96748 of volume 3ca68cd5-3abf-44ec-a7b5-8f03409dad03 {{(pid=86120) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 18:23:36 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-ffc4c691-c41e-4e39-9451-71e89344591f tempest-GroupSnapshotsTest-870685421 None] snapshot_file for this snap is: volume-3ca68cd5-3abf-44ec-a7b5-8f03409dad03.dc443d8d-ed0e-42d3-a310-37592de96748 {{(pid=86120) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 18:23:36 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[f50394a6-e1a1-4fd0-99d8-b59febf7140b]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:23:36 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-ffc4c691-c41e-4e39-9451-71e89344591f tempest-GroupSnapshotsTest-870685421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3ca68cd5-3abf-44ec-a7b5-8f03409dad03.dc443d8d-ed0e-42d3-a310-37592de96748 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:23:36 devstack sudo[88090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3ca68cd5-3abf-44ec-a7b5-8f03409dad03.dc443d8d-ed0e-42d3-a310-37592de96748
Nov 03 18:23:36 devstack sudo[88090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:23:37 devstack sudo[88090]: pam_unix(sudo:session): session closed for user root
Nov 03 18:23:37 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-ffc4c691-c41e-4e39-9451-71e89344591f tempest-GroupSnapshotsTest-870685421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3ca68cd5-3abf-44ec-a7b5-8f03409dad03.dc443d8d-ed0e-42d3-a310-37592de96748" returned: 0 in 0.733s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:23:37 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-ffc4c691-c41e-4e39-9451-71e89344591f tempest-GroupSnapshotsTest-870685421 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3ca68cd5-3abf-44ec-a7b5-8f03409dad03(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86120) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 18:23:37 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8974409-1eef-43e6-8712-2e3a57d6a43b]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:23:37 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-ffc4c691-c41e-4e39-9451-71e89344591f tempest-GroupSnapshotsTest-870685421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3ca68cd5-3abf-44ec-a7b5-8f03409dad03 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:23:37 devstack sudo[88097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3ca68cd5-3abf-44ec-a7b5-8f03409dad03
Nov 03 18:23:37 devstack sudo[88097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:23:38 devstack sudo[88097]: pam_unix(sudo:session): session closed for user root
Nov 03 18:23:38 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-ffc4c691-c41e-4e39-9451-71e89344591f tempest-GroupSnapshotsTest-870685421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3ca68cd5-3abf-44ec-a7b5-8f03409dad03" returned: 0 in 0.598s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:23:38 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-ffc4c691-c41e-4e39-9451-71e89344591f tempest-GroupSnapshotsTest-870685421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3ca68cd5-3abf-44ec-a7b5-8f03409dad03.dc443d8d-ed0e-42d3-a310-37592de96748 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:23:38 devstack sudo[88102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3ca68cd5-3abf-44ec-a7b5-8f03409dad03.dc443d8d-ed0e-42d3-a310-37592de96748
Nov 03 18:23:38 devstack sudo[88102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:23:38 devstack sudo[88102]: pam_unix(sudo:session): session closed for user root
Nov 03 18:23:38 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-ffc4c691-c41e-4e39-9451-71e89344591f tempest-GroupSnapshotsTest-870685421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3ca68cd5-3abf-44ec-a7b5-8f03409dad03.dc443d8d-ed0e-42d3-a310-37592de96748" returned: 0 in 0.542s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:23:38 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-ffc4c691-c41e-4e39-9451-71e89344591f tempest-GroupSnapshotsTest-870685421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3ca68cd5-3abf-44ec-a7b5-8f03409dad03.dc443d8d-ed0e-42d3-a310-37592de96748 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:23:38 devstack sudo[88108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3ca68cd5-3abf-44ec-a7b5-8f03409dad03.dc443d8d-ed0e-42d3-a310-37592de96748
Nov 03 18:23:38 devstack sudo[88108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:23:39 devstack sudo[88108]: pam_unix(sudo:session): session closed for user root
Nov 03 18:23:39 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-ffc4c691-c41e-4e39-9451-71e89344591f tempest-GroupSnapshotsTest-870685421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3ca68cd5-3abf-44ec-a7b5-8f03409dad03.dc443d8d-ed0e-42d3-a310-37592de96748" returned: 0 in 0.421s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:23:39 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-ffc4c691-c41e-4e39-9451-71e89344591f tempest-GroupSnapshotsTest-870685421 None] Lock "cinder-quobyte-dc443d8d-ed0e-42d3-a310-37592de96748" released by "_delete_snapshot" :: held 2.479s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:23:39 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-ffc4c691-c41e-4e39-9451-71e89344591f tempest-GroupSnapshotsTest-870685421 None] Lock "cinder-quobyte-3ca68cd5-3abf-44ec-a7b5-8f03409dad03" released by "delete_snapshot" :: held 2.512s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:23:39 devstack cinder-volume[86120]: DEBUG dbcounter [-] [86120] Writing DB stats cinder:UPDATE=75,cinder:SELECT=76,cinder:INSERT=15,cinder:DELETE=3 {{(pid=86120) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 18:23:39 devstack cinder-volume[86120]: DEBUG dbcounter [-] [86120] Writing DB stats cinder:SELECT=82,cinder:UPDATE=58,cinder:INSERT=12,cinder:DELETE=3 {{(pid=86120) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 18:23:39 devstack cinder-volume[86120]: WARNING cinder.quota [None req-ffc4c691-c41e-4e39-9451-71e89344591f tempest-GroupSnapshotsTest-870685421 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-947926624 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-947926624, it is now deprecated. Please use the default quota class for default quota.
Nov 03 18:23:39 devstack cinder-volume[86120]: WARNING cinder.quota [None req-ffc4c691-c41e-4e39-9451-71e89344591f tempest-GroupSnapshotsTest-870685421 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-947926624 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-947926624, it is now deprecated. Please use the default quota class for default quota.
Nov 03 18:23:39 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-ffc4c691-c41e-4e39-9451-71e89344591f tempest-GroupSnapshotsTest-870685421 None] Created reservations ['6fa4cf48-2a76-4cf1-8ce5-8eb9985a7086', '11846c97-8d28-4ba1-b6ec-851efe6fdeed', '29eb7060-717e-4759-bd70-dc751d6607ff', '32313bd5-848f-43aa-97b0-b4920decaa8b'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:23:39 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-ffc4c691-c41e-4e39-9451-71e89344591f tempest-GroupSnapshotsTest-870685421 None] Created reservations ['1ff5d463-750b-4334-bd81-47ebcd10008e', '59e35e2c-edea-4681-861b-1774887745d1', '662fdf2c-31b3-4dae-bfea-a1871c06a88c', 'c4b24cb1-89b0-4e7f-85f7-66c7269f369a'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:23:39 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-ffc4c691-c41e-4e39-9451-71e89344591f tempest-GroupSnapshotsTest-870685421 None] group_snapshot 0043842f-d7bf-406a-9d79-c0ff52688c15: deleted successfully
Nov 03 18:23:40 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-ef4437f8-e5b7-46f2-af12-dbf24575d016 tempest-GroupSnapshotsTest-870685421 None] Acquiring lock "cinder-quobyte-3ca68cd5-3abf-44ec-a7b5-8f03409dad03" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:23:40 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-ef4437f8-e5b7-46f2-af12-dbf24575d016 tempest-GroupSnapshotsTest-870685421 None] Lock "cinder-quobyte-3ca68cd5-3abf-44ec-a7b5-8f03409dad03" acquired by "delete_volume" :: waited 0.033s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:23:40 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[54cd83b2-6b55-4d7c-84c8-e094857c9e2a]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:23:40 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-ef4437f8-e5b7-46f2-af12-dbf24575d016 tempest-GroupSnapshotsTest-870685421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3ca68cd5-3abf-44ec-a7b5-8f03409dad03 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:23:41 devstack sudo[88113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3ca68cd5-3abf-44ec-a7b5-8f03409dad03
Nov 03 18:23:41 devstack sudo[88113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:23:41 devstack sudo[88113]: pam_unix(sudo:session): session closed for user root
Nov 03 18:23:41 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-ef4437f8-e5b7-46f2-af12-dbf24575d016 tempest-GroupSnapshotsTest-870685421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3ca68cd5-3abf-44ec-a7b5-8f03409dad03" returned: 0 in 0.555s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:23:41 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-ef4437f8-e5b7-46f2-af12-dbf24575d016 tempest-GroupSnapshotsTest-870685421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3ca68cd5-3abf-44ec-a7b5-8f03409dad03 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:23:41 devstack sudo[88121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3ca68cd5-3abf-44ec-a7b5-8f03409dad03
Nov 03 18:23:41 devstack sudo[88121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:23:41 devstack sudo[88121]: pam_unix(sudo:session): session closed for user root
Nov 03 18:23:41 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-ef4437f8-e5b7-46f2-af12-dbf24575d016 tempest-GroupSnapshotsTest-870685421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3ca68cd5-3abf-44ec-a7b5-8f03409dad03" returned: 0 in 0.420s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:23:41 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-ef4437f8-e5b7-46f2-af12-dbf24575d016 tempest-GroupSnapshotsTest-870685421 None] Lock "cinder-quobyte-3ca68cd5-3abf-44ec-a7b5-8f03409dad03" released by "delete_volume" :: held 1.094s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:23:41 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-ef4437f8-e5b7-46f2-af12-dbf24575d016 tempest-GroupSnapshotsTest-870685421 None] Acquiring lock "cinder-quobyte-95886be1-4d85-4eff-bda0-2d9f7964eed0" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:23:41 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-ef4437f8-e5b7-46f2-af12-dbf24575d016 tempest-GroupSnapshotsTest-870685421 None] Lock "cinder-quobyte-95886be1-4d85-4eff-bda0-2d9f7964eed0" acquired by "delete_volume" :: waited 0.025s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:23:42 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2cf8ed4-b146-41a2-ace3-d2257e79f2c5]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:23:42 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-ef4437f8-e5b7-46f2-af12-dbf24575d016 tempest-GroupSnapshotsTest-870685421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-95886be1-4d85-4eff-bda0-2d9f7964eed0 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:23:42 devstack sudo[88125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-95886be1-4d85-4eff-bda0-2d9f7964eed0
Nov 03 18:23:42 devstack sudo[88125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:23:42 devstack sudo[88125]: pam_unix(sudo:session): session closed for user root
Nov 03 18:23:42 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-ef4437f8-e5b7-46f2-af12-dbf24575d016 tempest-GroupSnapshotsTest-870685421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-95886be1-4d85-4eff-bda0-2d9f7964eed0" returned: 0 in 0.670s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:23:42 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-ef4437f8-e5b7-46f2-af12-dbf24575d016 tempest-GroupSnapshotsTest-870685421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-95886be1-4d85-4eff-bda0-2d9f7964eed0 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:23:42 devstack sudo[88130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-95886be1-4d85-4eff-bda0-2d9f7964eed0
Nov 03 18:23:42 devstack sudo[88130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:23:43 devstack sudo[88130]: pam_unix(sudo:session): session closed for user root
Nov 03 18:23:43 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-ef4437f8-e5b7-46f2-af12-dbf24575d016 tempest-GroupSnapshotsTest-870685421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-95886be1-4d85-4eff-bda0-2d9f7964eed0" returned: 0 in 0.398s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:23:43 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-ef4437f8-e5b7-46f2-af12-dbf24575d016 tempest-GroupSnapshotsTest-870685421 None] Lock "cinder-quobyte-95886be1-4d85-4eff-bda0-2d9f7964eed0" released by "delete_volume" :: held 1.163s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:23:43 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-ef4437f8-e5b7-46f2-af12-dbf24575d016 tempest-GroupSnapshotsTest-870685421 None] Created reservations ['9018d851-0c59-4f39-9212-015462686bbc'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:23:43 devstack cinder-volume[86120]: WARNING cinder.quota [None req-ef4437f8-e5b7-46f2-af12-dbf24575d016 tempest-GroupSnapshotsTest-870685421 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-947926624 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-947926624, it is now deprecated. Please use the default quota class for default quota.
Nov 03 18:23:43 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-ef4437f8-e5b7-46f2-af12-dbf24575d016 tempest-GroupSnapshotsTest-870685421 None] Created reservations ['f5a3d245-73bb-4433-85b4-90ead214cb7d', 'afa9d0a1-d9b2-4967-8629-5faaf10dc202', 'cbd4dc01-b84a-48d3-bf51-9c97817bef5b', 'ab516be2-392e-46aa-8242-6db4af4426af'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:23:43 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-ef4437f8-e5b7-46f2-af12-dbf24575d016 tempest-GroupSnapshotsTest-870685421 None] Created reservations ['bc47d470-f8aa-4abf-8518-0b9ba142c3bf', '027d1131-ec54-48a4-a7f7-9355eec40bfb', 'd0733808-d73b-46c2-8995-b7306c0c09f4', '3bfb3a35-f57d-43db-9f3e-e5ecbcfd4c68'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:23:43 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-ef4437f8-e5b7-46f2-af12-dbf24575d016 tempest-GroupSnapshotsTest-870685421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:23:43 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-ef4437f8-e5b7-46f2-af12-dbf24575d016 tempest-GroupSnapshotsTest-870685421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:23:43 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-ef4437f8-e5b7-46f2-af12-dbf24575d016 tempest-GroupSnapshotsTest-870685421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:23:43 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-ef4437f8-e5b7-46f2-af12-dbf24575d016 tempest-GroupSnapshotsTest-870685421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:23:43 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-ef4437f8-e5b7-46f2-af12-dbf24575d016 tempest-GroupSnapshotsTest-870685421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:23:43 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-ef4437f8-e5b7-46f2-af12-dbf24575d016 tempest-GroupSnapshotsTest-870685421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:23:43 devstack sudo[88135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:23:43 devstack sudo[88135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:23:44 devstack sudo[88135]: pam_unix(sudo:session): session closed for user root
Nov 03 18:23:44 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-ef4437f8-e5b7-46f2-af12-dbf24575d016 tempest-GroupSnapshotsTest-870685421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.507s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:23:44 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-ef4437f8-e5b7-46f2-af12-dbf24575d016 tempest-GroupSnapshotsTest-870685421 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:23:44 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-ef4437f8-e5b7-46f2-af12-dbf24575d016 tempest-GroupSnapshotsTest-870685421 None] Delete group completed successfully.
Nov 03 18:23:45 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-16b7aef3-17fd-4081-b787-a7b99fb03f71 tempest-GroupSnapshotsTest-870685421 None] Group tempest-GroupSnapshotsTest-Group-890843355: creating
Nov 03 18:23:45 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-16b7aef3-17fd-4081-b787-a7b99fb03f71 tempest-GroupSnapshotsTest-870685421 None] Group tempest-GroupSnapshotsTest-Group-890843355: created successfully
Nov 03 18:23:45 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-16b7aef3-17fd-4081-b787-a7b99fb03f71 tempest-GroupSnapshotsTest-870685421 None] Create group completed successfully.
Nov 03 18:23:47 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-481ecb4f-1ddf-45ce-a9b4-a982bdcf37e4 tempest-GroupSnapshotsTest-870685421 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:23:47 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-481ecb4f-1ddf-45ce-a9b4-a982bdcf37e4 tempest-GroupSnapshotsTest-870685421 None] Flow 'volume_create_manager' (6697b962-0f72-4df6-9034-148ab16dedfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:23:47 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-481ecb4f-1ddf-45ce-a9b4-a982bdcf37e4 tempest-GroupSnapshotsTest-870685421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1556df8-03d9-42bd-aa6e-84ca5eb83b20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:23:47 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-481ecb4f-1ddf-45ce-a9b4-a982bdcf37e4 tempest-GroupSnapshotsTest-870685421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1556df8-03d9-42bd-aa6e-84ca5eb83b20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:23:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-690794970',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=8745c387-116e-460e-b1aa-2f073097b365,host='devstack@QuobyteHD#QuobyteHD',id=2911283b-3296-4c0c-9f35-127c9269f4cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec4923426a2c48f8843125ecc43e5686',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:23:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:23:48Z,use_quota=True,user_id='05a831a8d48448f0bad34b8f768decd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79d69166-c141-42f5-a99b-d90a649edd7e),volume_type_id=79d69166-c141-42f5-a99b-d90a649edd7e)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:23:47 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-481ecb4f-1ddf-45ce-a9b4-a982bdcf37e4 tempest-GroupSnapshotsTest-870685421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0189287a-219b-438b-9bc0-8c12ff8d2505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:23:47 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-481ecb4f-1ddf-45ce-a9b4-a982bdcf37e4 tempest-GroupSnapshotsTest-870685421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0189287a-219b-438b-9bc0-8c12ff8d2505) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:23:47 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-481ecb4f-1ddf-45ce-a9b4-a982bdcf37e4 tempest-GroupSnapshotsTest-870685421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b136657-277d-48b8-be79-f3b88737f3c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:23:47 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-481ecb4f-1ddf-45ce-a9b4-a982bdcf37e4 tempest-GroupSnapshotsTest-870685421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b136657-277d-48b8-be79-f3b88737f3c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2911283b-3296-4c0c-9f35-127c9269f4cf', 'volume_name': 'volume-2911283b-3296-4c0c-9f35-127c9269f4cf', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:23:47 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-481ecb4f-1ddf-45ce-a9b4-a982bdcf37e4 tempest-GroupSnapshotsTest-870685421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a35f2fd-9a5c-4948-aeb9-f0976270f9e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:23:47 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-481ecb4f-1ddf-45ce-a9b4-a982bdcf37e4 tempest-GroupSnapshotsTest-870685421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a35f2fd-9a5c-4948-aeb9-f0976270f9e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:23:47 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-481ecb4f-1ddf-45ce-a9b4-a982bdcf37e4 tempest-GroupSnapshotsTest-870685421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33eca89e-0311-47d9-a6b9-4a921502b4f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:23:47 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-481ecb4f-1ddf-45ce-a9b4-a982bdcf37e4 tempest-GroupSnapshotsTest-870685421 None] Volume 2911283b-3296-4c0c-9f35-127c9269f4cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2911283b-3296-4c0c-9f35-127c9269f4cf', 'volume_size': 1}
Nov 03 18:23:47 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-481ecb4f-1ddf-45ce-a9b4-a982bdcf37e4 tempest-GroupSnapshotsTest-870685421 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:23:47 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-481ecb4f-1ddf-45ce-a9b4-a982bdcf37e4 tempest-GroupSnapshotsTest-870685421 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:23:47 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-481ecb4f-1ddf-45ce-a9b4-a982bdcf37e4 tempest-GroupSnapshotsTest-870685421 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=8745c387-116e-460e-b1aa-2f073097b365,created_at=2026-11-03T17:23:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-690794970',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=8745c387-116e-460e-b1aa-2f073097b365,host='devstack@QuobyteHD#QuobyteHD',id=2911283b-3296-4c0c-9f35-127c9269f4cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec4923426a2c48f8843125ecc43e5686',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:23:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:23:48Z,use_quota=True,user_id='05a831a8d48448f0bad34b8f768decd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79d69166-c141-42f5-a99b-d90a649edd7e),volume_type_id=79d69166-c141-42f5-a99b-d90a649edd7e)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:23:47 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-481ecb4f-1ddf-45ce-a9b4-a982bdcf37e4 tempest-GroupSnapshotsTest-870685421 None] Creating volume 2911283b-3296-4c0c-9f35-127c9269f4cf {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:23:47 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-481ecb4f-1ddf-45ce-a9b4-a982bdcf37e4 tempest-GroupSnapshotsTest-870685421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:23:47 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-481ecb4f-1ddf-45ce-a9b4-a982bdcf37e4 tempest-GroupSnapshotsTest-870685421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:23:47 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-481ecb4f-1ddf-45ce-a9b4-a982bdcf37e4 tempest-GroupSnapshotsTest-870685421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:23:47 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-481ecb4f-1ddf-45ce-a9b4-a982bdcf37e4 tempest-GroupSnapshotsTest-870685421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:23:47 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-481ecb4f-1ddf-45ce-a9b4-a982bdcf37e4 tempest-GroupSnapshotsTest-870685421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:23:47 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-481ecb4f-1ddf-45ce-a9b4-a982bdcf37e4 tempest-GroupSnapshotsTest-870685421 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:23:47 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-481ecb4f-1ddf-45ce-a9b4-a982bdcf37e4 tempest-GroupSnapshotsTest-870685421 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:23:47 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-481ecb4f-1ddf-45ce-a9b4-a982bdcf37e4 tempest-GroupSnapshotsTest-870685421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2911283b-3296-4c0c-9f35-127c9269f4cf 1073741824 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:23:47 devstack sudo[88197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2911283b-3296-4c0c-9f35-127c9269f4cf 1073741824
Nov 03 18:23:47 devstack sudo[88197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:23:48 devstack sudo[88197]: pam_unix(sudo:session): session closed for user root
Nov 03 18:23:48 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-481ecb4f-1ddf-45ce-a9b4-a982bdcf37e4 tempest-GroupSnapshotsTest-870685421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2911283b-3296-4c0c-9f35-127c9269f4cf 1073741824" returned: 0 in 0.659s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:23:48 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-481ecb4f-1ddf-45ce-a9b4-a982bdcf37e4 tempest-GroupSnapshotsTest-870685421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2911283b-3296-4c0c-9f35-127c9269f4cf {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:23:48 devstack sudo[88207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2911283b-3296-4c0c-9f35-127c9269f4cf
Nov 03 18:23:48 devstack sudo[88207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:23:48 devstack sudo[88207]: pam_unix(sudo:session): session closed for user root
Nov 03 18:23:48 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-481ecb4f-1ddf-45ce-a9b4-a982bdcf37e4 tempest-GroupSnapshotsTest-870685421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2911283b-3296-4c0c-9f35-127c9269f4cf" returned: 0 in 0.273s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:23:48 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-481ecb4f-1ddf-45ce-a9b4-a982bdcf37e4 tempest-GroupSnapshotsTest-870685421 None] <== create_volume: return (1001ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:23:48 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-481ecb4f-1ddf-45ce-a9b4-a982bdcf37e4 tempest-GroupSnapshotsTest-870685421 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.003s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:23:48 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-481ecb4f-1ddf-45ce-a9b4-a982bdcf37e4 tempest-GroupSnapshotsTest-870685421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33eca89e-0311-47d9-a6b9-4a921502b4f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2911283b-3296-4c0c-9f35-127c9269f4cf', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:23:48 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-481ecb4f-1ddf-45ce-a9b4-a982bdcf37e4 tempest-GroupSnapshotsTest-870685421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bf4a5ba-4e59-413b-8f43-7189d0954b82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:23:48 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-481ecb4f-1ddf-45ce-a9b4-a982bdcf37e4 tempest-GroupSnapshotsTest-870685421 None] Volume volume-2911283b-3296-4c0c-9f35-127c9269f4cf (2911283b-3296-4c0c-9f35-127c9269f4cf): created successfully
Nov 03 18:23:48 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-481ecb4f-1ddf-45ce-a9b4-a982bdcf37e4 tempest-GroupSnapshotsTest-870685421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bf4a5ba-4e59-413b-8f43-7189d0954b82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:23:48 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-481ecb4f-1ddf-45ce-a9b4-a982bdcf37e4 tempest-GroupSnapshotsTest-870685421 None] Flow 'volume_create_manager' (6697b962-0f72-4df6-9034-148ab16dedfd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:23:48 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-481ecb4f-1ddf-45ce-a9b4-a982bdcf37e4 tempest-GroupSnapshotsTest-870685421 None] Created volume successfully.
Nov 03 18:23:51 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-9c46f8c3-4060-4945-9e2e-62afca2f2f09 tempest-GroupSnapshotsTest-870685421 None] GroupSnapshot 7a9da4e8-a5b5-4280-92f6-38ac84b2eaf1: creating.
Nov 03 18:23:51 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-9c46f8c3-4060-4945-9e2e-62afca2f2f09 tempest-GroupSnapshotsTest-870685421 None] Group snapshot 7a9da4e8-a5b5-4280-92f6-38ac84b2eaf1: creating. {{(pid=86120) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Nov 03 18:23:51 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-9c46f8c3-4060-4945-9e2e-62afca2f2f09 tempest-GroupSnapshotsTest-870685421 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:23:51 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-9c46f8c3-4060-4945-9e2e-62afca2f2f09 tempest-GroupSnapshotsTest-870685421 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:23:51 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-9c46f8c3-4060-4945-9e2e-62afca2f2f09 tempest-GroupSnapshotsTest-870685421 None] Creating offline snapshot d7b98684-2a81-41e8-ad1d-43d3fcd902c5 of volume 2911283b-3296-4c0c-9f35-127c9269f4cf {{(pid=86120) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 18:23:51 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[d91ba4e0-bd06-475c-b72e-361d1087d122]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:23:51 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-9c46f8c3-4060-4945-9e2e-62afca2f2f09 tempest-GroupSnapshotsTest-870685421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2911283b-3296-4c0c-9f35-127c9269f4cf {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:23:51 devstack sudo[88292]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2911283b-3296-4c0c-9f35-127c9269f4cf
Nov 03 18:23:51 devstack sudo[88292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:23:51 devstack sudo[88292]: pam_unix(sudo:session): session closed for user root
Nov 03 18:23:51 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-9c46f8c3-4060-4945-9e2e-62afca2f2f09 tempest-GroupSnapshotsTest-870685421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2911283b-3296-4c0c-9f35-127c9269f4cf" returned: 0 in 0.504s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:23:51 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-9c46f8c3-4060-4945-9e2e-62afca2f2f09 tempest-GroupSnapshotsTest-870685421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2911283b-3296-4c0c-9f35-127c9269f4cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2911283b-3296-4c0c-9f35-127c9269f4cf.d7b98684-2a81-41e8-ad1d-43d3fcd902c5 1G {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:23:51 devstack sudo[88303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2911283b-3296-4c0c-9f35-127c9269f4cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2911283b-3296-4c0c-9f35-127c9269f4cf.d7b98684-2a81-41e8-ad1d-43d3fcd902c5 1G
Nov 03 18:23:51 devstack sudo[88303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:23:52 devstack sudo[88303]: pam_unix(sudo:session): session closed for user root
Nov 03 18:23:52 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-9c46f8c3-4060-4945-9e2e-62afca2f2f09 tempest-GroupSnapshotsTest-870685421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2911283b-3296-4c0c-9f35-127c9269f4cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2911283b-3296-4c0c-9f35-127c9269f4cf.d7b98684-2a81-41e8-ad1d-43d3fcd902c5 1G" returned: 0 in 0.789s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:23:52 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-9c46f8c3-4060-4945-9e2e-62afca2f2f09 tempest-GroupSnapshotsTest-870685421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2911283b-3296-4c0c-9f35-127c9269f4cf -F qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2911283b-3296-4c0c-9f35-127c9269f4cf.d7b98684-2a81-41e8-ad1d-43d3fcd902c5 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:23:52 devstack sudo[88312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2911283b-3296-4c0c-9f35-127c9269f4cf -F qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2911283b-3296-4c0c-9f35-127c9269f4cf.d7b98684-2a81-41e8-ad1d-43d3fcd902c5
Nov 03 18:23:52 devstack sudo[88312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:23:53 devstack sudo[88312]: pam_unix(sudo:session): session closed for user root
Nov 03 18:23:53 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-9c46f8c3-4060-4945-9e2e-62afca2f2f09 tempest-GroupSnapshotsTest-870685421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2911283b-3296-4c0c-9f35-127c9269f4cf -F qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2911283b-3296-4c0c-9f35-127c9269f4cf.d7b98684-2a81-41e8-ad1d-43d3fcd902c5" returned: 0 in 0.473s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:23:53 devstack cinder-volume[86120]: WARNING cinder.volume.drivers.remotefs [None req-9c46f8c3-4060-4945-9e2e-62afca2f2f09 tempest-GroupSnapshotsTest-870685421 None] /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2911283b-3296-4c0c-9f35-127c9269f4cf.d7b98684-2a81-41e8-ad1d-43d3fcd902c5 is being set with open permissions: ugo+rw: NotImplementedError
Nov 03 18:23:53 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-9c46f8c3-4060-4945-9e2e-62afca2f2f09 tempest-GroupSnapshotsTest-870685421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2911283b-3296-4c0c-9f35-127c9269f4cf.d7b98684-2a81-41e8-ad1d-43d3fcd902c5 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:23:53 devstack sudo[88317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2911283b-3296-4c0c-9f35-127c9269f4cf.d7b98684-2a81-41e8-ad1d-43d3fcd902c5
Nov 03 18:23:53 devstack sudo[88317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:23:53 devstack sudo[88317]: pam_unix(sudo:session): session closed for user root
Nov 03 18:23:53 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-9c46f8c3-4060-4945-9e2e-62afca2f2f09 tempest-GroupSnapshotsTest-870685421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2911283b-3296-4c0c-9f35-127c9269f4cf.d7b98684-2a81-41e8-ad1d-43d3fcd902c5" returned: 0 in 0.378s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:23:53 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-9c46f8c3-4060-4945-9e2e-62afca2f2f09 tempest-GroupSnapshotsTest-870685421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2911283b-3296-4c0c-9f35-127c9269f4cf.info {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:23:53 devstack sudo[88320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2911283b-3296-4c0c-9f35-127c9269f4cf.info
Nov 03 18:23:53 devstack sudo[88320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:23:54 devstack sudo[88320]: pam_unix(sudo:session): session closed for user root
Nov 03 18:23:54 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-9c46f8c3-4060-4945-9e2e-62afca2f2f09 tempest-GroupSnapshotsTest-870685421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2911283b-3296-4c0c-9f35-127c9269f4cf.info" returned: 0 in 0.583s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:23:54 devstack cinder-volume[86120]: WARNING cinder.volume.drivers.remotefs [None req-9c46f8c3-4060-4945-9e2e-62afca2f2f09 tempest-GroupSnapshotsTest-870685421 None] /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2911283b-3296-4c0c-9f35-127c9269f4cf.info is being set with open permissions: ugo+rw: NotImplementedError
Nov 03 18:23:54 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-9c46f8c3-4060-4945-9e2e-62afca2f2f09 tempest-GroupSnapshotsTest-870685421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2911283b-3296-4c0c-9f35-127c9269f4cf.info {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:23:54 devstack sudo[88327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2911283b-3296-4c0c-9f35-127c9269f4cf.info
Nov 03 18:23:54 devstack sudo[88327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:23:54 devstack sudo[88327]: pam_unix(sudo:session): session closed for user root
Nov 03 18:23:54 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-9c46f8c3-4060-4945-9e2e-62afca2f2f09 tempest-GroupSnapshotsTest-870685421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2911283b-3296-4c0c-9f35-127c9269f4cf.info" returned: 0 in 0.422s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:23:54 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-9c46f8c3-4060-4945-9e2e-62afca2f2f09 tempest-GroupSnapshotsTest-870685421 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.429s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:23:54 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-9c46f8c3-4060-4945-9e2e-62afca2f2f09 tempest-GroupSnapshotsTest-870685421 None] group_snapshot 7a9da4e8-a5b5-4280-92f6-38ac84b2eaf1: created successfully
Nov 03 18:23:56 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-f8040203-c23d-44d4-9341-b19346918cdd tempest-GroupSnapshotsTest-870685421 None] group_snapshot 7a9da4e8-a5b5-4280-92f6-38ac84b2eaf1: deleting
Nov 03 18:23:56 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-f8040203-c23d-44d4-9341-b19346918cdd tempest-GroupSnapshotsTest-870685421 None] group_snapshot 7a9da4e8-a5b5-4280-92f6-38ac84b2eaf1: deleting {{(pid=86120) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Nov 03 18:23:56 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-f8040203-c23d-44d4-9341-b19346918cdd tempest-GroupSnapshotsTest-870685421 None] Acquiring lock "cinder-quobyte-2911283b-3296-4c0c-9f35-127c9269f4cf" by "delete_snapshot" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:23:56 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-f8040203-c23d-44d4-9341-b19346918cdd tempest-GroupSnapshotsTest-870685421 None] Lock "cinder-quobyte-2911283b-3296-4c0c-9f35-127c9269f4cf" acquired by "delete_snapshot" :: waited 0.110s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:23:56 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-f8040203-c23d-44d4-9341-b19346918cdd tempest-GroupSnapshotsTest-870685421 None] Acquiring lock "cinder-quobyte-d7b98684-2a81-41e8-ad1d-43d3fcd902c5" by "_delete_snapshot" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:23:56 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-f8040203-c23d-44d4-9341-b19346918cdd tempest-GroupSnapshotsTest-870685421 None] Lock "cinder-quobyte-d7b98684-2a81-41e8-ad1d-43d3fcd902c5" acquired by "_delete_snapshot" :: waited 0.101s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:23:56 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-f8040203-c23d-44d4-9341-b19346918cdd tempest-GroupSnapshotsTest-870685421 None] Deleting offline snapshot d7b98684-2a81-41e8-ad1d-43d3fcd902c5 of volume 2911283b-3296-4c0c-9f35-127c9269f4cf {{(pid=86120) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 18:23:57 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-f8040203-c23d-44d4-9341-b19346918cdd tempest-GroupSnapshotsTest-870685421 None] snapshot_file for this snap is: volume-2911283b-3296-4c0c-9f35-127c9269f4cf.d7b98684-2a81-41e8-ad1d-43d3fcd902c5 {{(pid=86120) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 18:23:57 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcc0f530-546e-4390-9b4a-8a6a64660e89]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:23:57 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-f8040203-c23d-44d4-9341-b19346918cdd tempest-GroupSnapshotsTest-870685421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2911283b-3296-4c0c-9f35-127c9269f4cf.d7b98684-2a81-41e8-ad1d-43d3fcd902c5 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:23:57 devstack sudo[88406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2911283b-3296-4c0c-9f35-127c9269f4cf.d7b98684-2a81-41e8-ad1d-43d3fcd902c5
Nov 03 18:23:57 devstack sudo[88406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:23:57 devstack sudo[88406]: pam_unix(sudo:session): session closed for user root
Nov 03 18:23:57 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-f8040203-c23d-44d4-9341-b19346918cdd tempest-GroupSnapshotsTest-870685421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2911283b-3296-4c0c-9f35-127c9269f4cf.d7b98684-2a81-41e8-ad1d-43d3fcd902c5" returned: 0 in 0.690s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:23:57 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-f8040203-c23d-44d4-9341-b19346918cdd tempest-GroupSnapshotsTest-870685421 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2911283b-3296-4c0c-9f35-127c9269f4cf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86120) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 18:23:57 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[4272e274-438f-4967-8405-879ff155961a]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:23:57 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-f8040203-c23d-44d4-9341-b19346918cdd tempest-GroupSnapshotsTest-870685421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2911283b-3296-4c0c-9f35-127c9269f4cf {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:23:58 devstack sudo[88417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2911283b-3296-4c0c-9f35-127c9269f4cf
Nov 03 18:23:58 devstack sudo[88417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:23:58 devstack sudo[88417]: pam_unix(sudo:session): session closed for user root
Nov 03 18:23:58 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-f8040203-c23d-44d4-9341-b19346918cdd tempest-GroupSnapshotsTest-870685421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2911283b-3296-4c0c-9f35-127c9269f4cf" returned: 0 in 0.924s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:23:58 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-f8040203-c23d-44d4-9341-b19346918cdd tempest-GroupSnapshotsTest-870685421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2911283b-3296-4c0c-9f35-127c9269f4cf.d7b98684-2a81-41e8-ad1d-43d3fcd902c5 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:23:58 devstack sudo[88427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2911283b-3296-4c0c-9f35-127c9269f4cf.d7b98684-2a81-41e8-ad1d-43d3fcd902c5
Nov 03 18:23:58 devstack sudo[88427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:23:59 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [req-546c2a0e-8ce8-41ac-bafd-13c369c788bd req-8402d65e-5d46-4f03-92d7-5c147b36f58c tempest-ServerActionsTestOtherA-913173699 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:23:59 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [req-546c2a0e-8ce8-41ac-bafd-13c369c788bd req-8402d65e-5d46-4f03-92d7-5c147b36f58c tempest-ServerActionsTestOtherA-913173699 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:23:59 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [req-546c2a0e-8ce8-41ac-bafd-13c369c788bd req-8402d65e-5d46-4f03-92d7-5c147b36f58c tempest-ServerActionsTestOtherA-913173699 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:23:59 devstack sudo[88427]: pam_unix(sudo:session): session closed for user root
Nov 03 18:23:59 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-f8040203-c23d-44d4-9341-b19346918cdd tempest-GroupSnapshotsTest-870685421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2911283b-3296-4c0c-9f35-127c9269f4cf.d7b98684-2a81-41e8-ad1d-43d3fcd902c5" returned: 0 in 0.743s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:23:59 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-f8040203-c23d-44d4-9341-b19346918cdd tempest-GroupSnapshotsTest-870685421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2911283b-3296-4c0c-9f35-127c9269f4cf.d7b98684-2a81-41e8-ad1d-43d3fcd902c5 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:23:59 devstack sudo[88442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2911283b-3296-4c0c-9f35-127c9269f4cf.d7b98684-2a81-41e8-ad1d-43d3fcd902c5
Nov 03 18:23:59 devstack sudo[88442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:23:59 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [req-546c2a0e-8ce8-41ac-bafd-13c369c788bd req-8402d65e-5d46-4f03-92d7-5c147b36f58c tempest-ServerActionsTestOtherA-913173699 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c', 'name': 'volume-255042f8-8af6-4403-bed7-bea7fc953047', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0d00e7f2-fe6c-48fe-91f0-ac4520d57cc9', 'enforce_multipath': True} {{(pid=86120) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 03 18:23:59 devstack cinder-volume[86120]: INFO cinder.volume.manager [req-546c2a0e-8ce8-41ac-bafd-13c369c788bd req-8402d65e-5d46-4f03-92d7-5c147b36f58c tempest-ServerActionsTestOtherA-913173699 None] attachment_update completed successfully.
Nov 03 18:24:00 devstack sudo[88442]: pam_unix(sudo:session): session closed for user root
Nov 03 18:24:00 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-f8040203-c23d-44d4-9341-b19346918cdd tempest-GroupSnapshotsTest-870685421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2911283b-3296-4c0c-9f35-127c9269f4cf.d7b98684-2a81-41e8-ad1d-43d3fcd902c5" returned: 0 in 0.596s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:24:00 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-f8040203-c23d-44d4-9341-b19346918cdd tempest-GroupSnapshotsTest-870685421 None] Lock "cinder-quobyte-d7b98684-2a81-41e8-ad1d-43d3fcd902c5" released by "_delete_snapshot" :: held 3.382s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:24:00 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-f8040203-c23d-44d4-9341-b19346918cdd tempest-GroupSnapshotsTest-870685421 None] Lock "cinder-quobyte-2911283b-3296-4c0c-9f35-127c9269f4cf" released by "delete_snapshot" :: held 3.499s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:24:00 devstack cinder-volume[86120]: WARNING cinder.quota [None req-f8040203-c23d-44d4-9341-b19346918cdd tempest-GroupSnapshotsTest-870685421 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-754984101 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-754984101, it is now deprecated. Please use the default quota class for default quota.
Nov 03 18:24:00 devstack cinder-volume[86120]: WARNING cinder.quota [None req-f8040203-c23d-44d4-9341-b19346918cdd tempest-GroupSnapshotsTest-870685421 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-754984101 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-754984101, it is now deprecated. Please use the default quota class for default quota.
Nov 03 18:24:00 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-f8040203-c23d-44d4-9341-b19346918cdd tempest-GroupSnapshotsTest-870685421 None] Created reservations ['7b4e487e-3d3d-46ea-8774-981673bc3cbe', 'b49f6345-3889-40f7-8f96-2b983a97427e', '855fed89-4f3f-4e95-8352-8eedb336e63c', '465d11ba-8f3c-4ffb-a7cc-eaff213edbe9'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:24:00 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-f8040203-c23d-44d4-9341-b19346918cdd tempest-GroupSnapshotsTest-870685421 None] group_snapshot 7a9da4e8-a5b5-4280-92f6-38ac84b2eaf1: deleted successfully
Nov 03 18:24:01 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-70448257-90dc-4d86-8b2e-730f73320b42 tempest-VolumesAdminNegativeTest-1944305575 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:24:02 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-70448257-90dc-4d86-8b2e-730f73320b42 tempest-VolumesAdminNegativeTest-1944305575 None] Flow 'volume_create_manager' (fb55d67a-64c7-4319-87dd-933d681e68cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:24:02 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-70448257-90dc-4d86-8b2e-730f73320b42 tempest-VolumesAdminNegativeTest-1944305575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae5d6d20-0a00-4e6c-a855-fc2c9013911d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:24:02 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-70448257-90dc-4d86-8b2e-730f73320b42 tempest-VolumesAdminNegativeTest-1944305575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae5d6d20-0a00-4e6c-a855-fc2c9013911d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:24:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1520382642',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5362ee6-2817-4f80-bee8-3ed3287f5397,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3442e05b64db418fb9cf2885696ec482',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:24:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:24:02Z,use_quota=True,user_id='7f452959a4b24fa7bab7ed3b4b62956f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:24:02 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-70448257-90dc-4d86-8b2e-730f73320b42 tempest-VolumesAdminNegativeTest-1944305575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46a796ac-6152-4f1d-a5d6-ffd53348b3b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:24:02 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-70448257-90dc-4d86-8b2e-730f73320b42 tempest-VolumesAdminNegativeTest-1944305575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46a796ac-6152-4f1d-a5d6-ffd53348b3b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:24:02 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-70448257-90dc-4d86-8b2e-730f73320b42 tempest-VolumesAdminNegativeTest-1944305575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2674bcf2-f964-40b0-b32d-7a32c931b1ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:24:02 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-70448257-90dc-4d86-8b2e-730f73320b42 tempest-VolumesAdminNegativeTest-1944305575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2674bcf2-f964-40b0-b32d-7a32c931b1ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5362ee6-2817-4f80-bee8-3ed3287f5397', 'volume_name': 'volume-a5362ee6-2817-4f80-bee8-3ed3287f5397', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:24:02 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-70448257-90dc-4d86-8b2e-730f73320b42 tempest-VolumesAdminNegativeTest-1944305575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d36af8d1-59b2-496c-813f-9130b2592294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:24:02 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-70448257-90dc-4d86-8b2e-730f73320b42 tempest-VolumesAdminNegativeTest-1944305575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d36af8d1-59b2-496c-813f-9130b2592294) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:24:02 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-70448257-90dc-4d86-8b2e-730f73320b42 tempest-VolumesAdminNegativeTest-1944305575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b5bd6e2-58b3-45ae-baf2-c8b91ed522d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:24:02 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-70448257-90dc-4d86-8b2e-730f73320b42 tempest-VolumesAdminNegativeTest-1944305575 None] Volume a5362ee6-2817-4f80-bee8-3ed3287f5397: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5362ee6-2817-4f80-bee8-3ed3287f5397', 'volume_size': 1}
Nov 03 18:24:02 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-70448257-90dc-4d86-8b2e-730f73320b42 tempest-VolumesAdminNegativeTest-1944305575 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:24:02 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-70448257-90dc-4d86-8b2e-730f73320b42 tempest-VolumesAdminNegativeTest-1944305575 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:24:02 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-70448257-90dc-4d86-8b2e-730f73320b42 tempest-VolumesAdminNegativeTest-1944305575 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:24:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1520382642',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5362ee6-2817-4f80-bee8-3ed3287f5397,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3442e05b64db418fb9cf2885696ec482',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:24:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:24:02Z,use_quota=True,user_id='7f452959a4b24fa7bab7ed3b4b62956f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:24:02 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-70448257-90dc-4d86-8b2e-730f73320b42 tempest-VolumesAdminNegativeTest-1944305575 None] Creating volume a5362ee6-2817-4f80-bee8-3ed3287f5397 {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:24:02 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-70448257-90dc-4d86-8b2e-730f73320b42 tempest-VolumesAdminNegativeTest-1944305575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:24:02 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-70448257-90dc-4d86-8b2e-730f73320b42 tempest-VolumesAdminNegativeTest-1944305575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:24:02 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-70448257-90dc-4d86-8b2e-730f73320b42 tempest-VolumesAdminNegativeTest-1944305575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:24:02 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-70448257-90dc-4d86-8b2e-730f73320b42 tempest-VolumesAdminNegativeTest-1944305575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:24:02 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-70448257-90dc-4d86-8b2e-730f73320b42 tempest-VolumesAdminNegativeTest-1944305575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:24:02 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-70448257-90dc-4d86-8b2e-730f73320b42 tempest-VolumesAdminNegativeTest-1944305575 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:24:02 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-70448257-90dc-4d86-8b2e-730f73320b42 tempest-VolumesAdminNegativeTest-1944305575 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:24:02 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-70448257-90dc-4d86-8b2e-730f73320b42 tempest-VolumesAdminNegativeTest-1944305575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-a5362ee6-2817-4f80-bee8-3ed3287f5397 1073741824 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:24:02 devstack sudo[88889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-a5362ee6-2817-4f80-bee8-3ed3287f5397 1073741824
Nov 03 18:24:02 devstack sudo[88889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:24:02 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-1ec7fbe3-449c-4fed-9166-e91aed8b7377 tempest-GroupSnapshotsTest-870685421 None] Acquiring lock "cinder-quobyte-2911283b-3296-4c0c-9f35-127c9269f4cf" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:24:02 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-1ec7fbe3-449c-4fed-9166-e91aed8b7377 tempest-GroupSnapshotsTest-870685421 None] Lock "cinder-quobyte-2911283b-3296-4c0c-9f35-127c9269f4cf" acquired by "delete_volume" :: waited 0.059s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:24:02 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[939bf5ff-8b29-45bb-9a37-5f2809ff5d11]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:24:02 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-1ec7fbe3-449c-4fed-9166-e91aed8b7377 tempest-GroupSnapshotsTest-870685421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2911283b-3296-4c0c-9f35-127c9269f4cf {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:24:02 devstack sudo[88891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2911283b-3296-4c0c-9f35-127c9269f4cf
Nov 03 18:24:02 devstack sudo[88891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:24:03 devstack sudo[88889]: pam_unix(sudo:session): session closed for user root
Nov 03 18:24:03 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-70448257-90dc-4d86-8b2e-730f73320b42 tempest-VolumesAdminNegativeTest-1944305575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-a5362ee6-2817-4f80-bee8-3ed3287f5397 1073741824" returned: 0 in 1.022s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:24:03 devstack sudo[88891]: pam_unix(sudo:session): session closed for user root
Nov 03 18:24:03 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-1ec7fbe3-449c-4fed-9166-e91aed8b7377 tempest-GroupSnapshotsTest-870685421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2911283b-3296-4c0c-9f35-127c9269f4cf" returned: 0 in 0.832s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:24:03 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-1ec7fbe3-449c-4fed-9166-e91aed8b7377 tempest-GroupSnapshotsTest-870685421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2911283b-3296-4c0c-9f35-127c9269f4cf {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:24:03 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-70448257-90dc-4d86-8b2e-730f73320b42 tempest-VolumesAdminNegativeTest-1944305575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-a5362ee6-2817-4f80-bee8-3ed3287f5397 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:24:03 devstack sudo[88899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2911283b-3296-4c0c-9f35-127c9269f4cf
Nov 03 18:24:03 devstack sudo[88899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:24:03 devstack sudo[88900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-a5362ee6-2817-4f80-bee8-3ed3287f5397
Nov 03 18:24:03 devstack sudo[88900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:24:04 devstack sudo[88900]: pam_unix(sudo:session): session closed for user root
Nov 03 18:24:04 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-70448257-90dc-4d86-8b2e-730f73320b42 tempest-VolumesAdminNegativeTest-1944305575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-a5362ee6-2817-4f80-bee8-3ed3287f5397" returned: 0 in 0.777s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:24:04 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-70448257-90dc-4d86-8b2e-730f73320b42 tempest-VolumesAdminNegativeTest-1944305575 None] <== create_volume: return (1919ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:24:04 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-70448257-90dc-4d86-8b2e-730f73320b42 tempest-VolumesAdminNegativeTest-1944305575 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.923s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:24:04 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-70448257-90dc-4d86-8b2e-730f73320b42 tempest-VolumesAdminNegativeTest-1944305575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b5bd6e2-58b3-45ae-baf2-c8b91ed522d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5362ee6-2817-4f80-bee8-3ed3287f5397', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:24:04 devstack sudo[88899]: pam_unix(sudo:session): session closed for user root
Nov 03 18:24:04 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-70448257-90dc-4d86-8b2e-730f73320b42 tempest-VolumesAdminNegativeTest-1944305575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92b3f7e6-0a4a-4510-988e-43052c85e4e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:24:04 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-1ec7fbe3-449c-4fed-9166-e91aed8b7377 tempest-GroupSnapshotsTest-870685421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2911283b-3296-4c0c-9f35-127c9269f4cf" returned: 0 in 0.880s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:24:04 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-70448257-90dc-4d86-8b2e-730f73320b42 tempest-VolumesAdminNegativeTest-1944305575 None] Volume volume-a5362ee6-2817-4f80-bee8-3ed3287f5397 (a5362ee6-2817-4f80-bee8-3ed3287f5397): created successfully
Nov 03 18:24:04 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-70448257-90dc-4d86-8b2e-730f73320b42 tempest-VolumesAdminNegativeTest-1944305575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92b3f7e6-0a4a-4510-988e-43052c85e4e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:24:04 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-70448257-90dc-4d86-8b2e-730f73320b42 tempest-VolumesAdminNegativeTest-1944305575 None] Flow 'volume_create_manager' (fb55d67a-64c7-4319-87dd-933d681e68cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:24:04 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-1ec7fbe3-449c-4fed-9166-e91aed8b7377 tempest-GroupSnapshotsTest-870685421 None] Lock "cinder-quobyte-2911283b-3296-4c0c-9f35-127c9269f4cf" released by "delete_volume" :: held 1.866s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:24:04 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-70448257-90dc-4d86-8b2e-730f73320b42 tempest-VolumesAdminNegativeTest-1944305575 None] Created volume successfully.
Nov 03 18:24:04 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-1ec7fbe3-449c-4fed-9166-e91aed8b7377 tempest-GroupSnapshotsTest-870685421 None] Created reservations ['ec53e5ed-7b57-47d7-9403-66a463caec51'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:24:04 devstack cinder-volume[86120]: WARNING cinder.quota [None req-1ec7fbe3-449c-4fed-9166-e91aed8b7377 tempest-GroupSnapshotsTest-870685421 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-754984101 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-754984101, it is now deprecated. Please use the default quota class for default quota.
Nov 03 18:24:04 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-1ec7fbe3-449c-4fed-9166-e91aed8b7377 tempest-GroupSnapshotsTest-870685421 None] Created reservations ['589f3510-6946-409e-ad17-a08d8dc2ac4b', 'deedb37e-8ce5-47b9-903d-cb6062922640', '63a661c3-9ded-4169-81f5-00beb8b461be', '1f88c1ff-d040-41df-a8e2-fc39db678210'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:24:04 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-1ec7fbe3-449c-4fed-9166-e91aed8b7377 tempest-GroupSnapshotsTest-870685421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:24:04 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-1ec7fbe3-449c-4fed-9166-e91aed8b7377 tempest-GroupSnapshotsTest-870685421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:24:04 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-1ec7fbe3-449c-4fed-9166-e91aed8b7377 tempest-GroupSnapshotsTest-870685421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:24:04 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-1ec7fbe3-449c-4fed-9166-e91aed8b7377 tempest-GroupSnapshotsTest-870685421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:24:04 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-1ec7fbe3-449c-4fed-9166-e91aed8b7377 tempest-GroupSnapshotsTest-870685421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:24:04 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-1ec7fbe3-449c-4fed-9166-e91aed8b7377 tempest-GroupSnapshotsTest-870685421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:24:04 devstack sudo[88908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:24:04 devstack sudo[88908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:24:05 devstack sudo[88908]: pam_unix(sudo:session): session closed for user root
Nov 03 18:24:05 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-1ec7fbe3-449c-4fed-9166-e91aed8b7377 tempest-GroupSnapshotsTest-870685421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.692s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:24:05 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-1ec7fbe3-449c-4fed-9166-e91aed8b7377 tempest-GroupSnapshotsTest-870685421 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:24:05 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-1ec7fbe3-449c-4fed-9166-e91aed8b7377 tempest-GroupSnapshotsTest-870685421 None] Delete group completed successfully.
Nov 03 18:24:06 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-a9722a7d-9b65-4462-a229-3b4526003757 tempest-VolumesAdminNegativeTest-1944305575 None] Acquiring lock "cinder-a5362ee6-2817-4f80-bee8-3ed3287f5397-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:24:06 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-a9722a7d-9b65-4462-a229-3b4526003757 tempest-VolumesAdminNegativeTest-1944305575 None] Lock "cinder-a5362ee6-2817-4f80-bee8-3ed3287f5397-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:24:06 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-a9722a7d-9b65-4462-a229-3b4526003757 tempest-VolumesAdminNegativeTest-1944305575 None] Acquiring lock "cinder-quobyte-a5362ee6-2817-4f80-bee8-3ed3287f5397" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:24:06 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-a9722a7d-9b65-4462-a229-3b4526003757 tempest-VolumesAdminNegativeTest-1944305575 None] Lock "cinder-quobyte-a5362ee6-2817-4f80-bee8-3ed3287f5397" acquired by "delete_volume" :: waited 0.036s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:24:06 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e01fa47-8197-487f-ba62-b00c670a9aad]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:24:06 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-a9722a7d-9b65-4462-a229-3b4526003757 tempest-VolumesAdminNegativeTest-1944305575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-a5362ee6-2817-4f80-bee8-3ed3287f5397 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:24:07 devstack cinder-volume[86120]: INFO cinder.volume.manager [req-ee3f4977-0876-42d9-a1dd-7855937daabe req-d84bb7e7-a729-4e60-9da3-9974daf474b1 tempest-ServerActionsTestOtherA-913173699 None] Terminate volume connection completed successfully.
Nov 03 18:24:07 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [req-ee3f4977-0876-42d9-a1dd-7855937daabe req-d84bb7e7-a729-4e60-9da3-9974daf474b1 tempest-ServerActionsTestOtherA-913173699 None] Deleting attachment 0d00e7f2-fe6c-48fe-91f0-ac4520d57cc9. {{(pid=86120) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 03 18:24:07 devstack sudo[88964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-a5362ee6-2817-4f80-bee8-3ed3287f5397
Nov 03 18:24:07 devstack sudo[88964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:24:08 devstack sudo[88964]: pam_unix(sudo:session): session closed for user root
Nov 03 18:24:08 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-a9722a7d-9b65-4462-a229-3b4526003757 tempest-VolumesAdminNegativeTest-1944305575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-a5362ee6-2817-4f80-bee8-3ed3287f5397" returned: 0 in 1.600s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:24:08 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-a9722a7d-9b65-4462-a229-3b4526003757 tempest-VolumesAdminNegativeTest-1944305575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-a5362ee6-2817-4f80-bee8-3ed3287f5397 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:24:08 devstack sudo[89034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-a5362ee6-2817-4f80-bee8-3ed3287f5397
Nov 03 18:24:08 devstack sudo[89034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:24:09 devstack sudo[89034]: pam_unix(sudo:session): session closed for user root
Nov 03 18:24:09 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-a9722a7d-9b65-4462-a229-3b4526003757 tempest-VolumesAdminNegativeTest-1944305575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-a5362ee6-2817-4f80-bee8-3ed3287f5397" returned: 0 in 0.476s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:24:09 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-a9722a7d-9b65-4462-a229-3b4526003757 tempest-VolumesAdminNegativeTest-1944305575 None] Lock "cinder-quobyte-a5362ee6-2817-4f80-bee8-3ed3287f5397" released by "delete_volume" :: held 2.308s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:24:09 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-a9722a7d-9b65-4462-a229-3b4526003757 tempest-VolumesAdminNegativeTest-1944305575 None] Created reservations ['a62f15ad-7554-43a1-8198-aa550143cf4e', 'cff197a9-f205-427e-93f9-4ec8239a1889', '22aeea26-c759-4425-8547-c5d537619e98', 'd3f2b7e2-48f0-48bd-8281-0de33e094a12'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:24:09 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [req-ee3f4977-0876-42d9-a1dd-7855937daabe req-c9f399a8-0255-41c3-bbee-5606a9ab975b tempest-ServerActionsTestOtherA-913173699 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:24:09 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [req-ee3f4977-0876-42d9-a1dd-7855937daabe req-c9f399a8-0255-41c3-bbee-5606a9ab975b tempest-ServerActionsTestOtherA-913173699 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:24:09 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [req-ee3f4977-0876-42d9-a1dd-7855937daabe req-c9f399a8-0255-41c3-bbee-5606a9ab975b tempest-ServerActionsTestOtherA-913173699 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.037s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:24:09 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-a9722a7d-9b65-4462-a229-3b4526003757 tempest-VolumesAdminNegativeTest-1944305575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:24:09 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-a9722a7d-9b65-4462-a229-3b4526003757 tempest-VolumesAdminNegativeTest-1944305575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:24:09 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-a9722a7d-9b65-4462-a229-3b4526003757 tempest-VolumesAdminNegativeTest-1944305575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:24:09 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-a9722a7d-9b65-4462-a229-3b4526003757 tempest-VolumesAdminNegativeTest-1944305575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:24:09 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-a9722a7d-9b65-4462-a229-3b4526003757 tempest-VolumesAdminNegativeTest-1944305575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:24:09 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-a9722a7d-9b65-4462-a229-3b4526003757 tempest-VolumesAdminNegativeTest-1944305575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:24:09 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [req-ee3f4977-0876-42d9-a1dd-7855937daabe req-c9f399a8-0255-41c3-bbee-5606a9ab975b tempest-ServerActionsTestOtherA-913173699 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c', 'name': 'volume-255042f8-8af6-4403-bed7-bea7fc953047', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7ee12c8f-60d0-4784-a4e5-995a920846c3', 'enforce_multipath': True} {{(pid=86120) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 03 18:24:09 devstack sudo[89050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:24:09 devstack sudo[89050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:24:09 devstack cinder-volume[86120]: INFO cinder.volume.manager [req-ee3f4977-0876-42d9-a1dd-7855937daabe req-c9f399a8-0255-41c3-bbee-5606a9ab975b tempest-ServerActionsTestOtherA-913173699 None] attachment_update completed successfully.
Nov 03 18:24:10 devstack sudo[89050]: pam_unix(sudo:session): session closed for user root
Nov 03 18:24:10 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-a9722a7d-9b65-4462-a229-3b4526003757 tempest-VolumesAdminNegativeTest-1944305575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.863s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:24:10 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-a9722a7d-9b65-4462-a229-3b4526003757 tempest-VolumesAdminNegativeTest-1944305575 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:24:10 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-a9722a7d-9b65-4462-a229-3b4526003757 tempest-VolumesAdminNegativeTest-1944305575 None] Deleted volume successfully.
Nov 03 18:24:10 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-a9722a7d-9b65-4462-a229-3b4526003757 tempest-VolumesAdminNegativeTest-1944305575 None] Lock "cinder-a5362ee6-2817-4f80-bee8-3ed3287f5397-delete_volume" released by "delete_volume" :: held 3.922s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:24:14 devstack cinder-volume[86120]: DEBUG oslo_service.periodic_task [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86120) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 18:24:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:24:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:24:14 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:24:14 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:24:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:24:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:24:15 devstack sudo[89577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:24:15 devstack sudo[89577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:24:15 devstack sudo[89577]: pam_unix(sudo:session): session closed for user root
Nov 03 18:24:15 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.419s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:24:15 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:24:19 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-36272322-fd8e-45ee-b678-1845dc1fd9e6 tempest-ServersNegativeTestJSON-602261896 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:24:19 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-36272322-fd8e-45ee-b678-1845dc1fd9e6 tempest-ServersNegativeTestJSON-602261896 None] Flow 'volume_create_manager' (c270829d-5f85-41f4-819e-b4af66d9ca16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:24:19 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-36272322-fd8e-45ee-b678-1845dc1fd9e6 tempest-ServersNegativeTestJSON-602261896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62804cf5-1d2d-4833-b055-65843867bfcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:24:19 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-36272322-fd8e-45ee-b678-1845dc1fd9e6 tempest-ServersNegativeTestJSON-602261896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62804cf5-1d2d-4833-b055-65843867bfcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:24:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1921373389',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69a0c5d1-e9b7-4a3d-8b5a-2816fc6c5794,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='563e25ea0e0a49f5a752f4cea33e6d7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:24:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:24:20Z,use_quota=True,user_id='b28ff1e7c9284c5499d8b0d7206a221b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:24:19 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-36272322-fd8e-45ee-b678-1845dc1fd9e6 tempest-ServersNegativeTestJSON-602261896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cec04555-a407-4b98-a333-78c97f978624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:24:19 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-36272322-fd8e-45ee-b678-1845dc1fd9e6 tempest-ServersNegativeTestJSON-602261896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cec04555-a407-4b98-a333-78c97f978624) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:24:19 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-36272322-fd8e-45ee-b678-1845dc1fd9e6 tempest-ServersNegativeTestJSON-602261896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c18eac44-fa13-40dd-ad21-105c76926eef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:24:19 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-36272322-fd8e-45ee-b678-1845dc1fd9e6 tempest-ServersNegativeTestJSON-602261896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c18eac44-fa13-40dd-ad21-105c76926eef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69a0c5d1-e9b7-4a3d-8b5a-2816fc6c5794', 'volume_name': 'volume-69a0c5d1-e9b7-4a3d-8b5a-2816fc6c5794', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:24:19 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-36272322-fd8e-45ee-b678-1845dc1fd9e6 tempest-ServersNegativeTestJSON-602261896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30423b48-14cd-4833-ba9b-3d0cb2663ddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:24:19 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-36272322-fd8e-45ee-b678-1845dc1fd9e6 tempest-ServersNegativeTestJSON-602261896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30423b48-14cd-4833-ba9b-3d0cb2663ddd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:24:19 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-36272322-fd8e-45ee-b678-1845dc1fd9e6 tempest-ServersNegativeTestJSON-602261896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (391ddff7-8bd3-4159-957e-2822d2769caa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:24:19 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-36272322-fd8e-45ee-b678-1845dc1fd9e6 tempest-ServersNegativeTestJSON-602261896 None] Volume 69a0c5d1-e9b7-4a3d-8b5a-2816fc6c5794: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69a0c5d1-e9b7-4a3d-8b5a-2816fc6c5794', 'volume_size': 1}
Nov 03 18:24:19 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-36272322-fd8e-45ee-b678-1845dc1fd9e6 tempest-ServersNegativeTestJSON-602261896 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:24:19 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-36272322-fd8e-45ee-b678-1845dc1fd9e6 tempest-ServersNegativeTestJSON-602261896 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:24:19 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-36272322-fd8e-45ee-b678-1845dc1fd9e6 tempest-ServersNegativeTestJSON-602261896 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:24:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1921373389',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69a0c5d1-e9b7-4a3d-8b5a-2816fc6c5794,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='563e25ea0e0a49f5a752f4cea33e6d7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:24:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:24:20Z,use_quota=True,user_id='b28ff1e7c9284c5499d8b0d7206a221b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:24:19 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-36272322-fd8e-45ee-b678-1845dc1fd9e6 tempest-ServersNegativeTestJSON-602261896 None] Creating volume 69a0c5d1-e9b7-4a3d-8b5a-2816fc6c5794 {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:24:19 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-36272322-fd8e-45ee-b678-1845dc1fd9e6 tempest-ServersNegativeTestJSON-602261896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:24:19 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-36272322-fd8e-45ee-b678-1845dc1fd9e6 tempest-ServersNegativeTestJSON-602261896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:24:19 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-36272322-fd8e-45ee-b678-1845dc1fd9e6 tempest-ServersNegativeTestJSON-602261896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:24:19 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-36272322-fd8e-45ee-b678-1845dc1fd9e6 tempest-ServersNegativeTestJSON-602261896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:24:19 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-36272322-fd8e-45ee-b678-1845dc1fd9e6 tempest-ServersNegativeTestJSON-602261896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:24:19 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-36272322-fd8e-45ee-b678-1845dc1fd9e6 tempest-ServersNegativeTestJSON-602261896 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:24:19 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-36272322-fd8e-45ee-b678-1845dc1fd9e6 tempest-ServersNegativeTestJSON-602261896 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:24:19 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-36272322-fd8e-45ee-b678-1845dc1fd9e6 tempest-ServersNegativeTestJSON-602261896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-69a0c5d1-e9b7-4a3d-8b5a-2816fc6c5794 1073741824 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:24:19 devstack sudo[89624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-69a0c5d1-e9b7-4a3d-8b5a-2816fc6c5794 1073741824
Nov 03 18:24:19 devstack sudo[89624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:24:20 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-608c6d30-8a43-4c91-a62c-c5dd6c60581b tempest-SnapshotsActionsTest-1556821077 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:24:20 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-608c6d30-8a43-4c91-a62c-c5dd6c60581b tempest-SnapshotsActionsTest-1556821077 None] Flow 'volume_create_manager' (ec40241e-1a34-4e8a-8fbf-5e7142a3738b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:24:20 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-608c6d30-8a43-4c91-a62c-c5dd6c60581b tempest-SnapshotsActionsTest-1556821077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6a9a0ea-63e2-4bd3-9200-2a87eda92e14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:24:20 devstack sudo[89624]: pam_unix(sudo:session): session closed for user root
Nov 03 18:24:20 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-36272322-fd8e-45ee-b678-1845dc1fd9e6 tempest-ServersNegativeTestJSON-602261896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-69a0c5d1-e9b7-4a3d-8b5a-2816fc6c5794 1073741824" returned: 0 in 0.604s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:24:20 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-608c6d30-8a43-4c91-a62c-c5dd6c60581b tempest-SnapshotsActionsTest-1556821077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6a9a0ea-63e2-4bd3-9200-2a87eda92e14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:24:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-112802250',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbf5a8e9-33bc-4c52-98f1-b5eb25f48039,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f806d85d5489467684df0c6544a56c00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:24:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:24:20Z,use_quota=True,user_id='fac8b54e96144b85b1d23083e5bfe2e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:24:20 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-608c6d30-8a43-4c91-a62c-c5dd6c60581b tempest-SnapshotsActionsTest-1556821077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41455682-a541-4d52-94f0-72411bf97be9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:24:20 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-608c6d30-8a43-4c91-a62c-c5dd6c60581b tempest-SnapshotsActionsTest-1556821077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41455682-a541-4d52-94f0-72411bf97be9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:24:20 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-608c6d30-8a43-4c91-a62c-c5dd6c60581b tempest-SnapshotsActionsTest-1556821077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bf3fa6e-3676-4dcd-8f55-fbc65cea1c81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:24:20 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-608c6d30-8a43-4c91-a62c-c5dd6c60581b tempest-SnapshotsActionsTest-1556821077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bf3fa6e-3676-4dcd-8f55-fbc65cea1c81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dbf5a8e9-33bc-4c52-98f1-b5eb25f48039', 'volume_name': 'volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:24:20 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-608c6d30-8a43-4c91-a62c-c5dd6c60581b tempest-SnapshotsActionsTest-1556821077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0edda88-3cbe-414d-87de-0adcebad196f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:24:20 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-608c6d30-8a43-4c91-a62c-c5dd6c60581b tempest-SnapshotsActionsTest-1556821077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0edda88-3cbe-414d-87de-0adcebad196f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:24:20 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-608c6d30-8a43-4c91-a62c-c5dd6c60581b tempest-SnapshotsActionsTest-1556821077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e64311b-030f-4650-b565-0b69b01f8ea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:24:20 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-608c6d30-8a43-4c91-a62c-c5dd6c60581b tempest-SnapshotsActionsTest-1556821077 None] Volume dbf5a8e9-33bc-4c52-98f1-b5eb25f48039: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039', 'volume_size': 1}
Nov 03 18:24:20 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-608c6d30-8a43-4c91-a62c-c5dd6c60581b tempest-SnapshotsActionsTest-1556821077 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:24:20 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-36272322-fd8e-45ee-b678-1845dc1fd9e6 tempest-ServersNegativeTestJSON-602261896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-69a0c5d1-e9b7-4a3d-8b5a-2816fc6c5794 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:24:20 devstack sudo[89630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-69a0c5d1-e9b7-4a3d-8b5a-2816fc6c5794
Nov 03 18:24:20 devstack sudo[89630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:24:20 devstack sudo[89630]: pam_unix(sudo:session): session closed for user root
Nov 03 18:24:20 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-36272322-fd8e-45ee-b678-1845dc1fd9e6 tempest-ServersNegativeTestJSON-602261896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-69a0c5d1-e9b7-4a3d-8b5a-2816fc6c5794" returned: 0 in 0.271s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:24:20 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-36272322-fd8e-45ee-b678-1845dc1fd9e6 tempest-ServersNegativeTestJSON-602261896 None] <== create_volume: return (1007ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:24:20 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-36272322-fd8e-45ee-b678-1845dc1fd9e6 tempest-ServersNegativeTestJSON-602261896 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.010s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:24:20 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-608c6d30-8a43-4c91-a62c-c5dd6c60581b tempest-SnapshotsActionsTest-1556821077 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.309s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:24:20 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-608c6d30-8a43-4c91-a62c-c5dd6c60581b tempest-SnapshotsActionsTest-1556821077 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:24:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-112802250',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbf5a8e9-33bc-4c52-98f1-b5eb25f48039,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f806d85d5489467684df0c6544a56c00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:24:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:24:20Z,use_quota=True,user_id='fac8b54e96144b85b1d23083e5bfe2e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:24:20 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-608c6d30-8a43-4c91-a62c-c5dd6c60581b tempest-SnapshotsActionsTest-1556821077 None] Creating volume dbf5a8e9-33bc-4c52-98f1-b5eb25f48039 {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:24:20 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-608c6d30-8a43-4c91-a62c-c5dd6c60581b tempest-SnapshotsActionsTest-1556821077 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:24:20 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-608c6d30-8a43-4c91-a62c-c5dd6c60581b tempest-SnapshotsActionsTest-1556821077 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:24:20 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-608c6d30-8a43-4c91-a62c-c5dd6c60581b tempest-SnapshotsActionsTest-1556821077 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:24:20 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-608c6d30-8a43-4c91-a62c-c5dd6c60581b tempest-SnapshotsActionsTest-1556821077 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:24:20 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-608c6d30-8a43-4c91-a62c-c5dd6c60581b tempest-SnapshotsActionsTest-1556821077 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:24:20 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-608c6d30-8a43-4c91-a62c-c5dd6c60581b tempest-SnapshotsActionsTest-1556821077 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:24:20 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-608c6d30-8a43-4c91-a62c-c5dd6c60581b tempest-SnapshotsActionsTest-1556821077 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:24:20 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-608c6d30-8a43-4c91-a62c-c5dd6c60581b tempest-SnapshotsActionsTest-1556821077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039 1073741824 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:24:20 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-36272322-fd8e-45ee-b678-1845dc1fd9e6 tempest-ServersNegativeTestJSON-602261896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (391ddff7-8bd3-4159-957e-2822d2769caa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69a0c5d1-e9b7-4a3d-8b5a-2816fc6c5794', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:24:20 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-36272322-fd8e-45ee-b678-1845dc1fd9e6 tempest-ServersNegativeTestJSON-602261896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (234a0abb-e5a0-4f65-a4e1-7e4c0e8bf378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:24:20 devstack sudo[89633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039 1073741824
Nov 03 18:24:20 devstack sudo[89633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:24:20 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-36272322-fd8e-45ee-b678-1845dc1fd9e6 tempest-ServersNegativeTestJSON-602261896 None] Volume volume-69a0c5d1-e9b7-4a3d-8b5a-2816fc6c5794 (69a0c5d1-e9b7-4a3d-8b5a-2816fc6c5794): created successfully
Nov 03 18:24:20 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-36272322-fd8e-45ee-b678-1845dc1fd9e6 tempest-ServersNegativeTestJSON-602261896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (234a0abb-e5a0-4f65-a4e1-7e4c0e8bf378) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:24:21 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-36272322-fd8e-45ee-b678-1845dc1fd9e6 tempest-ServersNegativeTestJSON-602261896 None] Flow 'volume_create_manager' (c270829d-5f85-41f4-819e-b4af66d9ca16) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:24:21 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-36272322-fd8e-45ee-b678-1845dc1fd9e6 tempest-ServersNegativeTestJSON-602261896 None] Created volume successfully.
Nov 03 18:24:21 devstack sudo[89633]: pam_unix(sudo:session): session closed for user root
Nov 03 18:24:21 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-608c6d30-8a43-4c91-a62c-c5dd6c60581b tempest-SnapshotsActionsTest-1556821077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039 1073741824" returned: 0 in 0.704s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:24:21 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-608c6d30-8a43-4c91-a62c-c5dd6c60581b tempest-SnapshotsActionsTest-1556821077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:24:21 devstack sudo[89639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039
Nov 03 18:24:21 devstack sudo[89639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:24:22 devstack sudo[89639]: pam_unix(sudo:session): session closed for user root
Nov 03 18:24:22 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-608c6d30-8a43-4c91-a62c-c5dd6c60581b tempest-SnapshotsActionsTest-1556821077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039" returned: 0 in 0.375s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:24:22 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-608c6d30-8a43-4c91-a62c-c5dd6c60581b tempest-SnapshotsActionsTest-1556821077 None] <== create_volume: return (1140ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:24:22 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-608c6d30-8a43-4c91-a62c-c5dd6c60581b tempest-SnapshotsActionsTest-1556821077 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.144s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:24:22 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-608c6d30-8a43-4c91-a62c-c5dd6c60581b tempest-SnapshotsActionsTest-1556821077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e64311b-030f-4650-b565-0b69b01f8ea8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:24:22 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-608c6d30-8a43-4c91-a62c-c5dd6c60581b tempest-SnapshotsActionsTest-1556821077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96504eb2-66f5-4dbb-ab94-c8e5c903cec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:24:22 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-608c6d30-8a43-4c91-a62c-c5dd6c60581b tempest-SnapshotsActionsTest-1556821077 None] Volume volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039 (dbf5a8e9-33bc-4c52-98f1-b5eb25f48039): created successfully
Nov 03 18:24:22 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-608c6d30-8a43-4c91-a62c-c5dd6c60581b tempest-SnapshotsActionsTest-1556821077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96504eb2-66f5-4dbb-ab94-c8e5c903cec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:24:22 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-608c6d30-8a43-4c91-a62c-c5dd6c60581b tempest-SnapshotsActionsTest-1556821077 None] Flow 'volume_create_manager' (ec40241e-1a34-4e8a-8fbf-5e7142a3738b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:24:22 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-608c6d30-8a43-4c91-a62c-c5dd6c60581b tempest-SnapshotsActionsTest-1556821077 None] Created volume successfully.
Nov 03 18:24:22 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-37b0364e-859f-4afd-ad86-c9931a2d785d tempest-SnapshotsActionsTest-1556821077 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:24:22 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-37b0364e-859f-4afd-ad86-c9931a2d785d tempest-SnapshotsActionsTest-1556821077 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:24:22 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-37b0364e-859f-4afd-ad86-c9931a2d785d tempest-SnapshotsActionsTest-1556821077 None] Creating offline snapshot a43bab75-892a-4d77-bb53-3d89af613f4c of volume dbf5a8e9-33bc-4c52-98f1-b5eb25f48039 {{(pid=86120) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 18:24:22 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bef0857-9164-46a5-9834-95d3a31a2845]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:24:22 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-37b0364e-859f-4afd-ad86-c9931a2d785d tempest-SnapshotsActionsTest-1556821077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:24:23 devstack sudo[89643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039
Nov 03 18:24:23 devstack sudo[89643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:24:23 devstack sudo[89643]: pam_unix(sudo:session): session closed for user root
Nov 03 18:24:23 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-37b0364e-859f-4afd-ad86-c9931a2d785d tempest-SnapshotsActionsTest-1556821077 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039" returned: 0 in 0.533s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:24:23 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-37b0364e-859f-4afd-ad86-c9931a2d785d tempest-SnapshotsActionsTest-1556821077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039.a43bab75-892a-4d77-bb53-3d89af613f4c 1G {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:24:23 devstack sudo[89648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039.a43bab75-892a-4d77-bb53-3d89af613f4c 1G
Nov 03 18:24:23 devstack sudo[89648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:24:23 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0cababc-4198-43e8-91f6-2a21d3368263 tempest-ServersNegativeTestJSON-602261896 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:24:23 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-f0cababc-4198-43e8-91f6-2a21d3368263 tempest-ServersNegativeTestJSON-602261896 None] Flow 'volume_create_manager' (ab1e7742-19cb-4b09-9334-78376f362280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:24:23 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-f0cababc-4198-43e8-91f6-2a21d3368263 tempest-ServersNegativeTestJSON-602261896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e66aaa7c-a23a-4343-8264-21101ff6f185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:24:24 devstack sudo[89648]: pam_unix(sudo:session): session closed for user root
Nov 03 18:24:24 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-37b0364e-859f-4afd-ad86-c9931a2d785d tempest-SnapshotsActionsTest-1556821077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039.a43bab75-892a-4d77-bb53-3d89af613f4c 1G" returned: 0 in 0.525s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:24:24 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-37b0364e-859f-4afd-ad86-c9931a2d785d tempest-SnapshotsActionsTest-1556821077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039 -F qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039.a43bab75-892a-4d77-bb53-3d89af613f4c {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:24:24 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-f0cababc-4198-43e8-91f6-2a21d3368263 tempest-ServersNegativeTestJSON-602261896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e66aaa7c-a23a-4343-8264-21101ff6f185) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:24:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2138629762',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=165ea996-26b7-49cd-9f34-cf841e21725f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='563e25ea0e0a49f5a752f4cea33e6d7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:24:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:24:24Z,use_quota=True,user_id='b28ff1e7c9284c5499d8b0d7206a221b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:24:24 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-f0cababc-4198-43e8-91f6-2a21d3368263 tempest-ServersNegativeTestJSON-602261896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a3db95c-e801-479f-918c-5540aa1664bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:24:24 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-f0cababc-4198-43e8-91f6-2a21d3368263 tempest-ServersNegativeTestJSON-602261896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a3db95c-e801-479f-918c-5540aa1664bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:24:24 devstack sudo[89654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039 -F qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039.a43bab75-892a-4d77-bb53-3d89af613f4c
Nov 03 18:24:24 devstack sudo[89654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:24:24 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-f0cababc-4198-43e8-91f6-2a21d3368263 tempest-ServersNegativeTestJSON-602261896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09181f24-ca01-4477-ab96-1202dbd396ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:24:24 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-f0cababc-4198-43e8-91f6-2a21d3368263 tempest-ServersNegativeTestJSON-602261896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09181f24-ca01-4477-ab96-1202dbd396ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '165ea996-26b7-49cd-9f34-cf841e21725f', 'volume_name': 'volume-165ea996-26b7-49cd-9f34-cf841e21725f', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:24:24 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-f0cababc-4198-43e8-91f6-2a21d3368263 tempest-ServersNegativeTestJSON-602261896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e22a591-79c4-496d-80ed-913a4d0f037d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:24:24 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-f0cababc-4198-43e8-91f6-2a21d3368263 tempest-ServersNegativeTestJSON-602261896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e22a591-79c4-496d-80ed-913a4d0f037d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:24:24 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-f0cababc-4198-43e8-91f6-2a21d3368263 tempest-ServersNegativeTestJSON-602261896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33ba4c8d-7f7b-406c-89ac-bd9850753f23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:24:24 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-f0cababc-4198-43e8-91f6-2a21d3368263 tempest-ServersNegativeTestJSON-602261896 None] Volume 165ea996-26b7-49cd-9f34-cf841e21725f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-165ea996-26b7-49cd-9f34-cf841e21725f', 'volume_size': 1}
Nov 03 18:24:24 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-f0cababc-4198-43e8-91f6-2a21d3368263 tempest-ServersNegativeTestJSON-602261896 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:24:24 devstack sudo[89654]: pam_unix(sudo:session): session closed for user root
Nov 03 18:24:24 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-37b0364e-859f-4afd-ad86-c9931a2d785d tempest-SnapshotsActionsTest-1556821077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039 -F qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039.a43bab75-892a-4d77-bb53-3d89af613f4c" returned: 0 in 0.333s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:24:24 devstack cinder-volume[86120]: WARNING cinder.volume.drivers.remotefs [None req-37b0364e-859f-4afd-ad86-c9931a2d785d tempest-SnapshotsActionsTest-1556821077 None] /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039.a43bab75-892a-4d77-bb53-3d89af613f4c is being set with open permissions: ugo+rw
Nov 03 18:24:24 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-37b0364e-859f-4afd-ad86-c9931a2d785d tempest-SnapshotsActionsTest-1556821077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039.a43bab75-892a-4d77-bb53-3d89af613f4c {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:24:24 devstack sudo[89660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039.a43bab75-892a-4d77-bb53-3d89af613f4c
Nov 03 18:24:24 devstack sudo[89660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:24:24 devstack sudo[89660]: pam_unix(sudo:session): session closed for user root
Nov 03 18:24:24 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-37b0364e-859f-4afd-ad86-c9931a2d785d tempest-SnapshotsActionsTest-1556821077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039.a43bab75-892a-4d77-bb53-3d89af613f4c" returned: 0 in 0.295s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:24:24 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-37b0364e-859f-4afd-ad86-c9931a2d785d tempest-SnapshotsActionsTest-1556821077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039.info {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:24:24 devstack sudo[89663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039.info
Nov 03 18:24:24 devstack sudo[89663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:24:24 devstack sudo[89663]: pam_unix(sudo:session): session closed for user root
Nov 03 18:24:24 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-37b0364e-859f-4afd-ad86-c9931a2d785d tempest-SnapshotsActionsTest-1556821077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039.info" returned: 0 in 0.303s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:24:24 devstack cinder-volume[86120]: WARNING cinder.volume.drivers.remotefs [None req-37b0364e-859f-4afd-ad86-c9931a2d785d tempest-SnapshotsActionsTest-1556821077 None] /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039.info is being set with open permissions: ugo+rw
Nov 03 18:24:24 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-37b0364e-859f-4afd-ad86-c9931a2d785d tempest-SnapshotsActionsTest-1556821077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039.info {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:24:25 devstack sudo[89666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039.info
Nov 03 18:24:25 devstack sudo[89666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:24:25 devstack sudo[89666]: pam_unix(sudo:session): session closed for user root
Nov 03 18:24:25 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-37b0364e-859f-4afd-ad86-c9931a2d785d tempest-SnapshotsActionsTest-1556821077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039.info" returned: 0 in 0.249s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:24:25 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-37b0364e-859f-4afd-ad86-c9931a2d785d tempest-SnapshotsActionsTest-1556821077 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.375s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:24:25 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-f0cababc-4198-43e8-91f6-2a21d3368263 tempest-ServersNegativeTestJSON-602261896 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.189s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:24:25 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-f0cababc-4198-43e8-91f6-2a21d3368263 tempest-ServersNegativeTestJSON-602261896 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:24:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2138629762',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=165ea996-26b7-49cd-9f34-cf841e21725f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='563e25ea0e0a49f5a752f4cea33e6d7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:24:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:24:24Z,use_quota=True,user_id='b28ff1e7c9284c5499d8b0d7206a221b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:24:25 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-f0cababc-4198-43e8-91f6-2a21d3368263 tempest-ServersNegativeTestJSON-602261896 None] Creating volume 165ea996-26b7-49cd-9f34-cf841e21725f {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:24:25 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-f0cababc-4198-43e8-91f6-2a21d3368263 tempest-ServersNegativeTestJSON-602261896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:24:25 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-f0cababc-4198-43e8-91f6-2a21d3368263 tempest-ServersNegativeTestJSON-602261896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:24:25 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-f0cababc-4198-43e8-91f6-2a21d3368263 tempest-ServersNegativeTestJSON-602261896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:24:25 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-f0cababc-4198-43e8-91f6-2a21d3368263 tempest-ServersNegativeTestJSON-602261896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:24:25 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-f0cababc-4198-43e8-91f6-2a21d3368263 tempest-ServersNegativeTestJSON-602261896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:24:25 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-f0cababc-4198-43e8-91f6-2a21d3368263 tempest-ServersNegativeTestJSON-602261896 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:24:25 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-f0cababc-4198-43e8-91f6-2a21d3368263 tempest-ServersNegativeTestJSON-602261896 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:24:25 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-f0cababc-4198-43e8-91f6-2a21d3368263 tempest-ServersNegativeTestJSON-602261896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-165ea996-26b7-49cd-9f34-cf841e21725f 1073741824 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:24:25 devstack sudo[89669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-165ea996-26b7-49cd-9f34-cf841e21725f 1073741824
Nov 03 18:24:25 devstack sudo[89669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:24:25 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-37b0364e-859f-4afd-ad86-c9931a2d785d tempest-SnapshotsActionsTest-1556821077 None] Create snapshot completed successfully
Nov 03 18:24:25 devstack sudo[89669]: pam_unix(sudo:session): session closed for user root
Nov 03 18:24:25 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-f0cababc-4198-43e8-91f6-2a21d3368263 tempest-ServersNegativeTestJSON-602261896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-165ea996-26b7-49cd-9f34-cf841e21725f 1073741824" returned: 0 in 0.482s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:24:25 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-f0cababc-4198-43e8-91f6-2a21d3368263 tempest-ServersNegativeTestJSON-602261896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-165ea996-26b7-49cd-9f34-cf841e21725f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:24:25 devstack sudo[89674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-165ea996-26b7-49cd-9f34-cf841e21725f
Nov 03 18:24:25 devstack sudo[89674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:24:26 devstack sudo[89674]: pam_unix(sudo:session): session closed for user root
Nov 03 18:24:26 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-f0cababc-4198-43e8-91f6-2a21d3368263 tempest-ServersNegativeTestJSON-602261896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-165ea996-26b7-49cd-9f34-cf841e21725f" returned: 0 in 0.287s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:24:26 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-f0cababc-4198-43e8-91f6-2a21d3368263 tempest-ServersNegativeTestJSON-602261896 None] <== create_volume: return (819ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:24:26 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-f0cababc-4198-43e8-91f6-2a21d3368263 tempest-ServersNegativeTestJSON-602261896 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.824s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:24:26 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-f0cababc-4198-43e8-91f6-2a21d3368263 tempest-ServersNegativeTestJSON-602261896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33ba4c8d-7f7b-406c-89ac-bd9850753f23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-165ea996-26b7-49cd-9f34-cf841e21725f', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:24:26 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-f0cababc-4198-43e8-91f6-2a21d3368263 tempest-ServersNegativeTestJSON-602261896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76b0095c-bda7-4380-be2a-710925072a7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:24:26 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-f0cababc-4198-43e8-91f6-2a21d3368263 tempest-ServersNegativeTestJSON-602261896 None] Volume volume-165ea996-26b7-49cd-9f34-cf841e21725f (165ea996-26b7-49cd-9f34-cf841e21725f): created successfully
Nov 03 18:24:26 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-f0cababc-4198-43e8-91f6-2a21d3368263 tempest-ServersNegativeTestJSON-602261896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76b0095c-bda7-4380-be2a-710925072a7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:24:26 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-f0cababc-4198-43e8-91f6-2a21d3368263 tempest-ServersNegativeTestJSON-602261896 None] Flow 'volume_create_manager' (ab1e7742-19cb-4b09-9334-78376f362280) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:24:26 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-f0cababc-4198-43e8-91f6-2a21d3368263 tempest-ServersNegativeTestJSON-602261896 None] Created volume successfully.
Nov 03 18:24:26 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-24602871-e6a5-484d-90be-8fd3e7373c97 tempest-SnapshotsActionsTest-1556821077 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:24:26 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-24602871-e6a5-484d-90be-8fd3e7373c97 tempest-SnapshotsActionsTest-1556821077 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:24:26 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-24602871-e6a5-484d-90be-8fd3e7373c97 tempest-SnapshotsActionsTest-1556821077 None] Creating offline snapshot 12aa70d2-c742-4b85-90df-a5056ffdad4d of volume dbf5a8e9-33bc-4c52-98f1-b5eb25f48039 {{(pid=86120) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 18:24:26 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1a20e46-1440-4659-befe-335e21e05128]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:24:26 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-24602871-e6a5-484d-90be-8fd3e7373c97 tempest-SnapshotsActionsTest-1556821077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039.a43bab75-892a-4d77-bb53-3d89af613f4c {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:24:27 devstack sudo[89678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039.a43bab75-892a-4d77-bb53-3d89af613f4c
Nov 03 18:24:27 devstack sudo[89678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:24:27 devstack sudo[89678]: pam_unix(sudo:session): session closed for user root
Nov 03 18:24:27 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-24602871-e6a5-484d-90be-8fd3e7373c97 tempest-SnapshotsActionsTest-1556821077 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039.a43bab75-892a-4d77-bb53-3d89af613f4c" returned: 0 in 0.596s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:24:27 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-24602871-e6a5-484d-90be-8fd3e7373c97 tempest-SnapshotsActionsTest-1556821077 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86120) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 18:24:27 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-24602871-e6a5-484d-90be-8fd3e7373c97 tempest-SnapshotsActionsTest-1556821077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039.a43bab75-892a-4d77-bb53-3d89af613f4c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039.12aa70d2-c742-4b85-90df-a5056ffdad4d 1G {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:24:27 devstack sudo[89684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039.a43bab75-892a-4d77-bb53-3d89af613f4c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039.12aa70d2-c742-4b85-90df-a5056ffdad4d 1G
Nov 03 18:24:27 devstack sudo[89684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:24:27 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-97b523a4-2c95-4693-b20f-31e9aa4cccd3 tempest-ServersNegativeTestJSON-602261896 None] Acquiring lock "cinder-165ea996-26b7-49cd-9f34-cf841e21725f-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:24:27 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-97b523a4-2c95-4693-b20f-31e9aa4cccd3 tempest-ServersNegativeTestJSON-602261896 None] Lock "cinder-165ea996-26b7-49cd-9f34-cf841e21725f-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:24:27 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-97b523a4-2c95-4693-b20f-31e9aa4cccd3 tempest-ServersNegativeTestJSON-602261896 None] Acquiring lock "cinder-quobyte-165ea996-26b7-49cd-9f34-cf841e21725f" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:24:27 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-97b523a4-2c95-4693-b20f-31e9aa4cccd3 tempest-ServersNegativeTestJSON-602261896 None] Lock "cinder-quobyte-165ea996-26b7-49cd-9f34-cf841e21725f" acquired by "delete_volume" :: waited 0.029s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:24:27 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef6b0cc3-49d7-40eb-8cc2-a5a17e2aef11]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:24:27 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-97b523a4-2c95-4693-b20f-31e9aa4cccd3 tempest-ServersNegativeTestJSON-602261896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-165ea996-26b7-49cd-9f34-cf841e21725f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:24:28 devstack sudo[89687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-165ea996-26b7-49cd-9f34-cf841e21725f
Nov 03 18:24:28 devstack sudo[89687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:24:28 devstack sudo[89684]: pam_unix(sudo:session): session closed for user root
Nov 03 18:24:28 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-24602871-e6a5-484d-90be-8fd3e7373c97 tempest-SnapshotsActionsTest-1556821077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039.a43bab75-892a-4d77-bb53-3d89af613f4c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039.12aa70d2-c742-4b85-90df-a5056ffdad4d 1G" returned: 0 in 0.783s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:24:28 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-24602871-e6a5-484d-90be-8fd3e7373c97 tempest-SnapshotsActionsTest-1556821077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039.a43bab75-892a-4d77-bb53-3d89af613f4c -F qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039.12aa70d2-c742-4b85-90df-a5056ffdad4d {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:24:28 devstack sudo[89723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039.a43bab75-892a-4d77-bb53-3d89af613f4c -F qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039.12aa70d2-c742-4b85-90df-a5056ffdad4d
Nov 03 18:24:28 devstack sudo[89723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:24:28 devstack sudo[89687]: pam_unix(sudo:session): session closed for user root
Nov 03 18:24:28 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-97b523a4-2c95-4693-b20f-31e9aa4cccd3 tempest-ServersNegativeTestJSON-602261896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-165ea996-26b7-49cd-9f34-cf841e21725f" returned: 0 in 0.544s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:24:28 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-97b523a4-2c95-4693-b20f-31e9aa4cccd3 tempest-ServersNegativeTestJSON-602261896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-165ea996-26b7-49cd-9f34-cf841e21725f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:24:28 devstack sudo[89725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-165ea996-26b7-49cd-9f34-cf841e21725f
Nov 03 18:24:28 devstack sudo[89725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:24:28 devstack sudo[89723]: pam_unix(sudo:session): session closed for user root
Nov 03 18:24:28 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-24602871-e6a5-484d-90be-8fd3e7373c97 tempest-SnapshotsActionsTest-1556821077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039.a43bab75-892a-4d77-bb53-3d89af613f4c -F qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039.12aa70d2-c742-4b85-90df-a5056ffdad4d" returned: 0 in 0.409s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:24:28 devstack cinder-volume[86120]: WARNING cinder.volume.drivers.remotefs [None req-24602871-e6a5-484d-90be-8fd3e7373c97 tempest-SnapshotsActionsTest-1556821077 None] /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039.12aa70d2-c742-4b85-90df-a5056ffdad4d is being set with open permissions: ugo+rw
Nov 03 18:24:28 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-24602871-e6a5-484d-90be-8fd3e7373c97 tempest-SnapshotsActionsTest-1556821077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039.12aa70d2-c742-4b85-90df-a5056ffdad4d {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:24:28 devstack sudo[89725]: pam_unix(sudo:session): session closed for user root
Nov 03 18:24:28 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-97b523a4-2c95-4693-b20f-31e9aa4cccd3 tempest-ServersNegativeTestJSON-602261896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-165ea996-26b7-49cd-9f34-cf841e21725f" returned: 0 in 0.360s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:24:28 devstack sudo[89732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039.12aa70d2-c742-4b85-90df-a5056ffdad4d
Nov 03 18:24:28 devstack sudo[89732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:24:28 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-97b523a4-2c95-4693-b20f-31e9aa4cccd3 tempest-ServersNegativeTestJSON-602261896 None] Lock "cinder-quobyte-165ea996-26b7-49cd-9f34-cf841e21725f" released by "delete_volume" :: held 0.991s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:24:28 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-97b523a4-2c95-4693-b20f-31e9aa4cccd3 tempest-ServersNegativeTestJSON-602261896 None] Created reservations ['c65c4010-9220-42c9-aa50-de139e01ace9', 'abd53910-d7f8-47e4-9163-8275ac3850c9', '3f8107cc-7451-4a1a-9331-878a0fd9e4b2', '87575097-37dd-409f-93b1-76b15aa0eab7'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:24:29 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-97b523a4-2c95-4693-b20f-31e9aa4cccd3 tempest-ServersNegativeTestJSON-602261896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:24:29 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-97b523a4-2c95-4693-b20f-31e9aa4cccd3 tempest-ServersNegativeTestJSON-602261896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:24:29 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-97b523a4-2c95-4693-b20f-31e9aa4cccd3 tempest-ServersNegativeTestJSON-602261896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:24:29 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-97b523a4-2c95-4693-b20f-31e9aa4cccd3 tempest-ServersNegativeTestJSON-602261896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:24:29 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-97b523a4-2c95-4693-b20f-31e9aa4cccd3 tempest-ServersNegativeTestJSON-602261896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:24:29 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-97b523a4-2c95-4693-b20f-31e9aa4cccd3 tempest-ServersNegativeTestJSON-602261896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:24:29 devstack sudo[89734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:24:29 devstack sudo[89734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:24:29 devstack sudo[89732]: pam_unix(sudo:session): session closed for user root
Nov 03 18:24:29 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-24602871-e6a5-484d-90be-8fd3e7373c97 tempest-SnapshotsActionsTest-1556821077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039.12aa70d2-c742-4b85-90df-a5056ffdad4d" returned: 0 in 0.399s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:24:29 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-24602871-e6a5-484d-90be-8fd3e7373c97 tempest-SnapshotsActionsTest-1556821077 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.348s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:24:29 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-24602871-e6a5-484d-90be-8fd3e7373c97 tempest-SnapshotsActionsTest-1556821077 None] Create snapshot completed successfully
Nov 03 18:24:29 devstack sudo[89734]: pam_unix(sudo:session): session closed for user root
Nov 03 18:24:29 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-97b523a4-2c95-4693-b20f-31e9aa4cccd3 tempest-ServersNegativeTestJSON-602261896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.258s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:24:29 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-97b523a4-2c95-4693-b20f-31e9aa4cccd3 tempest-ServersNegativeTestJSON-602261896 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:24:29 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-97b523a4-2c95-4693-b20f-31e9aa4cccd3 tempest-ServersNegativeTestJSON-602261896 None] Deleted volume successfully.
Nov 03 18:24:29 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-97b523a4-2c95-4693-b20f-31e9aa4cccd3 tempest-ServersNegativeTestJSON-602261896 None] Lock "cinder-165ea996-26b7-49cd-9f34-cf841e21725f-delete_volume" released by "delete_volume" :: held 1.645s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:24:29 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-8e6c5ae1-6d40-4cd2-960b-f63a736b0fd0 tempest-ServersNegativeTestJSON-602261896 None] Acquiring lock "cinder-69a0c5d1-e9b7-4a3d-8b5a-2816fc6c5794-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:24:29 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-8e6c5ae1-6d40-4cd2-960b-f63a736b0fd0 tempest-ServersNegativeTestJSON-602261896 None] Lock "cinder-69a0c5d1-e9b7-4a3d-8b5a-2816fc6c5794-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:24:29 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-8e6c5ae1-6d40-4cd2-960b-f63a736b0fd0 tempest-ServersNegativeTestJSON-602261896 None] Acquiring lock "cinder-quobyte-69a0c5d1-e9b7-4a3d-8b5a-2816fc6c5794" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:24:29 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-8e6c5ae1-6d40-4cd2-960b-f63a736b0fd0 tempest-ServersNegativeTestJSON-602261896 None] Lock "cinder-quobyte-69a0c5d1-e9b7-4a3d-8b5a-2816fc6c5794" acquired by "delete_volume" :: waited 0.017s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:24:29 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[00bbe7e0-f918-4eea-9024-f8cfe19a5b06]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:24:30 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-8e6c5ae1-6d40-4cd2-960b-f63a736b0fd0 tempest-ServersNegativeTestJSON-602261896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-69a0c5d1-e9b7-4a3d-8b5a-2816fc6c5794 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:24:30 devstack sudo[89738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-69a0c5d1-e9b7-4a3d-8b5a-2816fc6c5794
Nov 03 18:24:30 devstack sudo[89738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:24:30 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-9c508607-90de-4c47-a606-e2764ea596de tempest-SnapshotsActionsTest-237430834 None] Acquiring lock "cinder-12aa70d2-c742-4b85-90df-a5056ffdad4d-delete_snapshot" by "delete_snapshot" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:24:30 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-9c508607-90de-4c47-a606-e2764ea596de tempest-SnapshotsActionsTest-237430834 None] Lock "cinder-12aa70d2-c742-4b85-90df-a5056ffdad4d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:24:30 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-9c508607-90de-4c47-a606-e2764ea596de tempest-SnapshotsActionsTest-237430834 None] Acquiring lock "cinder-quobyte-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039" by "delete_snapshot" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:24:30 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-9c508607-90de-4c47-a606-e2764ea596de tempest-SnapshotsActionsTest-237430834 None] Lock "cinder-quobyte-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:24:30 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-9c508607-90de-4c47-a606-e2764ea596de tempest-SnapshotsActionsTest-237430834 None] Acquiring lock "cinder-quobyte-12aa70d2-c742-4b85-90df-a5056ffdad4d" by "_delete_snapshot" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:24:30 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-9c508607-90de-4c47-a606-e2764ea596de tempest-SnapshotsActionsTest-237430834 None] Lock "cinder-quobyte-12aa70d2-c742-4b85-90df-a5056ffdad4d" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:24:30 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-9c508607-90de-4c47-a606-e2764ea596de tempest-SnapshotsActionsTest-237430834 None] Deleting offline snapshot 12aa70d2-c742-4b85-90df-a5056ffdad4d of volume dbf5a8e9-33bc-4c52-98f1-b5eb25f48039 {{(pid=86120) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 18:24:30 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-9c508607-90de-4c47-a606-e2764ea596de tempest-SnapshotsActionsTest-237430834 None] snapshot_file for this snap is: volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039.12aa70d2-c742-4b85-90df-a5056ffdad4d {{(pid=86120) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 18:24:30 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[a940e3a6-0fdb-43d3-bc5f-d77e45d6c94b]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:24:30 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-9c508607-90de-4c47-a606-e2764ea596de tempest-SnapshotsActionsTest-237430834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039.12aa70d2-c742-4b85-90df-a5056ffdad4d {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:24:30 devstack sudo[89738]: pam_unix(sudo:session): session closed for user root
Nov 03 18:24:30 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-8e6c5ae1-6d40-4cd2-960b-f63a736b0fd0 tempest-ServersNegativeTestJSON-602261896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-69a0c5d1-e9b7-4a3d-8b5a-2816fc6c5794" returned: 0 in 0.443s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:24:30 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-8e6c5ae1-6d40-4cd2-960b-f63a736b0fd0 tempest-ServersNegativeTestJSON-602261896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-69a0c5d1-e9b7-4a3d-8b5a-2816fc6c5794 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:24:30 devstack sudo[89745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-69a0c5d1-e9b7-4a3d-8b5a-2816fc6c5794
Nov 03 18:24:30 devstack sudo[89745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:24:30 devstack sudo[89743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039.12aa70d2-c742-4b85-90df-a5056ffdad4d
Nov 03 18:24:30 devstack sudo[89743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:24:30 devstack sudo[89745]: pam_unix(sudo:session): session closed for user root
Nov 03 18:24:30 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-8e6c5ae1-6d40-4cd2-960b-f63a736b0fd0 tempest-ServersNegativeTestJSON-602261896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-69a0c5d1-e9b7-4a3d-8b5a-2816fc6c5794" returned: 0 in 0.264s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:24:30 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-8e6c5ae1-6d40-4cd2-960b-f63a736b0fd0 tempest-ServersNegativeTestJSON-602261896 None] Lock "cinder-quobyte-69a0c5d1-e9b7-4a3d-8b5a-2816fc6c5794" released by "delete_volume" :: held 0.763s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:24:30 devstack sudo[89743]: pam_unix(sudo:session): session closed for user root
Nov 03 18:24:30 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-9c508607-90de-4c47-a606-e2764ea596de tempest-SnapshotsActionsTest-237430834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039.12aa70d2-c742-4b85-90df-a5056ffdad4d" returned: 0 in 0.378s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:24:30 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-9c508607-90de-4c47-a606-e2764ea596de tempest-SnapshotsActionsTest-237430834 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86120) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 18:24:30 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ccd0773-0eab-4a18-a9ae-8dac1d0e2b63]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:24:30 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-9c508607-90de-4c47-a606-e2764ea596de tempest-SnapshotsActionsTest-237430834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039.a43bab75-892a-4d77-bb53-3d89af613f4c {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:24:30 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-8e6c5ae1-6d40-4cd2-960b-f63a736b0fd0 tempest-ServersNegativeTestJSON-602261896 None] Created reservations ['5c686d5e-2f06-45e9-ad17-4fffdc8850ab', 'd2e44edb-d056-4de2-8515-8a9031bb930d', 'cf859829-8c9e-41c8-9ef9-c4b47bd73df0', '807595cd-0d43-4f7c-b058-89c3d9b09d53'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:24:30 devstack sudo[89752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039.a43bab75-892a-4d77-bb53-3d89af613f4c
Nov 03 18:24:30 devstack sudo[89752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:24:30 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-8e6c5ae1-6d40-4cd2-960b-f63a736b0fd0 tempest-ServersNegativeTestJSON-602261896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:24:30 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-8e6c5ae1-6d40-4cd2-960b-f63a736b0fd0 tempest-ServersNegativeTestJSON-602261896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:24:30 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-8e6c5ae1-6d40-4cd2-960b-f63a736b0fd0 tempest-ServersNegativeTestJSON-602261896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:24:30 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-8e6c5ae1-6d40-4cd2-960b-f63a736b0fd0 tempest-ServersNegativeTestJSON-602261896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:24:30 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-8e6c5ae1-6d40-4cd2-960b-f63a736b0fd0 tempest-ServersNegativeTestJSON-602261896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:24:30 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-8e6c5ae1-6d40-4cd2-960b-f63a736b0fd0 tempest-ServersNegativeTestJSON-602261896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:24:30 devstack sudo[89754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:24:30 devstack sudo[89754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:24:31 devstack sudo[89754]: pam_unix(sudo:session): session closed for user root
Nov 03 18:24:31 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-8e6c5ae1-6d40-4cd2-960b-f63a736b0fd0 tempest-ServersNegativeTestJSON-602261896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.263s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:24:31 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-8e6c5ae1-6d40-4cd2-960b-f63a736b0fd0 tempest-ServersNegativeTestJSON-602261896 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:24:31 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-8e6c5ae1-6d40-4cd2-960b-f63a736b0fd0 tempest-ServersNegativeTestJSON-602261896 None] Deleted volume successfully.
Nov 03 18:24:31 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-8e6c5ae1-6d40-4cd2-960b-f63a736b0fd0 tempest-ServersNegativeTestJSON-602261896 None] Lock "cinder-69a0c5d1-e9b7-4a3d-8b5a-2816fc6c5794-delete_volume" released by "delete_volume" :: held 1.307s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:24:31 devstack sudo[89752]: pam_unix(sudo:session): session closed for user root
Nov 03 18:24:31 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-9c508607-90de-4c47-a606-e2764ea596de tempest-SnapshotsActionsTest-237430834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039.a43bab75-892a-4d77-bb53-3d89af613f4c" returned: 0 in 0.449s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:24:31 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-9c508607-90de-4c47-a606-e2764ea596de tempest-SnapshotsActionsTest-237430834 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86120) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 18:24:31 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-9c508607-90de-4c47-a606-e2764ea596de tempest-SnapshotsActionsTest-237430834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039.12aa70d2-c742-4b85-90df-a5056ffdad4d {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:24:31 devstack sudo[89760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039.12aa70d2-c742-4b85-90df-a5056ffdad4d
Nov 03 18:24:31 devstack sudo[89760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:24:31 devstack sudo[89760]: pam_unix(sudo:session): session closed for user root
Nov 03 18:24:31 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-9c508607-90de-4c47-a606-e2764ea596de tempest-SnapshotsActionsTest-237430834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039.12aa70d2-c742-4b85-90df-a5056ffdad4d" returned: 0 in 0.482s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:24:31 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-9c508607-90de-4c47-a606-e2764ea596de tempest-SnapshotsActionsTest-237430834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039.12aa70d2-c742-4b85-90df-a5056ffdad4d {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:24:31 devstack sudo[89772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039.12aa70d2-c742-4b85-90df-a5056ffdad4d
Nov 03 18:24:31 devstack sudo[89772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:24:32 devstack sudo[89772]: pam_unix(sudo:session): session closed for user root
Nov 03 18:24:32 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-9c508607-90de-4c47-a606-e2764ea596de tempest-SnapshotsActionsTest-237430834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039.12aa70d2-c742-4b85-90df-a5056ffdad4d" returned: 0 in 0.335s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:24:32 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-9c508607-90de-4c47-a606-e2764ea596de tempest-SnapshotsActionsTest-237430834 None] Lock "cinder-quobyte-12aa70d2-c742-4b85-90df-a5056ffdad4d" released by "_delete_snapshot" :: held 1.768s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:24:32 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-9c508607-90de-4c47-a606-e2764ea596de tempest-SnapshotsActionsTest-237430834 None] Lock "cinder-quobyte-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039" released by "delete_snapshot" :: held 1.802s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:24:32 devstack cinder-volume[86120]: WARNING cinder.quota [None req-9c508607-90de-4c47-a606-e2764ea596de tempest-SnapshotsActionsTest-237430834 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Nov 03 18:24:32 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-9c508607-90de-4c47-a606-e2764ea596de tempest-SnapshotsActionsTest-237430834 None] Created reservations ['f5278601-1e07-43cc-8a38-471bad6603ba', '899a42e5-f99d-4b21-ad1d-4d04417cd2ad', 'd8171403-6678-41a8-b727-40ced86afaff', 'bd8ed36e-0f9f-4884-b1cf-6264861cfb75'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:24:32 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-9c508607-90de-4c47-a606-e2764ea596de tempest-SnapshotsActionsTest-237430834 None] Delete snapshot completed successfully.
Nov 03 18:24:32 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-9c508607-90de-4c47-a606-e2764ea596de tempest-SnapshotsActionsTest-237430834 None] Lock "cinder-12aa70d2-c742-4b85-90df-a5056ffdad4d-delete_snapshot" released by "delete_snapshot" :: held 1.987s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:24:32 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-aa66563a-12d3-4544-a616-bf84c8afb079 tempest-SnapshotsActionsTest-1556821077 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:24:32 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-aa66563a-12d3-4544-a616-bf84c8afb079 tempest-SnapshotsActionsTest-1556821077 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:24:32 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-aa66563a-12d3-4544-a616-bf84c8afb079 tempest-SnapshotsActionsTest-1556821077 None] Creating offline snapshot e559fafd-c2d4-4899-9680-de82cae63e79 of volume dbf5a8e9-33bc-4c52-98f1-b5eb25f48039 {{(pid=86120) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 18:24:32 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[02664430-c34c-4a7d-8e56-9627458fca7c]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:24:32 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-aa66563a-12d3-4544-a616-bf84c8afb079 tempest-SnapshotsActionsTest-1556821077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039.a43bab75-892a-4d77-bb53-3d89af613f4c {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:24:33 devstack sudo[89816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039.a43bab75-892a-4d77-bb53-3d89af613f4c
Nov 03 18:24:33 devstack sudo[89816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:24:33 devstack sudo[89816]: pam_unix(sudo:session): session closed for user root
Nov 03 18:24:33 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-aa66563a-12d3-4544-a616-bf84c8afb079 tempest-SnapshotsActionsTest-1556821077 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039.a43bab75-892a-4d77-bb53-3d89af613f4c" returned: 0 in 0.443s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:24:33 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-aa66563a-12d3-4544-a616-bf84c8afb079 tempest-SnapshotsActionsTest-1556821077 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86120) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 18:24:33 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-aa66563a-12d3-4544-a616-bf84c8afb079 tempest-SnapshotsActionsTest-1556821077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039.a43bab75-892a-4d77-bb53-3d89af613f4c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039.e559fafd-c2d4-4899-9680-de82cae63e79 1G {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:24:33 devstack sudo[89823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039.a43bab75-892a-4d77-bb53-3d89af613f4c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039.e559fafd-c2d4-4899-9680-de82cae63e79 1G
Nov 03 18:24:33 devstack sudo[89823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:24:33 devstack sudo[89823]: pam_unix(sudo:session): session closed for user root
Nov 03 18:24:33 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-aa66563a-12d3-4544-a616-bf84c8afb079 tempest-SnapshotsActionsTest-1556821077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039.a43bab75-892a-4d77-bb53-3d89af613f4c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039.e559fafd-c2d4-4899-9680-de82cae63e79 1G" returned: 0 in 0.529s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:24:33 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-aa66563a-12d3-4544-a616-bf84c8afb079 tempest-SnapshotsActionsTest-1556821077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039.a43bab75-892a-4d77-bb53-3d89af613f4c -F qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039.e559fafd-c2d4-4899-9680-de82cae63e79 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:24:33 devstack sudo[89830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039.a43bab75-892a-4d77-bb53-3d89af613f4c -F qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039.e559fafd-c2d4-4899-9680-de82cae63e79
Nov 03 18:24:33 devstack sudo[89830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:24:34 devstack sudo[89830]: pam_unix(sudo:session): session closed for user root
Nov 03 18:24:34 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-aa66563a-12d3-4544-a616-bf84c8afb079 tempest-SnapshotsActionsTest-1556821077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039.a43bab75-892a-4d77-bb53-3d89af613f4c -F qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039.e559fafd-c2d4-4899-9680-de82cae63e79" returned: 0 in 0.372s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:24:34 devstack cinder-volume[86120]: WARNING cinder.volume.drivers.remotefs [None req-aa66563a-12d3-4544-a616-bf84c8afb079 tempest-SnapshotsActionsTest-1556821077 None] /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039.e559fafd-c2d4-4899-9680-de82cae63e79 is being set with open permissions: ugo+rw
Nov 03 18:24:34 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-aa66563a-12d3-4544-a616-bf84c8afb079 tempest-SnapshotsActionsTest-1556821077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039.e559fafd-c2d4-4899-9680-de82cae63e79 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:24:34 devstack sudo[89836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039.e559fafd-c2d4-4899-9680-de82cae63e79
Nov 03 18:24:34 devstack sudo[89836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:24:34 devstack sudo[89836]: pam_unix(sudo:session): session closed for user root
Nov 03 18:24:34 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-aa66563a-12d3-4544-a616-bf84c8afb079 tempest-SnapshotsActionsTest-1556821077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039.e559fafd-c2d4-4899-9680-de82cae63e79" returned: 0 in 0.277s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:24:34 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-aa66563a-12d3-4544-a616-bf84c8afb079 tempest-SnapshotsActionsTest-1556821077 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.802s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:24:34 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-aa66563a-12d3-4544-a616-bf84c8afb079 tempest-SnapshotsActionsTest-1556821077 None] Create snapshot completed successfully
Nov 03 18:24:35 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-0681846c-8765-409f-a851-850eda09489b tempest-SnapshotsActionsTest-237430834 None] Acquiring lock "cinder-e559fafd-c2d4-4899-9680-de82cae63e79-delete_snapshot" by "delete_snapshot" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:24:35 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-0681846c-8765-409f-a851-850eda09489b tempest-SnapshotsActionsTest-237430834 None] Lock "cinder-e559fafd-c2d4-4899-9680-de82cae63e79-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:24:35 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-0681846c-8765-409f-a851-850eda09489b tempest-SnapshotsActionsTest-237430834 None] Acquiring lock "cinder-quobyte-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039" by "delete_snapshot" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:24:35 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-0681846c-8765-409f-a851-850eda09489b tempest-SnapshotsActionsTest-237430834 None] Lock "cinder-quobyte-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:24:35 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-0681846c-8765-409f-a851-850eda09489b tempest-SnapshotsActionsTest-237430834 None] Acquiring lock "cinder-quobyte-e559fafd-c2d4-4899-9680-de82cae63e79" by "_delete_snapshot" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:24:35 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-0681846c-8765-409f-a851-850eda09489b tempest-SnapshotsActionsTest-237430834 None] Lock "cinder-quobyte-e559fafd-c2d4-4899-9680-de82cae63e79" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:24:35 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-0681846c-8765-409f-a851-850eda09489b tempest-SnapshotsActionsTest-237430834 None] Deleting offline snapshot e559fafd-c2d4-4899-9680-de82cae63e79 of volume dbf5a8e9-33bc-4c52-98f1-b5eb25f48039 {{(pid=86120) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 18:24:35 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-0681846c-8765-409f-a851-850eda09489b tempest-SnapshotsActionsTest-237430834 None] snapshot_file for this snap is: volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039.e559fafd-c2d4-4899-9680-de82cae63e79 {{(pid=86120) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 18:24:35 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0825798-a0ff-493a-b3a0-5c730f1bd774]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:24:35 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-0681846c-8765-409f-a851-850eda09489b tempest-SnapshotsActionsTest-237430834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039.e559fafd-c2d4-4899-9680-de82cae63e79 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:24:35 devstack sudo[89839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039.e559fafd-c2d4-4899-9680-de82cae63e79
Nov 03 18:24:35 devstack sudo[89839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:24:35 devstack sudo[89839]: pam_unix(sudo:session): session closed for user root
Nov 03 18:24:35 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-0681846c-8765-409f-a851-850eda09489b tempest-SnapshotsActionsTest-237430834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039.e559fafd-c2d4-4899-9680-de82cae63e79" returned: 0 in 0.481s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:24:35 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-0681846c-8765-409f-a851-850eda09489b tempest-SnapshotsActionsTest-237430834 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86120) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 18:24:35 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ba02c78-c3fd-4131-aca9-cc28c8329064]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:24:35 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-0681846c-8765-409f-a851-850eda09489b tempest-SnapshotsActionsTest-237430834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039.a43bab75-892a-4d77-bb53-3d89af613f4c {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:24:36 devstack sudo[89845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039.a43bab75-892a-4d77-bb53-3d89af613f4c
Nov 03 18:24:36 devstack sudo[89845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:24:36 devstack sudo[89845]: pam_unix(sudo:session): session closed for user root
Nov 03 18:24:36 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-0681846c-8765-409f-a851-850eda09489b tempest-SnapshotsActionsTest-237430834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039.a43bab75-892a-4d77-bb53-3d89af613f4c" returned: 0 in 0.561s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:24:36 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-0681846c-8765-409f-a851-850eda09489b tempest-SnapshotsActionsTest-237430834 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86120) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 18:24:36 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-0681846c-8765-409f-a851-850eda09489b tempest-SnapshotsActionsTest-237430834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039.e559fafd-c2d4-4899-9680-de82cae63e79 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:24:36 devstack sudo[89851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039.e559fafd-c2d4-4899-9680-de82cae63e79
Nov 03 18:24:36 devstack sudo[89851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:24:36 devstack sudo[89851]: pam_unix(sudo:session): session closed for user root
Nov 03 18:24:36 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-0681846c-8765-409f-a851-850eda09489b tempest-SnapshotsActionsTest-237430834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039.e559fafd-c2d4-4899-9680-de82cae63e79" returned: 0 in 0.465s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:24:36 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-0681846c-8765-409f-a851-850eda09489b tempest-SnapshotsActionsTest-237430834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039.e559fafd-c2d4-4899-9680-de82cae63e79 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:24:36 devstack sudo[89859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039.e559fafd-c2d4-4899-9680-de82cae63e79
Nov 03 18:24:36 devstack sudo[89859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:24:37 devstack sudo[89859]: pam_unix(sudo:session): session closed for user root
Nov 03 18:24:37 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-0681846c-8765-409f-a851-850eda09489b tempest-SnapshotsActionsTest-237430834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039.e559fafd-c2d4-4899-9680-de82cae63e79" returned: 0 in 0.278s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:24:37 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-0681846c-8765-409f-a851-850eda09489b tempest-SnapshotsActionsTest-237430834 None] Lock "cinder-quobyte-e559fafd-c2d4-4899-9680-de82cae63e79" released by "_delete_snapshot" :: held 1.940s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:24:37 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-0681846c-8765-409f-a851-850eda09489b tempest-SnapshotsActionsTest-237430834 None] Lock "cinder-quobyte-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039" released by "delete_snapshot" :: held 1.980s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:24:37 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-0681846c-8765-409f-a851-850eda09489b tempest-SnapshotsActionsTest-237430834 None] Created reservations ['d0308791-2d0d-4737-916d-bbf1c52d5968', 'df73e133-6561-4853-ad55-32938acfc77f', '6e5139da-5917-4f84-bc4e-9a4626789d3c', 'b29538af-9d91-4360-88b2-b6391a1b5f35'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:24:37 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-0681846c-8765-409f-a851-850eda09489b tempest-SnapshotsActionsTest-237430834 None] Delete snapshot completed successfully.
Nov 03 18:24:37 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-0681846c-8765-409f-a851-850eda09489b tempest-SnapshotsActionsTest-237430834 None] Lock "cinder-e559fafd-c2d4-4899-9680-de82cae63e79-delete_snapshot" released by "delete_snapshot" :: held 2.189s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:24:38 devstack cinder-volume[86120]: INFO cinder.volume.manager [req-7ab833dc-5bd6-407f-a819-da00c2c8d6b4 req-0f64f16b-c725-42c5-81f1-cbdedd91e5f1 tempest-ServerActionsTestOtherA-913173699 None] Terminate volume connection completed successfully.
Nov 03 18:24:38 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [req-7ab833dc-5bd6-407f-a819-da00c2c8d6b4 req-0f64f16b-c725-42c5-81f1-cbdedd91e5f1 tempest-ServerActionsTestOtherA-913173699 None] Deleting attachment 7ee12c8f-60d0-4784-a4e5-995a920846c3. {{(pid=86120) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 03 18:24:39 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-b332c2e2-96a4-45d1-a3ad-194eeb829180 tempest-SnapshotsActionsTest-1556821077 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:24:39 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-b332c2e2-96a4-45d1-a3ad-194eeb829180 tempest-SnapshotsActionsTest-1556821077 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:24:39 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-b332c2e2-96a4-45d1-a3ad-194eeb829180 tempest-SnapshotsActionsTest-1556821077 None] Creating offline snapshot 413330de-1953-4668-9898-e8682c53c9da of volume dbf5a8e9-33bc-4c52-98f1-b5eb25f48039 {{(pid=86120) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 18:24:39 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[180f592f-e76a-4039-b775-2c586f11dbd7]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:24:39 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b332c2e2-96a4-45d1-a3ad-194eeb829180 tempest-SnapshotsActionsTest-1556821077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039.a43bab75-892a-4d77-bb53-3d89af613f4c {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:24:39 devstack sudo[89868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039.a43bab75-892a-4d77-bb53-3d89af613f4c
Nov 03 18:24:39 devstack sudo[89868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:24:39 devstack sudo[89868]: pam_unix(sudo:session): session closed for user root
Nov 03 18:24:39 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b332c2e2-96a4-45d1-a3ad-194eeb829180 tempest-SnapshotsActionsTest-1556821077 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039.a43bab75-892a-4d77-bb53-3d89af613f4c" returned: 0 in 0.594s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:24:39 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-b332c2e2-96a4-45d1-a3ad-194eeb829180 tempest-SnapshotsActionsTest-1556821077 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86120) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 18:24:39 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b332c2e2-96a4-45d1-a3ad-194eeb829180 tempest-SnapshotsActionsTest-1556821077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039.a43bab75-892a-4d77-bb53-3d89af613f4c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039.413330de-1953-4668-9898-e8682c53c9da 1G {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:24:39 devstack sudo[89876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039.a43bab75-892a-4d77-bb53-3d89af613f4c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039.413330de-1953-4668-9898-e8682c53c9da 1G
Nov 03 18:24:39 devstack sudo[89876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:24:40 devstack sudo[89876]: pam_unix(sudo:session): session closed for user root
Nov 03 18:24:40 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b332c2e2-96a4-45d1-a3ad-194eeb829180 tempest-SnapshotsActionsTest-1556821077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039.a43bab75-892a-4d77-bb53-3d89af613f4c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039.413330de-1953-4668-9898-e8682c53c9da 1G" returned: 0 in 0.816s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:24:40 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b332c2e2-96a4-45d1-a3ad-194eeb829180 tempest-SnapshotsActionsTest-1556821077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039.a43bab75-892a-4d77-bb53-3d89af613f4c -F qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039.413330de-1953-4668-9898-e8682c53c9da {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:24:40 devstack sudo[89905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039.a43bab75-892a-4d77-bb53-3d89af613f4c -F qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039.413330de-1953-4668-9898-e8682c53c9da
Nov 03 18:24:40 devstack sudo[89905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:24:40 devstack sudo[89905]: pam_unix(sudo:session): session closed for user root
Nov 03 18:24:40 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b332c2e2-96a4-45d1-a3ad-194eeb829180 tempest-SnapshotsActionsTest-1556821077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039.a43bab75-892a-4d77-bb53-3d89af613f4c -F qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039.413330de-1953-4668-9898-e8682c53c9da" returned: 0 in 0.383s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:24:40 devstack cinder-volume[86120]: WARNING cinder.volume.drivers.remotefs [None req-b332c2e2-96a4-45d1-a3ad-194eeb829180 tempest-SnapshotsActionsTest-1556821077 None] /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039.413330de-1953-4668-9898-e8682c53c9da is being set with open permissions: ugo+rw
Nov 03 18:24:40 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b332c2e2-96a4-45d1-a3ad-194eeb829180 tempest-SnapshotsActionsTest-1556821077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039.413330de-1953-4668-9898-e8682c53c9da {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:24:40 devstack sudo[89910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039.413330de-1953-4668-9898-e8682c53c9da
Nov 03 18:24:40 devstack sudo[89910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:24:41 devstack sudo[89910]: pam_unix(sudo:session): session closed for user root
Nov 03 18:24:41 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b332c2e2-96a4-45d1-a3ad-194eeb829180 tempest-SnapshotsActionsTest-1556821077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039.413330de-1953-4668-9898-e8682c53c9da" returned: 0 in 0.309s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:24:41 devstack cinder-volume[86120]: DEBUG dbcounter [-] [86120] Writing DB stats cinder:SELECT=107,cinder:INSERT=24,cinder:UPDATE=114,cinder:DELETE=5 {{(pid=86120) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 18:24:41 devstack cinder-volume[86120]: DEBUG dbcounter [-] [86120] Writing DB stats cinder:SELECT=103,cinder:INSERT=29,cinder:UPDATE=101,cinder:DELETE=6 {{(pid=86120) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 18:24:41 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-b332c2e2-96a4-45d1-a3ad-194eeb829180 tempest-SnapshotsActionsTest-1556821077 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.301s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:24:41 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-b332c2e2-96a4-45d1-a3ad-194eeb829180 tempest-SnapshotsActionsTest-1556821077 None] Create snapshot completed successfully
Nov 03 18:24:42 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-d3476e17-33c0-4451-8d9d-7424d6213a76 tempest-SnapshotsActionsTest-237430834 None] Acquiring lock "cinder-413330de-1953-4668-9898-e8682c53c9da-delete_snapshot" by "delete_snapshot" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:24:42 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-d3476e17-33c0-4451-8d9d-7424d6213a76 tempest-SnapshotsActionsTest-237430834 None] Lock "cinder-413330de-1953-4668-9898-e8682c53c9da-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:24:42 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-d3476e17-33c0-4451-8d9d-7424d6213a76 tempest-SnapshotsActionsTest-237430834 None] Acquiring lock "cinder-quobyte-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039" by "delete_snapshot" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:24:42 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-d3476e17-33c0-4451-8d9d-7424d6213a76 tempest-SnapshotsActionsTest-237430834 None] Lock "cinder-quobyte-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:24:42 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-d3476e17-33c0-4451-8d9d-7424d6213a76 tempest-SnapshotsActionsTest-237430834 None] Acquiring lock "cinder-quobyte-413330de-1953-4668-9898-e8682c53c9da" by "_delete_snapshot" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:24:42 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-d3476e17-33c0-4451-8d9d-7424d6213a76 tempest-SnapshotsActionsTest-237430834 None] Lock "cinder-quobyte-413330de-1953-4668-9898-e8682c53c9da" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:24:42 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-d3476e17-33c0-4451-8d9d-7424d6213a76 tempest-SnapshotsActionsTest-237430834 None] Deleting offline snapshot 413330de-1953-4668-9898-e8682c53c9da of volume dbf5a8e9-33bc-4c52-98f1-b5eb25f48039 {{(pid=86120) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 18:24:42 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-d3476e17-33c0-4451-8d9d-7424d6213a76 tempest-SnapshotsActionsTest-237430834 None] snapshot_file for this snap is: volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039.413330de-1953-4668-9898-e8682c53c9da {{(pid=86120) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 18:24:42 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fa95015-b2e3-482e-a125-45b721c81172]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:24:42 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-d3476e17-33c0-4451-8d9d-7424d6213a76 tempest-SnapshotsActionsTest-237430834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039.413330de-1953-4668-9898-e8682c53c9da {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:24:42 devstack sudo[89918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039.413330de-1953-4668-9898-e8682c53c9da
Nov 03 18:24:42 devstack sudo[89918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:24:42 devstack sudo[89918]: pam_unix(sudo:session): session closed for user root
Nov 03 18:24:42 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-d3476e17-33c0-4451-8d9d-7424d6213a76 tempest-SnapshotsActionsTest-237430834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039.413330de-1953-4668-9898-e8682c53c9da" returned: 0 in 0.449s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:24:42 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-d3476e17-33c0-4451-8d9d-7424d6213a76 tempest-SnapshotsActionsTest-237430834 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86120) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 18:24:43 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[80b898b6-67c2-4ad2-93d4-c9ecca0619f8]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:24:43 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-d3476e17-33c0-4451-8d9d-7424d6213a76 tempest-SnapshotsActionsTest-237430834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039.a43bab75-892a-4d77-bb53-3d89af613f4c {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:24:43 devstack sudo[89924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039.a43bab75-892a-4d77-bb53-3d89af613f4c
Nov 03 18:24:43 devstack sudo[89924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:24:43 devstack sudo[89924]: pam_unix(sudo:session): session closed for user root
Nov 03 18:24:43 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-d3476e17-33c0-4451-8d9d-7424d6213a76 tempest-SnapshotsActionsTest-237430834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039.a43bab75-892a-4d77-bb53-3d89af613f4c" returned: 0 in 0.404s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:24:43 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-d3476e17-33c0-4451-8d9d-7424d6213a76 tempest-SnapshotsActionsTest-237430834 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86120) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 18:24:43 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-d3476e17-33c0-4451-8d9d-7424d6213a76 tempest-SnapshotsActionsTest-237430834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039.413330de-1953-4668-9898-e8682c53c9da {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:24:43 devstack sudo[89929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039.413330de-1953-4668-9898-e8682c53c9da
Nov 03 18:24:43 devstack sudo[89929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:24:43 devstack sudo[89929]: pam_unix(sudo:session): session closed for user root
Nov 03 18:24:43 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-d3476e17-33c0-4451-8d9d-7424d6213a76 tempest-SnapshotsActionsTest-237430834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039.413330de-1953-4668-9898-e8682c53c9da" returned: 0 in 0.555s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:24:43 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-d3476e17-33c0-4451-8d9d-7424d6213a76 tempest-SnapshotsActionsTest-237430834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039.413330de-1953-4668-9898-e8682c53c9da {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:24:44 devstack sudo[89935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039.413330de-1953-4668-9898-e8682c53c9da
Nov 03 18:24:44 devstack sudo[89935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:24:44 devstack sudo[89935]: pam_unix(sudo:session): session closed for user root
Nov 03 18:24:44 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-d3476e17-33c0-4451-8d9d-7424d6213a76 tempest-SnapshotsActionsTest-237430834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039.413330de-1953-4668-9898-e8682c53c9da" returned: 0 in 0.318s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:24:44 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-d3476e17-33c0-4451-8d9d-7424d6213a76 tempest-SnapshotsActionsTest-237430834 None] Lock "cinder-quobyte-413330de-1953-4668-9898-e8682c53c9da" released by "_delete_snapshot" :: held 1.897s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:24:44 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-d3476e17-33c0-4451-8d9d-7424d6213a76 tempest-SnapshotsActionsTest-237430834 None] Lock "cinder-quobyte-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039" released by "delete_snapshot" :: held 1.939s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:24:44 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-d3476e17-33c0-4451-8d9d-7424d6213a76 tempest-SnapshotsActionsTest-237430834 None] Created reservations ['277411ed-915f-41c0-b8d9-f770c6b9a555', '0e1ce6d2-4f50-4c2c-bda3-843a68430eae', 'c963a2e7-27fe-4dca-bfe4-540715b5f3a3', 'f8c73566-9a63-4e94-b5a0-64fb602da640'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:24:44 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-d3476e17-33c0-4451-8d9d-7424d6213a76 tempest-SnapshotsActionsTest-237430834 None] Delete snapshot completed successfully.
Nov 03 18:24:44 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-d3476e17-33c0-4451-8d9d-7424d6213a76 tempest-SnapshotsActionsTest-237430834 None] Lock "cinder-413330de-1953-4668-9898-e8682c53c9da-delete_snapshot" released by "delete_snapshot" :: held 2.159s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:24:45 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [req-0fa47789-d7c9-4a88-8102-c72fa6ada044 req-2e8411c0-e786-4c56-a078-44953a63ae50 tempest-VolumesGetTestJSON-1684709547 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:24:45 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [req-0fa47789-d7c9-4a88-8102-c72fa6ada044 req-2e8411c0-e786-4c56-a078-44953a63ae50 tempest-VolumesGetTestJSON-1684709547 None] Flow 'volume_create_manager' (9dea094d-1784-4961-8215-802e8127bf77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:24:45 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [req-0fa47789-d7c9-4a88-8102-c72fa6ada044 req-2e8411c0-e786-4c56-a078-44953a63ae50 tempest-VolumesGetTestJSON-1684709547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65a8cf3f-d5d6-4163-b74e-a8c1364bb0e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:24:45 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [req-0fa47789-d7c9-4a88-8102-c72fa6ada044 req-2e8411c0-e786-4c56-a078-44953a63ae50 tempest-VolumesGetTestJSON-1684709547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65a8cf3f-d5d6-4163-b74e-a8c1364bb0e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:24:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1725075026',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bd58927-5ea4-47ef-a017-24d400c49282,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2bd5a463a6fd48e9925635bbb18f0148',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:24:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:24:45Z,use_quota=True,user_id='6dbb8537fc8a40beb546895dc78bbfc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:24:45 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [req-0fa47789-d7c9-4a88-8102-c72fa6ada044 req-2e8411c0-e786-4c56-a078-44953a63ae50 tempest-VolumesGetTestJSON-1684709547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c72878ab-d795-41d2-803a-6587d0e0e04c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:24:45 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [req-0fa47789-d7c9-4a88-8102-c72fa6ada044 req-2e8411c0-e786-4c56-a078-44953a63ae50 tempest-VolumesGetTestJSON-1684709547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c72878ab-d795-41d2-803a-6587d0e0e04c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:24:45 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [req-0fa47789-d7c9-4a88-8102-c72fa6ada044 req-2e8411c0-e786-4c56-a078-44953a63ae50 tempest-VolumesGetTestJSON-1684709547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7dac5e2-c872-48a6-b19b-48a4b56ad85c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:24:45 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [req-0fa47789-d7c9-4a88-8102-c72fa6ada044 req-2e8411c0-e786-4c56-a078-44953a63ae50 tempest-VolumesGetTestJSON-1684709547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7dac5e2-c872-48a6-b19b-48a4b56ad85c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8bd58927-5ea4-47ef-a017-24d400c49282', 'volume_name': 'volume-8bd58927-5ea4-47ef-a017-24d400c49282', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:24:45 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [req-0fa47789-d7c9-4a88-8102-c72fa6ada044 req-2e8411c0-e786-4c56-a078-44953a63ae50 tempest-VolumesGetTestJSON-1684709547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2270e67d-d055-444d-ba5a-eb8a18903d2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:24:45 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [req-0fa47789-d7c9-4a88-8102-c72fa6ada044 req-2e8411c0-e786-4c56-a078-44953a63ae50 tempest-VolumesGetTestJSON-1684709547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2270e67d-d055-444d-ba5a-eb8a18903d2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:24:45 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [req-0fa47789-d7c9-4a88-8102-c72fa6ada044 req-2e8411c0-e786-4c56-a078-44953a63ae50 tempest-VolumesGetTestJSON-1684709547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14ca7fa8-0e3c-49c9-ad88-0ba053bcda64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:24:45 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [req-0fa47789-d7c9-4a88-8102-c72fa6ada044 req-2e8411c0-e786-4c56-a078-44953a63ae50 tempest-VolumesGetTestJSON-1684709547 None] Volume 8bd58927-5ea4-47ef-a017-24d400c49282: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8bd58927-5ea4-47ef-a017-24d400c49282', 'volume_size': 1}
Nov 03 18:24:45 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [req-0fa47789-d7c9-4a88-8102-c72fa6ada044 req-2e8411c0-e786-4c56-a078-44953a63ae50 tempest-VolumesGetTestJSON-1684709547 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:24:45 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [req-0fa47789-d7c9-4a88-8102-c72fa6ada044 req-2e8411c0-e786-4c56-a078-44953a63ae50 tempest-VolumesGetTestJSON-1684709547 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:24:45 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [req-0fa47789-d7c9-4a88-8102-c72fa6ada044 req-2e8411c0-e786-4c56-a078-44953a63ae50 tempest-VolumesGetTestJSON-1684709547 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:24:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1725075026',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bd58927-5ea4-47ef-a017-24d400c49282,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2bd5a463a6fd48e9925635bbb18f0148',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:24:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:24:45Z,use_quota=True,user_id='6dbb8537fc8a40beb546895dc78bbfc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:24:45 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [req-0fa47789-d7c9-4a88-8102-c72fa6ada044 req-2e8411c0-e786-4c56-a078-44953a63ae50 tempest-VolumesGetTestJSON-1684709547 None] Creating volume 8bd58927-5ea4-47ef-a017-24d400c49282 {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:24:45 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [req-0fa47789-d7c9-4a88-8102-c72fa6ada044 req-2e8411c0-e786-4c56-a078-44953a63ae50 tempest-VolumesGetTestJSON-1684709547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:24:45 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [req-0fa47789-d7c9-4a88-8102-c72fa6ada044 req-2e8411c0-e786-4c56-a078-44953a63ae50 tempest-VolumesGetTestJSON-1684709547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:24:45 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [req-0fa47789-d7c9-4a88-8102-c72fa6ada044 req-2e8411c0-e786-4c56-a078-44953a63ae50 tempest-VolumesGetTestJSON-1684709547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:24:45 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [req-0fa47789-d7c9-4a88-8102-c72fa6ada044 req-2e8411c0-e786-4c56-a078-44953a63ae50 tempest-VolumesGetTestJSON-1684709547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:24:45 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [req-0fa47789-d7c9-4a88-8102-c72fa6ada044 req-2e8411c0-e786-4c56-a078-44953a63ae50 tempest-VolumesGetTestJSON-1684709547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:24:45 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [req-0fa47789-d7c9-4a88-8102-c72fa6ada044 req-2e8411c0-e786-4c56-a078-44953a63ae50 tempest-VolumesGetTestJSON-1684709547 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:24:45 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [req-0fa47789-d7c9-4a88-8102-c72fa6ada044 req-2e8411c0-e786-4c56-a078-44953a63ae50 tempest-VolumesGetTestJSON-1684709547 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:24:45 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [req-0fa47789-d7c9-4a88-8102-c72fa6ada044 req-2e8411c0-e786-4c56-a078-44953a63ae50 tempest-VolumesGetTestJSON-1684709547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8bd58927-5ea4-47ef-a017-24d400c49282 1073741824 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:24:45 devstack sudo[89938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8bd58927-5ea4-47ef-a017-24d400c49282 1073741824
Nov 03 18:24:45 devstack sudo[89938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:24:45 devstack sudo[89938]: pam_unix(sudo:session): session closed for user root
Nov 03 18:24:45 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-d1a6e33d-00cb-4b78-9352-2bddc63808fd tempest-SnapshotsActionsTest-1556821077 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:24:45 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [req-0fa47789-d7c9-4a88-8102-c72fa6ada044 req-2e8411c0-e786-4c56-a078-44953a63ae50 tempest-VolumesGetTestJSON-1684709547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8bd58927-5ea4-47ef-a017-24d400c49282 1073741824" returned: 0 in 0.601s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:24:46 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [req-0fa47789-d7c9-4a88-8102-c72fa6ada044 req-2e8411c0-e786-4c56-a078-44953a63ae50 tempest-VolumesGetTestJSON-1684709547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8bd58927-5ea4-47ef-a017-24d400c49282 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:24:46 devstack sudo[89945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8bd58927-5ea4-47ef-a017-24d400c49282
Nov 03 18:24:46 devstack sudo[89945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:24:46 devstack sudo[89945]: pam_unix(sudo:session): session closed for user root
Nov 03 18:24:46 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [req-0fa47789-d7c9-4a88-8102-c72fa6ada044 req-2e8411c0-e786-4c56-a078-44953a63ae50 tempest-VolumesGetTestJSON-1684709547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8bd58927-5ea4-47ef-a017-24d400c49282" returned: 0 in 0.287s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:24:46 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [req-0fa47789-d7c9-4a88-8102-c72fa6ada044 req-2e8411c0-e786-4c56-a078-44953a63ae50 tempest-VolumesGetTestJSON-1684709547 None] <== create_volume: return (957ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:24:46 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [req-0fa47789-d7c9-4a88-8102-c72fa6ada044 req-2e8411c0-e786-4c56-a078-44953a63ae50 tempest-VolumesGetTestJSON-1684709547 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.962s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:24:46 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-d1a6e33d-00cb-4b78-9352-2bddc63808fd tempest-SnapshotsActionsTest-1556821077 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.354s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:24:46 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [req-0fa47789-d7c9-4a88-8102-c72fa6ada044 req-2e8411c0-e786-4c56-a078-44953a63ae50 tempest-VolumesGetTestJSON-1684709547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14ca7fa8-0e3c-49c9-ad88-0ba053bcda64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8bd58927-5ea4-47ef-a017-24d400c49282', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:24:46 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [req-0fa47789-d7c9-4a88-8102-c72fa6ada044 req-2e8411c0-e786-4c56-a078-44953a63ae50 tempest-VolumesGetTestJSON-1684709547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (938a3f26-7270-42e6-af11-27c37779a614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:24:46 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-d1a6e33d-00cb-4b78-9352-2bddc63808fd tempest-SnapshotsActionsTest-1556821077 None] Creating offline snapshot a5440f8a-2675-4c98-b58a-7d363ff2f794 of volume dbf5a8e9-33bc-4c52-98f1-b5eb25f48039 {{(pid=86120) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 18:24:46 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [req-0fa47789-d7c9-4a88-8102-c72fa6ada044 req-2e8411c0-e786-4c56-a078-44953a63ae50 tempest-VolumesGetTestJSON-1684709547 None] Volume volume-8bd58927-5ea4-47ef-a017-24d400c49282 (8bd58927-5ea4-47ef-a017-24d400c49282): created successfully
Nov 03 18:24:46 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [req-0fa47789-d7c9-4a88-8102-c72fa6ada044 req-2e8411c0-e786-4c56-a078-44953a63ae50 tempest-VolumesGetTestJSON-1684709547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (938a3f26-7270-42e6-af11-27c37779a614) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:24:46 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [req-0fa47789-d7c9-4a88-8102-c72fa6ada044 req-2e8411c0-e786-4c56-a078-44953a63ae50 tempest-VolumesGetTestJSON-1684709547 None] Flow 'volume_create_manager' (9dea094d-1784-4961-8215-802e8127bf77) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:24:46 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a8074d7-a69a-44e3-9069-1c16905be873]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:24:46 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-d1a6e33d-00cb-4b78-9352-2bddc63808fd tempest-SnapshotsActionsTest-1556821077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039.a43bab75-892a-4d77-bb53-3d89af613f4c {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:24:46 devstack cinder-volume[86120]: INFO cinder.volume.manager [req-0fa47789-d7c9-4a88-8102-c72fa6ada044 req-2e8411c0-e786-4c56-a078-44953a63ae50 tempest-VolumesGetTestJSON-1684709547 None] Created volume successfully.
Nov 03 18:24:46 devstack sudo[89948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039.a43bab75-892a-4d77-bb53-3d89af613f4c
Nov 03 18:24:46 devstack sudo[89948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:24:47 devstack sudo[89948]: pam_unix(sudo:session): session closed for user root
Nov 03 18:24:47 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-d1a6e33d-00cb-4b78-9352-2bddc63808fd tempest-SnapshotsActionsTest-1556821077 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039.a43bab75-892a-4d77-bb53-3d89af613f4c" returned: 0 in 0.601s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:24:47 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-d1a6e33d-00cb-4b78-9352-2bddc63808fd tempest-SnapshotsActionsTest-1556821077 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86120) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 18:24:47 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-d1a6e33d-00cb-4b78-9352-2bddc63808fd tempest-SnapshotsActionsTest-1556821077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039.a43bab75-892a-4d77-bb53-3d89af613f4c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039.a5440f8a-2675-4c98-b58a-7d363ff2f794 1G {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:24:47 devstack sudo[89962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039.a43bab75-892a-4d77-bb53-3d89af613f4c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039.a5440f8a-2675-4c98-b58a-7d363ff2f794 1G
Nov 03 18:24:47 devstack sudo[89962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:24:47 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8190df2-9e11-436b-a264-fe355e5bdea5 tempest-ServerActionsTestOtherA-913173699 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:24:47 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-a8190df2-9e11-436b-a264-fe355e5bdea5 tempest-ServerActionsTestOtherA-913173699 None] Flow 'volume_create_manager' (c899479f-c759-497d-a33d-1591cfa55642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:24:47 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-a8190df2-9e11-436b-a264-fe355e5bdea5 tempest-ServerActionsTestOtherA-913173699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6363445-7c3e-4097-bc2f-44051ca9aa15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:24:47 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-a8190df2-9e11-436b-a264-fe355e5bdea5 tempest-ServerActionsTestOtherA-913173699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6363445-7c3e-4097-bc2f-44051ca9aa15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:24:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-783567645',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1e5365c-d629-4abc-bae0-700bacd2d382,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f06860b9996343eca46639219b8b45a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:24:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:24:47Z,use_quota=True,user_id='b59dba7ab59a483096665c78481a0796',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:24:47 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-a8190df2-9e11-436b-a264-fe355e5bdea5 tempest-ServerActionsTestOtherA-913173699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (167bb530-ef82-4363-bc54-587828485ce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:24:47 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-a8190df2-9e11-436b-a264-fe355e5bdea5 tempest-ServerActionsTestOtherA-913173699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (167bb530-ef82-4363-bc54-587828485ce1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:24:47 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-a8190df2-9e11-436b-a264-fe355e5bdea5 tempest-ServerActionsTestOtherA-913173699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46424493-c367-4839-add9-7169d121bb94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:24:47 devstack cinder-volume[86120]: DEBUG cinder.image.glance [None req-a8190df2-9e11-436b-a264-fe355e5bdea5 tempest-ServerActionsTestOtherA-913173699 None] Creating Keystone auth plugin from conf {{(pid=86120) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 03 18:24:47 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-a8190df2-9e11-436b-a264-fe355e5bdea5 tempest-ServerActionsTestOtherA-913173699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46424493-c367-4839-add9-7169d121bb94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b1e5365c-d629-4abc-bae0-700bacd2d382', 'volume_name': 'volume-b1e5365c-d629-4abc-bae0-700bacd2d382', 'volume_size': 1, 'image_id': '83b28d58-14b6-4404-8354-5cfe237c5c95', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/83b28d58-14b6-4404-8354-5cfe237c5c95', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4b0f900e807a4827ba1f8686981981d9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '83b28d58-14b6-4404-8354-5cfe237c5c95', 'created_at': datetime.datetime(2026, 11, 3, 17, 17, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 17, 17, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/83b28d58-14b6-4404-8354-5cfe237c5c95/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7a8d3c5eae40>}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:24:47 devstack sudo[89962]: pam_unix(sudo:session): session closed for user root
Nov 03 18:24:47 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-a8190df2-9e11-436b-a264-fe355e5bdea5 tempest-ServerActionsTestOtherA-913173699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6db9f677-cebc-4464-8acb-516ed04a3d81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:24:47 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-a8190df2-9e11-436b-a264-fe355e5bdea5 tempest-ServerActionsTestOtherA-913173699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6db9f677-cebc-4464-8acb-516ed04a3d81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:24:47 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-a8190df2-9e11-436b-a264-fe355e5bdea5 tempest-ServerActionsTestOtherA-913173699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a7f8416-6290-42ba-80eb-eb36a7f11089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:24:47 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-a8190df2-9e11-436b-a264-fe355e5bdea5 tempest-ServerActionsTestOtherA-913173699 None] Volume b1e5365c-d629-4abc-bae0-700bacd2d382: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b1e5365c-d629-4abc-bae0-700bacd2d382', 'volume_size': 1, 'image_id': '83b28d58-14b6-4404-8354-5cfe237c5c95', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/83b28d58-14b6-4404-8354-5cfe237c5c95', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4b0f900e807a4827ba1f8686981981d9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '83b28d58-14b6-4404-8354-5cfe237c5c95', 'created_at': datetime.datetime(2026, 11, 3, 17, 17, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 17, 17, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/83b28d58-14b6-4404-8354-5cfe237c5c95/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7a8d3c5eae40>}
Nov 03 18:24:47 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8190df2-9e11-436b-a264-fe355e5bdea5 tempest-ServerActionsTestOtherA-913173699 None] Trying to clone b1e5365c-d629-4abc-bae0-700bacd2d382 from image 83b28d58-14b6-4404-8354-5cfe237c5c95 at location (None, [{'url': 'file:///opt/stack/data/glance/images/83b28d58-14b6-4404-8354-5cfe237c5c95', 'metadata': {}}]). {{(pid=86120) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 03 18:24:47 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-d1a6e33d-00cb-4b78-9352-2bddc63808fd tempest-SnapshotsActionsTest-1556821077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039.a43bab75-892a-4d77-bb53-3d89af613f4c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039.a5440f8a-2675-4c98-b58a-7d363ff2f794 1G" returned: 0 in 0.650s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:24:47 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-d1a6e33d-00cb-4b78-9352-2bddc63808fd tempest-SnapshotsActionsTest-1556821077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039.a43bab75-892a-4d77-bb53-3d89af613f4c -F qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039.a5440f8a-2675-4c98-b58a-7d363ff2f794 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:24:47 devstack cinder-volume[86120]: DEBUG cinder.coordination [req-d7b93191-6f92-4159-8884-17a3bcd922ad req-f2c0c9de-b5a6-42fd-937d-12a364492090 tempest-VolumesGetTestJSON-1684709547 None] Acquiring lock "cinder-8bd58927-5ea4-47ef-a017-24d400c49282-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:24:47 devstack sudo[89968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039.a43bab75-892a-4d77-bb53-3d89af613f4c -F qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039.a5440f8a-2675-4c98-b58a-7d363ff2f794
Nov 03 18:24:47 devstack sudo[89968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:24:47 devstack cinder-volume[86120]: DEBUG cinder.coordination [req-d7b93191-6f92-4159-8884-17a3bcd922ad req-f2c0c9de-b5a6-42fd-937d-12a364492090 tempest-VolumesGetTestJSON-1684709547 None] Lock "cinder-8bd58927-5ea4-47ef-a017-24d400c49282-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:24:47 devstack cinder-volume[86120]: DEBUG cinder.coordination [req-d7b93191-6f92-4159-8884-17a3bcd922ad req-f2c0c9de-b5a6-42fd-937d-12a364492090 tempest-VolumesGetTestJSON-1684709547 None] Acquiring lock "cinder-quobyte-8bd58927-5ea4-47ef-a017-24d400c49282" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:24:47 devstack cinder-volume[86120]: DEBUG cinder.coordination [req-d7b93191-6f92-4159-8884-17a3bcd922ad req-f2c0c9de-b5a6-42fd-937d-12a364492090 tempest-VolumesGetTestJSON-1684709547 None] Lock "cinder-quobyte-8bd58927-5ea4-47ef-a017-24d400c49282" acquired by "delete_volume" :: waited 0.088s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:24:48 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[04aebd34-1582-4acb-9adc-a2d58d5076ee]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:24:48 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [req-d7b93191-6f92-4159-8884-17a3bcd922ad req-f2c0c9de-b5a6-42fd-937d-12a364492090 tempest-VolumesGetTestJSON-1684709547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8bd58927-5ea4-47ef-a017-24d400c49282 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:24:48 devstack sudo[89990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8bd58927-5ea4-47ef-a017-24d400c49282
Nov 03 18:24:48 devstack sudo[89990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:24:48 devstack sudo[89968]: pam_unix(sudo:session): session closed for user root
Nov 03 18:24:48 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-d1a6e33d-00cb-4b78-9352-2bddc63808fd tempest-SnapshotsActionsTest-1556821077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039.a43bab75-892a-4d77-bb53-3d89af613f4c -F qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039.a5440f8a-2675-4c98-b58a-7d363ff2f794" returned: 0 in 0.508s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:24:48 devstack cinder-volume[86120]: WARNING cinder.volume.drivers.remotefs [None req-d1a6e33d-00cb-4b78-9352-2bddc63808fd tempest-SnapshotsActionsTest-1556821077 None] /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039.a5440f8a-2675-4c98-b58a-7d363ff2f794 is being set with open permissions: ugo+rw
Nov 03 18:24:48 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-d1a6e33d-00cb-4b78-9352-2bddc63808fd tempest-SnapshotsActionsTest-1556821077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039.a5440f8a-2675-4c98-b58a-7d363ff2f794 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:24:48 devstack sudo[89996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039.a5440f8a-2675-4c98-b58a-7d363ff2f794
Nov 03 18:24:48 devstack sudo[89996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:24:48 devstack cinder-volume[86120]: DEBUG cinder.image.image_utils [None req-a8190df2-9e11-436b-a264-fe355e5bdea5 tempest-ServerActionsTestOtherA-913173699 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_83b28d58-14b6-4404-8354-5cfe237c5c95_co08y7v6devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86120) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 03 18:24:48 devstack cinder-volume[86120]: INFO cinder.image.image_utils [None req-a8190df2-9e11-436b-a264-fe355e5bdea5 tempest-ServerActionsTestOtherA-913173699 None] Image download 20.69 MB at 20.69 MB/s
Nov 03 18:24:48 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[222bf08d-4ae0-465d-bd33-500738cd9525]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:24:48 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-a8190df2-9e11-436b-a264-fe355e5bdea5 tempest-ServerActionsTestOtherA-913173699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_83b28d58-14b6-4404-8354-5cfe237c5c95_co08y7v6devstack@QuobyteHD {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:24:48 devstack sudo[89990]: pam_unix(sudo:session): session closed for user root
Nov 03 18:24:48 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [req-d7b93191-6f92-4159-8884-17a3bcd922ad req-f2c0c9de-b5a6-42fd-937d-12a364492090 tempest-VolumesGetTestJSON-1684709547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8bd58927-5ea4-47ef-a017-24d400c49282" returned: 0 in 0.459s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:24:48 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [req-d7b93191-6f92-4159-8884-17a3bcd922ad req-f2c0c9de-b5a6-42fd-937d-12a364492090 tempest-VolumesGetTestJSON-1684709547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8bd58927-5ea4-47ef-a017-24d400c49282 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:24:48 devstack sudo[90004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8bd58927-5ea4-47ef-a017-24d400c49282
Nov 03 18:24:48 devstack sudo[90004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:24:48 devstack sudo[89999]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_83b28d58-14b6-4404-8354-5cfe237c5c95_co08y7v6devstack@QuobyteHD
Nov 03 18:24:48 devstack sudo[89999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:24:48 devstack sudo[89996]: pam_unix(sudo:session): session closed for user root
Nov 03 18:24:48 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-d1a6e33d-00cb-4b78-9352-2bddc63808fd tempest-SnapshotsActionsTest-1556821077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039.a5440f8a-2675-4c98-b58a-7d363ff2f794" returned: 0 in 0.339s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:24:48 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-d1a6e33d-00cb-4b78-9352-2bddc63808fd tempest-SnapshotsActionsTest-1556821077 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.269s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:24:48 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-d1a6e33d-00cb-4b78-9352-2bddc63808fd tempest-SnapshotsActionsTest-1556821077 None] Create snapshot completed successfully
Nov 03 18:24:48 devstack sudo[89999]: pam_unix(sudo:session): session closed for user root
Nov 03 18:24:48 devstack sudo[90004]: pam_unix(sudo:session): session closed for user root
Nov 03 18:24:48 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-a8190df2-9e11-436b-a264-fe355e5bdea5 tempest-ServerActionsTestOtherA-913173699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_83b28d58-14b6-4404-8354-5cfe237c5c95_co08y7v6devstack@QuobyteHD" returned: 0 in 0.457s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:24:48 devstack cinder-volume[86120]: DEBUG cinder.image.image_utils [None req-a8190df2-9e11-436b-a264-fe355e5bdea5 tempest-ServerActionsTestOtherA-913173699 None] Temporary image 83b28d58-14b6-4404-8354-5cfe237c5c95 is fetched for user b59dba7ab59a483096665c78481a0796. {{(pid=86120) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 03 18:24:48 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [req-d7b93191-6f92-4159-8884-17a3bcd922ad req-f2c0c9de-b5a6-42fd-937d-12a364492090 tempest-VolumesGetTestJSON-1684709547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8bd58927-5ea4-47ef-a017-24d400c49282" returned: 0 in 0.329s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:24:48 devstack cinder-volume[86120]: DEBUG cinder.coordination [req-d7b93191-6f92-4159-8884-17a3bcd922ad req-f2c0c9de-b5a6-42fd-937d-12a364492090 tempest-VolumesGetTestJSON-1684709547 None] Lock "cinder-quobyte-8bd58927-5ea4-47ef-a017-24d400c49282" released by "delete_volume" :: held 0.894s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:24:48 devstack cinder-volume[86120]: DEBUG cinder.quota [req-d7b93191-6f92-4159-8884-17a3bcd922ad req-f2c0c9de-b5a6-42fd-937d-12a364492090 tempest-VolumesGetTestJSON-1684709547 None] Created reservations ['9b22d4d0-2a22-4448-8094-a9bf0659f061', 'b46287e5-1385-4322-8dc6-0b3c59d8c6df', '8adff24a-e00f-4170-b7c5-f0a6a87eb8d5', '717b6ab6-752d-4a6e-967a-32bfb61cdce7'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:24:48 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[70740bfc-9a3d-4324-b432-29aa45fc39c5]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:24:48 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-a8190df2-9e11-436b-a264-fe355e5bdea5 tempest-ServerActionsTestOtherA-913173699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_83b28d58-14b6-4404-8354-5cfe237c5c95_co08y7v6devstack@QuobyteHD {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:24:48 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [req-d7b93191-6f92-4159-8884-17a3bcd922ad req-f2c0c9de-b5a6-42fd-937d-12a364492090 tempest-VolumesGetTestJSON-1684709547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:24:48 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [req-d7b93191-6f92-4159-8884-17a3bcd922ad req-f2c0c9de-b5a6-42fd-937d-12a364492090 tempest-VolumesGetTestJSON-1684709547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:24:48 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [req-d7b93191-6f92-4159-8884-17a3bcd922ad req-f2c0c9de-b5a6-42fd-937d-12a364492090 tempest-VolumesGetTestJSON-1684709547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:24:49 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [req-d7b93191-6f92-4159-8884-17a3bcd922ad req-f2c0c9de-b5a6-42fd-937d-12a364492090 tempest-VolumesGetTestJSON-1684709547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:24:49 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [req-d7b93191-6f92-4159-8884-17a3bcd922ad req-f2c0c9de-b5a6-42fd-937d-12a364492090 tempest-VolumesGetTestJSON-1684709547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:24:49 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [req-d7b93191-6f92-4159-8884-17a3bcd922ad req-f2c0c9de-b5a6-42fd-937d-12a364492090 tempest-VolumesGetTestJSON-1684709547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:24:49 devstack sudo[90013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:24:49 devstack sudo[90013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:24:49 devstack sudo[90012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_83b28d58-14b6-4404-8354-5cfe237c5c95_co08y7v6devstack@QuobyteHD
Nov 03 18:24:49 devstack sudo[90012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:24:49 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-ba866e5d-91bb-439b-8c2c-184fccc56abc tempest-SnapshotsActionsTest-237430834 None] Acquiring lock "cinder-a5440f8a-2675-4c98-b58a-7d363ff2f794-delete_snapshot" by "delete_snapshot" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:24:49 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-ba866e5d-91bb-439b-8c2c-184fccc56abc tempest-SnapshotsActionsTest-237430834 None] Lock "cinder-a5440f8a-2675-4c98-b58a-7d363ff2f794-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:24:49 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-ba866e5d-91bb-439b-8c2c-184fccc56abc tempest-SnapshotsActionsTest-237430834 None] Acquiring lock "cinder-quobyte-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039" by "delete_snapshot" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:24:49 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-ba866e5d-91bb-439b-8c2c-184fccc56abc tempest-SnapshotsActionsTest-237430834 None] Lock "cinder-quobyte-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:24:49 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-ba866e5d-91bb-439b-8c2c-184fccc56abc tempest-SnapshotsActionsTest-237430834 None] Acquiring lock "cinder-quobyte-a5440f8a-2675-4c98-b58a-7d363ff2f794" by "_delete_snapshot" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:24:49 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-ba866e5d-91bb-439b-8c2c-184fccc56abc tempest-SnapshotsActionsTest-237430834 None] Lock "cinder-quobyte-a5440f8a-2675-4c98-b58a-7d363ff2f794" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:24:49 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-ba866e5d-91bb-439b-8c2c-184fccc56abc tempest-SnapshotsActionsTest-237430834 None] Deleting offline snapshot a5440f8a-2675-4c98-b58a-7d363ff2f794 of volume dbf5a8e9-33bc-4c52-98f1-b5eb25f48039 {{(pid=86120) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 18:24:49 devstack sudo[90013]: pam_unix(sudo:session): session closed for user root
Nov 03 18:24:49 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-ba866e5d-91bb-439b-8c2c-184fccc56abc tempest-SnapshotsActionsTest-237430834 None] snapshot_file for this snap is: volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039.a5440f8a-2675-4c98-b58a-7d363ff2f794 {{(pid=86120) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 18:24:49 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [req-d7b93191-6f92-4159-8884-17a3bcd922ad req-f2c0c9de-b5a6-42fd-937d-12a364492090 tempest-VolumesGetTestJSON-1684709547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.380s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:24:49 devstack sudo[90012]: pam_unix(sudo:session): session closed for user root
Nov 03 18:24:49 devstack cinder-volume[86120]: DEBUG cinder.manager [req-d7b93191-6f92-4159-8884-17a3bcd922ad req-f2c0c9de-b5a6-42fd-937d-12a364492090 tempest-VolumesGetTestJSON-1684709547 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:24:49 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-a8190df2-9e11-436b-a264-fe355e5bdea5 tempest-ServerActionsTestOtherA-913173699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_83b28d58-14b6-4404-8354-5cfe237c5c95_co08y7v6devstack@QuobyteHD" returned: 0 in 0.484s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:24:49 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-a8190df2-9e11-436b-a264-fe355e5bdea5 tempest-ServerActionsTestOtherA-913173699 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:24:49 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-a8190df2-9e11-436b-a264-fe355e5bdea5 tempest-ServerActionsTestOtherA-913173699 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:24:49 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-a8190df2-9e11-436b-a264-fe355e5bdea5 tempest-ServerActionsTestOtherA-913173699 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:24:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-783567645',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1e5365c-d629-4abc-bae0-700bacd2d382,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f06860b9996343eca46639219b8b45a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:24:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:24:47Z,use_quota=True,user_id='b59dba7ab59a483096665c78481a0796',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:24:49 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-a8190df2-9e11-436b-a264-fe355e5bdea5 tempest-ServerActionsTestOtherA-913173699 None] Creating volume b1e5365c-d629-4abc-bae0-700bacd2d382 {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:24:49 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-a8190df2-9e11-436b-a264-fe355e5bdea5 tempest-ServerActionsTestOtherA-913173699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:24:49 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-a8190df2-9e11-436b-a264-fe355e5bdea5 tempest-ServerActionsTestOtherA-913173699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:24:49 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-a8190df2-9e11-436b-a264-fe355e5bdea5 tempest-ServerActionsTestOtherA-913173699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:24:49 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-a8190df2-9e11-436b-a264-fe355e5bdea5 tempest-ServerActionsTestOtherA-913173699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:24:49 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-a8190df2-9e11-436b-a264-fe355e5bdea5 tempest-ServerActionsTestOtherA-913173699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:24:49 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-a8190df2-9e11-436b-a264-fe355e5bdea5 tempest-ServerActionsTestOtherA-913173699 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:24:49 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-a8190df2-9e11-436b-a264-fe355e5bdea5 tempest-ServerActionsTestOtherA-913173699 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:24:49 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-a8190df2-9e11-436b-a264-fe355e5bdea5 tempest-ServerActionsTestOtherA-913173699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-b1e5365c-d629-4abc-bae0-700bacd2d382 1073741824 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:24:49 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[3850397c-1a58-4e3a-bdcc-96860f22c750]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:24:49 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-ba866e5d-91bb-439b-8c2c-184fccc56abc tempest-SnapshotsActionsTest-237430834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039.a5440f8a-2675-4c98-b58a-7d363ff2f794 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:24:49 devstack sudo[90020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-b1e5365c-d629-4abc-bae0-700bacd2d382 1073741824
Nov 03 18:24:49 devstack cinder-volume[86120]: INFO cinder.volume.manager [req-d7b93191-6f92-4159-8884-17a3bcd922ad req-f2c0c9de-b5a6-42fd-937d-12a364492090 tempest-VolumesGetTestJSON-1684709547 None] Deleted volume successfully.
Nov 03 18:24:49 devstack sudo[90020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:24:49 devstack cinder-volume[86120]: DEBUG cinder.coordination [req-d7b93191-6f92-4159-8884-17a3bcd922ad req-f2c0c9de-b5a6-42fd-937d-12a364492090 tempest-VolumesGetTestJSON-1684709547 None] Lock "cinder-8bd58927-5ea4-47ef-a017-24d400c49282-delete_volume" released by "delete_volume" :: held 1.676s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:24:49 devstack sudo[90021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039.a5440f8a-2675-4c98-b58a-7d363ff2f794
Nov 03 18:24:49 devstack sudo[90021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:24:49 devstack sudo[90021]: pam_unix(sudo:session): session closed for user root
Nov 03 18:24:49 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-ba866e5d-91bb-439b-8c2c-184fccc56abc tempest-SnapshotsActionsTest-237430834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039.a5440f8a-2675-4c98-b58a-7d363ff2f794" returned: 0 in 0.416s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:24:49 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-ba866e5d-91bb-439b-8c2c-184fccc56abc tempest-SnapshotsActionsTest-237430834 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86120) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 18:24:49 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c611240-6148-4edb-a059-f719b70c9cb2]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:24:49 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-ba866e5d-91bb-439b-8c2c-184fccc56abc tempest-SnapshotsActionsTest-237430834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039.a43bab75-892a-4d77-bb53-3d89af613f4c {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:24:49 devstack sudo[90020]: pam_unix(sudo:session): session closed for user root
Nov 03 18:24:49 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-a8190df2-9e11-436b-a264-fe355e5bdea5 tempest-ServerActionsTestOtherA-913173699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-b1e5365c-d629-4abc-bae0-700bacd2d382 1073741824" returned: 0 in 0.548s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:24:49 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-a8190df2-9e11-436b-a264-fe355e5bdea5 tempest-ServerActionsTestOtherA-913173699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-b1e5365c-d629-4abc-bae0-700bacd2d382 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:24:50 devstack sudo[90032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039.a43bab75-892a-4d77-bb53-3d89af613f4c
Nov 03 18:24:50 devstack sudo[90032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:24:50 devstack sudo[90033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-b1e5365c-d629-4abc-bae0-700bacd2d382
Nov 03 18:24:50 devstack sudo[90033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:24:50 devstack sudo[90032]: pam_unix(sudo:session): session closed for user root
Nov 03 18:24:50 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-ba866e5d-91bb-439b-8c2c-184fccc56abc tempest-SnapshotsActionsTest-237430834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039.a43bab75-892a-4d77-bb53-3d89af613f4c" returned: 0 in 0.504s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:24:50 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-ba866e5d-91bb-439b-8c2c-184fccc56abc tempest-SnapshotsActionsTest-237430834 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86120) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 18:24:50 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-ba866e5d-91bb-439b-8c2c-184fccc56abc tempest-SnapshotsActionsTest-237430834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039.a5440f8a-2675-4c98-b58a-7d363ff2f794 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:24:50 devstack sudo[90040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039.a5440f8a-2675-4c98-b58a-7d363ff2f794
Nov 03 18:24:50 devstack sudo[90040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:24:50 devstack sudo[90033]: pam_unix(sudo:session): session closed for user root
Nov 03 18:24:50 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-a8190df2-9e11-436b-a264-fe355e5bdea5 tempest-ServerActionsTestOtherA-913173699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-b1e5365c-d629-4abc-bae0-700bacd2d382" returned: 0 in 0.457s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:24:50 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-a8190df2-9e11-436b-a264-fe355e5bdea5 tempest-ServerActionsTestOtherA-913173699 None] <== create_volume: return (1057ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:24:50 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-a8190df2-9e11-436b-a264-fe355e5bdea5 tempest-ServerActionsTestOtherA-913173699 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.063s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:24:50 devstack cinder-volume[86120]: DEBUG cinder.volume.volume_utils [None req-a8190df2-9e11-436b-a264-fe355e5bdea5 tempest-ServerActionsTestOtherA-913173699 None] Attempting download of 83b28d58-14b6-4404-8354-5cfe237c5c95 ((None, [{'url': 'file:///opt/stack/data/glance/images/83b28d58-14b6-4404-8354-5cfe237c5c95', 'metadata': {}}])) to volume b1e5365c-d629-4abc-bae0-700bacd2d382. {{(pid=86120) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 03 18:24:50 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[90fa7c96-7e78-42a9-8ee6-dd9b6dcfc804]: (4, 'raw') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:24:50 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-a8190df2-9e11-436b-a264-fe355e5bdea5 tempest-ServerActionsTestOtherA-913173699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_83b28d58-14b6-4404-8354-5cfe237c5c95_frb2ppdn {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:24:50 devstack sudo[90042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_83b28d58-14b6-4404-8354-5cfe237c5c95_frb2ppdn
Nov 03 18:24:50 devstack sudo[90042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:24:50 devstack sudo[90040]: pam_unix(sudo:session): session closed for user root
Nov 03 18:24:50 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-ba866e5d-91bb-439b-8c2c-184fccc56abc tempest-SnapshotsActionsTest-237430834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039.a5440f8a-2675-4c98-b58a-7d363ff2f794" returned: 0 in 0.507s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:24:50 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-ba866e5d-91bb-439b-8c2c-184fccc56abc tempest-SnapshotsActionsTest-237430834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039.a5440f8a-2675-4c98-b58a-7d363ff2f794 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:24:50 devstack sudo[90048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039.a5440f8a-2675-4c98-b58a-7d363ff2f794
Nov 03 18:24:50 devstack sudo[90048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:24:51 devstack sudo[90042]: pam_unix(sudo:session): session closed for user root
Nov 03 18:24:51 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-a8190df2-9e11-436b-a264-fe355e5bdea5 tempest-ServerActionsTestOtherA-913173699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_83b28d58-14b6-4404-8354-5cfe237c5c95_frb2ppdn" returned: 0 in 0.460s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:24:51 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-a8190df2-9e11-436b-a264-fe355e5bdea5 tempest-ServerActionsTestOtherA-913173699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_83b28d58-14b6-4404-8354-5cfe237c5c95_frb2ppdn {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:24:51 devstack sudo[90052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_83b28d58-14b6-4404-8354-5cfe237c5c95_frb2ppdn
Nov 03 18:24:51 devstack sudo[90052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:24:51 devstack sudo[90048]: pam_unix(sudo:session): session closed for user root
Nov 03 18:24:51 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-ba866e5d-91bb-439b-8c2c-184fccc56abc tempest-SnapshotsActionsTest-237430834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039.a5440f8a-2675-4c98-b58a-7d363ff2f794" returned: 0 in 0.362s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:24:51 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-ba866e5d-91bb-439b-8c2c-184fccc56abc tempest-SnapshotsActionsTest-237430834 None] Lock "cinder-quobyte-a5440f8a-2675-4c98-b58a-7d363ff2f794" released by "_delete_snapshot" :: held 1.974s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:24:51 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-ba866e5d-91bb-439b-8c2c-184fccc56abc tempest-SnapshotsActionsTest-237430834 None] Lock "cinder-quobyte-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039" released by "delete_snapshot" :: held 2.014s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:24:51 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-ba866e5d-91bb-439b-8c2c-184fccc56abc tempest-SnapshotsActionsTest-237430834 None] Created reservations ['c8c3eefa-800a-4238-b495-d1e5ad4c786b', 'f3a41a73-8236-483b-9560-dbbd694c3aee', 'ef812fdf-ba95-4b86-9578-45fd42890406', '2414541c-c3af-427b-ad7b-c49481356228'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:24:51 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-ba866e5d-91bb-439b-8c2c-184fccc56abc tempest-SnapshotsActionsTest-237430834 None] Delete snapshot completed successfully.
Nov 03 18:24:51 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-ba866e5d-91bb-439b-8c2c-184fccc56abc tempest-SnapshotsActionsTest-237430834 None] Lock "cinder-a5440f8a-2675-4c98-b58a-7d363ff2f794-delete_snapshot" released by "delete_snapshot" :: held 2.220s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:24:51 devstack sudo[90052]: pam_unix(sudo:session): session closed for user root
Nov 03 18:24:51 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-a8190df2-9e11-436b-a264-fe355e5bdea5 tempest-ServerActionsTestOtherA-913173699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_83b28d58-14b6-4404-8354-5cfe237c5c95_frb2ppdn" returned: 1 in 0.502s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:24:51 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-a8190df2-9e11-436b-a264-fe355e5bdea5 tempest-ServerActionsTestOtherA-913173699 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_83b28d58-14b6-4404-8354-5cfe237c5c95_frb2ppdn' failed. Not Retrying. {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 03 18:24:51 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b7f98f6-859c-4d8d-a779-653b0c034a4c]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:24:51 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-a8190df2-9e11-436b-a264-fe355e5bdea5 tempest-ServerActionsTestOtherA-913173699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_83b28d58-14b6-4404-8354-5cfe237c5c95_co08y7v6devstack@QuobyteHD {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:24:51 devstack sudo[90057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_83b28d58-14b6-4404-8354-5cfe237c5c95_co08y7v6devstack@QuobyteHD
Nov 03 18:24:51 devstack sudo[90057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:24:51 devstack sudo[90057]: pam_unix(sudo:session): session closed for user root
Nov 03 18:24:51 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-a8190df2-9e11-436b-a264-fe355e5bdea5 tempest-ServerActionsTestOtherA-913173699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_83b28d58-14b6-4404-8354-5cfe237c5c95_co08y7v6devstack@QuobyteHD" returned: 0 in 0.438s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:24:51 devstack cinder-volume[86120]: DEBUG cinder.image.image_utils [None req-a8190df2-9e11-436b-a264-fe355e5bdea5 tempest-ServerActionsTestOtherA-913173699 None] 83b28d58-14b6-4404-8354-5cfe237c5c95 was qcow2, converting to qcow2 {{(pid=86120) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 03 18:24:51 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-a8190df2-9e11-436b-a264-fe355e5bdea5 tempest-ServerActionsTestOtherA-913173699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_83b28d58-14b6-4404-8354-5cfe237c5c95_co08y7v6devstack@QuobyteHD /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-b1e5365c-d629-4abc-bae0-700bacd2d382 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:24:52 devstack sudo[90062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_83b28d58-14b6-4404-8354-5cfe237c5c95_co08y7v6devstack@QuobyteHD /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-b1e5365c-d629-4abc-bae0-700bacd2d382
Nov 03 18:24:52 devstack sudo[90062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:24:53 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-fd2ff8ee-9a96-4df2-88aa-b13778368a2e tempest-SnapshotsActionsTest-1556821077 None] Acquiring lock "cinder-a43bab75-892a-4d77-bb53-3d89af613f4c-delete_snapshot" by "delete_snapshot" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:24:53 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-fd2ff8ee-9a96-4df2-88aa-b13778368a2e tempest-SnapshotsActionsTest-1556821077 None] Lock "cinder-a43bab75-892a-4d77-bb53-3d89af613f4c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:24:53 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-fd2ff8ee-9a96-4df2-88aa-b13778368a2e tempest-SnapshotsActionsTest-1556821077 None] Acquiring lock "cinder-quobyte-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039" by "delete_snapshot" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:24:53 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-fd2ff8ee-9a96-4df2-88aa-b13778368a2e tempest-SnapshotsActionsTest-1556821077 None] Lock "cinder-quobyte-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:24:53 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-fd2ff8ee-9a96-4df2-88aa-b13778368a2e tempest-SnapshotsActionsTest-1556821077 None] Acquiring lock "cinder-quobyte-a43bab75-892a-4d77-bb53-3d89af613f4c" by "_delete_snapshot" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:24:53 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-fd2ff8ee-9a96-4df2-88aa-b13778368a2e tempest-SnapshotsActionsTest-1556821077 None] Lock "cinder-quobyte-a43bab75-892a-4d77-bb53-3d89af613f4c" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:24:53 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-fd2ff8ee-9a96-4df2-88aa-b13778368a2e tempest-SnapshotsActionsTest-1556821077 None] Deleting offline snapshot a43bab75-892a-4d77-bb53-3d89af613f4c of volume dbf5a8e9-33bc-4c52-98f1-b5eb25f48039 {{(pid=86120) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 18:24:53 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-fd2ff8ee-9a96-4df2-88aa-b13778368a2e tempest-SnapshotsActionsTest-1556821077 None] snapshot_file for this snap is: volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039.a43bab75-892a-4d77-bb53-3d89af613f4c {{(pid=86120) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 18:24:53 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[312abfd0-32bf-4d47-88f9-965704a75b9e]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:24:53 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-fd2ff8ee-9a96-4df2-88aa-b13778368a2e tempest-SnapshotsActionsTest-1556821077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039.a43bab75-892a-4d77-bb53-3d89af613f4c {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:24:53 devstack sudo[90069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039.a43bab75-892a-4d77-bb53-3d89af613f4c
Nov 03 18:24:53 devstack sudo[90069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:24:54 devstack sudo[90069]: pam_unix(sudo:session): session closed for user root
Nov 03 18:24:54 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-fd2ff8ee-9a96-4df2-88aa-b13778368a2e tempest-SnapshotsActionsTest-1556821077 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039.a43bab75-892a-4d77-bb53-3d89af613f4c" returned: 0 in 0.540s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:24:54 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-fd2ff8ee-9a96-4df2-88aa-b13778368a2e tempest-SnapshotsActionsTest-1556821077 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86120) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 18:24:54 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[e35dff8f-c6fa-4fec-ac0b-c8ec339c460a]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:24:54 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-fd2ff8ee-9a96-4df2-88aa-b13778368a2e tempest-SnapshotsActionsTest-1556821077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:24:54 devstack sudo[90074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039
Nov 03 18:24:54 devstack sudo[90074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:24:54 devstack sudo[90062]: pam_unix(sudo:session): session closed for user root
Nov 03 18:24:54 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-a8190df2-9e11-436b-a264-fe355e5bdea5 tempest-ServerActionsTestOtherA-913173699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_83b28d58-14b6-4404-8354-5cfe237c5c95_co08y7v6devstack@QuobyteHD /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-b1e5365c-d629-4abc-bae0-700bacd2d382" returned: 0 in 2.496s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:24:54 devstack cinder-volume[86120]: DEBUG cinder.image.image_utils [None req-a8190df2-9e11-436b-a264-fe355e5bdea5 tempest-ServerActionsTestOtherA-913173699 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_83b28d58-14b6-4404-8354-5cfe237c5c95_co08y7v6devstack@QuobyteHD, size 112.00 MB, duration 2.50 sec, destination /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-b1e5365c-d629-4abc-bae0-700bacd2d382 {{(pid=86120) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 03 18:24:54 devstack cinder-volume[86120]: INFO cinder.image.image_utils [None req-a8190df2-9e11-436b-a264-fe355e5bdea5 tempest-ServerActionsTestOtherA-913173699 None] Converted 112.00 MB image at 44.85 MB/s
Nov 03 18:24:54 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-a8190df2-9e11-436b-a264-fe355e5bdea5 tempest-ServerActionsTestOtherA-913173699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-b1e5365c-d629-4abc-bae0-700bacd2d382 1G {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:24:54 devstack sudo[90076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-b1e5365c-d629-4abc-bae0-700bacd2d382 1G
Nov 03 18:24:54 devstack sudo[90076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:24:54 devstack sudo[90074]: pam_unix(sudo:session): session closed for user root
Nov 03 18:24:54 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-fd2ff8ee-9a96-4df2-88aa-b13778368a2e tempest-SnapshotsActionsTest-1556821077 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039" returned: 0 in 0.507s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:24:54 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-fd2ff8ee-9a96-4df2-88aa-b13778368a2e tempest-SnapshotsActionsTest-1556821077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039.a43bab75-892a-4d77-bb53-3d89af613f4c {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:24:54 devstack sudo[90082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039.a43bab75-892a-4d77-bb53-3d89af613f4c
Nov 03 18:24:54 devstack sudo[90082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:24:54 devstack sudo[90076]: pam_unix(sudo:session): session closed for user root
Nov 03 18:24:54 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-a8190df2-9e11-436b-a264-fe355e5bdea5 tempest-ServerActionsTestOtherA-913173699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-b1e5365c-d629-4abc-bae0-700bacd2d382 1G" returned: 0 in 0.480s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:24:54 devstack cinder-volume[86120]: DEBUG cinder.volume.volume_utils [None req-a8190df2-9e11-436b-a264-fe355e5bdea5 tempest-ServerActionsTestOtherA-913173699 None] Downloaded image 83b28d58-14b6-4404-8354-5cfe237c5c95 ((None, [{'url': 'file:///opt/stack/data/glance/images/83b28d58-14b6-4404-8354-5cfe237c5c95', 'metadata': {}}])) to volume b1e5365c-d629-4abc-bae0-700bacd2d382 successfully. {{(pid=86120) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 03 18:24:54 devstack cinder-volume[86120]: DEBUG cinder.image.image_utils [None req-a8190df2-9e11-436b-a264-fe355e5bdea5 tempest-ServerActionsTestOtherA-913173699 None] Temporary image 83b28d58-14b6-4404-8354-5cfe237c5c95 for user b59dba7ab59a483096665c78481a0796 is deleted. {{(pid=86120) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 03 18:24:54 devstack cinder-volume[86120]: DEBUG cinder.volume.volume_utils [None req-a8190df2-9e11-436b-a264-fe355e5bdea5 tempest-ServerActionsTestOtherA-913173699 None] Marking volume b1e5365c-d629-4abc-bae0-700bacd2d382 as bootable. {{(pid=86120) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 03 18:24:55 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8190df2-9e11-436b-a264-fe355e5bdea5 tempest-ServerActionsTestOtherA-913173699 None] Copying metadata from image 83b28d58-14b6-4404-8354-5cfe237c5c95 to b1e5365c-d629-4abc-bae0-700bacd2d382. {{(pid=86120) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 03 18:24:55 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8190df2-9e11-436b-a264-fe355e5bdea5 tempest-ServerActionsTestOtherA-913173699 None] Creating volume glance metadata for volume b1e5365c-d629-4abc-bae0-700bacd2d382 backed by image 83b28d58-14b6-4404-8354-5cfe237c5c95 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '83b28d58-14b6-4404-8354-5cfe237c5c95', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86120) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 03 18:24:55 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-a8190df2-9e11-436b-a264-fe355e5bdea5 tempest-ServerActionsTestOtherA-913173699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a7f8416-6290-42ba-80eb-eb36a7f11089) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1e5365c-d629-4abc-bae0-700bacd2d382', 'volume_size': 1, 'image_id': '83b28d58-14b6-4404-8354-5cfe237c5c95', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/83b28d58-14b6-4404-8354-5cfe237c5c95', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4b0f900e807a4827ba1f8686981981d9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '83b28d58-14b6-4404-8354-5cfe237c5c95', 'created_at': datetime.datetime(2026, 11, 3, 17, 17, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 17, 17, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/83b28d58-14b6-4404-8354-5cfe237c5c95/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7a8d3c5eae40>}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:24:55 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-a8190df2-9e11-436b-a264-fe355e5bdea5 tempest-ServerActionsTestOtherA-913173699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d3df436-2032-424f-a202-ebf508bf9a79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:24:55 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-a8190df2-9e11-436b-a264-fe355e5bdea5 tempest-ServerActionsTestOtherA-913173699 None] Volume volume-b1e5365c-d629-4abc-bae0-700bacd2d382 (b1e5365c-d629-4abc-bae0-700bacd2d382): created successfully
Nov 03 18:24:55 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-a8190df2-9e11-436b-a264-fe355e5bdea5 tempest-ServerActionsTestOtherA-913173699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d3df436-2032-424f-a202-ebf508bf9a79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:24:55 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-a8190df2-9e11-436b-a264-fe355e5bdea5 tempest-ServerActionsTestOtherA-913173699 None] Flow 'volume_create_manager' (c899479f-c759-497d-a33d-1591cfa55642) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:24:55 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-a8190df2-9e11-436b-a264-fe355e5bdea5 tempest-ServerActionsTestOtherA-913173699 None] Created volume successfully.
Nov 03 18:24:55 devstack sudo[90082]: pam_unix(sudo:session): session closed for user root
Nov 03 18:24:55 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-fd2ff8ee-9a96-4df2-88aa-b13778368a2e tempest-SnapshotsActionsTest-1556821077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039.a43bab75-892a-4d77-bb53-3d89af613f4c" returned: 0 in 0.511s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:24:55 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-fd2ff8ee-9a96-4df2-88aa-b13778368a2e tempest-SnapshotsActionsTest-1556821077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039.a43bab75-892a-4d77-bb53-3d89af613f4c {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:24:55 devstack sudo[90092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039.a43bab75-892a-4d77-bb53-3d89af613f4c
Nov 03 18:24:55 devstack sudo[90092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:24:55 devstack sudo[90092]: pam_unix(sudo:session): session closed for user root
Nov 03 18:24:55 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-fd2ff8ee-9a96-4df2-88aa-b13778368a2e tempest-SnapshotsActionsTest-1556821077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039.a43bab75-892a-4d77-bb53-3d89af613f4c" returned: 0 in 0.259s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:24:55 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-fd2ff8ee-9a96-4df2-88aa-b13778368a2e tempest-SnapshotsActionsTest-1556821077 None] Lock "cinder-quobyte-a43bab75-892a-4d77-bb53-3d89af613f4c" released by "_delete_snapshot" :: held 1.994s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:24:55 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-fd2ff8ee-9a96-4df2-88aa-b13778368a2e tempest-SnapshotsActionsTest-1556821077 None] Lock "cinder-quobyte-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039" released by "delete_snapshot" :: held 2.032s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:24:55 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-fd2ff8ee-9a96-4df2-88aa-b13778368a2e tempest-SnapshotsActionsTest-1556821077 None] Created reservations ['cb61e7c3-0e63-4a27-83d1-66394c81ed74', 'ea1d81c2-fcd9-496c-b4bd-b861a0778c5d', 'c68acabf-6bca-4ee5-a736-df67ce140eb3', '1d92a3d0-9682-4d72-a4f6-98fe170751c1'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:24:55 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-fd2ff8ee-9a96-4df2-88aa-b13778368a2e tempest-SnapshotsActionsTest-1556821077 None] Delete snapshot completed successfully.
Nov 03 18:24:55 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-fd2ff8ee-9a96-4df2-88aa-b13778368a2e tempest-SnapshotsActionsTest-1556821077 None] Lock "cinder-a43bab75-892a-4d77-bb53-3d89af613f4c-delete_snapshot" released by "delete_snapshot" :: held 2.213s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:24:56 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-b1d3ac74-516c-4da7-81b9-9c052a7e7879 tempest-SnapshotsActionsTest-1556821077 None] Acquiring lock "cinder-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:24:56 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-b1d3ac74-516c-4da7-81b9-9c052a7e7879 tempest-SnapshotsActionsTest-1556821077 None] Lock "cinder-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:24:57 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-b1d3ac74-516c-4da7-81b9-9c052a7e7879 tempest-SnapshotsActionsTest-1556821077 None] Acquiring lock "cinder-quobyte-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:24:57 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-b1d3ac74-516c-4da7-81b9-9c052a7e7879 tempest-SnapshotsActionsTest-1556821077 None] Lock "cinder-quobyte-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039" acquired by "delete_volume" :: waited 0.024s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:24:57 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2d221fb-bb52-4371-9ede-52dcfdd451c9]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:24:57 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b1d3ac74-516c-4da7-81b9-9c052a7e7879 tempest-SnapshotsActionsTest-1556821077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:24:57 devstack sudo[90097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039
Nov 03 18:24:57 devstack sudo[90097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:24:57 devstack sudo[90097]: pam_unix(sudo:session): session closed for user root
Nov 03 18:24:57 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b1d3ac74-516c-4da7-81b9-9c052a7e7879 tempest-SnapshotsActionsTest-1556821077 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039" returned: 0 in 0.544s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:24:57 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b1d3ac74-516c-4da7-81b9-9c052a7e7879 tempest-SnapshotsActionsTest-1556821077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:24:57 devstack sudo[90105]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039
Nov 03 18:24:57 devstack sudo[90105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:24:58 devstack sudo[90105]: pam_unix(sudo:session): session closed for user root
Nov 03 18:24:58 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b1d3ac74-516c-4da7-81b9-9c052a7e7879 tempest-SnapshotsActionsTest-1556821077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039" returned: 0 in 0.345s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:24:58 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-b1d3ac74-516c-4da7-81b9-9c052a7e7879 tempest-SnapshotsActionsTest-1556821077 None] Lock "cinder-quobyte-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039" released by "delete_volume" :: held 1.019s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:24:58 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-b1d3ac74-516c-4da7-81b9-9c052a7e7879 tempest-SnapshotsActionsTest-1556821077 None] Created reservations ['ce8a0a80-7049-4bb9-8e7b-fce1d4d6f47a', 'cb90e251-c44e-4c50-8c36-ddcd0b9c3584', '461a0422-2d5d-4d7a-8738-11598f6bcc10', '7b04da7e-f8e2-4f37-85b8-af0cbddee365'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:24:58 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-b1d3ac74-516c-4da7-81b9-9c052a7e7879 tempest-SnapshotsActionsTest-1556821077 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:24:58 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-b1d3ac74-516c-4da7-81b9-9c052a7e7879 tempest-SnapshotsActionsTest-1556821077 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:24:58 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-b1d3ac74-516c-4da7-81b9-9c052a7e7879 tempest-SnapshotsActionsTest-1556821077 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:24:58 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-b1d3ac74-516c-4da7-81b9-9c052a7e7879 tempest-SnapshotsActionsTest-1556821077 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:24:58 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-b1d3ac74-516c-4da7-81b9-9c052a7e7879 tempest-SnapshotsActionsTest-1556821077 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:24:58 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b1d3ac74-516c-4da7-81b9-9c052a7e7879 tempest-SnapshotsActionsTest-1556821077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:24:58 devstack sudo[90111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:24:58 devstack sudo[90111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:24:58 devstack sudo[90111]: pam_unix(sudo:session): session closed for user root
Nov 03 18:24:58 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b1d3ac74-516c-4da7-81b9-9c052a7e7879 tempest-SnapshotsActionsTest-1556821077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.340s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:24:58 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-b1d3ac74-516c-4da7-81b9-9c052a7e7879 tempest-SnapshotsActionsTest-1556821077 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:24:58 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-b1d3ac74-516c-4da7-81b9-9c052a7e7879 tempest-SnapshotsActionsTest-1556821077 None] Deleted volume successfully.
Nov 03 18:24:58 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-b1d3ac74-516c-4da7-81b9-9c052a7e7879 tempest-SnapshotsActionsTest-1556821077 None] Lock "cinder-dbf5a8e9-33bc-4c52-98f1-b5eb25f48039-delete_volume" released by "delete_volume" :: held 1.755s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:24:59 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [req-ca0fbbaf-50b4-487d-a147-f930e0344215 req-ee1433f0-8a91-4243-b6b5-9816824e4dd7 tempest-ServerActionsTestOtherA-913173699 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:24:59 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [req-ca0fbbaf-50b4-487d-a147-f930e0344215 req-ee1433f0-8a91-4243-b6b5-9816824e4dd7 tempest-ServerActionsTestOtherA-913173699 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:24:59 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [req-ca0fbbaf-50b4-487d-a147-f930e0344215 req-ee1433f0-8a91-4243-b6b5-9816824e4dd7 tempest-ServerActionsTestOtherA-913173699 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:24:59 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [req-ca0fbbaf-50b4-487d-a147-f930e0344215 req-ee1433f0-8a91-4243-b6b5-9816824e4dd7 tempest-ServerActionsTestOtherA-913173699 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c', 'name': 'volume-b1e5365c-d629-4abc-bae0-700bacd2d382', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a1206403-a45e-4838-bf1d-6701e73c4751', 'enforce_multipath': True} {{(pid=86120) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 03 18:24:59 devstack cinder-volume[86120]: INFO cinder.volume.manager [req-ca0fbbaf-50b4-487d-a147-f930e0344215 req-ee1433f0-8a91-4243-b6b5-9816824e4dd7 tempest-ServerActionsTestOtherA-913173699 None] attachment_update completed successfully.
Nov 03 18:25:01 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-f8b62e0e-9d0d-4179-accf-7ce4e599ae83 tempest-GroupSnapshotsV319Test-1010438836 None] Group tempest-GroupSnapshotsV319Test-Group-733361014: creating
Nov 03 18:25:01 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-f8b62e0e-9d0d-4179-accf-7ce4e599ae83 tempest-GroupSnapshotsV319Test-1010438836 None] Group tempest-GroupSnapshotsV319Test-Group-733361014: created successfully
Nov 03 18:25:01 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-f8b62e0e-9d0d-4179-accf-7ce4e599ae83 tempest-GroupSnapshotsV319Test-1010438836 None] Create group completed successfully.
Nov 03 18:25:03 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-049db80d-a847-4f78-a0d2-73cdd42e92f4 tempest-GroupSnapshotsV319Test-1010438836 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:25:03 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-049db80d-a847-4f78-a0d2-73cdd42e92f4 tempest-GroupSnapshotsV319Test-1010438836 None] Flow 'volume_create_manager' (f1cb582a-4816-48d2-bcdb-fad2952acd68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:25:03 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-049db80d-a847-4f78-a0d2-73cdd42e92f4 tempest-GroupSnapshotsV319Test-1010438836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac8cd2f5-f8e3-472b-9d9e-1754f9ee7953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:25:03 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-049db80d-a847-4f78-a0d2-73cdd42e92f4 tempest-GroupSnapshotsV319Test-1010438836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac8cd2f5-f8e3-472b-9d9e-1754f9ee7953) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:25:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1565102542',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=04e937f0-cb74-4c1d-9044-9ee51e1b7099,host='devstack@QuobyteHD#QuobyteHD',id=99023f0f-9d6d-4193-a4ee-881cea3857a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c13c8d3ab37411491d040434500e297',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:25:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:25:04Z,use_quota=True,user_id='3afeae2ca2aa4209b7c2e8db2dd4c59d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98e9b3e3-2fd1-4a2e-b5fb-4b2828b061fc),volume_type_id=98e9b3e3-2fd1-4a2e-b5fb-4b2828b061fc)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:25:03 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-049db80d-a847-4f78-a0d2-73cdd42e92f4 tempest-GroupSnapshotsV319Test-1010438836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a98ccc3-c31c-48e7-90fc-bb72a52b82a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:25:03 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-049db80d-a847-4f78-a0d2-73cdd42e92f4 tempest-GroupSnapshotsV319Test-1010438836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a98ccc3-c31c-48e7-90fc-bb72a52b82a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:25:03 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-049db80d-a847-4f78-a0d2-73cdd42e92f4 tempest-GroupSnapshotsV319Test-1010438836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59edd3f8-c1b5-4f0c-ade2-594746398c4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:25:03 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-049db80d-a847-4f78-a0d2-73cdd42e92f4 tempest-GroupSnapshotsV319Test-1010438836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59edd3f8-c1b5-4f0c-ade2-594746398c4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99023f0f-9d6d-4193-a4ee-881cea3857a8', 'volume_name': 'volume-99023f0f-9d6d-4193-a4ee-881cea3857a8', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:25:03 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-049db80d-a847-4f78-a0d2-73cdd42e92f4 tempest-GroupSnapshotsV319Test-1010438836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7abf4831-1802-441a-b665-c5f58d3d8faa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:25:03 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-049db80d-a847-4f78-a0d2-73cdd42e92f4 tempest-GroupSnapshotsV319Test-1010438836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7abf4831-1802-441a-b665-c5f58d3d8faa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:25:03 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-049db80d-a847-4f78-a0d2-73cdd42e92f4 tempest-GroupSnapshotsV319Test-1010438836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1948226-e630-4590-bc69-db83ea5bb395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:25:03 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-049db80d-a847-4f78-a0d2-73cdd42e92f4 tempest-GroupSnapshotsV319Test-1010438836 None] Volume 99023f0f-9d6d-4193-a4ee-881cea3857a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99023f0f-9d6d-4193-a4ee-881cea3857a8', 'volume_size': 1}
Nov 03 18:25:03 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-049db80d-a847-4f78-a0d2-73cdd42e92f4 tempest-GroupSnapshotsV319Test-1010438836 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:25:03 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-049db80d-a847-4f78-a0d2-73cdd42e92f4 tempest-GroupSnapshotsV319Test-1010438836 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:25:03 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-049db80d-a847-4f78-a0d2-73cdd42e92f4 tempest-GroupSnapshotsV319Test-1010438836 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=04e937f0-cb74-4c1d-9044-9ee51e1b7099,created_at=2026-11-03T17:25:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1565102542',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=04e937f0-cb74-4c1d-9044-9ee51e1b7099,host='devstack@QuobyteHD#QuobyteHD',id=99023f0f-9d6d-4193-a4ee-881cea3857a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c13c8d3ab37411491d040434500e297',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:25:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:25:04Z,use_quota=True,user_id='3afeae2ca2aa4209b7c2e8db2dd4c59d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98e9b3e3-2fd1-4a2e-b5fb-4b2828b061fc),volume_type_id=98e9b3e3-2fd1-4a2e-b5fb-4b2828b061fc)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:25:03 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-049db80d-a847-4f78-a0d2-73cdd42e92f4 tempest-GroupSnapshotsV319Test-1010438836 None] Creating volume 99023f0f-9d6d-4193-a4ee-881cea3857a8 {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:25:03 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-049db80d-a847-4f78-a0d2-73cdd42e92f4 tempest-GroupSnapshotsV319Test-1010438836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:25:03 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-049db80d-a847-4f78-a0d2-73cdd42e92f4 tempest-GroupSnapshotsV319Test-1010438836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:25:03 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-049db80d-a847-4f78-a0d2-73cdd42e92f4 tempest-GroupSnapshotsV319Test-1010438836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:25:03 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-049db80d-a847-4f78-a0d2-73cdd42e92f4 tempest-GroupSnapshotsV319Test-1010438836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:25:03 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-049db80d-a847-4f78-a0d2-73cdd42e92f4 tempest-GroupSnapshotsV319Test-1010438836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:25:03 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-049db80d-a847-4f78-a0d2-73cdd42e92f4 tempest-GroupSnapshotsV319Test-1010438836 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:25:03 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-049db80d-a847-4f78-a0d2-73cdd42e92f4 tempest-GroupSnapshotsV319Test-1010438836 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:25:03 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-049db80d-a847-4f78-a0d2-73cdd42e92f4 tempest-GroupSnapshotsV319Test-1010438836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-99023f0f-9d6d-4193-a4ee-881cea3857a8 1073741824 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:25:03 devstack sudo[90460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-99023f0f-9d6d-4193-a4ee-881cea3857a8 1073741824
Nov 03 18:25:03 devstack sudo[90460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:25:04 devstack sudo[90460]: pam_unix(sudo:session): session closed for user root
Nov 03 18:25:04 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-049db80d-a847-4f78-a0d2-73cdd42e92f4 tempest-GroupSnapshotsV319Test-1010438836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-99023f0f-9d6d-4193-a4ee-881cea3857a8 1073741824" returned: 0 in 0.589s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:25:04 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-049db80d-a847-4f78-a0d2-73cdd42e92f4 tempest-GroupSnapshotsV319Test-1010438836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-99023f0f-9d6d-4193-a4ee-881cea3857a8 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:25:04 devstack sudo[90466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-99023f0f-9d6d-4193-a4ee-881cea3857a8
Nov 03 18:25:04 devstack sudo[90466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:25:04 devstack sudo[90466]: pam_unix(sudo:session): session closed for user root
Nov 03 18:25:04 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-049db80d-a847-4f78-a0d2-73cdd42e92f4 tempest-GroupSnapshotsV319Test-1010438836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-99023f0f-9d6d-4193-a4ee-881cea3857a8" returned: 0 in 0.270s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:25:04 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-049db80d-a847-4f78-a0d2-73cdd42e92f4 tempest-GroupSnapshotsV319Test-1010438836 None] <== create_volume: return (927ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:25:04 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-049db80d-a847-4f78-a0d2-73cdd42e92f4 tempest-GroupSnapshotsV319Test-1010438836 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.931s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:25:04 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-049db80d-a847-4f78-a0d2-73cdd42e92f4 tempest-GroupSnapshotsV319Test-1010438836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1948226-e630-4590-bc69-db83ea5bb395) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99023f0f-9d6d-4193-a4ee-881cea3857a8', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:25:04 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-049db80d-a847-4f78-a0d2-73cdd42e92f4 tempest-GroupSnapshotsV319Test-1010438836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f836d1c9-7bd5-4d61-a184-8596df5f3505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:25:04 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-049db80d-a847-4f78-a0d2-73cdd42e92f4 tempest-GroupSnapshotsV319Test-1010438836 None] Volume volume-99023f0f-9d6d-4193-a4ee-881cea3857a8 (99023f0f-9d6d-4193-a4ee-881cea3857a8): created successfully
Nov 03 18:25:04 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-049db80d-a847-4f78-a0d2-73cdd42e92f4 tempest-GroupSnapshotsV319Test-1010438836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f836d1c9-7bd5-4d61-a184-8596df5f3505) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:25:04 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-049db80d-a847-4f78-a0d2-73cdd42e92f4 tempest-GroupSnapshotsV319Test-1010438836 None] Flow 'volume_create_manager' (f1cb582a-4816-48d2-bcdb-fad2952acd68) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:25:04 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-049db80d-a847-4f78-a0d2-73cdd42e92f4 tempest-GroupSnapshotsV319Test-1010438836 None] Created volume successfully.
Nov 03 18:25:05 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-fe1199f7-39ae-4694-9b52-609526b36a3c tempest-GroupSnapshotsV319Test-1010438836 None] GroupSnapshot 96981283-c06f-47da-b3ba-3e7038d61363: creating.
Nov 03 18:25:05 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-fe1199f7-39ae-4694-9b52-609526b36a3c tempest-GroupSnapshotsV319Test-1010438836 None] Group snapshot 96981283-c06f-47da-b3ba-3e7038d61363: creating. {{(pid=86120) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Nov 03 18:25:05 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-fe1199f7-39ae-4694-9b52-609526b36a3c tempest-GroupSnapshotsV319Test-1010438836 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:25:05 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-fe1199f7-39ae-4694-9b52-609526b36a3c tempest-GroupSnapshotsV319Test-1010438836 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:25:05 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-fe1199f7-39ae-4694-9b52-609526b36a3c tempest-GroupSnapshotsV319Test-1010438836 None] Creating offline snapshot d98d16f3-0f5f-47a2-ba89-0a48db6c2197 of volume 99023f0f-9d6d-4193-a4ee-881cea3857a8 {{(pid=86120) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 18:25:05 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5f5dcbd-87e9-4436-9c50-acdfeacd5ac3]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:25:05 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-fe1199f7-39ae-4694-9b52-609526b36a3c tempest-GroupSnapshotsV319Test-1010438836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-99023f0f-9d6d-4193-a4ee-881cea3857a8 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:25:05 devstack sudo[90495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-99023f0f-9d6d-4193-a4ee-881cea3857a8
Nov 03 18:25:05 devstack sudo[90495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:25:06 devstack sudo[90495]: pam_unix(sudo:session): session closed for user root
Nov 03 18:25:06 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-fe1199f7-39ae-4694-9b52-609526b36a3c tempest-GroupSnapshotsV319Test-1010438836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-99023f0f-9d6d-4193-a4ee-881cea3857a8" returned: 0 in 0.625s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:25:06 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-fe1199f7-39ae-4694-9b52-609526b36a3c tempest-GroupSnapshotsV319Test-1010438836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-99023f0f-9d6d-4193-a4ee-881cea3857a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-99023f0f-9d6d-4193-a4ee-881cea3857a8.d98d16f3-0f5f-47a2-ba89-0a48db6c2197 1G {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:25:06 devstack sudo[90592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-99023f0f-9d6d-4193-a4ee-881cea3857a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-99023f0f-9d6d-4193-a4ee-881cea3857a8.d98d16f3-0f5f-47a2-ba89-0a48db6c2197 1G
Nov 03 18:25:06 devstack sudo[90592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:25:06 devstack sudo[90592]: pam_unix(sudo:session): session closed for user root
Nov 03 18:25:06 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-fe1199f7-39ae-4694-9b52-609526b36a3c tempest-GroupSnapshotsV319Test-1010438836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-99023f0f-9d6d-4193-a4ee-881cea3857a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-99023f0f-9d6d-4193-a4ee-881cea3857a8.d98d16f3-0f5f-47a2-ba89-0a48db6c2197 1G" returned: 0 in 0.669s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:25:06 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-fe1199f7-39ae-4694-9b52-609526b36a3c tempest-GroupSnapshotsV319Test-1010438836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99023f0f-9d6d-4193-a4ee-881cea3857a8 -F qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-99023f0f-9d6d-4193-a4ee-881cea3857a8.d98d16f3-0f5f-47a2-ba89-0a48db6c2197 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:25:06 devstack sudo[90931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99023f0f-9d6d-4193-a4ee-881cea3857a8 -F qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-99023f0f-9d6d-4193-a4ee-881cea3857a8.d98d16f3-0f5f-47a2-ba89-0a48db6c2197
Nov 03 18:25:06 devstack sudo[90931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:25:07 devstack sudo[90931]: pam_unix(sudo:session): session closed for user root
Nov 03 18:25:07 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-fe1199f7-39ae-4694-9b52-609526b36a3c tempest-GroupSnapshotsV319Test-1010438836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99023f0f-9d6d-4193-a4ee-881cea3857a8 -F qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-99023f0f-9d6d-4193-a4ee-881cea3857a8.d98d16f3-0f5f-47a2-ba89-0a48db6c2197" returned: 0 in 0.557s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:25:07 devstack cinder-volume[86120]: WARNING cinder.volume.drivers.remotefs [None req-fe1199f7-39ae-4694-9b52-609526b36a3c tempest-GroupSnapshotsV319Test-1010438836 None] /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-99023f0f-9d6d-4193-a4ee-881cea3857a8.d98d16f3-0f5f-47a2-ba89-0a48db6c2197 is being set with open permissions: ugo+rw: NotImplementedError
Nov 03 18:25:07 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-fe1199f7-39ae-4694-9b52-609526b36a3c tempest-GroupSnapshotsV319Test-1010438836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-99023f0f-9d6d-4193-a4ee-881cea3857a8.d98d16f3-0f5f-47a2-ba89-0a48db6c2197 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:25:07 devstack sudo[90936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-99023f0f-9d6d-4193-a4ee-881cea3857a8.d98d16f3-0f5f-47a2-ba89-0a48db6c2197
Nov 03 18:25:07 devstack sudo[90936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:25:07 devstack sudo[90936]: pam_unix(sudo:session): session closed for user root
Nov 03 18:25:07 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-fe1199f7-39ae-4694-9b52-609526b36a3c tempest-GroupSnapshotsV319Test-1010438836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-99023f0f-9d6d-4193-a4ee-881cea3857a8.d98d16f3-0f5f-47a2-ba89-0a48db6c2197" returned: 0 in 0.390s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:25:07 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-fe1199f7-39ae-4694-9b52-609526b36a3c tempest-GroupSnapshotsV319Test-1010438836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-99023f0f-9d6d-4193-a4ee-881cea3857a8.info {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:25:07 devstack sudo[90939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-99023f0f-9d6d-4193-a4ee-881cea3857a8.info
Nov 03 18:25:07 devstack sudo[90939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:25:08 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-0bc101a7-cb95-4b8d-aab1-f1521adadaa8 tempest-TaggedAttachmentsTest-1014450667 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:25:08 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-0bc101a7-cb95-4b8d-aab1-f1521adadaa8 tempest-TaggedAttachmentsTest-1014450667 None] Flow 'volume_create_manager' (3b7556da-da63-4537-88d9-bfdbdd37ef8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:25:08 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-0bc101a7-cb95-4b8d-aab1-f1521adadaa8 tempest-TaggedAttachmentsTest-1014450667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ef8d9b9-6e2c-49a1-ba79-318b3d73286a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:25:08 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-0bc101a7-cb95-4b8d-aab1-f1521adadaa8 tempest-TaggedAttachmentsTest-1014450667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ef8d9b9-6e2c-49a1-ba79-318b3d73286a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:25:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1578666277',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c96e35a0-647d-47e2-89d5-3018ed0956fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34cae049e6a54444b8272304d1cd5104',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:25:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:25:08Z,use_quota=True,user_id='e23f47bd7e4143f291cd0de400593b7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:25:08 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-0bc101a7-cb95-4b8d-aab1-f1521adadaa8 tempest-TaggedAttachmentsTest-1014450667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7616bb5-6300-455e-9e60-7efd0b698bf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:25:08 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-0bc101a7-cb95-4b8d-aab1-f1521adadaa8 tempest-TaggedAttachmentsTest-1014450667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7616bb5-6300-455e-9e60-7efd0b698bf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:25:08 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-0bc101a7-cb95-4b8d-aab1-f1521adadaa8 tempest-TaggedAttachmentsTest-1014450667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d523c24-ec65-4dde-bb0d-4a43577f51d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:25:08 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-0bc101a7-cb95-4b8d-aab1-f1521adadaa8 tempest-TaggedAttachmentsTest-1014450667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d523c24-ec65-4dde-bb0d-4a43577f51d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c96e35a0-647d-47e2-89d5-3018ed0956fa', 'volume_name': 'volume-c96e35a0-647d-47e2-89d5-3018ed0956fa', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:25:08 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-0bc101a7-cb95-4b8d-aab1-f1521adadaa8 tempest-TaggedAttachmentsTest-1014450667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (faf818c0-c24c-4ded-94da-b507cd00950f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:25:08 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-0bc101a7-cb95-4b8d-aab1-f1521adadaa8 tempest-TaggedAttachmentsTest-1014450667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (faf818c0-c24c-4ded-94da-b507cd00950f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:25:08 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-0bc101a7-cb95-4b8d-aab1-f1521adadaa8 tempest-TaggedAttachmentsTest-1014450667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (410b674e-8028-45d1-a310-e79bab7fd021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:25:08 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-0bc101a7-cb95-4b8d-aab1-f1521adadaa8 tempest-TaggedAttachmentsTest-1014450667 None] Volume c96e35a0-647d-47e2-89d5-3018ed0956fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c96e35a0-647d-47e2-89d5-3018ed0956fa', 'volume_size': 1}
Nov 03 18:25:08 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-0bc101a7-cb95-4b8d-aab1-f1521adadaa8 tempest-TaggedAttachmentsTest-1014450667 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:25:08 devstack sudo[90939]: pam_unix(sudo:session): session closed for user root
Nov 03 18:25:08 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-fe1199f7-39ae-4694-9b52-609526b36a3c tempest-GroupSnapshotsV319Test-1010438836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-99023f0f-9d6d-4193-a4ee-881cea3857a8.info" returned: 0 in 0.462s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:25:08 devstack cinder-volume[86120]: WARNING cinder.volume.drivers.remotefs [None req-fe1199f7-39ae-4694-9b52-609526b36a3c tempest-GroupSnapshotsV319Test-1010438836 None] /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-99023f0f-9d6d-4193-a4ee-881cea3857a8.info is being set with open permissions: ugo+rw: NotImplementedError
Nov 03 18:25:08 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-fe1199f7-39ae-4694-9b52-609526b36a3c tempest-GroupSnapshotsV319Test-1010438836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-99023f0f-9d6d-4193-a4ee-881cea3857a8.info {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:25:08 devstack sudo[90942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-99023f0f-9d6d-4193-a4ee-881cea3857a8.info
Nov 03 18:25:08 devstack sudo[90942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:25:08 devstack sudo[90942]: pam_unix(sudo:session): session closed for user root
Nov 03 18:25:08 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-fe1199f7-39ae-4694-9b52-609526b36a3c tempest-GroupSnapshotsV319Test-1010438836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-99023f0f-9d6d-4193-a4ee-881cea3857a8.info" returned: 0 in 0.344s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:25:08 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-fe1199f7-39ae-4694-9b52-609526b36a3c tempest-GroupSnapshotsV319Test-1010438836 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.233s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:25:08 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-0bc101a7-cb95-4b8d-aab1-f1521adadaa8 tempest-TaggedAttachmentsTest-1014450667 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.470s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:25:08 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-0bc101a7-cb95-4b8d-aab1-f1521adadaa8 tempest-TaggedAttachmentsTest-1014450667 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:25:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1578666277',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c96e35a0-647d-47e2-89d5-3018ed0956fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34cae049e6a54444b8272304d1cd5104',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:25:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:25:08Z,use_quota=True,user_id='e23f47bd7e4143f291cd0de400593b7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:25:08 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-0bc101a7-cb95-4b8d-aab1-f1521adadaa8 tempest-TaggedAttachmentsTest-1014450667 None] Creating volume c96e35a0-647d-47e2-89d5-3018ed0956fa {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:25:08 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-0bc101a7-cb95-4b8d-aab1-f1521adadaa8 tempest-TaggedAttachmentsTest-1014450667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:25:08 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-0bc101a7-cb95-4b8d-aab1-f1521adadaa8 tempest-TaggedAttachmentsTest-1014450667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:25:08 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-0bc101a7-cb95-4b8d-aab1-f1521adadaa8 tempest-TaggedAttachmentsTest-1014450667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:25:08 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-0bc101a7-cb95-4b8d-aab1-f1521adadaa8 tempest-TaggedAttachmentsTest-1014450667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:25:08 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-0bc101a7-cb95-4b8d-aab1-f1521adadaa8 tempest-TaggedAttachmentsTest-1014450667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:25:08 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-0bc101a7-cb95-4b8d-aab1-f1521adadaa8 tempest-TaggedAttachmentsTest-1014450667 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:25:08 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-0bc101a7-cb95-4b8d-aab1-f1521adadaa8 tempest-TaggedAttachmentsTest-1014450667 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:25:08 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-0bc101a7-cb95-4b8d-aab1-f1521adadaa8 tempest-TaggedAttachmentsTest-1014450667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-c96e35a0-647d-47e2-89d5-3018ed0956fa 1073741824 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:25:08 devstack sudo[90951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-c96e35a0-647d-47e2-89d5-3018ed0956fa 1073741824
Nov 03 18:25:08 devstack sudo[90951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:25:08 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-fe1199f7-39ae-4694-9b52-609526b36a3c tempest-GroupSnapshotsV319Test-1010438836 None] group_snapshot 96981283-c06f-47da-b3ba-3e7038d61363: created successfully
Nov 03 18:25:09 devstack sudo[90951]: pam_unix(sudo:session): session closed for user root
Nov 03 18:25:09 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-0bc101a7-cb95-4b8d-aab1-f1521adadaa8 tempest-TaggedAttachmentsTest-1014450667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-c96e35a0-647d-47e2-89d5-3018ed0956fa 1073741824" returned: 0 in 0.714s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:25:09 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-0bc101a7-cb95-4b8d-aab1-f1521adadaa8 tempest-TaggedAttachmentsTest-1014450667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-c96e35a0-647d-47e2-89d5-3018ed0956fa {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:25:09 devstack sudo[90958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-c96e35a0-647d-47e2-89d5-3018ed0956fa
Nov 03 18:25:09 devstack sudo[90958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:25:09 devstack sudo[90958]: pam_unix(sudo:session): session closed for user root
Nov 03 18:25:09 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-0bc101a7-cb95-4b8d-aab1-f1521adadaa8 tempest-TaggedAttachmentsTest-1014450667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-c96e35a0-647d-47e2-89d5-3018ed0956fa" returned: 0 in 0.373s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:25:09 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-0bc101a7-cb95-4b8d-aab1-f1521adadaa8 tempest-TaggedAttachmentsTest-1014450667 None] <== create_volume: return (1140ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:25:09 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-0bc101a7-cb95-4b8d-aab1-f1521adadaa8 tempest-TaggedAttachmentsTest-1014450667 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.149s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:25:09 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-0bc101a7-cb95-4b8d-aab1-f1521adadaa8 tempest-TaggedAttachmentsTest-1014450667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (410b674e-8028-45d1-a310-e79bab7fd021) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c96e35a0-647d-47e2-89d5-3018ed0956fa', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:25:09 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-0bc101a7-cb95-4b8d-aab1-f1521adadaa8 tempest-TaggedAttachmentsTest-1014450667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24e9dccf-4485-4344-a47a-899bf39fe561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:25:09 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-0bc101a7-cb95-4b8d-aab1-f1521adadaa8 tempest-TaggedAttachmentsTest-1014450667 None] Volume volume-c96e35a0-647d-47e2-89d5-3018ed0956fa (c96e35a0-647d-47e2-89d5-3018ed0956fa): created successfully
Nov 03 18:25:09 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-0bc101a7-cb95-4b8d-aab1-f1521adadaa8 tempest-TaggedAttachmentsTest-1014450667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24e9dccf-4485-4344-a47a-899bf39fe561) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:25:09 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-0bc101a7-cb95-4b8d-aab1-f1521adadaa8 tempest-TaggedAttachmentsTest-1014450667 None] Flow 'volume_create_manager' (3b7556da-da63-4537-88d9-bfdbdd37ef8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:25:10 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-0bc101a7-cb95-4b8d-aab1-f1521adadaa8 tempest-TaggedAttachmentsTest-1014450667 None] Created volume successfully.
Nov 03 18:25:11 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-1b536152-da63-42a2-b117-9e91494179dd tempest-GroupSnapshotsV319Test-1010438836 None] group_snapshot 96981283-c06f-47da-b3ba-3e7038d61363: deleting
Nov 03 18:25:11 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-1b536152-da63-42a2-b117-9e91494179dd tempest-GroupSnapshotsV319Test-1010438836 None] group_snapshot 96981283-c06f-47da-b3ba-3e7038d61363: deleting {{(pid=86120) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Nov 03 18:25:11 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-1b536152-da63-42a2-b117-9e91494179dd tempest-GroupSnapshotsV319Test-1010438836 None] Acquiring lock "cinder-quobyte-99023f0f-9d6d-4193-a4ee-881cea3857a8" by "delete_snapshot" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:25:11 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-1b536152-da63-42a2-b117-9e91494179dd tempest-GroupSnapshotsV319Test-1010438836 None] Lock "cinder-quobyte-99023f0f-9d6d-4193-a4ee-881cea3857a8" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:25:11 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-1b536152-da63-42a2-b117-9e91494179dd tempest-GroupSnapshotsV319Test-1010438836 None] Acquiring lock "cinder-quobyte-d98d16f3-0f5f-47a2-ba89-0a48db6c2197" by "_delete_snapshot" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:25:11 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-1b536152-da63-42a2-b117-9e91494179dd tempest-GroupSnapshotsV319Test-1010438836 None] Lock "cinder-quobyte-d98d16f3-0f5f-47a2-ba89-0a48db6c2197" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:25:11 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-1b536152-da63-42a2-b117-9e91494179dd tempest-GroupSnapshotsV319Test-1010438836 None] Deleting offline snapshot d98d16f3-0f5f-47a2-ba89-0a48db6c2197 of volume 99023f0f-9d6d-4193-a4ee-881cea3857a8 {{(pid=86120) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 18:25:11 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-1b536152-da63-42a2-b117-9e91494179dd tempest-GroupSnapshotsV319Test-1010438836 None] snapshot_file for this snap is: volume-99023f0f-9d6d-4193-a4ee-881cea3857a8.d98d16f3-0f5f-47a2-ba89-0a48db6c2197 {{(pid=86120) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 18:25:11 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[af4d6dec-67a6-4f68-88c4-ea39f45f0144]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:25:11 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-1b536152-da63-42a2-b117-9e91494179dd tempest-GroupSnapshotsV319Test-1010438836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-99023f0f-9d6d-4193-a4ee-881cea3857a8.d98d16f3-0f5f-47a2-ba89-0a48db6c2197 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:25:11 devstack sudo[90962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-99023f0f-9d6d-4193-a4ee-881cea3857a8.d98d16f3-0f5f-47a2-ba89-0a48db6c2197
Nov 03 18:25:11 devstack sudo[90962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:25:12 devstack sudo[90962]: pam_unix(sudo:session): session closed for user root
Nov 03 18:25:12 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-1b536152-da63-42a2-b117-9e91494179dd tempest-GroupSnapshotsV319Test-1010438836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-99023f0f-9d6d-4193-a4ee-881cea3857a8.d98d16f3-0f5f-47a2-ba89-0a48db6c2197" returned: 0 in 0.765s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:25:12 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-1b536152-da63-42a2-b117-9e91494179dd tempest-GroupSnapshotsV319Test-1010438836 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-99023f0f-9d6d-4193-a4ee-881cea3857a8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86120) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 18:25:12 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[50c0c0af-21ca-43e4-a771-836212682ea1]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:25:12 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-1b536152-da63-42a2-b117-9e91494179dd tempest-GroupSnapshotsV319Test-1010438836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-99023f0f-9d6d-4193-a4ee-881cea3857a8 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:25:12 devstack sudo[90969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-99023f0f-9d6d-4193-a4ee-881cea3857a8
Nov 03 18:25:12 devstack sudo[90969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:25:13 devstack sudo[90969]: pam_unix(sudo:session): session closed for user root
Nov 03 18:25:13 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-1b536152-da63-42a2-b117-9e91494179dd tempest-GroupSnapshotsV319Test-1010438836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-99023f0f-9d6d-4193-a4ee-881cea3857a8" returned: 0 in 0.719s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:25:13 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-1b536152-da63-42a2-b117-9e91494179dd tempest-GroupSnapshotsV319Test-1010438836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-99023f0f-9d6d-4193-a4ee-881cea3857a8.d98d16f3-0f5f-47a2-ba89-0a48db6c2197 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:25:13 devstack sudo[90977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-99023f0f-9d6d-4193-a4ee-881cea3857a8.d98d16f3-0f5f-47a2-ba89-0a48db6c2197
Nov 03 18:25:13 devstack sudo[90977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:25:14 devstack sudo[90977]: pam_unix(sudo:session): session closed for user root
Nov 03 18:25:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-1b536152-da63-42a2-b117-9e91494179dd tempest-GroupSnapshotsV319Test-1010438836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-99023f0f-9d6d-4193-a4ee-881cea3857a8.d98d16f3-0f5f-47a2-ba89-0a48db6c2197" returned: 0 in 0.878s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:25:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-1b536152-da63-42a2-b117-9e91494179dd tempest-GroupSnapshotsV319Test-1010438836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-99023f0f-9d6d-4193-a4ee-881cea3857a8.d98d16f3-0f5f-47a2-ba89-0a48db6c2197 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:25:14 devstack sudo[90989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-99023f0f-9d6d-4193-a4ee-881cea3857a8.d98d16f3-0f5f-47a2-ba89-0a48db6c2197
Nov 03 18:25:14 devstack sudo[90989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:25:14 devstack sudo[90989]: pam_unix(sudo:session): session closed for user root
Nov 03 18:25:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-1b536152-da63-42a2-b117-9e91494179dd tempest-GroupSnapshotsV319Test-1010438836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-99023f0f-9d6d-4193-a4ee-881cea3857a8.d98d16f3-0f5f-47a2-ba89-0a48db6c2197" returned: 0 in 0.482s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:25:14 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-1b536152-da63-42a2-b117-9e91494179dd tempest-GroupSnapshotsV319Test-1010438836 None] Lock "cinder-quobyte-d98d16f3-0f5f-47a2-ba89-0a48db6c2197" released by "_delete_snapshot" :: held 3.096s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:25:14 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-1b536152-da63-42a2-b117-9e91494179dd tempest-GroupSnapshotsV319Test-1010438836 None] Lock "cinder-quobyte-99023f0f-9d6d-4193-a4ee-881cea3857a8" released by "delete_snapshot" :: held 3.152s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:25:14 devstack cinder-volume[86120]: WARNING cinder.quota [None req-1b536152-da63-42a2-b117-9e91494179dd tempest-GroupSnapshotsV319Test-1010438836 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1114325758 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1114325758, it is now deprecated. Please use the default quota class for default quota.
Nov 03 18:25:14 devstack cinder-volume[86120]: WARNING cinder.quota [None req-1b536152-da63-42a2-b117-9e91494179dd tempest-GroupSnapshotsV319Test-1010438836 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1114325758 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1114325758, it is now deprecated. Please use the default quota class for default quota.
Nov 03 18:25:14 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-1b536152-da63-42a2-b117-9e91494179dd tempest-GroupSnapshotsV319Test-1010438836 None] Created reservations ['92225595-8dc9-4a31-a01c-0cbf1f45fb30', '032841fc-0423-4606-992a-de0239a08500', '331cd311-7cc7-482e-89c7-173cf4266bfa', '419c29c1-fd14-43e0-935c-f08317dc5ad5'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:25:14 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-1b536152-da63-42a2-b117-9e91494179dd tempest-GroupSnapshotsV319Test-1010438836 None] group_snapshot 96981283-c06f-47da-b3ba-3e7038d61363: deleted successfully
Nov 03 18:25:14 devstack cinder-volume[86120]: DEBUG oslo_service.periodic_task [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86120) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 18:25:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:25:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:25:14 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:25:14 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:25:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.040s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:25:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:25:15 devstack sudo[90993]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:25:15 devstack sudo[90993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:25:15 devstack sudo[90993]: pam_unix(sudo:session): session closed for user root
Nov 03 18:25:15 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.555s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:25:15 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:25:15 devstack cinder-volume[86120]: DEBUG oslo_service.periodic_task [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Running periodic task VolumeManager._thread_info {{(pid=86120) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 18:25:15 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] thread count: 28 {{(pid=86120) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 03 18:25:15 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] thread info: [<_MainThread(MainThread, started 134747145822336)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134747033686336)>, <Thread(Thread-3 (stat_writer), started daemon 134747030828736)>, <Thread(Rabbit-heartbeat, started daemon 134747035433408)>, <Thread(Thread-5 (_runner), started daemon 134747029587392)>, <Thread(Thread-7 (_runner), started daemon 134747029784256)>, <Thread(fd_logger, started daemon 134747027909120)>, <Thread(privsep_reader, started daemon 134747027006592)>, <Thread(tpool_thread_0, started daemon 134747018950336)>, <Thread(tpool_thread_1, started daemon 134747010541248)>, <Thread(tpool_thread_2, started daemon 134747002132160)>, <Thread(tpool_thread_3, started daemon 134746993723072)>, <Thread(tpool_thread_4, started daemon 134746985313984)>, <Thread(tpool_thread_5, started daemon 134746976904896)>, <Thread(tpool_thread_6, started daemon 134746968495808)>, <Thread(tpool_thread_7, started daemon 134746960086720)>, <Thread(tpool_thread_8, started daemon 134746951677632)>, <Thread(tpool_thread_9, started daemon 134746943268544)>, <Thread(tpool_thread_10, started daemon 134746934859456)>, <Thread(tpool_thread_11, started daemon 134746926450368)>, <Thread(tpool_thread_12, started daemon 134746918041280)>, <Thread(tpool_thread_13, started daemon 134746909632192)>, <Thread(tpool_thread_14, started daemon 134746901223104)>, <Thread(tpool_thread_15, started daemon 134746892814016)>, <Thread(tpool_thread_16, started daemon 134746884404928)>, <Thread(tpool_thread_17, started daemon 134746875995840)>, <Thread(tpool_thread_18, started daemon 134746867586752)>, <Thread(tpool_thread_19, started daemon 134746859177664)>] {{(pid=86120) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 03 18:25:15 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-39a885cc-a12c-403c-826d-3dc54a6d1133 tempest-GroupSnapshotsV319Test-1010438836 None] Acquiring lock "cinder-quobyte-99023f0f-9d6d-4193-a4ee-881cea3857a8" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:25:15 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-39a885cc-a12c-403c-826d-3dc54a6d1133 tempest-GroupSnapshotsV319Test-1010438836 None] Lock "cinder-quobyte-99023f0f-9d6d-4193-a4ee-881cea3857a8" acquired by "delete_volume" :: waited 0.027s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:25:15 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bf45dd0-6a91-4581-9f77-645e53643e85]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:25:15 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-39a885cc-a12c-403c-826d-3dc54a6d1133 tempest-GroupSnapshotsV319Test-1010438836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-99023f0f-9d6d-4193-a4ee-881cea3857a8 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:25:15 devstack sudo[90996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-99023f0f-9d6d-4193-a4ee-881cea3857a8
Nov 03 18:25:15 devstack sudo[90996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:25:16 devstack sudo[90996]: pam_unix(sudo:session): session closed for user root
Nov 03 18:25:16 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-39a885cc-a12c-403c-826d-3dc54a6d1133 tempest-GroupSnapshotsV319Test-1010438836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-99023f0f-9d6d-4193-a4ee-881cea3857a8" returned: 0 in 0.514s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:25:16 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-39a885cc-a12c-403c-826d-3dc54a6d1133 tempest-GroupSnapshotsV319Test-1010438836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-99023f0f-9d6d-4193-a4ee-881cea3857a8 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:25:16 devstack sudo[91002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-99023f0f-9d6d-4193-a4ee-881cea3857a8
Nov 03 18:25:16 devstack sudo[91002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:25:16 devstack sudo[91002]: pam_unix(sudo:session): session closed for user root
Nov 03 18:25:16 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-39a885cc-a12c-403c-826d-3dc54a6d1133 tempest-GroupSnapshotsV319Test-1010438836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-99023f0f-9d6d-4193-a4ee-881cea3857a8" returned: 0 in 0.414s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:25:16 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-39a885cc-a12c-403c-826d-3dc54a6d1133 tempest-GroupSnapshotsV319Test-1010438836 None] Lock "cinder-quobyte-99023f0f-9d6d-4193-a4ee-881cea3857a8" released by "delete_volume" :: held 1.058s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:25:16 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-39a885cc-a12c-403c-826d-3dc54a6d1133 tempest-GroupSnapshotsV319Test-1010438836 None] Created reservations ['3fa0c1ce-f6f6-4c0a-87e1-7cda6db6d77e'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:25:16 devstack cinder-volume[86120]: WARNING cinder.quota [None req-39a885cc-a12c-403c-826d-3dc54a6d1133 tempest-GroupSnapshotsV319Test-1010438836 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1114325758 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1114325758, it is now deprecated. Please use the default quota class for default quota.
Nov 03 18:25:17 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-39a885cc-a12c-403c-826d-3dc54a6d1133 tempest-GroupSnapshotsV319Test-1010438836 None] Created reservations ['3fd55395-a44d-462c-b721-0cac835a92c4', 'f45aea44-9229-46ef-bc88-3c2c87f522a1', '5659e6de-cfcc-4ec1-9235-486776de0650', '6e5170b0-014b-4755-9600-41c5103ce448'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:25:17 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-39a885cc-a12c-403c-826d-3dc54a6d1133 tempest-GroupSnapshotsV319Test-1010438836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:25:17 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-39a885cc-a12c-403c-826d-3dc54a6d1133 tempest-GroupSnapshotsV319Test-1010438836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:25:17 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-39a885cc-a12c-403c-826d-3dc54a6d1133 tempest-GroupSnapshotsV319Test-1010438836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:25:17 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-39a885cc-a12c-403c-826d-3dc54a6d1133 tempest-GroupSnapshotsV319Test-1010438836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:25:17 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-39a885cc-a12c-403c-826d-3dc54a6d1133 tempest-GroupSnapshotsV319Test-1010438836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.043s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:25:17 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-39a885cc-a12c-403c-826d-3dc54a6d1133 tempest-GroupSnapshotsV319Test-1010438836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:25:17 devstack sudo[91008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:25:17 devstack sudo[91008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:25:18 devstack sudo[91008]: pam_unix(sudo:session): session closed for user root
Nov 03 18:25:18 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-39a885cc-a12c-403c-826d-3dc54a6d1133 tempest-GroupSnapshotsV319Test-1010438836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.545s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:25:18 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-39a885cc-a12c-403c-826d-3dc54a6d1133 tempest-GroupSnapshotsV319Test-1010438836 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:25:18 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-39a885cc-a12c-403c-826d-3dc54a6d1133 tempest-GroupSnapshotsV319Test-1010438836 None] Delete group completed successfully.
Nov 03 18:25:27 devstack cinder-volume[86120]: INFO cinder.volume.manager [req-5eeb76bd-4720-4d81-8620-3fd6aaf8f8eb req-f3b676d3-85ce-4f49-8ef1-f436cac0c206 tempest-ServerActionsTestOtherA-913173699 None] Terminate volume connection completed successfully.
Nov 03 18:25:27 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [req-5eeb76bd-4720-4d81-8620-3fd6aaf8f8eb req-f3b676d3-85ce-4f49-8ef1-f436cac0c206 tempest-ServerActionsTestOtherA-913173699 None] Deleting attachment a1206403-a45e-4838-bf1d-6701e73c4751. {{(pid=86120) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 03 18:25:30 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-be432c39-6435-4fc2-b970-9bebd33c36aa tempest-VolumeSnapshotQuotasNegativeTestJSON-2133929569 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:25:30 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-be432c39-6435-4fc2-b970-9bebd33c36aa tempest-VolumeSnapshotQuotasNegativeTestJSON-2133929569 None] Flow 'volume_create_manager' (7497fbe7-1e4e-405f-9e17-b34d5d13c47f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:25:30 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-be432c39-6435-4fc2-b970-9bebd33c36aa tempest-VolumeSnapshotQuotasNegativeTestJSON-2133929569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3766715b-4ade-4b14-969d-54f7bbf52e0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:25:30 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-be432c39-6435-4fc2-b970-9bebd33c36aa tempest-VolumeSnapshotQuotasNegativeTestJSON-2133929569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3766715b-4ade-4b14-969d-54f7bbf52e0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:25:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1384537614',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34bc47a7-65bb-459c-a14b-21a2ac509b70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6a9d4985d3c4749a5eb5754a0569d8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:25:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:25:30Z,use_quota=True,user_id='b574a1495e964438bd29b1f1c03d75a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:25:30 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-be432c39-6435-4fc2-b970-9bebd33c36aa tempest-VolumeSnapshotQuotasNegativeTestJSON-2133929569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f473b96-b122-421d-b5b4-0790e3b936e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:25:30 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-be432c39-6435-4fc2-b970-9bebd33c36aa tempest-VolumeSnapshotQuotasNegativeTestJSON-2133929569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f473b96-b122-421d-b5b4-0790e3b936e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:25:30 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-be432c39-6435-4fc2-b970-9bebd33c36aa tempest-VolumeSnapshotQuotasNegativeTestJSON-2133929569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2e11d5e-d773-48a1-a618-f5153ee547af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:25:30 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-be432c39-6435-4fc2-b970-9bebd33c36aa tempest-VolumeSnapshotQuotasNegativeTestJSON-2133929569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2e11d5e-d773-48a1-a618-f5153ee547af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34bc47a7-65bb-459c-a14b-21a2ac509b70', 'volume_name': 'volume-34bc47a7-65bb-459c-a14b-21a2ac509b70', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:25:30 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-be432c39-6435-4fc2-b970-9bebd33c36aa tempest-VolumeSnapshotQuotasNegativeTestJSON-2133929569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b363c8a-4c84-459b-bd3f-7d2b9a55d426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:25:30 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-be432c39-6435-4fc2-b970-9bebd33c36aa tempest-VolumeSnapshotQuotasNegativeTestJSON-2133929569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b363c8a-4c84-459b-bd3f-7d2b9a55d426) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:25:30 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-be432c39-6435-4fc2-b970-9bebd33c36aa tempest-VolumeSnapshotQuotasNegativeTestJSON-2133929569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d1e197e-27c7-4909-b95c-e5277f86dbd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:25:30 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-be432c39-6435-4fc2-b970-9bebd33c36aa tempest-VolumeSnapshotQuotasNegativeTestJSON-2133929569 None] Volume 34bc47a7-65bb-459c-a14b-21a2ac509b70: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34bc47a7-65bb-459c-a14b-21a2ac509b70', 'volume_size': 1}
Nov 03 18:25:30 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-be432c39-6435-4fc2-b970-9bebd33c36aa tempest-VolumeSnapshotQuotasNegativeTestJSON-2133929569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:25:30 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-be432c39-6435-4fc2-b970-9bebd33c36aa tempest-VolumeSnapshotQuotasNegativeTestJSON-2133929569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:25:30 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-be432c39-6435-4fc2-b970-9bebd33c36aa tempest-VolumeSnapshotQuotasNegativeTestJSON-2133929569 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:25:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1384537614',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34bc47a7-65bb-459c-a14b-21a2ac509b70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6a9d4985d3c4749a5eb5754a0569d8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:25:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:25:30Z,use_quota=True,user_id='b574a1495e964438bd29b1f1c03d75a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:25:30 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-be432c39-6435-4fc2-b970-9bebd33c36aa tempest-VolumeSnapshotQuotasNegativeTestJSON-2133929569 None] Creating volume 34bc47a7-65bb-459c-a14b-21a2ac509b70 {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:25:30 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-be432c39-6435-4fc2-b970-9bebd33c36aa tempest-VolumeSnapshotQuotasNegativeTestJSON-2133929569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:25:30 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-be432c39-6435-4fc2-b970-9bebd33c36aa tempest-VolumeSnapshotQuotasNegativeTestJSON-2133929569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:25:30 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-be432c39-6435-4fc2-b970-9bebd33c36aa tempest-VolumeSnapshotQuotasNegativeTestJSON-2133929569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:25:30 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-be432c39-6435-4fc2-b970-9bebd33c36aa tempest-VolumeSnapshotQuotasNegativeTestJSON-2133929569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:25:30 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-be432c39-6435-4fc2-b970-9bebd33c36aa tempest-VolumeSnapshotQuotasNegativeTestJSON-2133929569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:25:30 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-be432c39-6435-4fc2-b970-9bebd33c36aa tempest-VolumeSnapshotQuotasNegativeTestJSON-2133929569 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:25:30 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-be432c39-6435-4fc2-b970-9bebd33c36aa tempest-VolumeSnapshotQuotasNegativeTestJSON-2133929569 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:25:30 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-be432c39-6435-4fc2-b970-9bebd33c36aa tempest-VolumeSnapshotQuotasNegativeTestJSON-2133929569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-34bc47a7-65bb-459c-a14b-21a2ac509b70 1073741824 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:25:30 devstack sudo[91293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-34bc47a7-65bb-459c-a14b-21a2ac509b70 1073741824
Nov 03 18:25:30 devstack sudo[91293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:25:30 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [req-5eeb76bd-4720-4d81-8620-3fd6aaf8f8eb req-3666099e-069f-45de-a59f-13f00b3d0525 tempest-ServerActionsTestOtherA-913173699 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:25:31 devstack sudo[91293]: pam_unix(sudo:session): session closed for user root
Nov 03 18:25:31 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-be432c39-6435-4fc2-b970-9bebd33c36aa tempest-VolumeSnapshotQuotasNegativeTestJSON-2133929569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-34bc47a7-65bb-459c-a14b-21a2ac509b70 1073741824" returned: 0 in 0.551s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:25:31 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-be432c39-6435-4fc2-b970-9bebd33c36aa tempest-VolumeSnapshotQuotasNegativeTestJSON-2133929569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-34bc47a7-65bb-459c-a14b-21a2ac509b70 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:25:31 devstack sudo[91299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-34bc47a7-65bb-459c-a14b-21a2ac509b70
Nov 03 18:25:31 devstack sudo[91299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:25:31 devstack sudo[91299]: pam_unix(sudo:session): session closed for user root
Nov 03 18:25:31 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-be432c39-6435-4fc2-b970-9bebd33c36aa tempest-VolumeSnapshotQuotasNegativeTestJSON-2133929569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-34bc47a7-65bb-459c-a14b-21a2ac509b70" returned: 0 in 0.405s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:25:31 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-be432c39-6435-4fc2-b970-9bebd33c36aa tempest-VolumeSnapshotQuotasNegativeTestJSON-2133929569 None] <== create_volume: return (1021ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:25:31 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-be432c39-6435-4fc2-b970-9bebd33c36aa tempest-VolumeSnapshotQuotasNegativeTestJSON-2133929569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.025s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:25:31 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [req-5eeb76bd-4720-4d81-8620-3fd6aaf8f8eb req-3666099e-069f-45de-a59f-13f00b3d0525 tempest-ServerActionsTestOtherA-913173699 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.902s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:25:31 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [req-5eeb76bd-4720-4d81-8620-3fd6aaf8f8eb req-3666099e-069f-45de-a59f-13f00b3d0525 tempest-ServerActionsTestOtherA-913173699 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.033s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:25:31 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-be432c39-6435-4fc2-b970-9bebd33c36aa tempest-VolumeSnapshotQuotasNegativeTestJSON-2133929569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d1e197e-27c7-4909-b95c-e5277f86dbd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34bc47a7-65bb-459c-a14b-21a2ac509b70', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:25:31 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-be432c39-6435-4fc2-b970-9bebd33c36aa tempest-VolumeSnapshotQuotasNegativeTestJSON-2133929569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6008cf97-98b3-4f1d-84eb-2613f428ffda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:25:31 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-be432c39-6435-4fc2-b970-9bebd33c36aa tempest-VolumeSnapshotQuotasNegativeTestJSON-2133929569 None] Volume volume-34bc47a7-65bb-459c-a14b-21a2ac509b70 (34bc47a7-65bb-459c-a14b-21a2ac509b70): created successfully
Nov 03 18:25:31 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-be432c39-6435-4fc2-b970-9bebd33c36aa tempest-VolumeSnapshotQuotasNegativeTestJSON-2133929569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6008cf97-98b3-4f1d-84eb-2613f428ffda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:25:31 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-be432c39-6435-4fc2-b970-9bebd33c36aa tempest-VolumeSnapshotQuotasNegativeTestJSON-2133929569 None] Flow 'volume_create_manager' (7497fbe7-1e4e-405f-9e17-b34d5d13c47f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:25:31 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-be432c39-6435-4fc2-b970-9bebd33c36aa tempest-VolumeSnapshotQuotasNegativeTestJSON-2133929569 None] Created volume successfully.
Nov 03 18:25:31 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [req-5eeb76bd-4720-4d81-8620-3fd6aaf8f8eb req-3666099e-069f-45de-a59f-13f00b3d0525 tempest-ServerActionsTestOtherA-913173699 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c', 'name': 'volume-b1e5365c-d629-4abc-bae0-700bacd2d382', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ca1282df-9565-4fb3-af86-73bb7e32ec8c', 'enforce_multipath': True} {{(pid=86120) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 03 18:25:31 devstack cinder-volume[86120]: INFO cinder.volume.manager [req-5eeb76bd-4720-4d81-8620-3fd6aaf8f8eb req-3666099e-069f-45de-a59f-13f00b3d0525 tempest-ServerActionsTestOtherA-913173699 None] attachment_update completed successfully.
Nov 03 18:25:32 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-71bff6f0-acce-43c3-8219-4b0e38dc1df2 tempest-VolumeSnapshotQuotasNegativeTestJSON-2133929569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:25:32 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-71bff6f0-acce-43c3-8219-4b0e38dc1df2 tempest-VolumeSnapshotQuotasNegativeTestJSON-2133929569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:25:32 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-71bff6f0-acce-43c3-8219-4b0e38dc1df2 tempest-VolumeSnapshotQuotasNegativeTestJSON-2133929569 None] Creating offline snapshot 105cccc4-0539-45a4-b903-a723b95e7e7a of volume 34bc47a7-65bb-459c-a14b-21a2ac509b70 {{(pid=86120) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 18:25:32 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[5768ad58-445c-4074-9113-a52e5ef7a357]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:25:32 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-71bff6f0-acce-43c3-8219-4b0e38dc1df2 tempest-VolumeSnapshotQuotasNegativeTestJSON-2133929569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-34bc47a7-65bb-459c-a14b-21a2ac509b70 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:25:32 devstack sudo[91383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-34bc47a7-65bb-459c-a14b-21a2ac509b70
Nov 03 18:25:32 devstack sudo[91383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:25:33 devstack sudo[91383]: pam_unix(sudo:session): session closed for user root
Nov 03 18:25:33 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-71bff6f0-acce-43c3-8219-4b0e38dc1df2 tempest-VolumeSnapshotQuotasNegativeTestJSON-2133929569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-34bc47a7-65bb-459c-a14b-21a2ac509b70" returned: 0 in 0.824s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:25:33 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-71bff6f0-acce-43c3-8219-4b0e38dc1df2 tempest-VolumeSnapshotQuotasNegativeTestJSON-2133929569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-34bc47a7-65bb-459c-a14b-21a2ac509b70,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-34bc47a7-65bb-459c-a14b-21a2ac509b70.105cccc4-0539-45a4-b903-a723b95e7e7a 1G {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:25:33 devstack sudo[91747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-34bc47a7-65bb-459c-a14b-21a2ac509b70,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-34bc47a7-65bb-459c-a14b-21a2ac509b70.105cccc4-0539-45a4-b903-a723b95e7e7a 1G
Nov 03 18:25:33 devstack sudo[91747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:25:34 devstack sudo[91747]: pam_unix(sudo:session): session closed for user root
Nov 03 18:25:34 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-71bff6f0-acce-43c3-8219-4b0e38dc1df2 tempest-VolumeSnapshotQuotasNegativeTestJSON-2133929569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-34bc47a7-65bb-459c-a14b-21a2ac509b70,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-34bc47a7-65bb-459c-a14b-21a2ac509b70.105cccc4-0539-45a4-b903-a723b95e7e7a 1G" returned: 0 in 0.915s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:25:34 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-71bff6f0-acce-43c3-8219-4b0e38dc1df2 tempest-VolumeSnapshotQuotasNegativeTestJSON-2133929569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34bc47a7-65bb-459c-a14b-21a2ac509b70 -F qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-34bc47a7-65bb-459c-a14b-21a2ac509b70.105cccc4-0539-45a4-b903-a723b95e7e7a {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:25:34 devstack sudo[91769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34bc47a7-65bb-459c-a14b-21a2ac509b70 -F qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-34bc47a7-65bb-459c-a14b-21a2ac509b70.105cccc4-0539-45a4-b903-a723b95e7e7a
Nov 03 18:25:34 devstack sudo[91769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:25:34 devstack sudo[91769]: pam_unix(sudo:session): session closed for user root
Nov 03 18:25:34 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-71bff6f0-acce-43c3-8219-4b0e38dc1df2 tempest-VolumeSnapshotQuotasNegativeTestJSON-2133929569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34bc47a7-65bb-459c-a14b-21a2ac509b70 -F qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-34bc47a7-65bb-459c-a14b-21a2ac509b70.105cccc4-0539-45a4-b903-a723b95e7e7a" returned: 0 in 0.541s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:25:34 devstack cinder-volume[86120]: WARNING cinder.volume.drivers.remotefs [None req-71bff6f0-acce-43c3-8219-4b0e38dc1df2 tempest-VolumeSnapshotQuotasNegativeTestJSON-2133929569 None] /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-34bc47a7-65bb-459c-a14b-21a2ac509b70.105cccc4-0539-45a4-b903-a723b95e7e7a is being set with open permissions: ugo+rw
Nov 03 18:25:34 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-71bff6f0-acce-43c3-8219-4b0e38dc1df2 tempest-VolumeSnapshotQuotasNegativeTestJSON-2133929569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-34bc47a7-65bb-459c-a14b-21a2ac509b70.105cccc4-0539-45a4-b903-a723b95e7e7a {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:25:34 devstack sudo[91776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-34bc47a7-65bb-459c-a14b-21a2ac509b70.105cccc4-0539-45a4-b903-a723b95e7e7a
Nov 03 18:25:34 devstack sudo[91776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:25:35 devstack sudo[91776]: pam_unix(sudo:session): session closed for user root
Nov 03 18:25:35 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-71bff6f0-acce-43c3-8219-4b0e38dc1df2 tempest-VolumeSnapshotQuotasNegativeTestJSON-2133929569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-34bc47a7-65bb-459c-a14b-21a2ac509b70.105cccc4-0539-45a4-b903-a723b95e7e7a" returned: 0 in 0.570s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:25:35 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-71bff6f0-acce-43c3-8219-4b0e38dc1df2 tempest-VolumeSnapshotQuotasNegativeTestJSON-2133929569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-34bc47a7-65bb-459c-a14b-21a2ac509b70.info {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:25:35 devstack sudo[91781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-34bc47a7-65bb-459c-a14b-21a2ac509b70.info
Nov 03 18:25:35 devstack sudo[91781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:25:35 devstack sudo[91781]: pam_unix(sudo:session): session closed for user root
Nov 03 18:25:35 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-71bff6f0-acce-43c3-8219-4b0e38dc1df2 tempest-VolumeSnapshotQuotasNegativeTestJSON-2133929569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-34bc47a7-65bb-459c-a14b-21a2ac509b70.info" returned: 0 in 0.334s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:25:35 devstack cinder-volume[86120]: WARNING cinder.volume.drivers.remotefs [None req-71bff6f0-acce-43c3-8219-4b0e38dc1df2 tempest-VolumeSnapshotQuotasNegativeTestJSON-2133929569 None] /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-34bc47a7-65bb-459c-a14b-21a2ac509b70.info is being set with open permissions: ugo+rw
Nov 03 18:25:35 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-71bff6f0-acce-43c3-8219-4b0e38dc1df2 tempest-VolumeSnapshotQuotasNegativeTestJSON-2133929569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-34bc47a7-65bb-459c-a14b-21a2ac509b70.info {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:25:35 devstack sudo[91785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-34bc47a7-65bb-459c-a14b-21a2ac509b70.info
Nov 03 18:25:35 devstack sudo[91785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:25:36 devstack sudo[91785]: pam_unix(sudo:session): session closed for user root
Nov 03 18:25:36 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-71bff6f0-acce-43c3-8219-4b0e38dc1df2 tempest-VolumeSnapshotQuotasNegativeTestJSON-2133929569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-34bc47a7-65bb-459c-a14b-21a2ac509b70.info" returned: 0 in 0.402s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:25:36 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-71bff6f0-acce-43c3-8219-4b0e38dc1df2 tempest-VolumeSnapshotQuotasNegativeTestJSON-2133929569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.764s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:25:36 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-71bff6f0-acce-43c3-8219-4b0e38dc1df2 tempest-VolumeSnapshotQuotasNegativeTestJSON-2133929569 None] Create snapshot completed successfully
Nov 03 18:25:37 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-e75639c9-4a89-4330-8d8d-49f66eeb1eb9 tempest-VolumeSnapshotQuotasNegativeTestJSON-2133929569 None] Acquiring lock "cinder-105cccc4-0539-45a4-b903-a723b95e7e7a-delete_snapshot" by "delete_snapshot" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:25:37 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-e75639c9-4a89-4330-8d8d-49f66eeb1eb9 tempest-VolumeSnapshotQuotasNegativeTestJSON-2133929569 None] Lock "cinder-105cccc4-0539-45a4-b903-a723b95e7e7a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.063s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:25:37 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-e75639c9-4a89-4330-8d8d-49f66eeb1eb9 tempest-VolumeSnapshotQuotasNegativeTestJSON-2133929569 None] Acquiring lock "cinder-quobyte-34bc47a7-65bb-459c-a14b-21a2ac509b70" by "delete_snapshot" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:25:38 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-e75639c9-4a89-4330-8d8d-49f66eeb1eb9 tempest-VolumeSnapshotQuotasNegativeTestJSON-2133929569 None] Lock "cinder-quobyte-34bc47a7-65bb-459c-a14b-21a2ac509b70" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:25:38 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-e75639c9-4a89-4330-8d8d-49f66eeb1eb9 tempest-VolumeSnapshotQuotasNegativeTestJSON-2133929569 None] Acquiring lock "cinder-quobyte-105cccc4-0539-45a4-b903-a723b95e7e7a" by "_delete_snapshot" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:25:38 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-e75639c9-4a89-4330-8d8d-49f66eeb1eb9 tempest-VolumeSnapshotQuotasNegativeTestJSON-2133929569 None] Lock "cinder-quobyte-105cccc4-0539-45a4-b903-a723b95e7e7a" acquired by "_delete_snapshot" :: waited 0.051s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:25:38 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-e75639c9-4a89-4330-8d8d-49f66eeb1eb9 tempest-VolumeSnapshotQuotasNegativeTestJSON-2133929569 None] Deleting offline snapshot 105cccc4-0539-45a4-b903-a723b95e7e7a of volume 34bc47a7-65bb-459c-a14b-21a2ac509b70 {{(pid=86120) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 18:25:38 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-e75639c9-4a89-4330-8d8d-49f66eeb1eb9 tempest-VolumeSnapshotQuotasNegativeTestJSON-2133929569 None] snapshot_file for this snap is: volume-34bc47a7-65bb-459c-a14b-21a2ac509b70.105cccc4-0539-45a4-b903-a723b95e7e7a {{(pid=86120) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 18:25:38 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[0367c4d3-d1c9-4ab0-a0cd-3b8f500943fc]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:25:38 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-e75639c9-4a89-4330-8d8d-49f66eeb1eb9 tempest-VolumeSnapshotQuotasNegativeTestJSON-2133929569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-34bc47a7-65bb-459c-a14b-21a2ac509b70.105cccc4-0539-45a4-b903-a723b95e7e7a {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:25:38 devstack sudo[91789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-34bc47a7-65bb-459c-a14b-21a2ac509b70.105cccc4-0539-45a4-b903-a723b95e7e7a
Nov 03 18:25:38 devstack sudo[91789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:25:38 devstack sudo[91789]: pam_unix(sudo:session): session closed for user root
Nov 03 18:25:38 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-e75639c9-4a89-4330-8d8d-49f66eeb1eb9 tempest-VolumeSnapshotQuotasNegativeTestJSON-2133929569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-34bc47a7-65bb-459c-a14b-21a2ac509b70.105cccc4-0539-45a4-b903-a723b95e7e7a" returned: 0 in 0.677s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:25:38 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-e75639c9-4a89-4330-8d8d-49f66eeb1eb9 tempest-VolumeSnapshotQuotasNegativeTestJSON-2133929569 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-34bc47a7-65bb-459c-a14b-21a2ac509b70(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86120) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 18:25:38 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e18419f-e3c4-4ea9-af3d-1e80d46a63cb]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:25:38 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-e75639c9-4a89-4330-8d8d-49f66eeb1eb9 tempest-VolumeSnapshotQuotasNegativeTestJSON-2133929569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-34bc47a7-65bb-459c-a14b-21a2ac509b70 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:25:39 devstack sudo[91795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-34bc47a7-65bb-459c-a14b-21a2ac509b70
Nov 03 18:25:39 devstack sudo[91795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:25:39 devstack sudo[91795]: pam_unix(sudo:session): session closed for user root
Nov 03 18:25:39 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-e75639c9-4a89-4330-8d8d-49f66eeb1eb9 tempest-VolumeSnapshotQuotasNegativeTestJSON-2133929569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-34bc47a7-65bb-459c-a14b-21a2ac509b70" returned: 0 in 0.584s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:25:39 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-e75639c9-4a89-4330-8d8d-49f66eeb1eb9 tempest-VolumeSnapshotQuotasNegativeTestJSON-2133929569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-34bc47a7-65bb-459c-a14b-21a2ac509b70.105cccc4-0539-45a4-b903-a723b95e7e7a {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:25:39 devstack sudo[91801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-34bc47a7-65bb-459c-a14b-21a2ac509b70.105cccc4-0539-45a4-b903-a723b95e7e7a
Nov 03 18:25:39 devstack sudo[91801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:25:40 devstack sudo[91801]: pam_unix(sudo:session): session closed for user root
Nov 03 18:25:40 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-e75639c9-4a89-4330-8d8d-49f66eeb1eb9 tempest-VolumeSnapshotQuotasNegativeTestJSON-2133929569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-34bc47a7-65bb-459c-a14b-21a2ac509b70.105cccc4-0539-45a4-b903-a723b95e7e7a" returned: 0 in 0.876s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:25:40 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-e75639c9-4a89-4330-8d8d-49f66eeb1eb9 tempest-VolumeSnapshotQuotasNegativeTestJSON-2133929569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-34bc47a7-65bb-459c-a14b-21a2ac509b70.105cccc4-0539-45a4-b903-a723b95e7e7a {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:25:40 devstack sudo[91807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-34bc47a7-65bb-459c-a14b-21a2ac509b70.105cccc4-0539-45a4-b903-a723b95e7e7a
Nov 03 18:25:40 devstack sudo[91807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:25:40 devstack sudo[91807]: pam_unix(sudo:session): session closed for user root
Nov 03 18:25:40 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-e75639c9-4a89-4330-8d8d-49f66eeb1eb9 tempest-VolumeSnapshotQuotasNegativeTestJSON-2133929569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-34bc47a7-65bb-459c-a14b-21a2ac509b70.105cccc4-0539-45a4-b903-a723b95e7e7a" returned: 0 in 0.402s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:25:40 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-e75639c9-4a89-4330-8d8d-49f66eeb1eb9 tempest-VolumeSnapshotQuotasNegativeTestJSON-2133929569 None] Lock "cinder-quobyte-105cccc4-0539-45a4-b903-a723b95e7e7a" released by "_delete_snapshot" :: held 2.843s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:25:40 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-e75639c9-4a89-4330-8d8d-49f66eeb1eb9 tempest-VolumeSnapshotQuotasNegativeTestJSON-2133929569 None] Lock "cinder-quobyte-34bc47a7-65bb-459c-a14b-21a2ac509b70" released by "delete_snapshot" :: held 2.912s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:25:41 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-e75639c9-4a89-4330-8d8d-49f66eeb1eb9 tempest-VolumeSnapshotQuotasNegativeTestJSON-2133929569 None] Created reservations ['393d2bf1-0c63-4df0-8173-1bcfc58e90fc', 'ee5e1ba9-66ef-47a2-ac01-737f7b9dd3cd', '1fba4114-6b6e-41bb-ad8f-7dde85e6a450', 'cfcb5757-a647-45cf-a99b-568c663e553f'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:25:41 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-e75639c9-4a89-4330-8d8d-49f66eeb1eb9 tempest-VolumeSnapshotQuotasNegativeTestJSON-2133929569 None] Delete snapshot completed successfully.
Nov 03 18:25:41 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-e75639c9-4a89-4330-8d8d-49f66eeb1eb9 tempest-VolumeSnapshotQuotasNegativeTestJSON-2133929569 None] Lock "cinder-105cccc4-0539-45a4-b903-a723b95e7e7a-delete_snapshot" released by "delete_snapshot" :: held 3.210s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:25:41 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-51b0675e-9e2a-41d4-afd7-49144faafc64 tempest-VolumeSnapshotQuotasNegativeTestJSON-2133929569 None] Acquiring lock "cinder-34bc47a7-65bb-459c-a14b-21a2ac509b70-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:25:41 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-51b0675e-9e2a-41d4-afd7-49144faafc64 tempest-VolumeSnapshotQuotasNegativeTestJSON-2133929569 None] Lock "cinder-34bc47a7-65bb-459c-a14b-21a2ac509b70-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:25:41 devstack cinder-volume[86120]: DEBUG dbcounter [-] [86120] Writing DB stats cinder:SELECT=94,cinder:UPDATE=81,cinder:DELETE=10,cinder:INSERT=27 {{(pid=86120) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 18:25:41 devstack cinder-volume[86120]: DEBUG dbcounter [-] [86120] Writing DB stats cinder:SELECT=88,cinder:INSERT=26,cinder:UPDATE=81 {{(pid=86120) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 18:25:41 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-51b0675e-9e2a-41d4-afd7-49144faafc64 tempest-VolumeSnapshotQuotasNegativeTestJSON-2133929569 None] Acquiring lock "cinder-quobyte-34bc47a7-65bb-459c-a14b-21a2ac509b70" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:25:41 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-51b0675e-9e2a-41d4-afd7-49144faafc64 tempest-VolumeSnapshotQuotasNegativeTestJSON-2133929569 None] Lock "cinder-quobyte-34bc47a7-65bb-459c-a14b-21a2ac509b70" acquired by "delete_volume" :: waited 0.023s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:25:41 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ffeec0e-3518-4b4e-9f8c-868015596121]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:25:41 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-51b0675e-9e2a-41d4-afd7-49144faafc64 tempest-VolumeSnapshotQuotasNegativeTestJSON-2133929569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-34bc47a7-65bb-459c-a14b-21a2ac509b70 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:25:41 devstack sudo[91815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-34bc47a7-65bb-459c-a14b-21a2ac509b70
Nov 03 18:25:41 devstack sudo[91815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:25:42 devstack sudo[91815]: pam_unix(sudo:session): session closed for user root
Nov 03 18:25:42 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-51b0675e-9e2a-41d4-afd7-49144faafc64 tempest-VolumeSnapshotQuotasNegativeTestJSON-2133929569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-34bc47a7-65bb-459c-a14b-21a2ac509b70" returned: 0 in 0.621s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:25:42 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-51b0675e-9e2a-41d4-afd7-49144faafc64 tempest-VolumeSnapshotQuotasNegativeTestJSON-2133929569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-34bc47a7-65bb-459c-a14b-21a2ac509b70 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:25:42 devstack sudo[91861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-34bc47a7-65bb-459c-a14b-21a2ac509b70
Nov 03 18:25:42 devstack sudo[91861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:25:42 devstack sudo[91861]: pam_unix(sudo:session): session closed for user root
Nov 03 18:25:42 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-51b0675e-9e2a-41d4-afd7-49144faafc64 tempest-VolumeSnapshotQuotasNegativeTestJSON-2133929569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-34bc47a7-65bb-459c-a14b-21a2ac509b70" returned: 0 in 0.435s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:25:42 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-51b0675e-9e2a-41d4-afd7-49144faafc64 tempest-VolumeSnapshotQuotasNegativeTestJSON-2133929569 None] Lock "cinder-quobyte-34bc47a7-65bb-459c-a14b-21a2ac509b70" released by "delete_volume" :: held 1.163s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:25:42 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-51b0675e-9e2a-41d4-afd7-49144faafc64 tempest-VolumeSnapshotQuotasNegativeTestJSON-2133929569 None] Created reservations ['bb3d6b79-a4d0-4ba9-9bf3-e028e299823e', '1dd39090-bcf1-43f8-bd95-a295331edd4d', '7a21f6df-e86e-4b1c-a6bb-24cc4981dd94', 'fd570816-b1d1-4c3c-bf2e-94b753ed3c15'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:25:42 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-51b0675e-9e2a-41d4-afd7-49144faafc64 tempest-VolumeSnapshotQuotasNegativeTestJSON-2133929569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:25:42 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-51b0675e-9e2a-41d4-afd7-49144faafc64 tempest-VolumeSnapshotQuotasNegativeTestJSON-2133929569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:25:42 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-51b0675e-9e2a-41d4-afd7-49144faafc64 tempest-VolumeSnapshotQuotasNegativeTestJSON-2133929569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:25:42 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-51b0675e-9e2a-41d4-afd7-49144faafc64 tempest-VolumeSnapshotQuotasNegativeTestJSON-2133929569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:25:42 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-51b0675e-9e2a-41d4-afd7-49144faafc64 tempest-VolumeSnapshotQuotasNegativeTestJSON-2133929569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:25:42 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-51b0675e-9e2a-41d4-afd7-49144faafc64 tempest-VolumeSnapshotQuotasNegativeTestJSON-2133929569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:25:42 devstack sudo[91864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:25:42 devstack sudo[91864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:25:43 devstack sudo[91864]: pam_unix(sudo:session): session closed for user root
Nov 03 18:25:43 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-51b0675e-9e2a-41d4-afd7-49144faafc64 tempest-VolumeSnapshotQuotasNegativeTestJSON-2133929569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.281s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:25:43 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-51b0675e-9e2a-41d4-afd7-49144faafc64 tempest-VolumeSnapshotQuotasNegativeTestJSON-2133929569 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:25:43 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-51b0675e-9e2a-41d4-afd7-49144faafc64 tempest-VolumeSnapshotQuotasNegativeTestJSON-2133929569 None] Deleted volume successfully.
Nov 03 18:25:43 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-51b0675e-9e2a-41d4-afd7-49144faafc64 tempest-VolumeSnapshotQuotasNegativeTestJSON-2133929569 None] Lock "cinder-34bc47a7-65bb-459c-a14b-21a2ac509b70-delete_volume" released by "delete_volume" :: held 1.744s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:25:51 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-49f7e9c7-17b1-413b-8288-713df358d1f4 tempest-VolumeTypesAccessTest-129588778 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:25:51 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-49f7e9c7-17b1-413b-8288-713df358d1f4 tempest-VolumeTypesAccessTest-129588778 None] Flow 'volume_create_manager' (6d781b9b-01a6-4ffa-87e5-dc86c06f231d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:25:51 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-49f7e9c7-17b1-413b-8288-713df358d1f4 tempest-VolumeTypesAccessTest-129588778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d95e60ab-c01f-47fb-8252-8b6d8f919dc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:25:51 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-49f7e9c7-17b1-413b-8288-713df358d1f4 tempest-VolumeTypesAccessTest-129588778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d95e60ab-c01f-47fb-8252-8b6d8f919dc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:25:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1401720997',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8b94d29-13d2-40d7-af45-e43603816073,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfb1af6d55b1492d937721584dd8bb64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:25:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:25:52Z,use_quota=True,user_id='e334a4907580456d9f0f33ee6167aceb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b340a0e-7bc1-4667-bfa8-616fa25989fb),volume_type_id=6b340a0e-7bc1-4667-bfa8-616fa25989fb)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:25:51 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-49f7e9c7-17b1-413b-8288-713df358d1f4 tempest-VolumeTypesAccessTest-129588778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72517e9d-421a-4564-a528-df2e0050e96b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:25:51 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-49f7e9c7-17b1-413b-8288-713df358d1f4 tempest-VolumeTypesAccessTest-129588778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72517e9d-421a-4564-a528-df2e0050e96b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:25:51 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-49f7e9c7-17b1-413b-8288-713df358d1f4 tempest-VolumeTypesAccessTest-129588778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09c2a146-b6eb-4806-aa2f-e01d1bb6e25a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:25:51 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-49f7e9c7-17b1-413b-8288-713df358d1f4 tempest-VolumeTypesAccessTest-129588778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09c2a146-b6eb-4806-aa2f-e01d1bb6e25a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8b94d29-13d2-40d7-af45-e43603816073', 'volume_name': 'volume-c8b94d29-13d2-40d7-af45-e43603816073', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:25:51 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-49f7e9c7-17b1-413b-8288-713df358d1f4 tempest-VolumeTypesAccessTest-129588778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (510c59b9-7966-4b22-8189-51541395c7c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:25:51 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-49f7e9c7-17b1-413b-8288-713df358d1f4 tempest-VolumeTypesAccessTest-129588778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (510c59b9-7966-4b22-8189-51541395c7c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:25:51 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-49f7e9c7-17b1-413b-8288-713df358d1f4 tempest-VolumeTypesAccessTest-129588778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccdfe618-dd43-4bfa-a012-f8cdaf02abfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:25:51 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-49f7e9c7-17b1-413b-8288-713df358d1f4 tempest-VolumeTypesAccessTest-129588778 None] Volume c8b94d29-13d2-40d7-af45-e43603816073: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8b94d29-13d2-40d7-af45-e43603816073', 'volume_size': 1}
Nov 03 18:25:51 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-49f7e9c7-17b1-413b-8288-713df358d1f4 tempest-VolumeTypesAccessTest-129588778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:25:51 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-49f7e9c7-17b1-413b-8288-713df358d1f4 tempest-VolumeTypesAccessTest-129588778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:25:51 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-49f7e9c7-17b1-413b-8288-713df358d1f4 tempest-VolumeTypesAccessTest-129588778 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:25:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1401720997',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8b94d29-13d2-40d7-af45-e43603816073,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfb1af6d55b1492d937721584dd8bb64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:25:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:25:52Z,use_quota=True,user_id='e334a4907580456d9f0f33ee6167aceb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b340a0e-7bc1-4667-bfa8-616fa25989fb),volume_type_id=6b340a0e-7bc1-4667-bfa8-616fa25989fb)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:25:51 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-49f7e9c7-17b1-413b-8288-713df358d1f4 tempest-VolumeTypesAccessTest-129588778 None] Creating volume c8b94d29-13d2-40d7-af45-e43603816073 {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:25:51 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-49f7e9c7-17b1-413b-8288-713df358d1f4 tempest-VolumeTypesAccessTest-129588778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:25:51 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-49f7e9c7-17b1-413b-8288-713df358d1f4 tempest-VolumeTypesAccessTest-129588778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:25:51 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-49f7e9c7-17b1-413b-8288-713df358d1f4 tempest-VolumeTypesAccessTest-129588778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:25:52 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-49f7e9c7-17b1-413b-8288-713df358d1f4 tempest-VolumeTypesAccessTest-129588778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:25:52 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-49f7e9c7-17b1-413b-8288-713df358d1f4 tempest-VolumeTypesAccessTest-129588778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:25:52 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-49f7e9c7-17b1-413b-8288-713df358d1f4 tempest-VolumeTypesAccessTest-129588778 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:25:52 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-49f7e9c7-17b1-413b-8288-713df358d1f4 tempest-VolumeTypesAccessTest-129588778 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:25:52 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-49f7e9c7-17b1-413b-8288-713df358d1f4 tempest-VolumeTypesAccessTest-129588778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-c8b94d29-13d2-40d7-af45-e43603816073 1073741824 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:25:52 devstack sudo[91883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-c8b94d29-13d2-40d7-af45-e43603816073 1073741824
Nov 03 18:25:52 devstack sudo[91883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:25:52 devstack sudo[91883]: pam_unix(sudo:session): session closed for user root
Nov 03 18:25:52 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-49f7e9c7-17b1-413b-8288-713df358d1f4 tempest-VolumeTypesAccessTest-129588778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-c8b94d29-13d2-40d7-af45-e43603816073 1073741824" returned: 0 in 0.700s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:25:52 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-49f7e9c7-17b1-413b-8288-713df358d1f4 tempest-VolumeTypesAccessTest-129588778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-c8b94d29-13d2-40d7-af45-e43603816073 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:25:52 devstack sudo[91964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-c8b94d29-13d2-40d7-af45-e43603816073
Nov 03 18:25:52 devstack sudo[91964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:25:53 devstack sudo[91964]: pam_unix(sudo:session): session closed for user root
Nov 03 18:25:53 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-49f7e9c7-17b1-413b-8288-713df358d1f4 tempest-VolumeTypesAccessTest-129588778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-c8b94d29-13d2-40d7-af45-e43603816073" returned: 0 in 0.322s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:25:53 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-49f7e9c7-17b1-413b-8288-713df358d1f4 tempest-VolumeTypesAccessTest-129588778 None] <== create_volume: return (1091ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:25:53 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-49f7e9c7-17b1-413b-8288-713df358d1f4 tempest-VolumeTypesAccessTest-129588778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.095s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:25:53 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-49f7e9c7-17b1-413b-8288-713df358d1f4 tempest-VolumeTypesAccessTest-129588778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccdfe618-dd43-4bfa-a012-f8cdaf02abfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8b94d29-13d2-40d7-af45-e43603816073', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:25:53 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-49f7e9c7-17b1-413b-8288-713df358d1f4 tempest-VolumeTypesAccessTest-129588778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (086727f8-17aa-4522-abef-f57af301e900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:25:53 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-49f7e9c7-17b1-413b-8288-713df358d1f4 tempest-VolumeTypesAccessTest-129588778 None] Volume volume-c8b94d29-13d2-40d7-af45-e43603816073 (c8b94d29-13d2-40d7-af45-e43603816073): created successfully
Nov 03 18:25:53 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-49f7e9c7-17b1-413b-8288-713df358d1f4 tempest-VolumeTypesAccessTest-129588778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (086727f8-17aa-4522-abef-f57af301e900) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:25:53 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-49f7e9c7-17b1-413b-8288-713df358d1f4 tempest-VolumeTypesAccessTest-129588778 None] Flow 'volume_create_manager' (6d781b9b-01a6-4ffa-87e5-dc86c06f231d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:25:53 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-49f7e9c7-17b1-413b-8288-713df358d1f4 tempest-VolumeTypesAccessTest-129588778 None] Created volume successfully.
Nov 03 18:25:54 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-3dfe5e24-36b4-433f-a2e7-20a51f3890dc tempest-VolumeTypesAccessTest-129588778 None] Acquiring lock "cinder-c8b94d29-13d2-40d7-af45-e43603816073-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:25:54 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-3dfe5e24-36b4-433f-a2e7-20a51f3890dc tempest-VolumeTypesAccessTest-129588778 None] Lock "cinder-c8b94d29-13d2-40d7-af45-e43603816073-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:25:54 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-3dfe5e24-36b4-433f-a2e7-20a51f3890dc tempest-VolumeTypesAccessTest-129588778 None] Acquiring lock "cinder-quobyte-c8b94d29-13d2-40d7-af45-e43603816073" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:25:54 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-3dfe5e24-36b4-433f-a2e7-20a51f3890dc tempest-VolumeTypesAccessTest-129588778 None] Lock "cinder-quobyte-c8b94d29-13d2-40d7-af45-e43603816073" acquired by "delete_volume" :: waited 0.023s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:25:54 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ddece06-b702-49d1-bd37-0c2cc4ecb45b]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:25:54 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-3dfe5e24-36b4-433f-a2e7-20a51f3890dc tempest-VolumeTypesAccessTest-129588778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-c8b94d29-13d2-40d7-af45-e43603816073 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:25:54 devstack sudo[91968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-c8b94d29-13d2-40d7-af45-e43603816073
Nov 03 18:25:54 devstack sudo[91968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:25:54 devstack sudo[91968]: pam_unix(sudo:session): session closed for user root
Nov 03 18:25:54 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-3dfe5e24-36b4-433f-a2e7-20a51f3890dc tempest-VolumeTypesAccessTest-129588778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-c8b94d29-13d2-40d7-af45-e43603816073" returned: 0 in 0.445s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:25:54 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-3dfe5e24-36b4-433f-a2e7-20a51f3890dc tempest-VolumeTypesAccessTest-129588778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-c8b94d29-13d2-40d7-af45-e43603816073 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:25:54 devstack sudo[91973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-c8b94d29-13d2-40d7-af45-e43603816073
Nov 03 18:25:54 devstack sudo[91973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:25:55 devstack sudo[91973]: pam_unix(sudo:session): session closed for user root
Nov 03 18:25:55 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-3dfe5e24-36b4-433f-a2e7-20a51f3890dc tempest-VolumeTypesAccessTest-129588778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-c8b94d29-13d2-40d7-af45-e43603816073" returned: 0 in 0.274s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:25:55 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-3dfe5e24-36b4-433f-a2e7-20a51f3890dc tempest-VolumeTypesAccessTest-129588778 None] Lock "cinder-quobyte-c8b94d29-13d2-40d7-af45-e43603816073" released by "delete_volume" :: held 0.794s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:25:55 devstack cinder-volume[86120]: WARNING cinder.quota [None req-3dfe5e24-36b4-433f-a2e7-20a51f3890dc tempest-VolumeTypesAccessTest-129588778 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-975217224 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-975217224, it is now deprecated. Please use the default quota class for default quota.
Nov 03 18:25:55 devstack cinder-volume[86120]: WARNING cinder.quota [None req-3dfe5e24-36b4-433f-a2e7-20a51f3890dc tempest-VolumeTypesAccessTest-129588778 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-975217224 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-975217224, it is now deprecated. Please use the default quota class for default quota.
Nov 03 18:25:55 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-3dfe5e24-36b4-433f-a2e7-20a51f3890dc tempest-VolumeTypesAccessTest-129588778 None] Created reservations ['32f139ca-7a51-4a0d-b323-9d51e257ef6d', 'f42edbe5-f145-4304-a2b9-258741f04d2c', '36dbdb8e-e342-4b2b-822b-0730705b67fa', 'f030679e-e8f9-4e31-b996-e4151c747db7'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:25:55 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-3dfe5e24-36b4-433f-a2e7-20a51f3890dc tempest-VolumeTypesAccessTest-129588778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:25:55 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-3dfe5e24-36b4-433f-a2e7-20a51f3890dc tempest-VolumeTypesAccessTest-129588778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:25:55 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-3dfe5e24-36b4-433f-a2e7-20a51f3890dc tempest-VolumeTypesAccessTest-129588778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:25:55 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-3dfe5e24-36b4-433f-a2e7-20a51f3890dc tempest-VolumeTypesAccessTest-129588778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:25:55 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-3dfe5e24-36b4-433f-a2e7-20a51f3890dc tempest-VolumeTypesAccessTest-129588778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:25:55 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-3dfe5e24-36b4-433f-a2e7-20a51f3890dc tempest-VolumeTypesAccessTest-129588778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:25:55 devstack sudo[91976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:25:55 devstack sudo[91976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:25:55 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf81f9ba-f62a-4518-9bab-c88766a67ee8 tempest-VolumeQuotasNegativeTestJSON-126104058 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:25:55 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-cf81f9ba-f62a-4518-9bab-c88766a67ee8 tempest-VolumeQuotasNegativeTestJSON-126104058 None] Flow 'volume_create_manager' (a65d3f10-8ee9-48a1-ae61-e528626d835d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:25:55 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-cf81f9ba-f62a-4518-9bab-c88766a67ee8 tempest-VolumeQuotasNegativeTestJSON-126104058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f82d14ff-1f22-496a-979c-12013344992c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:25:55 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-cf81f9ba-f62a-4518-9bab-c88766a67ee8 tempest-VolumeQuotasNegativeTestJSON-126104058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f82d14ff-1f22-496a-979c-12013344992c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:25:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-35474845',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39af84f3-439c-4d6d-b2f2-2977452949ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78e476ccb1204f1ebee79560c2e347b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:25:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:25:55Z,use_quota=True,user_id='dfe364b011504dcea7539b37e865edcf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:25:55 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-cf81f9ba-f62a-4518-9bab-c88766a67ee8 tempest-VolumeQuotasNegativeTestJSON-126104058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d9adab6-6252-4e4d-84d2-db7c43ea8ca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:25:55 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-cf81f9ba-f62a-4518-9bab-c88766a67ee8 tempest-VolumeQuotasNegativeTestJSON-126104058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d9adab6-6252-4e4d-84d2-db7c43ea8ca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:25:55 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-cf81f9ba-f62a-4518-9bab-c88766a67ee8 tempest-VolumeQuotasNegativeTestJSON-126104058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7088784d-e6c9-4528-8019-7f69eb2a2294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:25:55 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-cf81f9ba-f62a-4518-9bab-c88766a67ee8 tempest-VolumeQuotasNegativeTestJSON-126104058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7088784d-e6c9-4528-8019-7f69eb2a2294) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39af84f3-439c-4d6d-b2f2-2977452949ab', 'volume_name': 'volume-39af84f3-439c-4d6d-b2f2-2977452949ab', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:25:55 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-cf81f9ba-f62a-4518-9bab-c88766a67ee8 tempest-VolumeQuotasNegativeTestJSON-126104058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c32f3e9-1472-4f21-82e8-b05e05013cfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:25:55 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-cf81f9ba-f62a-4518-9bab-c88766a67ee8 tempest-VolumeQuotasNegativeTestJSON-126104058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c32f3e9-1472-4f21-82e8-b05e05013cfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:25:55 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-cf81f9ba-f62a-4518-9bab-c88766a67ee8 tempest-VolumeQuotasNegativeTestJSON-126104058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33b75b1f-1e7f-4e1e-aa69-0d65144de0f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:25:55 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-cf81f9ba-f62a-4518-9bab-c88766a67ee8 tempest-VolumeQuotasNegativeTestJSON-126104058 None] Volume 39af84f3-439c-4d6d-b2f2-2977452949ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39af84f3-439c-4d6d-b2f2-2977452949ab', 'volume_size': 1}
Nov 03 18:25:55 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-cf81f9ba-f62a-4518-9bab-c88766a67ee8 tempest-VolumeQuotasNegativeTestJSON-126104058 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:25:55 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-cf81f9ba-f62a-4518-9bab-c88766a67ee8 tempest-VolumeQuotasNegativeTestJSON-126104058 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:25:55 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-cf81f9ba-f62a-4518-9bab-c88766a67ee8 tempest-VolumeQuotasNegativeTestJSON-126104058 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:25:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-35474845',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39af84f3-439c-4d6d-b2f2-2977452949ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78e476ccb1204f1ebee79560c2e347b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:25:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:25:55Z,use_quota=True,user_id='dfe364b011504dcea7539b37e865edcf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:25:55 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-cf81f9ba-f62a-4518-9bab-c88766a67ee8 tempest-VolumeQuotasNegativeTestJSON-126104058 None] Creating volume 39af84f3-439c-4d6d-b2f2-2977452949ab {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:25:55 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-cf81f9ba-f62a-4518-9bab-c88766a67ee8 tempest-VolumeQuotasNegativeTestJSON-126104058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:25:55 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-cf81f9ba-f62a-4518-9bab-c88766a67ee8 tempest-VolumeQuotasNegativeTestJSON-126104058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:25:55 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-cf81f9ba-f62a-4518-9bab-c88766a67ee8 tempest-VolumeQuotasNegativeTestJSON-126104058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:25:55 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-cf81f9ba-f62a-4518-9bab-c88766a67ee8 tempest-VolumeQuotasNegativeTestJSON-126104058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:25:55 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-cf81f9ba-f62a-4518-9bab-c88766a67ee8 tempest-VolumeQuotasNegativeTestJSON-126104058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:25:55 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-cf81f9ba-f62a-4518-9bab-c88766a67ee8 tempest-VolumeQuotasNegativeTestJSON-126104058 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:25:55 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-cf81f9ba-f62a-4518-9bab-c88766a67ee8 tempest-VolumeQuotasNegativeTestJSON-126104058 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:25:55 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-cf81f9ba-f62a-4518-9bab-c88766a67ee8 tempest-VolumeQuotasNegativeTestJSON-126104058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-39af84f3-439c-4d6d-b2f2-2977452949ab 1073741824 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:25:55 devstack sudo[91980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-39af84f3-439c-4d6d-b2f2-2977452949ab 1073741824
Nov 03 18:25:55 devstack sudo[91980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:25:55 devstack sudo[91976]: pam_unix(sudo:session): session closed for user root
Nov 03 18:25:55 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-3dfe5e24-36b4-433f-a2e7-20a51f3890dc tempest-VolumeTypesAccessTest-129588778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.345s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:25:55 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-3dfe5e24-36b4-433f-a2e7-20a51f3890dc tempest-VolumeTypesAccessTest-129588778 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:25:55 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-3dfe5e24-36b4-433f-a2e7-20a51f3890dc tempest-VolumeTypesAccessTest-129588778 None] Deleted volume successfully.
Nov 03 18:25:55 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-3dfe5e24-36b4-433f-a2e7-20a51f3890dc tempest-VolumeTypesAccessTest-129588778 None] Lock "cinder-c8b94d29-13d2-40d7-af45-e43603816073-delete_volume" released by "delete_volume" :: held 1.438s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:25:56 devstack sudo[91980]: pam_unix(sudo:session): session closed for user root
Nov 03 18:25:56 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-cf81f9ba-f62a-4518-9bab-c88766a67ee8 tempest-VolumeQuotasNegativeTestJSON-126104058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-39af84f3-439c-4d6d-b2f2-2977452949ab 1073741824" returned: 0 in 0.571s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:25:56 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-cf81f9ba-f62a-4518-9bab-c88766a67ee8 tempest-VolumeQuotasNegativeTestJSON-126104058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-39af84f3-439c-4d6d-b2f2-2977452949ab {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:25:56 devstack sudo[91987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-39af84f3-439c-4d6d-b2f2-2977452949ab
Nov 03 18:25:56 devstack sudo[91987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:25:56 devstack sudo[91987]: pam_unix(sudo:session): session closed for user root
Nov 03 18:25:56 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-cf81f9ba-f62a-4518-9bab-c88766a67ee8 tempest-VolumeQuotasNegativeTestJSON-126104058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-39af84f3-439c-4d6d-b2f2-2977452949ab" returned: 0 in 0.449s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:25:56 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-cf81f9ba-f62a-4518-9bab-c88766a67ee8 tempest-VolumeQuotasNegativeTestJSON-126104058 None] <== create_volume: return (1075ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:25:56 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-cf81f9ba-f62a-4518-9bab-c88766a67ee8 tempest-VolumeQuotasNegativeTestJSON-126104058 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.079s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:25:56 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-cf81f9ba-f62a-4518-9bab-c88766a67ee8 tempest-VolumeQuotasNegativeTestJSON-126104058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33b75b1f-1e7f-4e1e-aa69-0d65144de0f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39af84f3-439c-4d6d-b2f2-2977452949ab', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:25:56 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-cf81f9ba-f62a-4518-9bab-c88766a67ee8 tempest-VolumeQuotasNegativeTestJSON-126104058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6061689-8d58-48a6-be6e-015583857196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:25:56 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-cf81f9ba-f62a-4518-9bab-c88766a67ee8 tempest-VolumeQuotasNegativeTestJSON-126104058 None] Volume volume-39af84f3-439c-4d6d-b2f2-2977452949ab (39af84f3-439c-4d6d-b2f2-2977452949ab): created successfully
Nov 03 18:25:56 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-cf81f9ba-f62a-4518-9bab-c88766a67ee8 tempest-VolumeQuotasNegativeTestJSON-126104058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6061689-8d58-48a6-be6e-015583857196) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:25:56 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-cf81f9ba-f62a-4518-9bab-c88766a67ee8 tempest-VolumeQuotasNegativeTestJSON-126104058 None] Flow 'volume_create_manager' (a65d3f10-8ee9-48a1-ae61-e528626d835d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:25:56 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-cf81f9ba-f62a-4518-9bab-c88766a67ee8 tempest-VolumeQuotasNegativeTestJSON-126104058 None] Created volume successfully.
Nov 03 18:25:58 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [req-16360b9a-fd9e-4ea6-b1f4-08897d0e9409 req-c13adcda-0191-4adf-90bf-994037c3458f tempest-TaggedAttachmentsTest-1014450667 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:25:58 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [req-16360b9a-fd9e-4ea6-b1f4-08897d0e9409 req-c13adcda-0191-4adf-90bf-994037c3458f tempest-TaggedAttachmentsTest-1014450667 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:25:58 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [req-16360b9a-fd9e-4ea6-b1f4-08897d0e9409 req-c13adcda-0191-4adf-90bf-994037c3458f tempest-TaggedAttachmentsTest-1014450667 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:25:58 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [req-16360b9a-fd9e-4ea6-b1f4-08897d0e9409 req-c13adcda-0191-4adf-90bf-994037c3458f tempest-TaggedAttachmentsTest-1014450667 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c', 'name': 'volume-c96e35a0-647d-47e2-89d5-3018ed0956fa', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '376802a6-80e0-4bfb-9e02-5735af685f0e', 'enforce_multipath': True} {{(pid=86120) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 03 18:25:58 devstack cinder-volume[86120]: INFO cinder.volume.manager [req-16360b9a-fd9e-4ea6-b1f4-08897d0e9409 req-c13adcda-0191-4adf-90bf-994037c3458f tempest-TaggedAttachmentsTest-1014450667 None] attachment_update completed successfully.
Nov 03 18:25:59 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-15fa4405-c569-4929-89e6-9c852de5815b tempest-VolumeQuotasNegativeTestJSON-126104058 None] Acquiring lock "cinder-39af84f3-439c-4d6d-b2f2-2977452949ab-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:25:59 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-15fa4405-c569-4929-89e6-9c852de5815b tempest-VolumeQuotasNegativeTestJSON-126104058 None] Lock "cinder-39af84f3-439c-4d6d-b2f2-2977452949ab-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:25:59 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-15fa4405-c569-4929-89e6-9c852de5815b tempest-VolumeQuotasNegativeTestJSON-126104058 None] Acquiring lock "cinder-quobyte-39af84f3-439c-4d6d-b2f2-2977452949ab" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:25:59 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-15fa4405-c569-4929-89e6-9c852de5815b tempest-VolumeQuotasNegativeTestJSON-126104058 None] Lock "cinder-quobyte-39af84f3-439c-4d6d-b2f2-2977452949ab" acquired by "delete_volume" :: waited 0.025s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:25:59 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[491717d7-c79f-4fe0-b82e-d7f378fbb76a]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:25:59 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-15fa4405-c569-4929-89e6-9c852de5815b tempest-VolumeQuotasNegativeTestJSON-126104058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-39af84f3-439c-4d6d-b2f2-2977452949ab {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:25:59 devstack sudo[92056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-39af84f3-439c-4d6d-b2f2-2977452949ab
Nov 03 18:25:59 devstack sudo[92056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:25:59 devstack sudo[92056]: pam_unix(sudo:session): session closed for user root
Nov 03 18:25:59 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-15fa4405-c569-4929-89e6-9c852de5815b tempest-VolumeQuotasNegativeTestJSON-126104058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-39af84f3-439c-4d6d-b2f2-2977452949ab" returned: 0 in 0.485s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:25:59 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-15fa4405-c569-4929-89e6-9c852de5815b tempest-VolumeQuotasNegativeTestJSON-126104058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-39af84f3-439c-4d6d-b2f2-2977452949ab {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:25:59 devstack sudo[92062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-39af84f3-439c-4d6d-b2f2-2977452949ab
Nov 03 18:25:59 devstack sudo[92062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:26:00 devstack sudo[92062]: pam_unix(sudo:session): session closed for user root
Nov 03 18:26:00 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-15fa4405-c569-4929-89e6-9c852de5815b tempest-VolumeQuotasNegativeTestJSON-126104058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-39af84f3-439c-4d6d-b2f2-2977452949ab" returned: 0 in 0.261s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:26:00 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-15fa4405-c569-4929-89e6-9c852de5815b tempest-VolumeQuotasNegativeTestJSON-126104058 None] Lock "cinder-quobyte-39af84f3-439c-4d6d-b2f2-2977452949ab" released by "delete_volume" :: held 0.829s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:26:00 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-15fa4405-c569-4929-89e6-9c852de5815b tempest-VolumeQuotasNegativeTestJSON-126104058 None] Created reservations ['ae58639b-106c-4d80-a3e2-70b968308c6f', '534555cc-1adf-451b-b35f-0517ddf6046f', '17349ba0-d6ea-4e2e-a02b-fbd3c9dfd18d', 'efcbecd4-4606-4732-b46d-739768c83267'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:26:00 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-15fa4405-c569-4929-89e6-9c852de5815b tempest-VolumeQuotasNegativeTestJSON-126104058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:26:00 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-15fa4405-c569-4929-89e6-9c852de5815b tempest-VolumeQuotasNegativeTestJSON-126104058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:26:00 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-15fa4405-c569-4929-89e6-9c852de5815b tempest-VolumeQuotasNegativeTestJSON-126104058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:26:00 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-15fa4405-c569-4929-89e6-9c852de5815b tempest-VolumeQuotasNegativeTestJSON-126104058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:26:00 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-15fa4405-c569-4929-89e6-9c852de5815b tempest-VolumeQuotasNegativeTestJSON-126104058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:26:00 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-15fa4405-c569-4929-89e6-9c852de5815b tempest-VolumeQuotasNegativeTestJSON-126104058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:26:00 devstack sudo[92065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:26:00 devstack sudo[92065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:26:00 devstack sudo[92065]: pam_unix(sudo:session): session closed for user root
Nov 03 18:26:00 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-15fa4405-c569-4929-89e6-9c852de5815b tempest-VolumeQuotasNegativeTestJSON-126104058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.403s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:26:00 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-15fa4405-c569-4929-89e6-9c852de5815b tempest-VolumeQuotasNegativeTestJSON-126104058 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:26:00 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-15fa4405-c569-4929-89e6-9c852de5815b tempest-VolumeQuotasNegativeTestJSON-126104058 None] Deleted volume successfully.
Nov 03 18:26:00 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-15fa4405-c569-4929-89e6-9c852de5815b tempest-VolumeQuotasNegativeTestJSON-126104058 None] Lock "cinder-39af84f3-439c-4d6d-b2f2-2977452949ab-delete_volume" released by "delete_volume" :: held 1.506s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:26:01 devstack cinder-volume[86120]: INFO cinder.volume.manager [req-02a46c5b-e3eb-4539-b29b-a5085c03088a req-4619f0ed-8225-4cfc-916c-34dfa342dcfe tempest-TaggedAttachmentsTest-1014450667 None] Terminate volume connection completed successfully.
Nov 03 18:26:01 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [req-02a46c5b-e3eb-4539-b29b-a5085c03088a req-4619f0ed-8225-4cfc-916c-34dfa342dcfe tempest-TaggedAttachmentsTest-1014450667 None] Deleting attachment 376802a6-80e0-4bfb-9e02-5735af685f0e. {{(pid=86120) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 03 18:26:07 devstack cinder-volume[86120]: INFO cinder.volume.manager [req-d0c5eda0-ee0a-40ac-bf5d-9ee8ec523dff req-7b65b030-8859-40d8-943b-f2149aeb6fd9 tempest-ServerActionsTestOtherA-913173699 None] Terminate volume connection completed successfully.
Nov 03 18:26:07 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [req-d0c5eda0-ee0a-40ac-bf5d-9ee8ec523dff req-7b65b030-8859-40d8-943b-f2149aeb6fd9 tempest-ServerActionsTestOtherA-913173699 None] Deleting attachment ca1282df-9565-4fb3-af86-73bb7e32ec8c. {{(pid=86120) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 03 18:26:07 devstack cinder-volume[86120]: DEBUG cinder.coordination [req-d0c5eda0-ee0a-40ac-bf5d-9ee8ec523dff req-0fbeac51-05ed-4500-aa42-22309136de4a tempest-ServerActionsTestOtherA-913173699 None] Acquiring lock "cinder-b1e5365c-d629-4abc-bae0-700bacd2d382-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:26:07 devstack cinder-volume[86120]: DEBUG cinder.coordination [req-d0c5eda0-ee0a-40ac-bf5d-9ee8ec523dff req-0fbeac51-05ed-4500-aa42-22309136de4a tempest-ServerActionsTestOtherA-913173699 None] Lock "cinder-b1e5365c-d629-4abc-bae0-700bacd2d382-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:26:07 devstack cinder-volume[86120]: DEBUG cinder.coordination [req-d0c5eda0-ee0a-40ac-bf5d-9ee8ec523dff req-0fbeac51-05ed-4500-aa42-22309136de4a tempest-ServerActionsTestOtherA-913173699 None] Acquiring lock "cinder-quobyte-b1e5365c-d629-4abc-bae0-700bacd2d382" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:26:07 devstack cinder-volume[86120]: DEBUG cinder.coordination [req-d0c5eda0-ee0a-40ac-bf5d-9ee8ec523dff req-0fbeac51-05ed-4500-aa42-22309136de4a tempest-ServerActionsTestOtherA-913173699 None] Lock "cinder-quobyte-b1e5365c-d629-4abc-bae0-700bacd2d382" acquired by "delete_volume" :: waited 0.017s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:26:07 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4bd9488-5416-4c63-9134-f6c1cfd65843]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:26:07 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [req-d0c5eda0-ee0a-40ac-bf5d-9ee8ec523dff req-0fbeac51-05ed-4500-aa42-22309136de4a tempest-ServerActionsTestOtherA-913173699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-b1e5365c-d629-4abc-bae0-700bacd2d382 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:26:07 devstack sudo[92127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-b1e5365c-d629-4abc-bae0-700bacd2d382
Nov 03 18:26:07 devstack sudo[92127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:26:08 devstack sudo[92127]: pam_unix(sudo:session): session closed for user root
Nov 03 18:26:08 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [req-d0c5eda0-ee0a-40ac-bf5d-9ee8ec523dff req-0fbeac51-05ed-4500-aa42-22309136de4a tempest-ServerActionsTestOtherA-913173699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-b1e5365c-d629-4abc-bae0-700bacd2d382" returned: 0 in 0.781s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:26:08 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [req-d0c5eda0-ee0a-40ac-bf5d-9ee8ec523dff req-0fbeac51-05ed-4500-aa42-22309136de4a tempest-ServerActionsTestOtherA-913173699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-b1e5365c-d629-4abc-bae0-700bacd2d382 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:26:08 devstack sudo[92136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-b1e5365c-d629-4abc-bae0-700bacd2d382
Nov 03 18:26:08 devstack sudo[92136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:26:08 devstack sudo[92136]: pam_unix(sudo:session): session closed for user root
Nov 03 18:26:08 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [req-d0c5eda0-ee0a-40ac-bf5d-9ee8ec523dff req-0fbeac51-05ed-4500-aa42-22309136de4a tempest-ServerActionsTestOtherA-913173699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-b1e5365c-d629-4abc-bae0-700bacd2d382" returned: 0 in 0.490s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:26:08 devstack cinder-volume[86120]: DEBUG cinder.coordination [req-d0c5eda0-ee0a-40ac-bf5d-9ee8ec523dff req-0fbeac51-05ed-4500-aa42-22309136de4a tempest-ServerActionsTestOtherA-913173699 None] Lock "cinder-quobyte-b1e5365c-d629-4abc-bae0-700bacd2d382" released by "delete_volume" :: held 1.361s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:26:08 devstack cinder-volume[86120]: DEBUG cinder.quota [req-d0c5eda0-ee0a-40ac-bf5d-9ee8ec523dff req-0fbeac51-05ed-4500-aa42-22309136de4a tempest-ServerActionsTestOtherA-913173699 None] Created reservations ['0cdf555f-6b43-433a-864a-79ec0a2c53aa', 'a1b299ab-cd2d-4bf4-9c6e-a29f392039c4', '13e9fd5b-c448-45aa-8c3e-dc4f71354ce7', '86b7690e-b2f4-41be-b661-295216ebe1ce'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:26:08 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [req-d0c5eda0-ee0a-40ac-bf5d-9ee8ec523dff req-0fbeac51-05ed-4500-aa42-22309136de4a tempest-ServerActionsTestOtherA-913173699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:26:08 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [req-d0c5eda0-ee0a-40ac-bf5d-9ee8ec523dff req-0fbeac51-05ed-4500-aa42-22309136de4a tempest-ServerActionsTestOtherA-913173699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:26:08 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [req-d0c5eda0-ee0a-40ac-bf5d-9ee8ec523dff req-0fbeac51-05ed-4500-aa42-22309136de4a tempest-ServerActionsTestOtherA-913173699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:26:08 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [req-d0c5eda0-ee0a-40ac-bf5d-9ee8ec523dff req-0fbeac51-05ed-4500-aa42-22309136de4a tempest-ServerActionsTestOtherA-913173699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:26:08 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [req-d0c5eda0-ee0a-40ac-bf5d-9ee8ec523dff req-0fbeac51-05ed-4500-aa42-22309136de4a tempest-ServerActionsTestOtherA-913173699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:26:08 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [req-d0c5eda0-ee0a-40ac-bf5d-9ee8ec523dff req-0fbeac51-05ed-4500-aa42-22309136de4a tempest-ServerActionsTestOtherA-913173699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:26:08 devstack sudo[92160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:26:08 devstack sudo[92160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:26:09 devstack sudo[92160]: pam_unix(sudo:session): session closed for user root
Nov 03 18:26:09 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [req-d0c5eda0-ee0a-40ac-bf5d-9ee8ec523dff req-0fbeac51-05ed-4500-aa42-22309136de4a tempest-ServerActionsTestOtherA-913173699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.432s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:26:09 devstack cinder-volume[86120]: DEBUG cinder.manager [req-d0c5eda0-ee0a-40ac-bf5d-9ee8ec523dff req-0fbeac51-05ed-4500-aa42-22309136de4a tempest-ServerActionsTestOtherA-913173699 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:26:09 devstack cinder-volume[86120]: INFO cinder.volume.manager [req-d0c5eda0-ee0a-40ac-bf5d-9ee8ec523dff req-0fbeac51-05ed-4500-aa42-22309136de4a tempest-ServerActionsTestOtherA-913173699 None] Deleted volume successfully.
Nov 03 18:26:09 devstack cinder-volume[86120]: DEBUG cinder.coordination [req-d0c5eda0-ee0a-40ac-bf5d-9ee8ec523dff req-0fbeac51-05ed-4500-aa42-22309136de4a tempest-ServerActionsTestOtherA-913173699 None] Lock "cinder-b1e5365c-d629-4abc-bae0-700bacd2d382-delete_volume" released by "delete_volume" :: held 2.094s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:26:09 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-93953514-d3eb-484d-a3b6-07007f25ef9a tempest-ServerActionsTestOtherA-913173699 None] Acquiring lock "cinder-255042f8-8af6-4403-bed7-bea7fc953047-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:26:09 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-93953514-d3eb-484d-a3b6-07007f25ef9a tempest-ServerActionsTestOtherA-913173699 None] Lock "cinder-255042f8-8af6-4403-bed7-bea7fc953047-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:26:09 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-93953514-d3eb-484d-a3b6-07007f25ef9a tempest-ServerActionsTestOtherA-913173699 None] Acquiring lock "cinder-quobyte-255042f8-8af6-4403-bed7-bea7fc953047" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:26:09 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-93953514-d3eb-484d-a3b6-07007f25ef9a tempest-ServerActionsTestOtherA-913173699 None] Lock "cinder-quobyte-255042f8-8af6-4403-bed7-bea7fc953047" acquired by "delete_volume" :: waited 0.020s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:26:09 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[11023f86-ec00-46d6-b4be-8dbaf22bc982]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:26:09 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-93953514-d3eb-484d-a3b6-07007f25ef9a tempest-ServerActionsTestOtherA-913173699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-255042f8-8af6-4403-bed7-bea7fc953047 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:26:09 devstack sudo[92164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-255042f8-8af6-4403-bed7-bea7fc953047
Nov 03 18:26:09 devstack sudo[92164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:26:10 devstack sudo[92164]: pam_unix(sudo:session): session closed for user root
Nov 03 18:26:10 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-93953514-d3eb-484d-a3b6-07007f25ef9a tempest-ServerActionsTestOtherA-913173699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-255042f8-8af6-4403-bed7-bea7fc953047" returned: 0 in 0.672s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:26:10 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-93953514-d3eb-484d-a3b6-07007f25ef9a tempest-ServerActionsTestOtherA-913173699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-255042f8-8af6-4403-bed7-bea7fc953047 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:26:10 devstack sudo[92175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-255042f8-8af6-4403-bed7-bea7fc953047
Nov 03 18:26:10 devstack sudo[92175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:26:10 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-92d2b728-2a59-46f1-b6f1-17451abd11fe tempest-VolumesServicesTestJSON-80376705 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:26:10 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-92d2b728-2a59-46f1-b6f1-17451abd11fe tempest-VolumesServicesTestJSON-80376705 None] Flow 'volume_create_manager' (ca80bd18-e85e-4e2e-8507-10901af67500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:26:10 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-92d2b728-2a59-46f1-b6f1-17451abd11fe tempest-VolumesServicesTestJSON-80376705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddb33718-0d55-425e-822c-1f80a5a45d7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:26:10 devstack sudo[92175]: pam_unix(sudo:session): session closed for user root
Nov 03 18:26:10 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-93953514-d3eb-484d-a3b6-07007f25ef9a tempest-ServerActionsTestOtherA-913173699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-255042f8-8af6-4403-bed7-bea7fc953047" returned: 0 in 0.383s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:26:10 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-92d2b728-2a59-46f1-b6f1-17451abd11fe tempest-VolumesServicesTestJSON-80376705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddb33718-0d55-425e-822c-1f80a5a45d7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:26:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-525595459',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a60d296c-3d67-439a-b554-55ed298debd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38093708f103471e8a415c9e79484c28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:26:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:26:11Z,use_quota=True,user_id='c07aa92a614442c98cb53f1f7b890937',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:26:10 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-92d2b728-2a59-46f1-b6f1-17451abd11fe tempest-VolumesServicesTestJSON-80376705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e248f3f5-0ee0-40d3-8e78-8bad583b5203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:26:10 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-92d2b728-2a59-46f1-b6f1-17451abd11fe tempest-VolumesServicesTestJSON-80376705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e248f3f5-0ee0-40d3-8e78-8bad583b5203) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:26:10 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-92d2b728-2a59-46f1-b6f1-17451abd11fe tempest-VolumesServicesTestJSON-80376705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8644efd4-e7ec-44fd-99b8-e943c67eb85c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:26:10 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-92d2b728-2a59-46f1-b6f1-17451abd11fe tempest-VolumesServicesTestJSON-80376705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8644efd4-e7ec-44fd-99b8-e943c67eb85c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a60d296c-3d67-439a-b554-55ed298debd0', 'volume_name': 'volume-a60d296c-3d67-439a-b554-55ed298debd0', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:26:10 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-92d2b728-2a59-46f1-b6f1-17451abd11fe tempest-VolumesServicesTestJSON-80376705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d1cbdb3-2d5a-4c13-8b0a-2cf240166e74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:26:10 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-92d2b728-2a59-46f1-b6f1-17451abd11fe tempest-VolumesServicesTestJSON-80376705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d1cbdb3-2d5a-4c13-8b0a-2cf240166e74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:26:10 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-92d2b728-2a59-46f1-b6f1-17451abd11fe tempest-VolumesServicesTestJSON-80376705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (825ffd88-2e8b-4dd7-846a-74e06b117674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:26:10 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-92d2b728-2a59-46f1-b6f1-17451abd11fe tempest-VolumesServicesTestJSON-80376705 None] Volume a60d296c-3d67-439a-b554-55ed298debd0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a60d296c-3d67-439a-b554-55ed298debd0', 'volume_size': 1}
Nov 03 18:26:10 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-92d2b728-2a59-46f1-b6f1-17451abd11fe tempest-VolumesServicesTestJSON-80376705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:26:10 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-92d2b728-2a59-46f1-b6f1-17451abd11fe tempest-VolumesServicesTestJSON-80376705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:26:10 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-92d2b728-2a59-46f1-b6f1-17451abd11fe tempest-VolumesServicesTestJSON-80376705 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:26:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-525595459',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a60d296c-3d67-439a-b554-55ed298debd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38093708f103471e8a415c9e79484c28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:26:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:26:11Z,use_quota=True,user_id='c07aa92a614442c98cb53f1f7b890937',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:26:10 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-92d2b728-2a59-46f1-b6f1-17451abd11fe tempest-VolumesServicesTestJSON-80376705 None] Creating volume a60d296c-3d67-439a-b554-55ed298debd0 {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:26:10 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-92d2b728-2a59-46f1-b6f1-17451abd11fe tempest-VolumesServicesTestJSON-80376705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:26:10 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-92d2b728-2a59-46f1-b6f1-17451abd11fe tempest-VolumesServicesTestJSON-80376705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:26:10 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-92d2b728-2a59-46f1-b6f1-17451abd11fe tempest-VolumesServicesTestJSON-80376705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:26:10 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-92d2b728-2a59-46f1-b6f1-17451abd11fe tempest-VolumesServicesTestJSON-80376705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:26:10 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-92d2b728-2a59-46f1-b6f1-17451abd11fe tempest-VolumesServicesTestJSON-80376705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:26:10 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-92d2b728-2a59-46f1-b6f1-17451abd11fe tempest-VolumesServicesTestJSON-80376705 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:26:10 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-92d2b728-2a59-46f1-b6f1-17451abd11fe tempest-VolumesServicesTestJSON-80376705 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:26:10 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-92d2b728-2a59-46f1-b6f1-17451abd11fe tempest-VolumesServicesTestJSON-80376705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-a60d296c-3d67-439a-b554-55ed298debd0 1073741824 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:26:10 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-93953514-d3eb-484d-a3b6-07007f25ef9a tempest-ServerActionsTestOtherA-913173699 None] Lock "cinder-quobyte-255042f8-8af6-4403-bed7-bea7fc953047" released by "delete_volume" :: held 1.218s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:26:10 devstack sudo[92178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-a60d296c-3d67-439a-b554-55ed298debd0 1073741824
Nov 03 18:26:10 devstack sudo[92178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:26:10 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-93953514-d3eb-484d-a3b6-07007f25ef9a tempest-ServerActionsTestOtherA-913173699 None] Created reservations ['80f5d17a-cdc1-4364-8a0b-a13aeee991ac', '34b052d3-df06-479f-a685-d9ea2a381d56', 'd976fafd-5e1d-4776-be36-0972b7424633', 'ab40e2d4-18fa-4295-b3e3-f709135d9e09'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:26:10 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-93953514-d3eb-484d-a3b6-07007f25ef9a tempest-ServerActionsTestOtherA-913173699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:26:10 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-93953514-d3eb-484d-a3b6-07007f25ef9a tempest-ServerActionsTestOtherA-913173699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:26:10 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-93953514-d3eb-484d-a3b6-07007f25ef9a tempest-ServerActionsTestOtherA-913173699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:26:10 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-93953514-d3eb-484d-a3b6-07007f25ef9a tempest-ServerActionsTestOtherA-913173699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:26:10 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-93953514-d3eb-484d-a3b6-07007f25ef9a tempest-ServerActionsTestOtherA-913173699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:26:10 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-93953514-d3eb-484d-a3b6-07007f25ef9a tempest-ServerActionsTestOtherA-913173699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:26:10 devstack sudo[92180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:26:10 devstack sudo[92180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:26:11 devstack sudo[92180]: pam_unix(sudo:session): session closed for user root
Nov 03 18:26:11 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-93953514-d3eb-484d-a3b6-07007f25ef9a tempest-ServerActionsTestOtherA-913173699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.322s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:26:11 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-93953514-d3eb-484d-a3b6-07007f25ef9a tempest-ServerActionsTestOtherA-913173699 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:26:11 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-93953514-d3eb-484d-a3b6-07007f25ef9a tempest-ServerActionsTestOtherA-913173699 None] Deleted volume successfully.
Nov 03 18:26:11 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-93953514-d3eb-484d-a3b6-07007f25ef9a tempest-ServerActionsTestOtherA-913173699 None] Lock "cinder-255042f8-8af6-4403-bed7-bea7fc953047-delete_volume" released by "delete_volume" :: held 1.820s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:26:11 devstack sudo[92178]: pam_unix(sudo:session): session closed for user root
Nov 03 18:26:11 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-92d2b728-2a59-46f1-b6f1-17451abd11fe tempest-VolumesServicesTestJSON-80376705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-a60d296c-3d67-439a-b554-55ed298debd0 1073741824" returned: 0 in 0.583s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:26:11 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-92d2b728-2a59-46f1-b6f1-17451abd11fe tempest-VolumesServicesTestJSON-80376705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-a60d296c-3d67-439a-b554-55ed298debd0 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:26:11 devstack sudo[92187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-a60d296c-3d67-439a-b554-55ed298debd0
Nov 03 18:26:11 devstack sudo[92187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:26:11 devstack sudo[92187]: pam_unix(sudo:session): session closed for user root
Nov 03 18:26:11 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-92d2b728-2a59-46f1-b6f1-17451abd11fe tempest-VolumesServicesTestJSON-80376705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-a60d296c-3d67-439a-b554-55ed298debd0" returned: 0 in 0.300s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:26:11 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-92d2b728-2a59-46f1-b6f1-17451abd11fe tempest-VolumesServicesTestJSON-80376705 None] <== create_volume: return (943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:26:11 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-92d2b728-2a59-46f1-b6f1-17451abd11fe tempest-VolumesServicesTestJSON-80376705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.947s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:26:11 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-92d2b728-2a59-46f1-b6f1-17451abd11fe tempest-VolumesServicesTestJSON-80376705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (825ffd88-2e8b-4dd7-846a-74e06b117674) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a60d296c-3d67-439a-b554-55ed298debd0', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:26:11 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-92d2b728-2a59-46f1-b6f1-17451abd11fe tempest-VolumesServicesTestJSON-80376705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dce0e724-9354-4f75-8114-b9c0ea323ac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:26:11 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-92d2b728-2a59-46f1-b6f1-17451abd11fe tempest-VolumesServicesTestJSON-80376705 None] Volume volume-a60d296c-3d67-439a-b554-55ed298debd0 (a60d296c-3d67-439a-b554-55ed298debd0): created successfully
Nov 03 18:26:11 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-92d2b728-2a59-46f1-b6f1-17451abd11fe tempest-VolumesServicesTestJSON-80376705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dce0e724-9354-4f75-8114-b9c0ea323ac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:26:11 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-92d2b728-2a59-46f1-b6f1-17451abd11fe tempest-VolumesServicesTestJSON-80376705 None] Flow 'volume_create_manager' (ca80bd18-e85e-4e2e-8507-10901af67500) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:26:11 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-92d2b728-2a59-46f1-b6f1-17451abd11fe tempest-VolumesServicesTestJSON-80376705 None] Created volume successfully.
Nov 03 18:26:12 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-f5a9d17e-670e-4373-a0e7-8f105108434b tempest-VolumesServicesTestJSON-80376705 None] Acquiring lock "cinder-a60d296c-3d67-439a-b554-55ed298debd0-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:26:12 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-f5a9d17e-670e-4373-a0e7-8f105108434b tempest-VolumesServicesTestJSON-80376705 None] Lock "cinder-a60d296c-3d67-439a-b554-55ed298debd0-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:26:12 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-f5a9d17e-670e-4373-a0e7-8f105108434b tempest-VolumesServicesTestJSON-80376705 None] Acquiring lock "cinder-quobyte-a60d296c-3d67-439a-b554-55ed298debd0" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:26:12 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-f5a9d17e-670e-4373-a0e7-8f105108434b tempest-VolumesServicesTestJSON-80376705 None] Lock "cinder-quobyte-a60d296c-3d67-439a-b554-55ed298debd0" acquired by "delete_volume" :: waited 0.022s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:26:12 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2cf2091-6a0a-4268-ac68-48f4e5df99bd]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:26:12 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-f5a9d17e-670e-4373-a0e7-8f105108434b tempest-VolumesServicesTestJSON-80376705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-a60d296c-3d67-439a-b554-55ed298debd0 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:26:13 devstack sudo[92214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-a60d296c-3d67-439a-b554-55ed298debd0
Nov 03 18:26:13 devstack sudo[92214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:26:13 devstack sudo[92214]: pam_unix(sudo:session): session closed for user root
Nov 03 18:26:13 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-f5a9d17e-670e-4373-a0e7-8f105108434b tempest-VolumesServicesTestJSON-80376705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-a60d296c-3d67-439a-b554-55ed298debd0" returned: 0 in 0.446s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:26:13 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-f5a9d17e-670e-4373-a0e7-8f105108434b tempest-VolumesServicesTestJSON-80376705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-a60d296c-3d67-439a-b554-55ed298debd0 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:26:13 devstack sudo[92226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-a60d296c-3d67-439a-b554-55ed298debd0
Nov 03 18:26:13 devstack sudo[92226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:26:13 devstack sudo[92226]: pam_unix(sudo:session): session closed for user root
Nov 03 18:26:13 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-f5a9d17e-670e-4373-a0e7-8f105108434b tempest-VolumesServicesTestJSON-80376705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-a60d296c-3d67-439a-b554-55ed298debd0" returned: 0 in 0.345s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:26:13 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-f5a9d17e-670e-4373-a0e7-8f105108434b tempest-VolumesServicesTestJSON-80376705 None] Lock "cinder-quobyte-a60d296c-3d67-439a-b554-55ed298debd0" released by "delete_volume" :: held 0.868s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:26:13 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-f5a9d17e-670e-4373-a0e7-8f105108434b tempest-VolumesServicesTestJSON-80376705 None] Created reservations ['6eca857f-f4d3-44bd-a2c0-39dc183f455f', '750cb84a-436b-44d1-b12f-915af68fd9e7', '5dd76592-7b20-4619-8f43-d10e5c7f5481', '4861511e-5795-4bcb-9f61-fc8f29a77891'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:26:13 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-f5a9d17e-670e-4373-a0e7-8f105108434b tempest-VolumesServicesTestJSON-80376705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:26:13 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-f5a9d17e-670e-4373-a0e7-8f105108434b tempest-VolumesServicesTestJSON-80376705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:26:13 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-f5a9d17e-670e-4373-a0e7-8f105108434b tempest-VolumesServicesTestJSON-80376705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:26:13 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-f5a9d17e-670e-4373-a0e7-8f105108434b tempest-VolumesServicesTestJSON-80376705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:26:13 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-f5a9d17e-670e-4373-a0e7-8f105108434b tempest-VolumesServicesTestJSON-80376705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:26:13 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-f5a9d17e-670e-4373-a0e7-8f105108434b tempest-VolumesServicesTestJSON-80376705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:26:14 devstack sudo[92230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:26:14 devstack sudo[92230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:26:14 devstack sudo[92230]: pam_unix(sudo:session): session closed for user root
Nov 03 18:26:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-f5a9d17e-670e-4373-a0e7-8f105108434b tempest-VolumesServicesTestJSON-80376705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.404s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:26:14 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-f5a9d17e-670e-4373-a0e7-8f105108434b tempest-VolumesServicesTestJSON-80376705 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:26:14 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-f5a9d17e-670e-4373-a0e7-8f105108434b tempest-VolumesServicesTestJSON-80376705 None] Deleted volume successfully.
Nov 03 18:26:14 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-f5a9d17e-670e-4373-a0e7-8f105108434b tempest-VolumesServicesTestJSON-80376705 None] Lock "cinder-a60d296c-3d67-439a-b554-55ed298debd0-delete_volume" released by "delete_volume" :: held 1.576s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:26:14 devstack cinder-volume[86120]: DEBUG oslo_service.periodic_task [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86120) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 18:26:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:26:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:26:14 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:26:14 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:26:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:26:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:26:15 devstack sudo[92236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:26:15 devstack sudo[92236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:26:15 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-a570afe4-9636-4e01-9cc3-123739e8f96a tempest-TaggedAttachmentsTest-1014450667 None] Acquiring lock "cinder-c96e35a0-647d-47e2-89d5-3018ed0956fa-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:26:15 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-a570afe4-9636-4e01-9cc3-123739e8f96a tempest-TaggedAttachmentsTest-1014450667 None] Lock "cinder-c96e35a0-647d-47e2-89d5-3018ed0956fa-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:26:15 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-a570afe4-9636-4e01-9cc3-123739e8f96a tempest-TaggedAttachmentsTest-1014450667 None] Acquiring lock "cinder-quobyte-c96e35a0-647d-47e2-89d5-3018ed0956fa" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:26:15 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-a570afe4-9636-4e01-9cc3-123739e8f96a tempest-TaggedAttachmentsTest-1014450667 None] Lock "cinder-quobyte-c96e35a0-647d-47e2-89d5-3018ed0956fa" acquired by "delete_volume" :: waited 0.027s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:26:15 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c4e420f-a233-43b6-8d60-b303b71d909d]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:26:15 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-a570afe4-9636-4e01-9cc3-123739e8f96a tempest-TaggedAttachmentsTest-1014450667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-c96e35a0-647d-47e2-89d5-3018ed0956fa {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:26:15 devstack sudo[92236]: pam_unix(sudo:session): session closed for user root
Nov 03 18:26:15 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.410s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:26:15 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:26:15 devstack cinder-volume[86120]: DEBUG oslo_service.periodic_task [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Running periodic task VolumeManager._thread_info {{(pid=86120) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 18:26:15 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] thread count: 28 {{(pid=86120) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 03 18:26:15 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] thread info: [<_MainThread(MainThread, started 134747145822336)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134747033686336)>, <Thread(Thread-3 (stat_writer), started daemon 134747030828736)>, <Thread(Rabbit-heartbeat, started daemon 134747035433408)>, <Thread(Thread-5 (_runner), started daemon 134747029587392)>, <Thread(Thread-7 (_runner), started daemon 134747029784256)>, <Thread(fd_logger, started daemon 134747027909120)>, <Thread(privsep_reader, started daemon 134747027006592)>, <Thread(tpool_thread_0, started daemon 134747018950336)>, <Thread(tpool_thread_1, started daemon 134747010541248)>, <Thread(tpool_thread_2, started daemon 134747002132160)>, <Thread(tpool_thread_3, started daemon 134746993723072)>, <Thread(tpool_thread_4, started daemon 134746985313984)>, <Thread(tpool_thread_5, started daemon 134746976904896)>, <Thread(tpool_thread_6, started daemon 134746968495808)>, <Thread(tpool_thread_7, started daemon 134746960086720)>, <Thread(tpool_thread_8, started daemon 134746951677632)>, <Thread(tpool_thread_9, started daemon 134746943268544)>, <Thread(tpool_thread_10, started daemon 134746934859456)>, <Thread(tpool_thread_11, started daemon 134746926450368)>, <Thread(tpool_thread_12, started daemon 134746918041280)>, <Thread(tpool_thread_13, started daemon 134746909632192)>, <Thread(tpool_thread_14, started daemon 134746901223104)>, <Thread(tpool_thread_15, started daemon 134746892814016)>, <Thread(tpool_thread_16, started daemon 134746884404928)>, <Thread(tpool_thread_17, started daemon 134746875995840)>, <Thread(tpool_thread_18, started daemon 134746867586752)>, <Thread(tpool_thread_19, started daemon 134746859177664)>] {{(pid=86120) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 03 18:26:15 devstack sudo[92239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-c96e35a0-647d-47e2-89d5-3018ed0956fa
Nov 03 18:26:15 devstack sudo[92239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:26:15 devstack sudo[92239]: pam_unix(sudo:session): session closed for user root
Nov 03 18:26:15 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-a570afe4-9636-4e01-9cc3-123739e8f96a tempest-TaggedAttachmentsTest-1014450667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-c96e35a0-647d-47e2-89d5-3018ed0956fa" returned: 0 in 0.473s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:26:15 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-a570afe4-9636-4e01-9cc3-123739e8f96a tempest-TaggedAttachmentsTest-1014450667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-c96e35a0-647d-47e2-89d5-3018ed0956fa {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:26:15 devstack sudo[92245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-c96e35a0-647d-47e2-89d5-3018ed0956fa
Nov 03 18:26:15 devstack sudo[92245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:26:16 devstack sudo[92245]: pam_unix(sudo:session): session closed for user root
Nov 03 18:26:16 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-a570afe4-9636-4e01-9cc3-123739e8f96a tempest-TaggedAttachmentsTest-1014450667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-c96e35a0-647d-47e2-89d5-3018ed0956fa" returned: 0 in 0.358s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:26:16 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-a570afe4-9636-4e01-9cc3-123739e8f96a tempest-TaggedAttachmentsTest-1014450667 None] Lock "cinder-quobyte-c96e35a0-647d-47e2-89d5-3018ed0956fa" released by "delete_volume" :: held 0.917s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:26:16 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-a570afe4-9636-4e01-9cc3-123739e8f96a tempest-TaggedAttachmentsTest-1014450667 None] Created reservations ['e0fc80a7-c5a1-4c5d-989d-b31b6269c681', '98d68a20-8ff7-4de7-a45c-2e8a6c6e5428', '431aa6d5-21da-48a0-a1e4-f40e3f855cdf', 'f2572fed-27c8-4d70-8996-5f077e024ef4'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:26:16 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-a570afe4-9636-4e01-9cc3-123739e8f96a tempest-TaggedAttachmentsTest-1014450667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:26:16 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-a570afe4-9636-4e01-9cc3-123739e8f96a tempest-TaggedAttachmentsTest-1014450667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:26:16 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-a570afe4-9636-4e01-9cc3-123739e8f96a tempest-TaggedAttachmentsTest-1014450667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:26:16 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-a570afe4-9636-4e01-9cc3-123739e8f96a tempest-TaggedAttachmentsTest-1014450667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:26:16 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-a570afe4-9636-4e01-9cc3-123739e8f96a tempest-TaggedAttachmentsTest-1014450667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:26:16 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-a570afe4-9636-4e01-9cc3-123739e8f96a tempest-TaggedAttachmentsTest-1014450667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:26:16 devstack sudo[92248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:26:16 devstack sudo[92248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:26:16 devstack sudo[92248]: pam_unix(sudo:session): session closed for user root
Nov 03 18:26:16 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-a570afe4-9636-4e01-9cc3-123739e8f96a tempest-TaggedAttachmentsTest-1014450667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.282s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:26:16 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-a570afe4-9636-4e01-9cc3-123739e8f96a tempest-TaggedAttachmentsTest-1014450667 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:26:16 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-a570afe4-9636-4e01-9cc3-123739e8f96a tempest-TaggedAttachmentsTest-1014450667 None] Deleted volume successfully.
Nov 03 18:26:16 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-a570afe4-9636-4e01-9cc3-123739e8f96a tempest-TaggedAttachmentsTest-1014450667 None] Lock "cinder-c96e35a0-647d-47e2-89d5-3018ed0956fa-delete_volume" released by "delete_volume" :: held 1.560s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:26:26 devstack cinder-volume[86120]: DEBUG dbcounter [-] [86120] Writing DB stats cinder:SELECT=42,cinder:INSERT=12,cinder:UPDATE=79,cinder:DELETE=3 {{(pid=86120) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 18:26:26 devstack cinder-volume[86120]: DEBUG dbcounter [-] [86120] Writing DB stats cinder:SELECT=57,cinder:INSERT=19,cinder:UPDATE=54,cinder:DELETE=7 {{(pid=86120) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 18:26:33 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-74153a3f-9c4a-49a3-bc2e-c89117bc4680 tempest-VolumesMetadataTest-1369352289 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:26:33 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-74153a3f-9c4a-49a3-bc2e-c89117bc4680 tempest-VolumesMetadataTest-1369352289 None] Flow 'volume_create_manager' (7ae93038-c8a6-4d58-a733-1adbc0fea738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:26:33 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-74153a3f-9c4a-49a3-bc2e-c89117bc4680 tempest-VolumesMetadataTest-1369352289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbd7b88f-9a0f-4c4c-9bd4-c86af64156f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:26:33 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-74153a3f-9c4a-49a3-bc2e-c89117bc4680 tempest-VolumesMetadataTest-1369352289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbd7b88f-9a0f-4c4c-9bd4-c86af64156f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:26:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1792349625',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26426030-0752-4a7f-817f-ad32e661bfd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39a8524175d5469fb02ce9315bff77f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:26:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:26:33Z,use_quota=True,user_id='2a8aa6e9dd04468ea2699f60849126b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:26:33 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-74153a3f-9c4a-49a3-bc2e-c89117bc4680 tempest-VolumesMetadataTest-1369352289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82c8dfed-00a2-4ffc-bee2-0397213dba6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:26:33 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-74153a3f-9c4a-49a3-bc2e-c89117bc4680 tempest-VolumesMetadataTest-1369352289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82c8dfed-00a2-4ffc-bee2-0397213dba6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:26:33 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-74153a3f-9c4a-49a3-bc2e-c89117bc4680 tempest-VolumesMetadataTest-1369352289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (282a66f2-5355-4ad0-b77d-73ba62391633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:26:33 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-74153a3f-9c4a-49a3-bc2e-c89117bc4680 tempest-VolumesMetadataTest-1369352289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (282a66f2-5355-4ad0-b77d-73ba62391633) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26426030-0752-4a7f-817f-ad32e661bfd8', 'volume_name': 'volume-26426030-0752-4a7f-817f-ad32e661bfd8', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:26:33 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-74153a3f-9c4a-49a3-bc2e-c89117bc4680 tempest-VolumesMetadataTest-1369352289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9d3a075-331d-48c5-a27e-43e062ee25f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:26:33 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-74153a3f-9c4a-49a3-bc2e-c89117bc4680 tempest-VolumesMetadataTest-1369352289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9d3a075-331d-48c5-a27e-43e062ee25f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:26:33 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-74153a3f-9c4a-49a3-bc2e-c89117bc4680 tempest-VolumesMetadataTest-1369352289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9899387d-ddf5-4062-86d7-07afcd7f3506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:26:33 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-74153a3f-9c4a-49a3-bc2e-c89117bc4680 tempest-VolumesMetadataTest-1369352289 None] Volume 26426030-0752-4a7f-817f-ad32e661bfd8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26426030-0752-4a7f-817f-ad32e661bfd8', 'volume_size': 1}
Nov 03 18:26:33 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-74153a3f-9c4a-49a3-bc2e-c89117bc4680 tempest-VolumesMetadataTest-1369352289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:26:33 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-74153a3f-9c4a-49a3-bc2e-c89117bc4680 tempest-VolumesMetadataTest-1369352289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:26:33 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-74153a3f-9c4a-49a3-bc2e-c89117bc4680 tempest-VolumesMetadataTest-1369352289 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:26:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1792349625',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26426030-0752-4a7f-817f-ad32e661bfd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39a8524175d5469fb02ce9315bff77f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:26:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:26:33Z,use_quota=True,user_id='2a8aa6e9dd04468ea2699f60849126b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:26:33 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-74153a3f-9c4a-49a3-bc2e-c89117bc4680 tempest-VolumesMetadataTest-1369352289 None] Creating volume 26426030-0752-4a7f-817f-ad32e661bfd8 {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:26:33 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-74153a3f-9c4a-49a3-bc2e-c89117bc4680 tempest-VolumesMetadataTest-1369352289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:26:33 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-74153a3f-9c4a-49a3-bc2e-c89117bc4680 tempest-VolumesMetadataTest-1369352289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:26:33 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-74153a3f-9c4a-49a3-bc2e-c89117bc4680 tempest-VolumesMetadataTest-1369352289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:26:33 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-74153a3f-9c4a-49a3-bc2e-c89117bc4680 tempest-VolumesMetadataTest-1369352289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:26:33 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-74153a3f-9c4a-49a3-bc2e-c89117bc4680 tempest-VolumesMetadataTest-1369352289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:26:33 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-74153a3f-9c4a-49a3-bc2e-c89117bc4680 tempest-VolumesMetadataTest-1369352289 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:26:33 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-74153a3f-9c4a-49a3-bc2e-c89117bc4680 tempest-VolumesMetadataTest-1369352289 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:26:33 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-74153a3f-9c4a-49a3-bc2e-c89117bc4680 tempest-VolumesMetadataTest-1369352289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-26426030-0752-4a7f-817f-ad32e661bfd8 1073741824 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:26:33 devstack sudo[92296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-26426030-0752-4a7f-817f-ad32e661bfd8 1073741824
Nov 03 18:26:33 devstack sudo[92296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:26:33 devstack sudo[92296]: pam_unix(sudo:session): session closed for user root
Nov 03 18:26:33 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-74153a3f-9c4a-49a3-bc2e-c89117bc4680 tempest-VolumesMetadataTest-1369352289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-26426030-0752-4a7f-817f-ad32e661bfd8 1073741824" returned: 0 in 0.630s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:26:33 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-74153a3f-9c4a-49a3-bc2e-c89117bc4680 tempest-VolumesMetadataTest-1369352289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-26426030-0752-4a7f-817f-ad32e661bfd8 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:26:33 devstack sudo[92302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-26426030-0752-4a7f-817f-ad32e661bfd8
Nov 03 18:26:33 devstack sudo[92302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:26:34 devstack sudo[92302]: pam_unix(sudo:session): session closed for user root
Nov 03 18:26:34 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-74153a3f-9c4a-49a3-bc2e-c89117bc4680 tempest-VolumesMetadataTest-1369352289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-26426030-0752-4a7f-817f-ad32e661bfd8" returned: 0 in 0.341s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:26:34 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-74153a3f-9c4a-49a3-bc2e-c89117bc4680 tempest-VolumesMetadataTest-1369352289 None] <== create_volume: return (1050ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:26:34 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-74153a3f-9c4a-49a3-bc2e-c89117bc4680 tempest-VolumesMetadataTest-1369352289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.053s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:26:34 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-74153a3f-9c4a-49a3-bc2e-c89117bc4680 tempest-VolumesMetadataTest-1369352289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9899387d-ddf5-4062-86d7-07afcd7f3506) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26426030-0752-4a7f-817f-ad32e661bfd8', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:26:34 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-74153a3f-9c4a-49a3-bc2e-c89117bc4680 tempest-VolumesMetadataTest-1369352289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea82a048-bd36-4a15-b1b4-4aba11992b42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:26:34 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-74153a3f-9c4a-49a3-bc2e-c89117bc4680 tempest-VolumesMetadataTest-1369352289 None] Volume volume-26426030-0752-4a7f-817f-ad32e661bfd8 (26426030-0752-4a7f-817f-ad32e661bfd8): created successfully
Nov 03 18:26:34 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-74153a3f-9c4a-49a3-bc2e-c89117bc4680 tempest-VolumesMetadataTest-1369352289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea82a048-bd36-4a15-b1b4-4aba11992b42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:26:34 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-74153a3f-9c4a-49a3-bc2e-c89117bc4680 tempest-VolumesMetadataTest-1369352289 None] Flow 'volume_create_manager' (7ae93038-c8a6-4d58-a733-1adbc0fea738) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:26:34 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-74153a3f-9c4a-49a3-bc2e-c89117bc4680 tempest-VolumesMetadataTest-1369352289 None] Created volume successfully.
Nov 03 18:26:36 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-5bd1681e-9293-44d7-8e2a-6e3caae07280 tempest-VolumesMetadataTest-1369352289 None] Acquiring lock "cinder-26426030-0752-4a7f-817f-ad32e661bfd8-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:26:36 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-5bd1681e-9293-44d7-8e2a-6e3caae07280 tempest-VolumesMetadataTest-1369352289 None] Lock "cinder-26426030-0752-4a7f-817f-ad32e661bfd8-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:26:36 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-5bd1681e-9293-44d7-8e2a-6e3caae07280 tempest-VolumesMetadataTest-1369352289 None] Acquiring lock "cinder-quobyte-26426030-0752-4a7f-817f-ad32e661bfd8" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:26:36 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-5bd1681e-9293-44d7-8e2a-6e3caae07280 tempest-VolumesMetadataTest-1369352289 None] Lock "cinder-quobyte-26426030-0752-4a7f-817f-ad32e661bfd8" acquired by "delete_volume" :: waited 0.022s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:26:36 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[801e06e5-1a68-433a-9ab2-47012f54c6c3]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:26:36 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-5bd1681e-9293-44d7-8e2a-6e3caae07280 tempest-VolumesMetadataTest-1369352289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-26426030-0752-4a7f-817f-ad32e661bfd8 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:26:36 devstack sudo[92305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-26426030-0752-4a7f-817f-ad32e661bfd8
Nov 03 18:26:36 devstack sudo[92305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:26:36 devstack sudo[92305]: pam_unix(sudo:session): session closed for user root
Nov 03 18:26:36 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-5bd1681e-9293-44d7-8e2a-6e3caae07280 tempest-VolumesMetadataTest-1369352289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-26426030-0752-4a7f-817f-ad32e661bfd8" returned: 0 in 0.415s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:26:36 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-5bd1681e-9293-44d7-8e2a-6e3caae07280 tempest-VolumesMetadataTest-1369352289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-26426030-0752-4a7f-817f-ad32e661bfd8 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:26:36 devstack sudo[92310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-26426030-0752-4a7f-817f-ad32e661bfd8
Nov 03 18:26:36 devstack sudo[92310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:26:37 devstack sudo[92310]: pam_unix(sudo:session): session closed for user root
Nov 03 18:26:37 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-5bd1681e-9293-44d7-8e2a-6e3caae07280 tempest-VolumesMetadataTest-1369352289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-26426030-0752-4a7f-817f-ad32e661bfd8" returned: 0 in 0.306s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:26:37 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-5bd1681e-9293-44d7-8e2a-6e3caae07280 tempest-VolumesMetadataTest-1369352289 None] Lock "cinder-quobyte-26426030-0752-4a7f-817f-ad32e661bfd8" released by "delete_volume" :: held 0.787s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:26:37 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-5bd1681e-9293-44d7-8e2a-6e3caae07280 tempest-VolumesMetadataTest-1369352289 None] Created reservations ['2174e2ab-a840-491b-9b37-6639eb46a304', '09f8960a-bcc2-481c-b991-e19217f9d763', '5007b74e-363a-4549-ab9e-cbc1c498fd01', '117f8228-7de9-44f1-bdad-861c5ae76d55'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:26:37 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-5bd1681e-9293-44d7-8e2a-6e3caae07280 tempest-VolumesMetadataTest-1369352289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:26:37 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-5bd1681e-9293-44d7-8e2a-6e3caae07280 tempest-VolumesMetadataTest-1369352289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:26:37 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-5bd1681e-9293-44d7-8e2a-6e3caae07280 tempest-VolumesMetadataTest-1369352289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:26:37 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-5bd1681e-9293-44d7-8e2a-6e3caae07280 tempest-VolumesMetadataTest-1369352289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:26:37 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-5bd1681e-9293-44d7-8e2a-6e3caae07280 tempest-VolumesMetadataTest-1369352289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:26:37 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-5bd1681e-9293-44d7-8e2a-6e3caae07280 tempest-VolumesMetadataTest-1369352289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:26:37 devstack sudo[92313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:26:37 devstack sudo[92313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:26:37 devstack sudo[92313]: pam_unix(sudo:session): session closed for user root
Nov 03 18:26:37 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-5bd1681e-9293-44d7-8e2a-6e3caae07280 tempest-VolumesMetadataTest-1369352289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.299s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:26:37 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-5bd1681e-9293-44d7-8e2a-6e3caae07280 tempest-VolumesMetadataTest-1369352289 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:26:37 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-5bd1681e-9293-44d7-8e2a-6e3caae07280 tempest-VolumesMetadataTest-1369352289 None] Deleted volume successfully.
Nov 03 18:26:37 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-5bd1681e-9293-44d7-8e2a-6e3caae07280 tempest-VolumesMetadataTest-1369352289 None] Lock "cinder-26426030-0752-4a7f-817f-ad32e661bfd8-delete_volume" released by "delete_volume" :: held 1.346s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:26:40 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7e3f4f8-85ac-4ffc-bcb8-72c1e798ee69 tempest-VolumesDeleteCascade-1806251197 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:26:40 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-c7e3f4f8-85ac-4ffc-bcb8-72c1e798ee69 tempest-VolumesDeleteCascade-1806251197 None] Flow 'volume_create_manager' (e06d3ac0-a532-42ca-8f40-cd9badbe55fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:26:40 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-c7e3f4f8-85ac-4ffc-bcb8-72c1e798ee69 tempest-VolumesDeleteCascade-1806251197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (182a49fe-80c0-42f5-8d3d-3f4b12207513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:26:40 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-c7e3f4f8-85ac-4ffc-bcb8-72c1e798ee69 tempest-VolumesDeleteCascade-1806251197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (182a49fe-80c0-42f5-8d3d-3f4b12207513) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:26:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-385374449',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d46c49dc-ce38-4bee-af9c-1a7708b451f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd86f61877b243e0ad265eb0a159d6c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:26:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:26:41Z,use_quota=True,user_id='26bb5bef8a064b59a865d7ded0d83879',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:26:40 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-c7e3f4f8-85ac-4ffc-bcb8-72c1e798ee69 tempest-VolumesDeleteCascade-1806251197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b41b049-e6ef-4bc7-8873-19acb0d400e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:26:40 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-c7e3f4f8-85ac-4ffc-bcb8-72c1e798ee69 tempest-VolumesDeleteCascade-1806251197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b41b049-e6ef-4bc7-8873-19acb0d400e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:26:40 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-c7e3f4f8-85ac-4ffc-bcb8-72c1e798ee69 tempest-VolumesDeleteCascade-1806251197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc8193cc-7735-4539-b6ed-aa701a5ebed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:26:40 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-c7e3f4f8-85ac-4ffc-bcb8-72c1e798ee69 tempest-VolumesDeleteCascade-1806251197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc8193cc-7735-4539-b6ed-aa701a5ebed1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd46c49dc-ce38-4bee-af9c-1a7708b451f4', 'volume_name': 'volume-d46c49dc-ce38-4bee-af9c-1a7708b451f4', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:26:40 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-c7e3f4f8-85ac-4ffc-bcb8-72c1e798ee69 tempest-VolumesDeleteCascade-1806251197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ce6b1f1-e904-4f0f-b9fd-3d39b84e39e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:26:40 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-c7e3f4f8-85ac-4ffc-bcb8-72c1e798ee69 tempest-VolumesDeleteCascade-1806251197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ce6b1f1-e904-4f0f-b9fd-3d39b84e39e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:26:40 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-c7e3f4f8-85ac-4ffc-bcb8-72c1e798ee69 tempest-VolumesDeleteCascade-1806251197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (823aa113-4a82-4b49-8669-37de1ce9f846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:26:40 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-c7e3f4f8-85ac-4ffc-bcb8-72c1e798ee69 tempest-VolumesDeleteCascade-1806251197 None] Volume d46c49dc-ce38-4bee-af9c-1a7708b451f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d46c49dc-ce38-4bee-af9c-1a7708b451f4', 'volume_size': 1}
Nov 03 18:26:40 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-c7e3f4f8-85ac-4ffc-bcb8-72c1e798ee69 tempest-VolumesDeleteCascade-1806251197 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:26:40 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-c7e3f4f8-85ac-4ffc-bcb8-72c1e798ee69 tempest-VolumesDeleteCascade-1806251197 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:26:40 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-c7e3f4f8-85ac-4ffc-bcb8-72c1e798ee69 tempest-VolumesDeleteCascade-1806251197 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:26:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-385374449',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d46c49dc-ce38-4bee-af9c-1a7708b451f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd86f61877b243e0ad265eb0a159d6c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:26:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:26:41Z,use_quota=True,user_id='26bb5bef8a064b59a865d7ded0d83879',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:26:40 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-c7e3f4f8-85ac-4ffc-bcb8-72c1e798ee69 tempest-VolumesDeleteCascade-1806251197 None] Creating volume d46c49dc-ce38-4bee-af9c-1a7708b451f4 {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:26:40 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-c7e3f4f8-85ac-4ffc-bcb8-72c1e798ee69 tempest-VolumesDeleteCascade-1806251197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:26:40 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-c7e3f4f8-85ac-4ffc-bcb8-72c1e798ee69 tempest-VolumesDeleteCascade-1806251197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:26:40 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-c7e3f4f8-85ac-4ffc-bcb8-72c1e798ee69 tempest-VolumesDeleteCascade-1806251197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:26:40 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-c7e3f4f8-85ac-4ffc-bcb8-72c1e798ee69 tempest-VolumesDeleteCascade-1806251197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:26:40 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-c7e3f4f8-85ac-4ffc-bcb8-72c1e798ee69 tempest-VolumesDeleteCascade-1806251197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:26:40 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-c7e3f4f8-85ac-4ffc-bcb8-72c1e798ee69 tempest-VolumesDeleteCascade-1806251197 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:26:40 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-c7e3f4f8-85ac-4ffc-bcb8-72c1e798ee69 tempest-VolumesDeleteCascade-1806251197 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:26:40 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-c7e3f4f8-85ac-4ffc-bcb8-72c1e798ee69 tempest-VolumesDeleteCascade-1806251197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d46c49dc-ce38-4bee-af9c-1a7708b451f4 1073741824 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:26:40 devstack sudo[92318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d46c49dc-ce38-4bee-af9c-1a7708b451f4 1073741824
Nov 03 18:26:40 devstack sudo[92318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:26:41 devstack sudo[92318]: pam_unix(sudo:session): session closed for user root
Nov 03 18:26:41 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-c7e3f4f8-85ac-4ffc-bcb8-72c1e798ee69 tempest-VolumesDeleteCascade-1806251197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d46c49dc-ce38-4bee-af9c-1a7708b451f4 1073741824" returned: 0 in 0.640s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:26:41 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-c7e3f4f8-85ac-4ffc-bcb8-72c1e798ee69 tempest-VolumesDeleteCascade-1806251197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d46c49dc-ce38-4bee-af9c-1a7708b451f4 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:26:41 devstack sudo[92326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d46c49dc-ce38-4bee-af9c-1a7708b451f4
Nov 03 18:26:41 devstack sudo[92326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:26:41 devstack sudo[92326]: pam_unix(sudo:session): session closed for user root
Nov 03 18:26:41 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-c7e3f4f8-85ac-4ffc-bcb8-72c1e798ee69 tempest-VolumesDeleteCascade-1806251197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d46c49dc-ce38-4bee-af9c-1a7708b451f4" returned: 0 in 0.348s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:26:41 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-c7e3f4f8-85ac-4ffc-bcb8-72c1e798ee69 tempest-VolumesDeleteCascade-1806251197 None] <== create_volume: return (1053ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:26:41 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-c7e3f4f8-85ac-4ffc-bcb8-72c1e798ee69 tempest-VolumesDeleteCascade-1806251197 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.056s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:26:41 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-c7e3f4f8-85ac-4ffc-bcb8-72c1e798ee69 tempest-VolumesDeleteCascade-1806251197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (823aa113-4a82-4b49-8669-37de1ce9f846) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d46c49dc-ce38-4bee-af9c-1a7708b451f4', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:26:41 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-c7e3f4f8-85ac-4ffc-bcb8-72c1e798ee69 tempest-VolumesDeleteCascade-1806251197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1725ee6a-7e90-4820-ac27-3227814ff490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:26:41 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-c7e3f4f8-85ac-4ffc-bcb8-72c1e798ee69 tempest-VolumesDeleteCascade-1806251197 None] Volume volume-d46c49dc-ce38-4bee-af9c-1a7708b451f4 (d46c49dc-ce38-4bee-af9c-1a7708b451f4): created successfully
Nov 03 18:26:41 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-c7e3f4f8-85ac-4ffc-bcb8-72c1e798ee69 tempest-VolumesDeleteCascade-1806251197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1725ee6a-7e90-4820-ac27-3227814ff490) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:26:42 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-c7e3f4f8-85ac-4ffc-bcb8-72c1e798ee69 tempest-VolumesDeleteCascade-1806251197 None] Flow 'volume_create_manager' (e06d3ac0-a532-42ca-8f40-cd9badbe55fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:26:42 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-c7e3f4f8-85ac-4ffc-bcb8-72c1e798ee69 tempest-VolumesDeleteCascade-1806251197 None] Created volume successfully.
Nov 03 18:26:43 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-96a9d718-799a-4582-9d47-de170fd44312 tempest-VolumesDeleteCascade-1806251197 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:26:43 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-96a9d718-799a-4582-9d47-de170fd44312 tempest-VolumesDeleteCascade-1806251197 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:26:43 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-96a9d718-799a-4582-9d47-de170fd44312 tempest-VolumesDeleteCascade-1806251197 None] Creating offline snapshot 84c58a47-d6a5-4c6c-a055-a38f40573729 of volume d46c49dc-ce38-4bee-af9c-1a7708b451f4 {{(pid=86120) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 18:26:43 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca0675a4-ce6a-48f7-8707-1576427f972f]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:26:43 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-96a9d718-799a-4582-9d47-de170fd44312 tempest-VolumesDeleteCascade-1806251197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d46c49dc-ce38-4bee-af9c-1a7708b451f4 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:26:43 devstack sudo[92332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d46c49dc-ce38-4bee-af9c-1a7708b451f4
Nov 03 18:26:43 devstack sudo[92332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:26:44 devstack sudo[92332]: pam_unix(sudo:session): session closed for user root
Nov 03 18:26:44 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-96a9d718-799a-4582-9d47-de170fd44312 tempest-VolumesDeleteCascade-1806251197 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d46c49dc-ce38-4bee-af9c-1a7708b451f4" returned: 0 in 0.795s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:26:44 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-96a9d718-799a-4582-9d47-de170fd44312 tempest-VolumesDeleteCascade-1806251197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d46c49dc-ce38-4bee-af9c-1a7708b451f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d46c49dc-ce38-4bee-af9c-1a7708b451f4.84c58a47-d6a5-4c6c-a055-a38f40573729 1G {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:26:44 devstack sudo[92337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d46c49dc-ce38-4bee-af9c-1a7708b451f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d46c49dc-ce38-4bee-af9c-1a7708b451f4.84c58a47-d6a5-4c6c-a055-a38f40573729 1G
Nov 03 18:26:44 devstack sudo[92337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:26:44 devstack sudo[92337]: pam_unix(sudo:session): session closed for user root
Nov 03 18:26:44 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-96a9d718-799a-4582-9d47-de170fd44312 tempest-VolumesDeleteCascade-1806251197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d46c49dc-ce38-4bee-af9c-1a7708b451f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d46c49dc-ce38-4bee-af9c-1a7708b451f4.84c58a47-d6a5-4c6c-a055-a38f40573729 1G" returned: 0 in 0.686s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:26:44 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-96a9d718-799a-4582-9d47-de170fd44312 tempest-VolumesDeleteCascade-1806251197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d46c49dc-ce38-4bee-af9c-1a7708b451f4 -F qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d46c49dc-ce38-4bee-af9c-1a7708b451f4.84c58a47-d6a5-4c6c-a055-a38f40573729 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:26:44 devstack sudo[92348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d46c49dc-ce38-4bee-af9c-1a7708b451f4 -F qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d46c49dc-ce38-4bee-af9c-1a7708b451f4.84c58a47-d6a5-4c6c-a055-a38f40573729
Nov 03 18:26:44 devstack sudo[92348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:26:45 devstack sudo[92348]: pam_unix(sudo:session): session closed for user root
Nov 03 18:26:45 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-96a9d718-799a-4582-9d47-de170fd44312 tempest-VolumesDeleteCascade-1806251197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d46c49dc-ce38-4bee-af9c-1a7708b451f4 -F qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d46c49dc-ce38-4bee-af9c-1a7708b451f4.84c58a47-d6a5-4c6c-a055-a38f40573729" returned: 0 in 0.445s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:26:45 devstack cinder-volume[86120]: WARNING cinder.volume.drivers.remotefs [None req-96a9d718-799a-4582-9d47-de170fd44312 tempest-VolumesDeleteCascade-1806251197 None] /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d46c49dc-ce38-4bee-af9c-1a7708b451f4.84c58a47-d6a5-4c6c-a055-a38f40573729 is being set with open permissions: ugo+rw
Nov 03 18:26:45 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-96a9d718-799a-4582-9d47-de170fd44312 tempest-VolumesDeleteCascade-1806251197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d46c49dc-ce38-4bee-af9c-1a7708b451f4.84c58a47-d6a5-4c6c-a055-a38f40573729 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:26:45 devstack sudo[92354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d46c49dc-ce38-4bee-af9c-1a7708b451f4.84c58a47-d6a5-4c6c-a055-a38f40573729
Nov 03 18:26:45 devstack sudo[92354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:26:45 devstack sudo[92354]: pam_unix(sudo:session): session closed for user root
Nov 03 18:26:45 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-96a9d718-799a-4582-9d47-de170fd44312 tempest-VolumesDeleteCascade-1806251197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d46c49dc-ce38-4bee-af9c-1a7708b451f4.84c58a47-d6a5-4c6c-a055-a38f40573729" returned: 0 in 0.469s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:26:45 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-96a9d718-799a-4582-9d47-de170fd44312 tempest-VolumesDeleteCascade-1806251197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d46c49dc-ce38-4bee-af9c-1a7708b451f4.info {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:26:45 devstack sudo[92359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d46c49dc-ce38-4bee-af9c-1a7708b451f4.info
Nov 03 18:26:45 devstack sudo[92359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:26:46 devstack sudo[92359]: pam_unix(sudo:session): session closed for user root
Nov 03 18:26:46 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-96a9d718-799a-4582-9d47-de170fd44312 tempest-VolumesDeleteCascade-1806251197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d46c49dc-ce38-4bee-af9c-1a7708b451f4.info" returned: 0 in 0.558s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:26:46 devstack cinder-volume[86120]: WARNING cinder.volume.drivers.remotefs [None req-96a9d718-799a-4582-9d47-de170fd44312 tempest-VolumesDeleteCascade-1806251197 None] /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d46c49dc-ce38-4bee-af9c-1a7708b451f4.info is being set with open permissions: ugo+rw
Nov 03 18:26:46 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-96a9d718-799a-4582-9d47-de170fd44312 tempest-VolumesDeleteCascade-1806251197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d46c49dc-ce38-4bee-af9c-1a7708b451f4.info {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:26:46 devstack sudo[92363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d46c49dc-ce38-4bee-af9c-1a7708b451f4.info
Nov 03 18:26:46 devstack sudo[92363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:26:46 devstack sudo[92363]: pam_unix(sudo:session): session closed for user root
Nov 03 18:26:46 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-96a9d718-799a-4582-9d47-de170fd44312 tempest-VolumesDeleteCascade-1806251197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d46c49dc-ce38-4bee-af9c-1a7708b451f4.info" returned: 0 in 0.441s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:26:46 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-96a9d718-799a-4582-9d47-de170fd44312 tempest-VolumesDeleteCascade-1806251197 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.557s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:26:46 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-96a9d718-799a-4582-9d47-de170fd44312 tempest-VolumesDeleteCascade-1806251197 None] Create snapshot completed successfully
Nov 03 18:26:47 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-77774922-3a83-412c-b66e-57a55db444e5 tempest-VolumesDeleteCascade-1806251197 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:26:47 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-77774922-3a83-412c-b66e-57a55db444e5 tempest-VolumesDeleteCascade-1806251197 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:26:47 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-77774922-3a83-412c-b66e-57a55db444e5 tempest-VolumesDeleteCascade-1806251197 None] Creating offline snapshot 46d70cd4-ef18-4af6-85d9-2d9c94e3085b of volume d46c49dc-ce38-4bee-af9c-1a7708b451f4 {{(pid=86120) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 18:26:47 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[78a6cf92-03d0-4789-99eb-0e2b35e2616c]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:26:47 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-77774922-3a83-412c-b66e-57a55db444e5 tempest-VolumesDeleteCascade-1806251197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d46c49dc-ce38-4bee-af9c-1a7708b451f4.84c58a47-d6a5-4c6c-a055-a38f40573729 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:26:48 devstack sudo[92390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d46c49dc-ce38-4bee-af9c-1a7708b451f4.84c58a47-d6a5-4c6c-a055-a38f40573729
Nov 03 18:26:48 devstack sudo[92390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:26:48 devstack sudo[92390]: pam_unix(sudo:session): session closed for user root
Nov 03 18:26:48 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-77774922-3a83-412c-b66e-57a55db444e5 tempest-VolumesDeleteCascade-1806251197 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d46c49dc-ce38-4bee-af9c-1a7708b451f4.84c58a47-d6a5-4c6c-a055-a38f40573729" returned: 0 in 0.536s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:26:48 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-77774922-3a83-412c-b66e-57a55db444e5 tempest-VolumesDeleteCascade-1806251197 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d46c49dc-ce38-4bee-af9c-1a7708b451f4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86120) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 18:26:48 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-77774922-3a83-412c-b66e-57a55db444e5 tempest-VolumesDeleteCascade-1806251197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d46c49dc-ce38-4bee-af9c-1a7708b451f4.84c58a47-d6a5-4c6c-a055-a38f40573729,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d46c49dc-ce38-4bee-af9c-1a7708b451f4.46d70cd4-ef18-4af6-85d9-2d9c94e3085b 1G {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:26:48 devstack sudo[92402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d46c49dc-ce38-4bee-af9c-1a7708b451f4.84c58a47-d6a5-4c6c-a055-a38f40573729,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d46c49dc-ce38-4bee-af9c-1a7708b451f4.46d70cd4-ef18-4af6-85d9-2d9c94e3085b 1G
Nov 03 18:26:48 devstack sudo[92402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:26:48 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b31573c-224a-4a83-a1bd-99677d5e0ff1 tempest-VolumesTransfersV357Test-1069450187 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:26:48 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-7b31573c-224a-4a83-a1bd-99677d5e0ff1 tempest-VolumesTransfersV357Test-1069450187 None] Flow 'volume_create_manager' (163bb9cf-65cb-434b-b656-ac5deba6bd53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:26:48 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-7b31573c-224a-4a83-a1bd-99677d5e0ff1 tempest-VolumesTransfersV357Test-1069450187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d408b315-590d-494c-a6eb-5a6acc63cbfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:26:48 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-7b31573c-224a-4a83-a1bd-99677d5e0ff1 tempest-VolumesTransfersV357Test-1069450187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d408b315-590d-494c-a6eb-5a6acc63cbfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:26:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1569713226',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fe0c923-b2e2-46cd-b1dd-3e3e87bdda43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4367d8246f14c30b02a9f8a5ddb0ace',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:26:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:26:49Z,use_quota=True,user_id='e5055fb18ad84829a5d9a027eac19583',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:26:48 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-7b31573c-224a-4a83-a1bd-99677d5e0ff1 tempest-VolumesTransfersV357Test-1069450187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2ab1a18-c527-4cee-beeb-b4c3e90fa602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:26:48 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-7b31573c-224a-4a83-a1bd-99677d5e0ff1 tempest-VolumesTransfersV357Test-1069450187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2ab1a18-c527-4cee-beeb-b4c3e90fa602) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:26:48 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-7b31573c-224a-4a83-a1bd-99677d5e0ff1 tempest-VolumesTransfersV357Test-1069450187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b85b3aa-661c-43b1-8e66-5f5070d52edf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:26:48 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-7b31573c-224a-4a83-a1bd-99677d5e0ff1 tempest-VolumesTransfersV357Test-1069450187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b85b3aa-661c-43b1-8e66-5f5070d52edf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1fe0c923-b2e2-46cd-b1dd-3e3e87bdda43', 'volume_name': 'volume-1fe0c923-b2e2-46cd-b1dd-3e3e87bdda43', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:26:48 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-7b31573c-224a-4a83-a1bd-99677d5e0ff1 tempest-VolumesTransfersV357Test-1069450187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3001bf39-c044-4183-b5f0-730f66b6b553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:26:48 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-7b31573c-224a-4a83-a1bd-99677d5e0ff1 tempest-VolumesTransfersV357Test-1069450187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3001bf39-c044-4183-b5f0-730f66b6b553) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:26:48 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-7b31573c-224a-4a83-a1bd-99677d5e0ff1 tempest-VolumesTransfersV357Test-1069450187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (517a0d38-0215-4d52-bef4-90566fbfb061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:26:48 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-7b31573c-224a-4a83-a1bd-99677d5e0ff1 tempest-VolumesTransfersV357Test-1069450187 None] Volume 1fe0c923-b2e2-46cd-b1dd-3e3e87bdda43: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1fe0c923-b2e2-46cd-b1dd-3e3e87bdda43', 'volume_size': 1}
Nov 03 18:26:48 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-7b31573c-224a-4a83-a1bd-99677d5e0ff1 tempest-VolumesTransfersV357Test-1069450187 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:26:49 devstack sudo[92402]: pam_unix(sudo:session): session closed for user root
Nov 03 18:26:49 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-77774922-3a83-412c-b66e-57a55db444e5 tempest-VolumesDeleteCascade-1806251197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d46c49dc-ce38-4bee-af9c-1a7708b451f4.84c58a47-d6a5-4c6c-a055-a38f40573729,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d46c49dc-ce38-4bee-af9c-1a7708b451f4.46d70cd4-ef18-4af6-85d9-2d9c94e3085b 1G" returned: 0 in 0.907s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:26:49 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-77774922-3a83-412c-b66e-57a55db444e5 tempest-VolumesDeleteCascade-1806251197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d46c49dc-ce38-4bee-af9c-1a7708b451f4.84c58a47-d6a5-4c6c-a055-a38f40573729 -F qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d46c49dc-ce38-4bee-af9c-1a7708b451f4.46d70cd4-ef18-4af6-85d9-2d9c94e3085b {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:26:49 devstack sudo[92411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d46c49dc-ce38-4bee-af9c-1a7708b451f4.84c58a47-d6a5-4c6c-a055-a38f40573729 -F qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d46c49dc-ce38-4bee-af9c-1a7708b451f4.46d70cd4-ef18-4af6-85d9-2d9c94e3085b
Nov 03 18:26:49 devstack sudo[92411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:26:49 devstack sudo[92411]: pam_unix(sudo:session): session closed for user root
Nov 03 18:26:49 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-77774922-3a83-412c-b66e-57a55db444e5 tempest-VolumesDeleteCascade-1806251197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d46c49dc-ce38-4bee-af9c-1a7708b451f4.84c58a47-d6a5-4c6c-a055-a38f40573729 -F qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d46c49dc-ce38-4bee-af9c-1a7708b451f4.46d70cd4-ef18-4af6-85d9-2d9c94e3085b" returned: 0 in 0.420s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:26:49 devstack cinder-volume[86120]: WARNING cinder.volume.drivers.remotefs [None req-77774922-3a83-412c-b66e-57a55db444e5 tempest-VolumesDeleteCascade-1806251197 None] /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d46c49dc-ce38-4bee-af9c-1a7708b451f4.46d70cd4-ef18-4af6-85d9-2d9c94e3085b is being set with open permissions: ugo+rw
Nov 03 18:26:49 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-77774922-3a83-412c-b66e-57a55db444e5 tempest-VolumesDeleteCascade-1806251197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d46c49dc-ce38-4bee-af9c-1a7708b451f4.46d70cd4-ef18-4af6-85d9-2d9c94e3085b {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:26:49 devstack sudo[92417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d46c49dc-ce38-4bee-af9c-1a7708b451f4.46d70cd4-ef18-4af6-85d9-2d9c94e3085b
Nov 03 18:26:49 devstack sudo[92417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:26:50 devstack sudo[92417]: pam_unix(sudo:session): session closed for user root
Nov 03 18:26:50 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-77774922-3a83-412c-b66e-57a55db444e5 tempest-VolumesDeleteCascade-1806251197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d46c49dc-ce38-4bee-af9c-1a7708b451f4.46d70cd4-ef18-4af6-85d9-2d9c94e3085b" returned: 0 in 0.338s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:26:50 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-77774922-3a83-412c-b66e-57a55db444e5 tempest-VolumesDeleteCascade-1806251197 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.379s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:26:50 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-7b31573c-224a-4a83-a1bd-99677d5e0ff1 tempest-VolumesTransfersV357Test-1069450187 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.216s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:26:50 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-7b31573c-224a-4a83-a1bd-99677d5e0ff1 tempest-VolumesTransfersV357Test-1069450187 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:26:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1569713226',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fe0c923-b2e2-46cd-b1dd-3e3e87bdda43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4367d8246f14c30b02a9f8a5ddb0ace',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:26:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:26:49Z,use_quota=True,user_id='e5055fb18ad84829a5d9a027eac19583',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:26:50 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-7b31573c-224a-4a83-a1bd-99677d5e0ff1 tempest-VolumesTransfersV357Test-1069450187 None] Creating volume 1fe0c923-b2e2-46cd-b1dd-3e3e87bdda43 {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:26:50 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-7b31573c-224a-4a83-a1bd-99677d5e0ff1 tempest-VolumesTransfersV357Test-1069450187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:26:50 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-7b31573c-224a-4a83-a1bd-99677d5e0ff1 tempest-VolumesTransfersV357Test-1069450187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:26:50 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-7b31573c-224a-4a83-a1bd-99677d5e0ff1 tempest-VolumesTransfersV357Test-1069450187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:26:50 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-7b31573c-224a-4a83-a1bd-99677d5e0ff1 tempest-VolumesTransfersV357Test-1069450187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:26:50 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-7b31573c-224a-4a83-a1bd-99677d5e0ff1 tempest-VolumesTransfersV357Test-1069450187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:26:50 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-7b31573c-224a-4a83-a1bd-99677d5e0ff1 tempest-VolumesTransfersV357Test-1069450187 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:26:50 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-7b31573c-224a-4a83-a1bd-99677d5e0ff1 tempest-VolumesTransfersV357Test-1069450187 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:26:50 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-7b31573c-224a-4a83-a1bd-99677d5e0ff1 tempest-VolumesTransfersV357Test-1069450187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-1fe0c923-b2e2-46cd-b1dd-3e3e87bdda43 1073741824 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:26:50 devstack sudo[92420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-1fe0c923-b2e2-46cd-b1dd-3e3e87bdda43 1073741824
Nov 03 18:26:50 devstack sudo[92420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:26:50 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-77774922-3a83-412c-b66e-57a55db444e5 tempest-VolumesDeleteCascade-1806251197 None] Create snapshot completed successfully
Nov 03 18:26:50 devstack sudo[92420]: pam_unix(sudo:session): session closed for user root
Nov 03 18:26:50 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-7b31573c-224a-4a83-a1bd-99677d5e0ff1 tempest-VolumesTransfersV357Test-1069450187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-1fe0c923-b2e2-46cd-b1dd-3e3e87bdda43 1073741824" returned: 0 in 0.614s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:26:50 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-7b31573c-224a-4a83-a1bd-99677d5e0ff1 tempest-VolumesTransfersV357Test-1069450187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-1fe0c923-b2e2-46cd-b1dd-3e3e87bdda43 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:26:50 devstack sudo[92428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-1fe0c923-b2e2-46cd-b1dd-3e3e87bdda43
Nov 03 18:26:50 devstack sudo[92428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:26:51 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-4694981d-1308-42ea-b108-8b188de4cdcb tempest-VolumesDeleteCascade-1806251197 None] Acquiring lock "cinder-d46c49dc-ce38-4bee-af9c-1a7708b451f4-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:26:51 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-4694981d-1308-42ea-b108-8b188de4cdcb tempest-VolumesDeleteCascade-1806251197 None] Lock "cinder-d46c49dc-ce38-4bee-af9c-1a7708b451f4-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:26:51 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-4694981d-1308-42ea-b108-8b188de4cdcb tempest-VolumesDeleteCascade-1806251197 None] Performing cascade delete. {{(pid=86120) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Nov 03 18:26:51 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-4694981d-1308-42ea-b108-8b188de4cdcb tempest-VolumesDeleteCascade-1806251197 None] Acquiring lock "cinder-46d70cd4-ef18-4af6-85d9-2d9c94e3085b-delete_snapshot" by "delete_snapshot" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:26:51 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-4694981d-1308-42ea-b108-8b188de4cdcb tempest-VolumesDeleteCascade-1806251197 None] Lock "cinder-46d70cd4-ef18-4af6-85d9-2d9c94e3085b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:26:51 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-4694981d-1308-42ea-b108-8b188de4cdcb tempest-VolumesDeleteCascade-1806251197 None] Acquiring lock "cinder-quobyte-d46c49dc-ce38-4bee-af9c-1a7708b451f4" by "delete_snapshot" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:26:51 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-4694981d-1308-42ea-b108-8b188de4cdcb tempest-VolumesDeleteCascade-1806251197 None] Lock "cinder-quobyte-d46c49dc-ce38-4bee-af9c-1a7708b451f4" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:26:51 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-4694981d-1308-42ea-b108-8b188de4cdcb tempest-VolumesDeleteCascade-1806251197 None] Acquiring lock "cinder-quobyte-46d70cd4-ef18-4af6-85d9-2d9c94e3085b" by "_delete_snapshot" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:26:51 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-4694981d-1308-42ea-b108-8b188de4cdcb tempest-VolumesDeleteCascade-1806251197 None] Lock "cinder-quobyte-46d70cd4-ef18-4af6-85d9-2d9c94e3085b" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:26:51 devstack sudo[92428]: pam_unix(sudo:session): session closed for user root
Nov 03 18:26:51 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-4694981d-1308-42ea-b108-8b188de4cdcb tempest-VolumesDeleteCascade-1806251197 None] Deleting offline snapshot 46d70cd4-ef18-4af6-85d9-2d9c94e3085b of volume d46c49dc-ce38-4bee-af9c-1a7708b451f4 {{(pid=86120) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 18:26:51 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-4694981d-1308-42ea-b108-8b188de4cdcb tempest-VolumesDeleteCascade-1806251197 None] snapshot_file for this snap is: volume-d46c49dc-ce38-4bee-af9c-1a7708b451f4.46d70cd4-ef18-4af6-85d9-2d9c94e3085b {{(pid=86120) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 18:26:51 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-7b31573c-224a-4a83-a1bd-99677d5e0ff1 tempest-VolumesTransfersV357Test-1069450187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-1fe0c923-b2e2-46cd-b1dd-3e3e87bdda43" returned: 0 in 0.454s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:26:51 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-7b31573c-224a-4a83-a1bd-99677d5e0ff1 tempest-VolumesTransfersV357Test-1069450187 None] <== create_volume: return (1150ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:26:51 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-7b31573c-224a-4a83-a1bd-99677d5e0ff1 tempest-VolumesTransfersV357Test-1069450187 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.153s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:26:51 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-7b31573c-224a-4a83-a1bd-99677d5e0ff1 tempest-VolumesTransfersV357Test-1069450187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (517a0d38-0215-4d52-bef4-90566fbfb061) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1fe0c923-b2e2-46cd-b1dd-3e3e87bdda43', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:26:51 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-7b31573c-224a-4a83-a1bd-99677d5e0ff1 tempest-VolumesTransfersV357Test-1069450187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5431bf33-5749-4863-9874-23c5e8e1d30e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:26:51 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[09b9cac0-e91c-4dc4-980f-97c29e69c3a4]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:26:51 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-4694981d-1308-42ea-b108-8b188de4cdcb tempest-VolumesDeleteCascade-1806251197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d46c49dc-ce38-4bee-af9c-1a7708b451f4.46d70cd4-ef18-4af6-85d9-2d9c94e3085b {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:26:51 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-7b31573c-224a-4a83-a1bd-99677d5e0ff1 tempest-VolumesTransfersV357Test-1069450187 None] Volume volume-1fe0c923-b2e2-46cd-b1dd-3e3e87bdda43 (1fe0c923-b2e2-46cd-b1dd-3e3e87bdda43): created successfully
Nov 03 18:26:51 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-7b31573c-224a-4a83-a1bd-99677d5e0ff1 tempest-VolumesTransfersV357Test-1069450187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5431bf33-5749-4863-9874-23c5e8e1d30e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:26:51 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-7b31573c-224a-4a83-a1bd-99677d5e0ff1 tempest-VolumesTransfersV357Test-1069450187 None] Flow 'volume_create_manager' (163bb9cf-65cb-434b-b656-ac5deba6bd53) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:26:51 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-7b31573c-224a-4a83-a1bd-99677d5e0ff1 tempest-VolumesTransfersV357Test-1069450187 None] Created volume successfully.
Nov 03 18:26:51 devstack sudo[92432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d46c49dc-ce38-4bee-af9c-1a7708b451f4.46d70cd4-ef18-4af6-85d9-2d9c94e3085b
Nov 03 18:26:51 devstack sudo[92432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:26:51 devstack sudo[92432]: pam_unix(sudo:session): session closed for user root
Nov 03 18:26:51 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-4694981d-1308-42ea-b108-8b188de4cdcb tempest-VolumesDeleteCascade-1806251197 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d46c49dc-ce38-4bee-af9c-1a7708b451f4.46d70cd4-ef18-4af6-85d9-2d9c94e3085b" returned: 0 in 0.476s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:26:51 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-4694981d-1308-42ea-b108-8b188de4cdcb tempest-VolumesDeleteCascade-1806251197 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d46c49dc-ce38-4bee-af9c-1a7708b451f4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86120) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 18:26:51 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[c377ee8b-0aa4-4f65-adbb-5443391a9e3c]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:26:51 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-4694981d-1308-42ea-b108-8b188de4cdcb tempest-VolumesDeleteCascade-1806251197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d46c49dc-ce38-4bee-af9c-1a7708b451f4.84c58a47-d6a5-4c6c-a055-a38f40573729 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:26:52 devstack sudo[92439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d46c49dc-ce38-4bee-af9c-1a7708b451f4.84c58a47-d6a5-4c6c-a055-a38f40573729
Nov 03 18:26:52 devstack sudo[92439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:26:52 devstack sudo[92439]: pam_unix(sudo:session): session closed for user root
Nov 03 18:26:52 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-4694981d-1308-42ea-b108-8b188de4cdcb tempest-VolumesDeleteCascade-1806251197 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d46c49dc-ce38-4bee-af9c-1a7708b451f4.84c58a47-d6a5-4c6c-a055-a38f40573729" returned: 0 in 0.495s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:26:52 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-4694981d-1308-42ea-b108-8b188de4cdcb tempest-VolumesDeleteCascade-1806251197 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d46c49dc-ce38-4bee-af9c-1a7708b451f4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86120) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 18:26:52 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-4694981d-1308-42ea-b108-8b188de4cdcb tempest-VolumesDeleteCascade-1806251197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d46c49dc-ce38-4bee-af9c-1a7708b451f4.46d70cd4-ef18-4af6-85d9-2d9c94e3085b {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:26:52 devstack sudo[92447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d46c49dc-ce38-4bee-af9c-1a7708b451f4.46d70cd4-ef18-4af6-85d9-2d9c94e3085b
Nov 03 18:26:52 devstack sudo[92447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:26:52 devstack sudo[92447]: pam_unix(sudo:session): session closed for user root
Nov 03 18:26:52 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-4694981d-1308-42ea-b108-8b188de4cdcb tempest-VolumesDeleteCascade-1806251197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d46c49dc-ce38-4bee-af9c-1a7708b451f4.46d70cd4-ef18-4af6-85d9-2d9c94e3085b" returned: 0 in 0.602s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:26:52 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-4694981d-1308-42ea-b108-8b188de4cdcb tempest-VolumesDeleteCascade-1806251197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d46c49dc-ce38-4bee-af9c-1a7708b451f4.46d70cd4-ef18-4af6-85d9-2d9c94e3085b {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:26:53 devstack sudo[92461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d46c49dc-ce38-4bee-af9c-1a7708b451f4.46d70cd4-ef18-4af6-85d9-2d9c94e3085b
Nov 03 18:26:53 devstack sudo[92461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:26:53 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-6053f0d5-f6cb-4715-adfe-fd9dea631e32 tempest-VolumesTransfersV357Test-1880952788 None] Transfer volume completed successfully.
Nov 03 18:26:53 devstack sudo[92461]: pam_unix(sudo:session): session closed for user root
Nov 03 18:26:53 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-4694981d-1308-42ea-b108-8b188de4cdcb tempest-VolumesDeleteCascade-1806251197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d46c49dc-ce38-4bee-af9c-1a7708b451f4.46d70cd4-ef18-4af6-85d9-2d9c94e3085b" returned: 0 in 0.888s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:26:53 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-4694981d-1308-42ea-b108-8b188de4cdcb tempest-VolumesDeleteCascade-1806251197 None] Lock "cinder-quobyte-46d70cd4-ef18-4af6-85d9-2d9c94e3085b" released by "_delete_snapshot" :: held 2.644s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:26:53 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-4694981d-1308-42ea-b108-8b188de4cdcb tempest-VolumesDeleteCascade-1806251197 None] Lock "cinder-quobyte-d46c49dc-ce38-4bee-af9c-1a7708b451f4" released by "delete_snapshot" :: held 2.700s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:26:54 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-4694981d-1308-42ea-b108-8b188de4cdcb tempest-VolumesDeleteCascade-1806251197 None] Created reservations ['1751b23a-8500-4d9f-820c-026b42693537', '35e6d8da-26d4-496e-aa58-2ac59f24b4e7', '3b8ee23e-bae9-4e95-af77-88b053065224', 'e6db3a20-bf21-4b42-8e31-1e3b3a123e1c'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:26:54 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-4694981d-1308-42ea-b108-8b188de4cdcb tempest-VolumesDeleteCascade-1806251197 None] Delete snapshot completed successfully.
Nov 03 18:26:54 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-4694981d-1308-42ea-b108-8b188de4cdcb tempest-VolumesDeleteCascade-1806251197 None] Lock "cinder-46d70cd4-ef18-4af6-85d9-2d9c94e3085b-delete_snapshot" released by "delete_snapshot" :: held 3.123s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:26:54 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-4694981d-1308-42ea-b108-8b188de4cdcb tempest-VolumesDeleteCascade-1806251197 None] Acquiring lock "cinder-84c58a47-d6a5-4c6c-a055-a38f40573729-delete_snapshot" by "delete_snapshot" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:26:54 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-4694981d-1308-42ea-b108-8b188de4cdcb tempest-VolumesDeleteCascade-1806251197 None] Lock "cinder-84c58a47-d6a5-4c6c-a055-a38f40573729-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:26:54 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-4694981d-1308-42ea-b108-8b188de4cdcb tempest-VolumesDeleteCascade-1806251197 None] Acquiring lock "cinder-quobyte-d46c49dc-ce38-4bee-af9c-1a7708b451f4" by "delete_snapshot" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:26:54 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-4694981d-1308-42ea-b108-8b188de4cdcb tempest-VolumesDeleteCascade-1806251197 None] Lock "cinder-quobyte-d46c49dc-ce38-4bee-af9c-1a7708b451f4" acquired by "delete_snapshot" :: waited 0.076s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:26:54 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-4694981d-1308-42ea-b108-8b188de4cdcb tempest-VolumesDeleteCascade-1806251197 None] Acquiring lock "cinder-quobyte-84c58a47-d6a5-4c6c-a055-a38f40573729" by "_delete_snapshot" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:26:54 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-4694981d-1308-42ea-b108-8b188de4cdcb tempest-VolumesDeleteCascade-1806251197 None] Lock "cinder-quobyte-84c58a47-d6a5-4c6c-a055-a38f40573729" acquired by "_delete_snapshot" :: waited 0.058s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:26:54 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-4694981d-1308-42ea-b108-8b188de4cdcb tempest-VolumesDeleteCascade-1806251197 None] Deleting offline snapshot 84c58a47-d6a5-4c6c-a055-a38f40573729 of volume d46c49dc-ce38-4bee-af9c-1a7708b451f4 {{(pid=86120) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 18:26:54 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-4694981d-1308-42ea-b108-8b188de4cdcb tempest-VolumesDeleteCascade-1806251197 None] snapshot_file for this snap is: volume-d46c49dc-ce38-4bee-af9c-1a7708b451f4.84c58a47-d6a5-4c6c-a055-a38f40573729 {{(pid=86120) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 18:26:54 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[02aa847e-36a6-4bfd-bfbf-d07dd355eeaa]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:26:54 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-4694981d-1308-42ea-b108-8b188de4cdcb tempest-VolumesDeleteCascade-1806251197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d46c49dc-ce38-4bee-af9c-1a7708b451f4.84c58a47-d6a5-4c6c-a055-a38f40573729 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:26:54 devstack sudo[92546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d46c49dc-ce38-4bee-af9c-1a7708b451f4.84c58a47-d6a5-4c6c-a055-a38f40573729
Nov 03 18:26:54 devstack sudo[92546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:26:55 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-5aa9fe5e-20be-4cb5-991b-fecda20deeef tempest-VolumesTransfersV357Test-1752960053 None] Acquiring lock "cinder-1fe0c923-b2e2-46cd-b1dd-3e3e87bdda43-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:26:55 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-5aa9fe5e-20be-4cb5-991b-fecda20deeef tempest-VolumesTransfersV357Test-1752960053 None] Lock "cinder-1fe0c923-b2e2-46cd-b1dd-3e3e87bdda43-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:26:55 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-5aa9fe5e-20be-4cb5-991b-fecda20deeef tempest-VolumesTransfersV357Test-1752960053 None] Acquiring lock "cinder-quobyte-1fe0c923-b2e2-46cd-b1dd-3e3e87bdda43" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:26:55 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-5aa9fe5e-20be-4cb5-991b-fecda20deeef tempest-VolumesTransfersV357Test-1752960053 None] Lock "cinder-quobyte-1fe0c923-b2e2-46cd-b1dd-3e3e87bdda43" acquired by "delete_volume" :: waited 0.031s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:26:55 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ac919fd-6248-4a4d-8df3-836a5438f4b5]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:26:55 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-5aa9fe5e-20be-4cb5-991b-fecda20deeef tempest-VolumesTransfersV357Test-1752960053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-1fe0c923-b2e2-46cd-b1dd-3e3e87bdda43 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:26:55 devstack sudo[92546]: pam_unix(sudo:session): session closed for user root
Nov 03 18:26:55 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-4694981d-1308-42ea-b108-8b188de4cdcb tempest-VolumesDeleteCascade-1806251197 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d46c49dc-ce38-4bee-af9c-1a7708b451f4.84c58a47-d6a5-4c6c-a055-a38f40573729" returned: 0 in 0.947s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:26:55 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-4694981d-1308-42ea-b108-8b188de4cdcb tempest-VolumesDeleteCascade-1806251197 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d46c49dc-ce38-4bee-af9c-1a7708b451f4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86120) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 18:26:55 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4cd1684-55a2-4ce6-a0c3-554bbc0927d7]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:26:55 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-4694981d-1308-42ea-b108-8b188de4cdcb tempest-VolumesDeleteCascade-1806251197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d46c49dc-ce38-4bee-af9c-1a7708b451f4 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:26:55 devstack sudo[92563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-1fe0c923-b2e2-46cd-b1dd-3e3e87bdda43
Nov 03 18:26:55 devstack sudo[92563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:26:55 devstack sudo[92564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d46c49dc-ce38-4bee-af9c-1a7708b451f4
Nov 03 18:26:55 devstack sudo[92564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:26:56 devstack sudo[92563]: pam_unix(sudo:session): session closed for user root
Nov 03 18:26:56 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-5aa9fe5e-20be-4cb5-991b-fecda20deeef tempest-VolumesTransfersV357Test-1752960053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-1fe0c923-b2e2-46cd-b1dd-3e3e87bdda43" returned: 0 in 0.763s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:26:56 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-5aa9fe5e-20be-4cb5-991b-fecda20deeef tempest-VolumesTransfersV357Test-1752960053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-1fe0c923-b2e2-46cd-b1dd-3e3e87bdda43 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:26:56 devstack sudo[92575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-1fe0c923-b2e2-46cd-b1dd-3e3e87bdda43
Nov 03 18:26:56 devstack sudo[92575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:26:56 devstack sudo[92564]: pam_unix(sudo:session): session closed for user root
Nov 03 18:26:56 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-4694981d-1308-42ea-b108-8b188de4cdcb tempest-VolumesDeleteCascade-1806251197 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d46c49dc-ce38-4bee-af9c-1a7708b451f4" returned: 0 in 0.860s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:26:56 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-4694981d-1308-42ea-b108-8b188de4cdcb tempest-VolumesDeleteCascade-1806251197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d46c49dc-ce38-4bee-af9c-1a7708b451f4.84c58a47-d6a5-4c6c-a055-a38f40573729 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:26:56 devstack sudo[92581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d46c49dc-ce38-4bee-af9c-1a7708b451f4.84c58a47-d6a5-4c6c-a055-a38f40573729
Nov 03 18:26:56 devstack sudo[92581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:26:56 devstack sudo[92575]: pam_unix(sudo:session): session closed for user root
Nov 03 18:26:56 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-5aa9fe5e-20be-4cb5-991b-fecda20deeef tempest-VolumesTransfersV357Test-1752960053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-1fe0c923-b2e2-46cd-b1dd-3e3e87bdda43" returned: 0 in 0.450s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:26:56 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-5aa9fe5e-20be-4cb5-991b-fecda20deeef tempest-VolumesTransfersV357Test-1752960053 None] Lock "cinder-quobyte-1fe0c923-b2e2-46cd-b1dd-3e3e87bdda43" released by "delete_volume" :: held 1.283s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:26:56 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-5aa9fe5e-20be-4cb5-991b-fecda20deeef tempest-VolumesTransfersV357Test-1752960053 None] Created reservations ['052366fc-acb8-4cea-8bf9-1874c0a225be', 'b07ecc4f-84d2-4ccd-8e4a-f049ee84fbd4', 'c329cefd-ea4b-4c56-8003-9bac40921c85', '1922c88d-cdcd-460b-9fd7-323470164fdf'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:26:57 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-5aa9fe5e-20be-4cb5-991b-fecda20deeef tempest-VolumesTransfersV357Test-1752960053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:26:57 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-5aa9fe5e-20be-4cb5-991b-fecda20deeef tempest-VolumesTransfersV357Test-1752960053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:26:57 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-5aa9fe5e-20be-4cb5-991b-fecda20deeef tempest-VolumesTransfersV357Test-1752960053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:26:57 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-5aa9fe5e-20be-4cb5-991b-fecda20deeef tempest-VolumesTransfersV357Test-1752960053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:26:57 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-5aa9fe5e-20be-4cb5-991b-fecda20deeef tempest-VolumesTransfersV357Test-1752960053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:26:57 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-5aa9fe5e-20be-4cb5-991b-fecda20deeef tempest-VolumesTransfersV357Test-1752960053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:26:57 devstack sudo[92587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:26:57 devstack sudo[92587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:26:57 devstack sudo[92581]: pam_unix(sudo:session): session closed for user root
Nov 03 18:26:57 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-4694981d-1308-42ea-b108-8b188de4cdcb tempest-VolumesDeleteCascade-1806251197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d46c49dc-ce38-4bee-af9c-1a7708b451f4.84c58a47-d6a5-4c6c-a055-a38f40573729" returned: 0 in 0.673s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:26:57 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-4694981d-1308-42ea-b108-8b188de4cdcb tempest-VolumesDeleteCascade-1806251197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d46c49dc-ce38-4bee-af9c-1a7708b451f4.84c58a47-d6a5-4c6c-a055-a38f40573729 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:26:57 devstack sudo[92590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d46c49dc-ce38-4bee-af9c-1a7708b451f4.84c58a47-d6a5-4c6c-a055-a38f40573729
Nov 03 18:26:57 devstack sudo[92590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:26:57 devstack sudo[92587]: pam_unix(sudo:session): session closed for user root
Nov 03 18:26:57 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-5aa9fe5e-20be-4cb5-991b-fecda20deeef tempest-VolumesTransfersV357Test-1752960053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.368s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:26:57 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-5aa9fe5e-20be-4cb5-991b-fecda20deeef tempest-VolumesTransfersV357Test-1752960053 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:26:57 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-5aa9fe5e-20be-4cb5-991b-fecda20deeef tempest-VolumesTransfersV357Test-1752960053 None] Deleted volume successfully.
Nov 03 18:26:57 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-5aa9fe5e-20be-4cb5-991b-fecda20deeef tempest-VolumesTransfersV357Test-1752960053 None] Lock "cinder-1fe0c923-b2e2-46cd-b1dd-3e3e87bdda43-delete_volume" released by "delete_volume" :: held 2.059s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:26:57 devstack sudo[92590]: pam_unix(sudo:session): session closed for user root
Nov 03 18:26:57 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-4694981d-1308-42ea-b108-8b188de4cdcb tempest-VolumesDeleteCascade-1806251197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d46c49dc-ce38-4bee-af9c-1a7708b451f4.84c58a47-d6a5-4c6c-a055-a38f40573729" returned: 0 in 0.335s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:26:57 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-4694981d-1308-42ea-b108-8b188de4cdcb tempest-VolumesDeleteCascade-1806251197 None] Lock "cinder-quobyte-84c58a47-d6a5-4c6c-a055-a38f40573729" released by "_delete_snapshot" :: held 3.083s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:26:57 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-4694981d-1308-42ea-b108-8b188de4cdcb tempest-VolumesDeleteCascade-1806251197 None] Lock "cinder-quobyte-d46c49dc-ce38-4bee-af9c-1a7708b451f4" released by "delete_snapshot" :: held 3.165s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:26:57 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-4694981d-1308-42ea-b108-8b188de4cdcb tempest-VolumesDeleteCascade-1806251197 None] Created reservations ['677825c5-70b5-4dd9-99de-2b945ab9500c', '7111b0eb-1934-46b9-8f77-33e5b020a396', 'de536b8a-6c99-4e23-9f1f-64381acd24db', '6f940019-161c-45a4-99d3-816e30284d6e'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:26:57 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-4694981d-1308-42ea-b108-8b188de4cdcb tempest-VolumesDeleteCascade-1806251197 None] Delete snapshot completed successfully.
Nov 03 18:26:57 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-4694981d-1308-42ea-b108-8b188de4cdcb tempest-VolumesDeleteCascade-1806251197 None] Lock "cinder-84c58a47-d6a5-4c6c-a055-a38f40573729-delete_snapshot" released by "delete_snapshot" :: held 3.509s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:26:57 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-4694981d-1308-42ea-b108-8b188de4cdcb tempest-VolumesDeleteCascade-1806251197 None] Snapshots deleted, issuing volume delete {{(pid=86120) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Nov 03 18:26:57 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-4694981d-1308-42ea-b108-8b188de4cdcb tempest-VolumesDeleteCascade-1806251197 None] Acquiring lock "cinder-quobyte-d46c49dc-ce38-4bee-af9c-1a7708b451f4" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:26:57 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-4694981d-1308-42ea-b108-8b188de4cdcb tempest-VolumesDeleteCascade-1806251197 None] Lock "cinder-quobyte-d46c49dc-ce38-4bee-af9c-1a7708b451f4" acquired by "delete_volume" :: waited 0.032s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:26:58 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[af2e8489-0844-4bd7-8a8d-e23b92f466f3]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:26:58 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-4694981d-1308-42ea-b108-8b188de4cdcb tempest-VolumesDeleteCascade-1806251197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d46c49dc-ce38-4bee-af9c-1a7708b451f4 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:26:58 devstack sudo[92600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d46c49dc-ce38-4bee-af9c-1a7708b451f4
Nov 03 18:26:58 devstack sudo[92600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:26:58 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-23b8276b-ffdd-496d-b8de-27198c00e32f tempest-VolumesTransfersV357Test-1069450187 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:26:58 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-23b8276b-ffdd-496d-b8de-27198c00e32f tempest-VolumesTransfersV357Test-1069450187 None] Flow 'volume_create_manager' (50c9d052-c28a-4911-8bd3-4da1d483694b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:26:58 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-23b8276b-ffdd-496d-b8de-27198c00e32f tempest-VolumesTransfersV357Test-1069450187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2fff6d7-4881-4e1e-af1f-46e99fe6b1cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:26:58 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-23b8276b-ffdd-496d-b8de-27198c00e32f tempest-VolumesTransfersV357Test-1069450187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2fff6d7-4881-4e1e-af1f-46e99fe6b1cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:26:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-335956435',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75701317-12f6-4c3e-8d2d-db03a16487ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4367d8246f14c30b02a9f8a5ddb0ace',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:26:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:26:59Z,use_quota=True,user_id='e5055fb18ad84829a5d9a027eac19583',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:26:59 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-23b8276b-ffdd-496d-b8de-27198c00e32f tempest-VolumesTransfersV357Test-1069450187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cce79e0-2499-4d27-8f89-6f6af060e802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:26:59 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-23b8276b-ffdd-496d-b8de-27198c00e32f tempest-VolumesTransfersV357Test-1069450187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cce79e0-2499-4d27-8f89-6f6af060e802) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:26:59 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-23b8276b-ffdd-496d-b8de-27198c00e32f tempest-VolumesTransfersV357Test-1069450187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (417d6384-305a-474f-8a9b-443ce2fdabc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:26:59 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-23b8276b-ffdd-496d-b8de-27198c00e32f tempest-VolumesTransfersV357Test-1069450187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (417d6384-305a-474f-8a9b-443ce2fdabc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75701317-12f6-4c3e-8d2d-db03a16487ee', 'volume_name': 'volume-75701317-12f6-4c3e-8d2d-db03a16487ee', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:26:59 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-23b8276b-ffdd-496d-b8de-27198c00e32f tempest-VolumesTransfersV357Test-1069450187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (387e0a00-05f7-4af7-9d6b-768d7ce13439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:26:59 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-23b8276b-ffdd-496d-b8de-27198c00e32f tempest-VolumesTransfersV357Test-1069450187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (387e0a00-05f7-4af7-9d6b-768d7ce13439) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:26:59 devstack sudo[92600]: pam_unix(sudo:session): session closed for user root
Nov 03 18:26:59 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-23b8276b-ffdd-496d-b8de-27198c00e32f tempest-VolumesTransfersV357Test-1069450187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3ad4763-01dc-4334-9ae3-befd24808f53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:26:59 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-23b8276b-ffdd-496d-b8de-27198c00e32f tempest-VolumesTransfersV357Test-1069450187 None] Volume 75701317-12f6-4c3e-8d2d-db03a16487ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75701317-12f6-4c3e-8d2d-db03a16487ee', 'volume_size': 1}
Nov 03 18:26:59 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-23b8276b-ffdd-496d-b8de-27198c00e32f tempest-VolumesTransfersV357Test-1069450187 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:26:59 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-23b8276b-ffdd-496d-b8de-27198c00e32f tempest-VolumesTransfersV357Test-1069450187 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:26:59 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-23b8276b-ffdd-496d-b8de-27198c00e32f tempest-VolumesTransfersV357Test-1069450187 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:26:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-335956435',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75701317-12f6-4c3e-8d2d-db03a16487ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4367d8246f14c30b02a9f8a5ddb0ace',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:26:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:26:59Z,use_quota=True,user_id='e5055fb18ad84829a5d9a027eac19583',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:26:59 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-23b8276b-ffdd-496d-b8de-27198c00e32f tempest-VolumesTransfersV357Test-1069450187 None] Creating volume 75701317-12f6-4c3e-8d2d-db03a16487ee {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:26:59 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-23b8276b-ffdd-496d-b8de-27198c00e32f tempest-VolumesTransfersV357Test-1069450187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:26:59 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-23b8276b-ffdd-496d-b8de-27198c00e32f tempest-VolumesTransfersV357Test-1069450187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:26:59 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-23b8276b-ffdd-496d-b8de-27198c00e32f tempest-VolumesTransfersV357Test-1069450187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:26:59 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-23b8276b-ffdd-496d-b8de-27198c00e32f tempest-VolumesTransfersV357Test-1069450187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:26:59 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-23b8276b-ffdd-496d-b8de-27198c00e32f tempest-VolumesTransfersV357Test-1069450187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:26:59 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-23b8276b-ffdd-496d-b8de-27198c00e32f tempest-VolumesTransfersV357Test-1069450187 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:26:59 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-23b8276b-ffdd-496d-b8de-27198c00e32f tempest-VolumesTransfersV357Test-1069450187 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:26:59 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-23b8276b-ffdd-496d-b8de-27198c00e32f tempest-VolumesTransfersV357Test-1069450187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-75701317-12f6-4c3e-8d2d-db03a16487ee 1073741824 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:26:59 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-4694981d-1308-42ea-b108-8b188de4cdcb tempest-VolumesDeleteCascade-1806251197 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d46c49dc-ce38-4bee-af9c-1a7708b451f4" returned: 0 in 1.109s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:26:59 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-4694981d-1308-42ea-b108-8b188de4cdcb tempest-VolumesDeleteCascade-1806251197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d46c49dc-ce38-4bee-af9c-1a7708b451f4 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:26:59 devstack sudo[92608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d46c49dc-ce38-4bee-af9c-1a7708b451f4
Nov 03 18:26:59 devstack sudo[92608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:26:59 devstack sudo[92607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-75701317-12f6-4c3e-8d2d-db03a16487ee 1073741824
Nov 03 18:26:59 devstack sudo[92607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:26:59 devstack sudo[92608]: pam_unix(sudo:session): session closed for user root
Nov 03 18:26:59 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-4694981d-1308-42ea-b108-8b188de4cdcb tempest-VolumesDeleteCascade-1806251197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d46c49dc-ce38-4bee-af9c-1a7708b451f4" returned: 0 in 0.417s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:26:59 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-4694981d-1308-42ea-b108-8b188de4cdcb tempest-VolumesDeleteCascade-1806251197 None] Lock "cinder-quobyte-d46c49dc-ce38-4bee-af9c-1a7708b451f4" released by "delete_volume" :: held 1.777s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:26:59 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-4694981d-1308-42ea-b108-8b188de4cdcb tempest-VolumesDeleteCascade-1806251197 None] Created reservations ['e30b954b-2eb4-47ef-8ea3-58f7005d6aa4', '2cd77a62-cd12-4d9d-949b-bc8b23530da3', '4de0e937-01fa-43e6-8739-1fdc7f3de966', '91257947-2989-4a26-b377-50c39044513a'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:27:00 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-4694981d-1308-42ea-b108-8b188de4cdcb tempest-VolumesDeleteCascade-1806251197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:27:00 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-4694981d-1308-42ea-b108-8b188de4cdcb tempest-VolumesDeleteCascade-1806251197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:27:00 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-4694981d-1308-42ea-b108-8b188de4cdcb tempest-VolumesDeleteCascade-1806251197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:27:00 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-4694981d-1308-42ea-b108-8b188de4cdcb tempest-VolumesDeleteCascade-1806251197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:27:00 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-4694981d-1308-42ea-b108-8b188de4cdcb tempest-VolumesDeleteCascade-1806251197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:27:00 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-4694981d-1308-42ea-b108-8b188de4cdcb tempest-VolumesDeleteCascade-1806251197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:27:00 devstack sudo[92616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:27:00 devstack sudo[92616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:27:00 devstack sudo[92607]: pam_unix(sudo:session): session closed for user root
Nov 03 18:27:00 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-23b8276b-ffdd-496d-b8de-27198c00e32f tempest-VolumesTransfersV357Test-1069450187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-75701317-12f6-4c3e-8d2d-db03a16487ee 1073741824" returned: 0 in 1.247s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:27:00 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-23b8276b-ffdd-496d-b8de-27198c00e32f tempest-VolumesTransfersV357Test-1069450187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-75701317-12f6-4c3e-8d2d-db03a16487ee {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:27:00 devstack sudo[92620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-75701317-12f6-4c3e-8d2d-db03a16487ee
Nov 03 18:27:00 devstack sudo[92620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:27:00 devstack sudo[92616]: pam_unix(sudo:session): session closed for user root
Nov 03 18:27:00 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-4694981d-1308-42ea-b108-8b188de4cdcb tempest-VolumesDeleteCascade-1806251197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.654s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:27:00 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-4694981d-1308-42ea-b108-8b188de4cdcb tempest-VolumesDeleteCascade-1806251197 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:27:00 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-4694981d-1308-42ea-b108-8b188de4cdcb tempest-VolumesDeleteCascade-1806251197 None] Deleted volume successfully.
Nov 03 18:27:00 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-4694981d-1308-42ea-b108-8b188de4cdcb tempest-VolumesDeleteCascade-1806251197 None] Lock "cinder-d46c49dc-ce38-4bee-af9c-1a7708b451f4-delete_volume" released by "delete_volume" :: held 9.648s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:27:01 devstack sudo[92620]: pam_unix(sudo:session): session closed for user root
Nov 03 18:27:01 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-23b8276b-ffdd-496d-b8de-27198c00e32f tempest-VolumesTransfersV357Test-1069450187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-75701317-12f6-4c3e-8d2d-db03a16487ee" returned: 0 in 0.748s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:27:01 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-23b8276b-ffdd-496d-b8de-27198c00e32f tempest-VolumesTransfersV357Test-1069450187 None] <== create_volume: return (2161ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:27:01 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-23b8276b-ffdd-496d-b8de-27198c00e32f tempest-VolumesTransfersV357Test-1069450187 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.173s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:27:01 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-23b8276b-ffdd-496d-b8de-27198c00e32f tempest-VolumesTransfersV357Test-1069450187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3ad4763-01dc-4334-9ae3-befd24808f53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75701317-12f6-4c3e-8d2d-db03a16487ee', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:27:01 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-23b8276b-ffdd-496d-b8de-27198c00e32f tempest-VolumesTransfersV357Test-1069450187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8336258e-5c2e-4fb9-921e-35f9d2b944ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:27:01 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-23b8276b-ffdd-496d-b8de-27198c00e32f tempest-VolumesTransfersV357Test-1069450187 None] Volume volume-75701317-12f6-4c3e-8d2d-db03a16487ee (75701317-12f6-4c3e-8d2d-db03a16487ee): created successfully
Nov 03 18:27:01 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-23b8276b-ffdd-496d-b8de-27198c00e32f tempest-VolumesTransfersV357Test-1069450187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8336258e-5c2e-4fb9-921e-35f9d2b944ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:27:01 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-23b8276b-ffdd-496d-b8de-27198c00e32f tempest-VolumesTransfersV357Test-1069450187 None] Flow 'volume_create_manager' (50c9d052-c28a-4911-8bd3-4da1d483694b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:27:01 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-23b8276b-ffdd-496d-b8de-27198c00e32f tempest-VolumesTransfersV357Test-1069450187 None] Created volume successfully.
Nov 03 18:27:02 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a841190-1ffa-45ca-a0ef-47cd2c55beda tempest-VolumesDeleteCascade-1806251197 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:27:02 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-8a841190-1ffa-45ca-a0ef-47cd2c55beda tempest-VolumesDeleteCascade-1806251197 None] Flow 'volume_create_manager' (eed46ffd-66c8-4ec0-8869-902618fc9f99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:27:02 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-8a841190-1ffa-45ca-a0ef-47cd2c55beda tempest-VolumesDeleteCascade-1806251197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (614e5c5b-f36a-44df-886a-8b1d77fe36ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:27:03 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-8a841190-1ffa-45ca-a0ef-47cd2c55beda tempest-VolumesDeleteCascade-1806251197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (614e5c5b-f36a-44df-886a-8b1d77fe36ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:27:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1302757462',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97991c77-d4d5-4e22-a3cf-2fb233a850e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd86f61877b243e0ad265eb0a159d6c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:27:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:27:03Z,use_quota=True,user_id='26bb5bef8a064b59a865d7ded0d83879',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:27:03 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-8a841190-1ffa-45ca-a0ef-47cd2c55beda tempest-VolumesDeleteCascade-1806251197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (beb89af4-9d71-40e3-86ff-7459290e55b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:27:03 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-8a841190-1ffa-45ca-a0ef-47cd2c55beda tempest-VolumesDeleteCascade-1806251197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (beb89af4-9d71-40e3-86ff-7459290e55b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:27:03 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-8a841190-1ffa-45ca-a0ef-47cd2c55beda tempest-VolumesDeleteCascade-1806251197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93697e7b-6c08-4852-8ff4-363b4a62fd01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:27:03 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-8a841190-1ffa-45ca-a0ef-47cd2c55beda tempest-VolumesDeleteCascade-1806251197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93697e7b-6c08-4852-8ff4-363b4a62fd01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97991c77-d4d5-4e22-a3cf-2fb233a850e6', 'volume_name': 'volume-97991c77-d4d5-4e22-a3cf-2fb233a850e6', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:27:03 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-8a841190-1ffa-45ca-a0ef-47cd2c55beda tempest-VolumesDeleteCascade-1806251197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aca49d9b-5ddc-46a5-9b5e-355a45b46b58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:27:03 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-8a841190-1ffa-45ca-a0ef-47cd2c55beda tempest-VolumesDeleteCascade-1806251197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aca49d9b-5ddc-46a5-9b5e-355a45b46b58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:27:03 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-8a841190-1ffa-45ca-a0ef-47cd2c55beda tempest-VolumesDeleteCascade-1806251197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa294455-1e8b-4764-89df-22b59a4d5fab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:27:03 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-8a841190-1ffa-45ca-a0ef-47cd2c55beda tempest-VolumesDeleteCascade-1806251197 None] Volume 97991c77-d4d5-4e22-a3cf-2fb233a850e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97991c77-d4d5-4e22-a3cf-2fb233a850e6', 'volume_size': 1}
Nov 03 18:27:03 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-8a841190-1ffa-45ca-a0ef-47cd2c55beda tempest-VolumesDeleteCascade-1806251197 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:27:03 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-8a841190-1ffa-45ca-a0ef-47cd2c55beda tempest-VolumesDeleteCascade-1806251197 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:27:03 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-8a841190-1ffa-45ca-a0ef-47cd2c55beda tempest-VolumesDeleteCascade-1806251197 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:27:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1302757462',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97991c77-d4d5-4e22-a3cf-2fb233a850e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd86f61877b243e0ad265eb0a159d6c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:27:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:27:03Z,use_quota=True,user_id='26bb5bef8a064b59a865d7ded0d83879',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:27:03 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-8a841190-1ffa-45ca-a0ef-47cd2c55beda tempest-VolumesDeleteCascade-1806251197 None] Creating volume 97991c77-d4d5-4e22-a3cf-2fb233a850e6 {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:27:03 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-8a841190-1ffa-45ca-a0ef-47cd2c55beda tempest-VolumesDeleteCascade-1806251197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:27:03 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-8a841190-1ffa-45ca-a0ef-47cd2c55beda tempest-VolumesDeleteCascade-1806251197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:27:03 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-8a841190-1ffa-45ca-a0ef-47cd2c55beda tempest-VolumesDeleteCascade-1806251197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:27:03 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-8a841190-1ffa-45ca-a0ef-47cd2c55beda tempest-VolumesDeleteCascade-1806251197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:27:03 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-8a841190-1ffa-45ca-a0ef-47cd2c55beda tempest-VolumesDeleteCascade-1806251197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:27:03 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-8a841190-1ffa-45ca-a0ef-47cd2c55beda tempest-VolumesDeleteCascade-1806251197 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:27:03 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-8a841190-1ffa-45ca-a0ef-47cd2c55beda tempest-VolumesDeleteCascade-1806251197 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:27:03 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-8a841190-1ffa-45ca-a0ef-47cd2c55beda tempest-VolumesDeleteCascade-1806251197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-97991c77-d4d5-4e22-a3cf-2fb233a850e6 1073741824 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:27:03 devstack sudo[92656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-97991c77-d4d5-4e22-a3cf-2fb233a850e6 1073741824
Nov 03 18:27:03 devstack sudo[92656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:27:03 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-d9b666d8-55fe-4255-ad69-1dae58933c4c tempest-VolumesTransfersV357Test-1752960053 None] Acquiring lock "cinder-75701317-12f6-4c3e-8d2d-db03a16487ee-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:27:03 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-d9b666d8-55fe-4255-ad69-1dae58933c4c tempest-VolumesTransfersV357Test-1752960053 None] Lock "cinder-75701317-12f6-4c3e-8d2d-db03a16487ee-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:27:03 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-d9b666d8-55fe-4255-ad69-1dae58933c4c tempest-VolumesTransfersV357Test-1752960053 None] Acquiring lock "cinder-quobyte-75701317-12f6-4c3e-8d2d-db03a16487ee" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:27:03 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-d9b666d8-55fe-4255-ad69-1dae58933c4c tempest-VolumesTransfersV357Test-1752960053 None] Lock "cinder-quobyte-75701317-12f6-4c3e-8d2d-db03a16487ee" acquired by "delete_volume" :: waited 0.045s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:27:03 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fbed651-61d6-4739-b209-179b390aba85]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:27:03 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-d9b666d8-55fe-4255-ad69-1dae58933c4c tempest-VolumesTransfersV357Test-1752960053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-75701317-12f6-4c3e-8d2d-db03a16487ee {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:27:03 devstack sudo[92670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-75701317-12f6-4c3e-8d2d-db03a16487ee
Nov 03 18:27:03 devstack sudo[92670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:27:04 devstack sudo[92656]: pam_unix(sudo:session): session closed for user root
Nov 03 18:27:04 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-8a841190-1ffa-45ca-a0ef-47cd2c55beda tempest-VolumesDeleteCascade-1806251197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-97991c77-d4d5-4e22-a3cf-2fb233a850e6 1073741824" returned: 0 in 1.012s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:27:04 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-8a841190-1ffa-45ca-a0ef-47cd2c55beda tempest-VolumesDeleteCascade-1806251197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-97991c77-d4d5-4e22-a3cf-2fb233a850e6 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:27:04 devstack sudo[92688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-97991c77-d4d5-4e22-a3cf-2fb233a850e6
Nov 03 18:27:04 devstack sudo[92688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:27:04 devstack sudo[92670]: pam_unix(sudo:session): session closed for user root
Nov 03 18:27:04 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-d9b666d8-55fe-4255-ad69-1dae58933c4c tempest-VolumesTransfersV357Test-1752960053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-75701317-12f6-4c3e-8d2d-db03a16487ee" returned: 0 in 0.686s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:27:04 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-d9b666d8-55fe-4255-ad69-1dae58933c4c tempest-VolumesTransfersV357Test-1752960053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-75701317-12f6-4c3e-8d2d-db03a16487ee {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:27:04 devstack sudo[92693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-75701317-12f6-4c3e-8d2d-db03a16487ee
Nov 03 18:27:04 devstack sudo[92693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:27:04 devstack sudo[92693]: pam_unix(sudo:session): session closed for user root
Nov 03 18:27:04 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-d9b666d8-55fe-4255-ad69-1dae58933c4c tempest-VolumesTransfersV357Test-1752960053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-75701317-12f6-4c3e-8d2d-db03a16487ee" returned: 0 in 0.440s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:27:04 devstack sudo[92688]: pam_unix(sudo:session): session closed for user root
Nov 03 18:27:04 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-8a841190-1ffa-45ca-a0ef-47cd2c55beda tempest-VolumesDeleteCascade-1806251197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-97991c77-d4d5-4e22-a3cf-2fb233a850e6" returned: 0 in 0.629s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:27:04 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-8a841190-1ffa-45ca-a0ef-47cd2c55beda tempest-VolumesDeleteCascade-1806251197 None] <== create_volume: return (1757ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:27:04 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-8a841190-1ffa-45ca-a0ef-47cd2c55beda tempest-VolumesDeleteCascade-1806251197 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.773s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:27:04 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-d9b666d8-55fe-4255-ad69-1dae58933c4c tempest-VolumesTransfersV357Test-1752960053 None] Lock "cinder-quobyte-75701317-12f6-4c3e-8d2d-db03a16487ee" released by "delete_volume" :: held 1.248s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:27:04 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-8a841190-1ffa-45ca-a0ef-47cd2c55beda tempest-VolumesDeleteCascade-1806251197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa294455-1e8b-4764-89df-22b59a4d5fab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97991c77-d4d5-4e22-a3cf-2fb233a850e6', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:27:04 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-8a841190-1ffa-45ca-a0ef-47cd2c55beda tempest-VolumesDeleteCascade-1806251197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9eff906-1ba0-47b9-8ee5-eb1b4a0ece5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:27:04 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-8a841190-1ffa-45ca-a0ef-47cd2c55beda tempest-VolumesDeleteCascade-1806251197 None] Volume volume-97991c77-d4d5-4e22-a3cf-2fb233a850e6 (97991c77-d4d5-4e22-a3cf-2fb233a850e6): created successfully
Nov 03 18:27:04 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-8a841190-1ffa-45ca-a0ef-47cd2c55beda tempest-VolumesDeleteCascade-1806251197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9eff906-1ba0-47b9-8ee5-eb1b4a0ece5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:27:04 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-8a841190-1ffa-45ca-a0ef-47cd2c55beda tempest-VolumesDeleteCascade-1806251197 None] Flow 'volume_create_manager' (eed46ffd-66c8-4ec0-8869-902618fc9f99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:27:04 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-8a841190-1ffa-45ca-a0ef-47cd2c55beda tempest-VolumesDeleteCascade-1806251197 None] Created volume successfully.
Nov 03 18:27:04 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-d9b666d8-55fe-4255-ad69-1dae58933c4c tempest-VolumesTransfersV357Test-1752960053 None] Created reservations ['64118691-fb37-4c12-aee4-170a79c44597', 'bbf07e61-a923-41f9-8b23-2de901ff3f88', '0fe35871-a7e4-40c9-8b4f-9109dfdab9a6', 'ff3d2e23-a32f-4b38-a7c3-438ececce537'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:27:05 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-d9b666d8-55fe-4255-ad69-1dae58933c4c tempest-VolumesTransfersV357Test-1752960053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:27:05 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-d9b666d8-55fe-4255-ad69-1dae58933c4c tempest-VolumesTransfersV357Test-1752960053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:27:05 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-d9b666d8-55fe-4255-ad69-1dae58933c4c tempest-VolumesTransfersV357Test-1752960053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:27:05 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-d9b666d8-55fe-4255-ad69-1dae58933c4c tempest-VolumesTransfersV357Test-1752960053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:27:05 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-d9b666d8-55fe-4255-ad69-1dae58933c4c tempest-VolumesTransfersV357Test-1752960053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:27:05 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-d9b666d8-55fe-4255-ad69-1dae58933c4c tempest-VolumesTransfersV357Test-1752960053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:27:05 devstack sudo[92697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:27:05 devstack sudo[92697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:27:05 devstack sudo[92697]: pam_unix(sudo:session): session closed for user root
Nov 03 18:27:05 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-d9b666d8-55fe-4255-ad69-1dae58933c4c tempest-VolumesTransfersV357Test-1752960053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.422s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:27:05 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-d9b666d8-55fe-4255-ad69-1dae58933c4c tempest-VolumesTransfersV357Test-1752960053 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:27:05 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-d9b666d8-55fe-4255-ad69-1dae58933c4c tempest-VolumesTransfersV357Test-1752960053 None] Deleted volume successfully.
Nov 03 18:27:05 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-d9b666d8-55fe-4255-ad69-1dae58933c4c tempest-VolumesTransfersV357Test-1752960053 None] Lock "cinder-75701317-12f6-4c3e-8d2d-db03a16487ee-delete_volume" released by "delete_volume" :: held 2.164s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:27:06 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-3098f5f1-ae8c-44a0-92cf-f9c1c973fd79 tempest-VolumesDeleteCascade-1806251197 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:27:06 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-3098f5f1-ae8c-44a0-92cf-f9c1c973fd79 tempest-VolumesDeleteCascade-1806251197 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:27:06 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-3098f5f1-ae8c-44a0-92cf-f9c1c973fd79 tempest-VolumesDeleteCascade-1806251197 None] Creating offline snapshot 910776ee-e943-4ee7-a291-10a10e01ea9e of volume 97991c77-d4d5-4e22-a3cf-2fb233a850e6 {{(pid=86120) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 18:27:06 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffe1ed64-228a-4c63-a440-556a8e45e438]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:27:06 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-3098f5f1-ae8c-44a0-92cf-f9c1c973fd79 tempest-VolumesDeleteCascade-1806251197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-97991c77-d4d5-4e22-a3cf-2fb233a850e6 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:27:06 devstack sudo[92702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-97991c77-d4d5-4e22-a3cf-2fb233a850e6
Nov 03 18:27:06 devstack sudo[92702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:27:08 devstack sudo[92702]: pam_unix(sudo:session): session closed for user root
Nov 03 18:27:08 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-3098f5f1-ae8c-44a0-92cf-f9c1c973fd79 tempest-VolumesDeleteCascade-1806251197 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-97991c77-d4d5-4e22-a3cf-2fb233a850e6" returned: 0 in 1.628s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:27:08 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-3098f5f1-ae8c-44a0-92cf-f9c1c973fd79 tempest-VolumesDeleteCascade-1806251197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-97991c77-d4d5-4e22-a3cf-2fb233a850e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-97991c77-d4d5-4e22-a3cf-2fb233a850e6.910776ee-e943-4ee7-a291-10a10e01ea9e 1G {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:27:08 devstack sudo[92763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-97991c77-d4d5-4e22-a3cf-2fb233a850e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-97991c77-d4d5-4e22-a3cf-2fb233a850e6.910776ee-e943-4ee7-a291-10a10e01ea9e 1G
Nov 03 18:27:08 devstack sudo[92763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:27:09 devstack sudo[92763]: pam_unix(sudo:session): session closed for user root
Nov 03 18:27:09 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-3098f5f1-ae8c-44a0-92cf-f9c1c973fd79 tempest-VolumesDeleteCascade-1806251197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-97991c77-d4d5-4e22-a3cf-2fb233a850e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-97991c77-d4d5-4e22-a3cf-2fb233a850e6.910776ee-e943-4ee7-a291-10a10e01ea9e 1G" returned: 0 in 1.392s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:27:09 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-3098f5f1-ae8c-44a0-92cf-f9c1c973fd79 tempest-VolumesDeleteCascade-1806251197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97991c77-d4d5-4e22-a3cf-2fb233a850e6 -F qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-97991c77-d4d5-4e22-a3cf-2fb233a850e6.910776ee-e943-4ee7-a291-10a10e01ea9e {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:27:09 devstack sudo[92779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97991c77-d4d5-4e22-a3cf-2fb233a850e6 -F qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-97991c77-d4d5-4e22-a3cf-2fb233a850e6.910776ee-e943-4ee7-a291-10a10e01ea9e
Nov 03 18:27:09 devstack sudo[92779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:27:10 devstack sudo[92779]: pam_unix(sudo:session): session closed for user root
Nov 03 18:27:10 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-3098f5f1-ae8c-44a0-92cf-f9c1c973fd79 tempest-VolumesDeleteCascade-1806251197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97991c77-d4d5-4e22-a3cf-2fb233a850e6 -F qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-97991c77-d4d5-4e22-a3cf-2fb233a850e6.910776ee-e943-4ee7-a291-10a10e01ea9e" returned: 0 in 0.621s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:27:10 devstack cinder-volume[86120]: WARNING cinder.volume.drivers.remotefs [None req-3098f5f1-ae8c-44a0-92cf-f9c1c973fd79 tempest-VolumesDeleteCascade-1806251197 None] /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-97991c77-d4d5-4e22-a3cf-2fb233a850e6.910776ee-e943-4ee7-a291-10a10e01ea9e is being set with open permissions: ugo+rw
Nov 03 18:27:10 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-3098f5f1-ae8c-44a0-92cf-f9c1c973fd79 tempest-VolumesDeleteCascade-1806251197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-97991c77-d4d5-4e22-a3cf-2fb233a850e6.910776ee-e943-4ee7-a291-10a10e01ea9e {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:27:10 devstack sudo[92786]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-97991c77-d4d5-4e22-a3cf-2fb233a850e6.910776ee-e943-4ee7-a291-10a10e01ea9e
Nov 03 18:27:10 devstack sudo[92786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:27:10 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d5c2455-5e12-4fad-bd46-f2c969a8f5e2 tempest-ServerRescueNegativeTestJSON-923794999 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:27:10 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-1d5c2455-5e12-4fad-bd46-f2c969a8f5e2 tempest-ServerRescueNegativeTestJSON-923794999 None] Flow 'volume_create_manager' (cb7742c6-e9da-47c2-8eac-cdef8146341a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:27:10 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-1d5c2455-5e12-4fad-bd46-f2c969a8f5e2 tempest-ServerRescueNegativeTestJSON-923794999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee236773-8de4-4e72-957b-eff321e830d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:27:10 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-1d5c2455-5e12-4fad-bd46-f2c969a8f5e2 tempest-ServerRescueNegativeTestJSON-923794999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee236773-8de4-4e72-957b-eff321e830d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:27:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1472000454',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a59fa1fe-7520-4fc2-a1c1-5a21bcf43c05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b26843d75cd4940b306243bef306561',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:27:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:27:11Z,use_quota=True,user_id='2e6203d528c54dbba54ff29bbfd0d9b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:27:10 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-1d5c2455-5e12-4fad-bd46-f2c969a8f5e2 tempest-ServerRescueNegativeTestJSON-923794999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d15b71e-19a7-4cb2-9b72-dc86f0014c7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:27:10 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-1d5c2455-5e12-4fad-bd46-f2c969a8f5e2 tempest-ServerRescueNegativeTestJSON-923794999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d15b71e-19a7-4cb2-9b72-dc86f0014c7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:27:10 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-1d5c2455-5e12-4fad-bd46-f2c969a8f5e2 tempest-ServerRescueNegativeTestJSON-923794999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c44ecb1-cd76-485a-8775-f7420629e955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:27:10 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-1d5c2455-5e12-4fad-bd46-f2c969a8f5e2 tempest-ServerRescueNegativeTestJSON-923794999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c44ecb1-cd76-485a-8775-f7420629e955) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a59fa1fe-7520-4fc2-a1c1-5a21bcf43c05', 'volume_name': 'volume-a59fa1fe-7520-4fc2-a1c1-5a21bcf43c05', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:27:10 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-1d5c2455-5e12-4fad-bd46-f2c969a8f5e2 tempest-ServerRescueNegativeTestJSON-923794999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3173c62-aff6-4d27-8cbd-cc8baa80b5f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:27:10 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-1d5c2455-5e12-4fad-bd46-f2c969a8f5e2 tempest-ServerRescueNegativeTestJSON-923794999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3173c62-aff6-4d27-8cbd-cc8baa80b5f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:27:10 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-1d5c2455-5e12-4fad-bd46-f2c969a8f5e2 tempest-ServerRescueNegativeTestJSON-923794999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef9708be-fa8e-4a74-b8c7-3c27e6bc5c6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:27:10 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-1d5c2455-5e12-4fad-bd46-f2c969a8f5e2 tempest-ServerRescueNegativeTestJSON-923794999 None] Volume a59fa1fe-7520-4fc2-a1c1-5a21bcf43c05: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a59fa1fe-7520-4fc2-a1c1-5a21bcf43c05', 'volume_size': 1}
Nov 03 18:27:10 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-1d5c2455-5e12-4fad-bd46-f2c969a8f5e2 tempest-ServerRescueNegativeTestJSON-923794999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:27:11 devstack sudo[92786]: pam_unix(sudo:session): session closed for user root
Nov 03 18:27:11 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-3098f5f1-ae8c-44a0-92cf-f9c1c973fd79 tempest-VolumesDeleteCascade-1806251197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-97991c77-d4d5-4e22-a3cf-2fb233a850e6.910776ee-e943-4ee7-a291-10a10e01ea9e" returned: 0 in 0.998s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:27:11 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-3098f5f1-ae8c-44a0-92cf-f9c1c973fd79 tempest-VolumesDeleteCascade-1806251197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-97991c77-d4d5-4e22-a3cf-2fb233a850e6.info {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:27:11 devstack sudo[92816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-97991c77-d4d5-4e22-a3cf-2fb233a850e6.info
Nov 03 18:27:11 devstack sudo[92816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:27:11 devstack sudo[92816]: pam_unix(sudo:session): session closed for user root
Nov 03 18:27:11 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-3098f5f1-ae8c-44a0-92cf-f9c1c973fd79 tempest-VolumesDeleteCascade-1806251197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-97991c77-d4d5-4e22-a3cf-2fb233a850e6.info" returned: 0 in 0.459s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:27:11 devstack cinder-volume[86120]: WARNING cinder.volume.drivers.remotefs [None req-3098f5f1-ae8c-44a0-92cf-f9c1c973fd79 tempest-VolumesDeleteCascade-1806251197 None] /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-97991c77-d4d5-4e22-a3cf-2fb233a850e6.info is being set with open permissions: ugo+rw
Nov 03 18:27:11 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-3098f5f1-ae8c-44a0-92cf-f9c1c973fd79 tempest-VolumesDeleteCascade-1806251197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-97991c77-d4d5-4e22-a3cf-2fb233a850e6.info {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:27:11 devstack sudo[92819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-97991c77-d4d5-4e22-a3cf-2fb233a850e6.info
Nov 03 18:27:11 devstack sudo[92819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:27:11 devstack sudo[92819]: pam_unix(sudo:session): session closed for user root
Nov 03 18:27:11 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-3098f5f1-ae8c-44a0-92cf-f9c1c973fd79 tempest-VolumesDeleteCascade-1806251197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-97991c77-d4d5-4e22-a3cf-2fb233a850e6.info" returned: 0 in 0.317s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:27:12 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-3098f5f1-ae8c-44a0-92cf-f9c1c973fd79 tempest-VolumesDeleteCascade-1806251197 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.604s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:27:12 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-1d5c2455-5e12-4fad-bd46-f2c969a8f5e2 tempest-ServerRescueNegativeTestJSON-923794999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.103s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:27:12 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-1d5c2455-5e12-4fad-bd46-f2c969a8f5e2 tempest-ServerRescueNegativeTestJSON-923794999 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:27:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1472000454',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a59fa1fe-7520-4fc2-a1c1-5a21bcf43c05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b26843d75cd4940b306243bef306561',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:27:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:27:11Z,use_quota=True,user_id='2e6203d528c54dbba54ff29bbfd0d9b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:27:12 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-1d5c2455-5e12-4fad-bd46-f2c969a8f5e2 tempest-ServerRescueNegativeTestJSON-923794999 None] Creating volume a59fa1fe-7520-4fc2-a1c1-5a21bcf43c05 {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:27:12 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-1d5c2455-5e12-4fad-bd46-f2c969a8f5e2 tempest-ServerRescueNegativeTestJSON-923794999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:27:12 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-1d5c2455-5e12-4fad-bd46-f2c969a8f5e2 tempest-ServerRescueNegativeTestJSON-923794999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:27:12 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-1d5c2455-5e12-4fad-bd46-f2c969a8f5e2 tempest-ServerRescueNegativeTestJSON-923794999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:27:12 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-1d5c2455-5e12-4fad-bd46-f2c969a8f5e2 tempest-ServerRescueNegativeTestJSON-923794999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:27:12 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-1d5c2455-5e12-4fad-bd46-f2c969a8f5e2 tempest-ServerRescueNegativeTestJSON-923794999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:27:12 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-1d5c2455-5e12-4fad-bd46-f2c969a8f5e2 tempest-ServerRescueNegativeTestJSON-923794999 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:27:12 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-1d5c2455-5e12-4fad-bd46-f2c969a8f5e2 tempest-ServerRescueNegativeTestJSON-923794999 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:27:12 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-1d5c2455-5e12-4fad-bd46-f2c969a8f5e2 tempest-ServerRescueNegativeTestJSON-923794999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-a59fa1fe-7520-4fc2-a1c1-5a21bcf43c05 1073741824 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:27:12 devstack sudo[92822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-a59fa1fe-7520-4fc2-a1c1-5a21bcf43c05 1073741824
Nov 03 18:27:12 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-3098f5f1-ae8c-44a0-92cf-f9c1c973fd79 tempest-VolumesDeleteCascade-1806251197 None] Create snapshot completed successfully
Nov 03 18:27:12 devstack sudo[92822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:27:12 devstack sudo[92822]: pam_unix(sudo:session): session closed for user root
Nov 03 18:27:12 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-1d5c2455-5e12-4fad-bd46-f2c969a8f5e2 tempest-ServerRescueNegativeTestJSON-923794999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-a59fa1fe-7520-4fc2-a1c1-5a21bcf43c05 1073741824" returned: 0 in 0.785s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:27:12 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-1d5c2455-5e12-4fad-bd46-f2c969a8f5e2 tempest-ServerRescueNegativeTestJSON-923794999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-a59fa1fe-7520-4fc2-a1c1-5a21bcf43c05 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:27:12 devstack sudo[92828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-a59fa1fe-7520-4fc2-a1c1-5a21bcf43c05
Nov 03 18:27:12 devstack sudo[92828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:27:13 devstack sudo[92828]: pam_unix(sudo:session): session closed for user root
Nov 03 18:27:13 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-1d5c2455-5e12-4fad-bd46-f2c969a8f5e2 tempest-ServerRescueNegativeTestJSON-923794999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-a59fa1fe-7520-4fc2-a1c1-5a21bcf43c05" returned: 0 in 0.602s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:27:13 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-1d5c2455-5e12-4fad-bd46-f2c969a8f5e2 tempest-ServerRescueNegativeTestJSON-923794999 None] <== create_volume: return (1475ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:27:13 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-1d5c2455-5e12-4fad-bd46-f2c969a8f5e2 tempest-ServerRescueNegativeTestJSON-923794999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.483s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:27:13 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-1d5c2455-5e12-4fad-bd46-f2c969a8f5e2 tempest-ServerRescueNegativeTestJSON-923794999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef9708be-fa8e-4a74-b8c7-3c27e6bc5c6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a59fa1fe-7520-4fc2-a1c1-5a21bcf43c05', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:27:13 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-1d5c2455-5e12-4fad-bd46-f2c969a8f5e2 tempest-ServerRescueNegativeTestJSON-923794999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b03a403b-17e4-4fd4-9b7a-dccd72951001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:27:13 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-1d5c2455-5e12-4fad-bd46-f2c969a8f5e2 tempest-ServerRescueNegativeTestJSON-923794999 None] Volume volume-a59fa1fe-7520-4fc2-a1c1-5a21bcf43c05 (a59fa1fe-7520-4fc2-a1c1-5a21bcf43c05): created successfully
Nov 03 18:27:13 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-1d5c2455-5e12-4fad-bd46-f2c969a8f5e2 tempest-ServerRescueNegativeTestJSON-923794999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b03a403b-17e4-4fd4-9b7a-dccd72951001) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:27:13 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-1d5c2455-5e12-4fad-bd46-f2c969a8f5e2 tempest-ServerRescueNegativeTestJSON-923794999 None] Flow 'volume_create_manager' (cb7742c6-e9da-47c2-8eac-cdef8146341a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:27:13 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-1d5c2455-5e12-4fad-bd46-f2c969a8f5e2 tempest-ServerRescueNegativeTestJSON-923794999 None] Created volume successfully.
Nov 03 18:27:14 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-cca6f6a5-b75f-46ba-b508-8ed5e93b4a90 tempest-VolumesDeleteCascade-1806251197 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:27:14 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-cca6f6a5-b75f-46ba-b508-8ed5e93b4a90 tempest-VolumesDeleteCascade-1806251197 None] Flow 'volume_create_manager' (c1c5ed3f-bee1-4dc1-8c5d-4f41a028cfec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:27:14 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-cca6f6a5-b75f-46ba-b508-8ed5e93b4a90 tempest-VolumesDeleteCascade-1806251197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (228faa02-b0bf-41ab-841e-474a149208d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:27:14 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-cca6f6a5-b75f-46ba-b508-8ed5e93b4a90 tempest-VolumesDeleteCascade-1806251197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (228faa02-b0bf-41ab-841e-474a149208d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:27:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-200875178',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84298105-9eca-45ea-be26-9028982677e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd86f61877b243e0ad265eb0a159d6c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:27:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=910776ee-e943-4ee7-a291-10a10e01ea9e,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:27:14Z,use_quota=True,user_id='26bb5bef8a064b59a865d7ded0d83879',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:27:14 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-cca6f6a5-b75f-46ba-b508-8ed5e93b4a90 tempest-VolumesDeleteCascade-1806251197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (020f91f4-6f67-4c78-a16f-1acd5aba7ce3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:27:14 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-cca6f6a5-b75f-46ba-b508-8ed5e93b4a90 tempest-VolumesDeleteCascade-1806251197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (020f91f4-6f67-4c78-a16f-1acd5aba7ce3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:27:14 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-cca6f6a5-b75f-46ba-b508-8ed5e93b4a90 tempest-VolumesDeleteCascade-1806251197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd6c665a-57e2-4894-a68d-62f0ffd2da4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:27:14 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-cca6f6a5-b75f-46ba-b508-8ed5e93b4a90 tempest-VolumesDeleteCascade-1806251197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd6c665a-57e2-4894-a68d-62f0ffd2da4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '84298105-9eca-45ea-be26-9028982677e1', 'volume_name': 'volume-84298105-9eca-45ea-be26-9028982677e1', 'volume_size': 1, 'snapshot_id': '910776ee-e943-4ee7-a291-10a10e01ea9e'}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:27:14 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-cca6f6a5-b75f-46ba-b508-8ed5e93b4a90 tempest-VolumesDeleteCascade-1806251197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f93710d-032b-4385-9f87-ffd03bdde7b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:27:14 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-cca6f6a5-b75f-46ba-b508-8ed5e93b4a90 tempest-VolumesDeleteCascade-1806251197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f93710d-032b-4385-9f87-ffd03bdde7b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:27:14 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-cca6f6a5-b75f-46ba-b508-8ed5e93b4a90 tempest-VolumesDeleteCascade-1806251197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cf9d32e-373b-49f4-aa2e-b8bf87e98f1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:27:14 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-cca6f6a5-b75f-46ba-b508-8ed5e93b4a90 tempest-VolumesDeleteCascade-1806251197 None] Volume 84298105-9eca-45ea-be26-9028982677e1: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-84298105-9eca-45ea-be26-9028982677e1', 'volume_size': 1, 'snapshot_id': '910776ee-e943-4ee7-a291-10a10e01ea9e'}
Nov 03 18:27:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-cca6f6a5-b75f-46ba-b508-8ed5e93b4a90 tempest-VolumesDeleteCascade-1806251197 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:27:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-cca6f6a5-b75f-46ba-b508-8ed5e93b4a90 tempest-VolumesDeleteCascade-1806251197 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:27:14 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-cca6f6a5-b75f-46ba-b508-8ed5e93b4a90 tempest-VolumesDeleteCascade-1806251197 None] Acquiring lock "cinder-quobyte-910776ee-e943-4ee7-a291-10a10e01ea9e-84298105-9eca-45ea-be26-9028982677e1" by "_create_volume_from_snapshot" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:27:14 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-cca6f6a5-b75f-46ba-b508-8ed5e93b4a90 tempest-VolumesDeleteCascade-1806251197 None] Lock "cinder-quobyte-910776ee-e943-4ee7-a291-10a10e01ea9e-84298105-9eca-45ea-be26-9028982677e1" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:27:14 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-cca6f6a5-b75f-46ba-b508-8ed5e93b4a90 tempest-VolumesDeleteCascade-1806251197 None] Creating volume 84298105-9eca-45ea-be26-9028982677e1 from snapshot 910776ee-e943-4ee7-a291-10a10e01ea9e {{(pid=86120) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 03 18:27:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-cca6f6a5-b75f-46ba-b508-8ed5e93b4a90 tempest-VolumesDeleteCascade-1806251197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:27:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-cca6f6a5-b75f-46ba-b508-8ed5e93b4a90 tempest-VolumesDeleteCascade-1806251197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:27:14 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-cca6f6a5-b75f-46ba-b508-8ed5e93b4a90 tempest-VolumesDeleteCascade-1806251197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:27:14 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-cca6f6a5-b75f-46ba-b508-8ed5e93b4a90 tempest-VolumesDeleteCascade-1806251197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:27:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-cca6f6a5-b75f-46ba-b508-8ed5e93b4a90 tempest-VolumesDeleteCascade-1806251197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:27:14 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-cca6f6a5-b75f-46ba-b508-8ed5e93b4a90 tempest-VolumesDeleteCascade-1806251197 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:27:14 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-cca6f6a5-b75f-46ba-b508-8ed5e93b4a90 tempest-VolumesDeleteCascade-1806251197 None] Acquiring lock "cinder-quobyte-84298105-9eca-45ea-be26-9028982677e1" by "_copy_volume_from_snapshot" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:27:14 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-cca6f6a5-b75f-46ba-b508-8ed5e93b4a90 tempest-VolumesDeleteCascade-1806251197 None] Lock "cinder-quobyte-84298105-9eca-45ea-be26-9028982677e1" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:27:14 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-cca6f6a5-b75f-46ba-b508-8ed5e93b4a90 tempest-VolumesDeleteCascade-1806251197 None] snapshot: 910776ee-e943-4ee7-a291-10a10e01ea9e, volume: 84298105-9eca-45ea-be26-9028982677e1,  {{(pid=86120) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 03 18:27:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-cca6f6a5-b75f-46ba-b508-8ed5e93b4a90 tempest-VolumesDeleteCascade-1806251197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:27:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-cca6f6a5-b75f-46ba-b508-8ed5e93b4a90 tempest-VolumesDeleteCascade-1806251197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:27:14 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-cca6f6a5-b75f-46ba-b508-8ed5e93b4a90 tempest-VolumesDeleteCascade-1806251197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:27:14 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-cca6f6a5-b75f-46ba-b508-8ed5e93b4a90 tempest-VolumesDeleteCascade-1806251197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:27:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-cca6f6a5-b75f-46ba-b508-8ed5e93b4a90 tempest-VolumesDeleteCascade-1806251197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:27:14 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[40e49284-a738-4bae-9b8b-3c13e3fee8dd]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:27:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-cca6f6a5-b75f-46ba-b508-8ed5e93b4a90 tempest-VolumesDeleteCascade-1806251197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-97991c77-d4d5-4e22-a3cf-2fb233a850e6.910776ee-e943-4ee7-a291-10a10e01ea9e {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:27:14 devstack sudo[92837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-97991c77-d4d5-4e22-a3cf-2fb233a850e6.910776ee-e943-4ee7-a291-10a10e01ea9e
Nov 03 18:27:14 devstack sudo[92837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:27:14 devstack cinder-volume[86120]: DEBUG oslo_service.periodic_task [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86120) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 18:27:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:27:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:27:14 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:27:14 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:27:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:27:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:27:15 devstack sudo[92840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:27:15 devstack sudo[92840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:27:15 devstack sudo[92837]: pam_unix(sudo:session): session closed for user root
Nov 03 18:27:15 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-cca6f6a5-b75f-46ba-b508-8ed5e93b4a90 tempest-VolumesDeleteCascade-1806251197 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-97991c77-d4d5-4e22-a3cf-2fb233a850e6.910776ee-e943-4ee7-a291-10a10e01ea9e" returned: 0 in 0.989s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:27:15 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-cca6f6a5-b75f-46ba-b508-8ed5e93b4a90 tempest-VolumesDeleteCascade-1806251197 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-97991c77-d4d5-4e22-a3cf-2fb233a850e6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86120) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 18:27:15 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[902d26ff-cb0c-444b-a0eb-8b2deeb8f73d]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:27:15 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-cca6f6a5-b75f-46ba-b508-8ed5e93b4a90 tempest-VolumesDeleteCascade-1806251197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-97991c77-d4d5-4e22-a3cf-2fb233a850e6 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:27:15 devstack sudo[92846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-97991c77-d4d5-4e22-a3cf-2fb233a850e6
Nov 03 18:27:15 devstack sudo[92846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:27:15 devstack sudo[92840]: pam_unix(sudo:session): session closed for user root
Nov 03 18:27:15 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.787s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:27:15 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:27:15 devstack cinder-volume[86120]: DEBUG oslo_service.periodic_task [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Running periodic task VolumeManager._thread_info {{(pid=86120) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 18:27:15 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] thread count: 28 {{(pid=86120) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 03 18:27:15 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] thread info: [<_MainThread(MainThread, started 134747145822336)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134747033686336)>, <Thread(Thread-3 (stat_writer), started daemon 134747030828736)>, <Thread(Rabbit-heartbeat, started daemon 134747035433408)>, <Thread(Thread-5 (_runner), started daemon 134747029587392)>, <Thread(Thread-7 (_runner), started daemon 134747029784256)>, <Thread(fd_logger, started daemon 134747027909120)>, <Thread(privsep_reader, started daemon 134747027006592)>, <Thread(tpool_thread_0, started daemon 134747018950336)>, <Thread(tpool_thread_1, started daemon 134747010541248)>, <Thread(tpool_thread_2, started daemon 134747002132160)>, <Thread(tpool_thread_3, started daemon 134746993723072)>, <Thread(tpool_thread_4, started daemon 134746985313984)>, <Thread(tpool_thread_5, started daemon 134746976904896)>, <Thread(tpool_thread_6, started daemon 134746968495808)>, <Thread(tpool_thread_7, started daemon 134746960086720)>, <Thread(tpool_thread_8, started daemon 134746951677632)>, <Thread(tpool_thread_9, started daemon 134746943268544)>, <Thread(tpool_thread_10, started daemon 134746934859456)>, <Thread(tpool_thread_11, started daemon 134746926450368)>, <Thread(tpool_thread_12, started daemon 134746918041280)>, <Thread(tpool_thread_13, started daemon 134746909632192)>, <Thread(tpool_thread_14, started daemon 134746901223104)>, <Thread(tpool_thread_15, started daemon 134746892814016)>, <Thread(tpool_thread_16, started daemon 134746884404928)>, <Thread(tpool_thread_17, started daemon 134746875995840)>, <Thread(tpool_thread_18, started daemon 134746867586752)>, <Thread(tpool_thread_19, started daemon 134746859177664)>] {{(pid=86120) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 03 18:27:16 devstack sudo[92846]: pam_unix(sudo:session): session closed for user root
Nov 03 18:27:16 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-cca6f6a5-b75f-46ba-b508-8ed5e93b4a90 tempest-VolumesDeleteCascade-1806251197 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-97991c77-d4d5-4e22-a3cf-2fb233a850e6" returned: 0 in 0.553s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:27:16 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-cca6f6a5-b75f-46ba-b508-8ed5e93b4a90 tempest-VolumesDeleteCascade-1806251197 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-97991c77-d4d5-4e22-a3cf-2fb233a850e6 {{(pid=86120) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 03 18:27:16 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-cca6f6a5-b75f-46ba-b508-8ed5e93b4a90 tempest-VolumesDeleteCascade-1806251197 None] Creating direct copy from snapshot {{(pid=86120) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 03 18:27:16 devstack cinder-volume[86120]: DEBUG cinder.utils [None req-cca6f6a5-b75f-46ba-b508-8ed5e93b4a90 tempest-VolumesDeleteCascade-1806251197 None] Path /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-84298105-9eca-45ea-be26-9028982677e1 not found in is_blk_device check {{(pid=86120) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 03 18:27:16 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-cca6f6a5-b75f-46ba-b508-8ed5e93b4a90 tempest-VolumesDeleteCascade-1806251197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-97991c77-d4d5-4e22-a3cf-2fb233a850e6 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-84298105-9eca-45ea-be26-9028982677e1 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:27:16 devstack sudo[92853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-97991c77-d4d5-4e22-a3cf-2fb233a850e6 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-84298105-9eca-45ea-be26-9028982677e1
Nov 03 18:27:16 devstack sudo[92853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:27:24 devstack cinder-volume[86120]: DEBUG dbcounter [-] [86120] Writing DB stats cinder:SELECT=54,cinder:UPDATE=68,cinder:INSERT=16,cinder:DELETE=7 {{(pid=86120) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 18:27:24 devstack cinder-volume[86120]: DEBUG dbcounter [-] [86120] Writing DB stats cinder:SELECT=55,cinder:UPDATE=63,cinder:INSERT=16,cinder:DELETE=6 {{(pid=86120) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 18:27:29 devstack sudo[92853]: pam_unix(sudo:session): session closed for user root
Nov 03 18:27:29 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-cca6f6a5-b75f-46ba-b508-8ed5e93b4a90 tempest-VolumesDeleteCascade-1806251197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-97991c77-d4d5-4e22-a3cf-2fb233a850e6 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-84298105-9eca-45ea-be26-9028982677e1" returned: 0 in 13.488s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:27:29 devstack cinder-volume[86120]: DEBUG cinder.image.image_utils [None req-cca6f6a5-b75f-46ba-b508-8ed5e93b4a90 tempest-VolumesDeleteCascade-1806251197 None] Image conversion details: src /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-97991c77-d4d5-4e22-a3cf-2fb233a850e6, size 1024.00 MB, duration 13.49 sec, destination /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-84298105-9eca-45ea-be26-9028982677e1 {{(pid=86120) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 03 18:27:29 devstack cinder-volume[86120]: INFO cinder.image.image_utils [None req-cca6f6a5-b75f-46ba-b508-8ed5e93b4a90 tempest-VolumesDeleteCascade-1806251197 None] Converted 1024.00 MB image at 75.91 MB/s
Nov 03 18:27:29 devstack cinder-volume[86120]: WARNING cinder.volume.drivers.remotefs [None req-cca6f6a5-b75f-46ba-b508-8ed5e93b4a90 tempest-VolumesDeleteCascade-1806251197 None] /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-84298105-9eca-45ea-be26-9028982677e1 is being set with open permissions: ugo+rw
Nov 03 18:27:29 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-cca6f6a5-b75f-46ba-b508-8ed5e93b4a90 tempest-VolumesDeleteCascade-1806251197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-84298105-9eca-45ea-be26-9028982677e1 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:27:29 devstack sudo[93023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-84298105-9eca-45ea-be26-9028982677e1
Nov 03 18:27:29 devstack sudo[93023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:27:29 devstack sudo[93023]: pam_unix(sudo:session): session closed for user root
Nov 03 18:27:29 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-cca6f6a5-b75f-46ba-b508-8ed5e93b4a90 tempest-VolumesDeleteCascade-1806251197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-84298105-9eca-45ea-be26-9028982677e1" returned: 0 in 0.263s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:27:29 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-cca6f6a5-b75f-46ba-b508-8ed5e93b4a90 tempest-VolumesDeleteCascade-1806251197 None] Lock "cinder-quobyte-84298105-9eca-45ea-be26-9028982677e1" released by "_copy_volume_from_snapshot" :: held 15.431s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:27:29 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-cca6f6a5-b75f-46ba-b508-8ed5e93b4a90 tempest-VolumesDeleteCascade-1806251197 None] Lock "cinder-quobyte-910776ee-e943-4ee7-a291-10a10e01ea9e-84298105-9eca-45ea-be26-9028982677e1" released by "_create_volume_from_snapshot" :: held 15.523s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:27:29 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-cca6f6a5-b75f-46ba-b508-8ed5e93b4a90 tempest-VolumesDeleteCascade-1806251197 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 15.547s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:27:29 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-cca6f6a5-b75f-46ba-b508-8ed5e93b4a90 tempest-VolumesDeleteCascade-1806251197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cf9d32e-373b-49f4-aa2e-b8bf87e98f1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84298105-9eca-45ea-be26-9028982677e1', 'volume_size': 1, 'snapshot_id': '910776ee-e943-4ee7-a291-10a10e01ea9e'}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:27:29 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-cca6f6a5-b75f-46ba-b508-8ed5e93b4a90 tempest-VolumesDeleteCascade-1806251197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (554b3dac-2213-4f33-b20b-c63463368384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:27:30 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-cca6f6a5-b75f-46ba-b508-8ed5e93b4a90 tempest-VolumesDeleteCascade-1806251197 None] Volume volume-84298105-9eca-45ea-be26-9028982677e1 (84298105-9eca-45ea-be26-9028982677e1): created successfully
Nov 03 18:27:30 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-cca6f6a5-b75f-46ba-b508-8ed5e93b4a90 tempest-VolumesDeleteCascade-1806251197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (554b3dac-2213-4f33-b20b-c63463368384) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:27:30 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-cca6f6a5-b75f-46ba-b508-8ed5e93b4a90 tempest-VolumesDeleteCascade-1806251197 None] Flow 'volume_create_manager' (c1c5ed3f-bee1-4dc1-8c5d-4f41a028cfec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:27:30 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-cca6f6a5-b75f-46ba-b508-8ed5e93b4a90 tempest-VolumesDeleteCascade-1806251197 None] Created volume successfully.
Nov 03 18:27:31 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-941acfd4-9f5b-4531-8690-ca013fcec57f tempest-VolumesDeleteCascade-1806251197 None] Acquiring lock "cinder-97991c77-d4d5-4e22-a3cf-2fb233a850e6-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:27:31 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-941acfd4-9f5b-4531-8690-ca013fcec57f tempest-VolumesDeleteCascade-1806251197 None] Lock "cinder-97991c77-d4d5-4e22-a3cf-2fb233a850e6-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:27:31 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-941acfd4-9f5b-4531-8690-ca013fcec57f tempest-VolumesDeleteCascade-1806251197 None] Performing cascade delete. {{(pid=86120) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Nov 03 18:27:31 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-941acfd4-9f5b-4531-8690-ca013fcec57f tempest-VolumesDeleteCascade-1806251197 None] Acquiring lock "cinder-910776ee-e943-4ee7-a291-10a10e01ea9e-delete_snapshot" by "delete_snapshot" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:27:31 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-941acfd4-9f5b-4531-8690-ca013fcec57f tempest-VolumesDeleteCascade-1806251197 None] Lock "cinder-910776ee-e943-4ee7-a291-10a10e01ea9e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:27:31 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-941acfd4-9f5b-4531-8690-ca013fcec57f tempest-VolumesDeleteCascade-1806251197 None] Acquiring lock "cinder-quobyte-97991c77-d4d5-4e22-a3cf-2fb233a850e6" by "delete_snapshot" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:27:31 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-941acfd4-9f5b-4531-8690-ca013fcec57f tempest-VolumesDeleteCascade-1806251197 None] Lock "cinder-quobyte-97991c77-d4d5-4e22-a3cf-2fb233a850e6" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:27:31 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-941acfd4-9f5b-4531-8690-ca013fcec57f tempest-VolumesDeleteCascade-1806251197 None] Acquiring lock "cinder-quobyte-910776ee-e943-4ee7-a291-10a10e01ea9e" by "_delete_snapshot" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:27:31 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-941acfd4-9f5b-4531-8690-ca013fcec57f tempest-VolumesDeleteCascade-1806251197 None] Lock "cinder-quobyte-910776ee-e943-4ee7-a291-10a10e01ea9e" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:27:31 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-941acfd4-9f5b-4531-8690-ca013fcec57f tempest-VolumesDeleteCascade-1806251197 None] Deleting offline snapshot 910776ee-e943-4ee7-a291-10a10e01ea9e of volume 97991c77-d4d5-4e22-a3cf-2fb233a850e6 {{(pid=86120) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 18:27:31 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-941acfd4-9f5b-4531-8690-ca013fcec57f tempest-VolumesDeleteCascade-1806251197 None] snapshot_file for this snap is: volume-97991c77-d4d5-4e22-a3cf-2fb233a850e6.910776ee-e943-4ee7-a291-10a10e01ea9e {{(pid=86120) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 18:27:31 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e282f75-679f-4c2e-966a-6fa8693ad21f]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:27:31 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-941acfd4-9f5b-4531-8690-ca013fcec57f tempest-VolumesDeleteCascade-1806251197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-97991c77-d4d5-4e22-a3cf-2fb233a850e6.910776ee-e943-4ee7-a291-10a10e01ea9e {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:27:31 devstack sudo[93038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-97991c77-d4d5-4e22-a3cf-2fb233a850e6.910776ee-e943-4ee7-a291-10a10e01ea9e
Nov 03 18:27:31 devstack sudo[93038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:27:32 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4c3f7a8-f8fa-45b5-b21e-24efb4a54b82 tempest-VolumesSnapshotListTestJSON-1439242857 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:27:32 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-c4c3f7a8-f8fa-45b5-b21e-24efb4a54b82 tempest-VolumesSnapshotListTestJSON-1439242857 None] Flow 'volume_create_manager' (9106b594-ffaf-4b6a-9a15-852be260f1ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:27:32 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-c4c3f7a8-f8fa-45b5-b21e-24efb4a54b82 tempest-VolumesSnapshotListTestJSON-1439242857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3de26c13-6390-476f-a1a5-3c2f148ce54f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:27:32 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-c4c3f7a8-f8fa-45b5-b21e-24efb4a54b82 tempest-VolumesSnapshotListTestJSON-1439242857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3de26c13-6390-476f-a1a5-3c2f148ce54f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:27:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-28742929',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8a8ac9d-ef51-41f8-8b5d-04379b1eca75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f5bf310484843569241cc5e394fac51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:27:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:27:32Z,use_quota=True,user_id='2694b7c0de194dc489a50bb3f8b516fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:27:32 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-c4c3f7a8-f8fa-45b5-b21e-24efb4a54b82 tempest-VolumesSnapshotListTestJSON-1439242857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (309a0fda-edd9-4415-9adc-e101e46efb42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:27:32 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-c4c3f7a8-f8fa-45b5-b21e-24efb4a54b82 tempest-VolumesSnapshotListTestJSON-1439242857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (309a0fda-edd9-4415-9adc-e101e46efb42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:27:32 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-c4c3f7a8-f8fa-45b5-b21e-24efb4a54b82 tempest-VolumesSnapshotListTestJSON-1439242857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d42bd51-bb66-46e9-bfa1-357ed279d06b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:27:32 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-c4c3f7a8-f8fa-45b5-b21e-24efb4a54b82 tempest-VolumesSnapshotListTestJSON-1439242857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d42bd51-bb66-46e9-bfa1-357ed279d06b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8a8ac9d-ef51-41f8-8b5d-04379b1eca75', 'volume_name': 'volume-e8a8ac9d-ef51-41f8-8b5d-04379b1eca75', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:27:32 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-c4c3f7a8-f8fa-45b5-b21e-24efb4a54b82 tempest-VolumesSnapshotListTestJSON-1439242857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8d5d7a1-0a7b-4dc3-924c-b5bec58f2023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:27:32 devstack sudo[93038]: pam_unix(sudo:session): session closed for user root
Nov 03 18:27:32 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-c4c3f7a8-f8fa-45b5-b21e-24efb4a54b82 tempest-VolumesSnapshotListTestJSON-1439242857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8d5d7a1-0a7b-4dc3-924c-b5bec58f2023) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:27:32 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-c4c3f7a8-f8fa-45b5-b21e-24efb4a54b82 tempest-VolumesSnapshotListTestJSON-1439242857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d119a63-52b2-4974-832c-327505c133d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:27:32 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-c4c3f7a8-f8fa-45b5-b21e-24efb4a54b82 tempest-VolumesSnapshotListTestJSON-1439242857 None] Volume e8a8ac9d-ef51-41f8-8b5d-04379b1eca75: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8a8ac9d-ef51-41f8-8b5d-04379b1eca75', 'volume_size': 1}
Nov 03 18:27:32 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-c4c3f7a8-f8fa-45b5-b21e-24efb4a54b82 tempest-VolumesSnapshotListTestJSON-1439242857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:27:32 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-c4c3f7a8-f8fa-45b5-b21e-24efb4a54b82 tempest-VolumesSnapshotListTestJSON-1439242857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:27:32 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-c4c3f7a8-f8fa-45b5-b21e-24efb4a54b82 tempest-VolumesSnapshotListTestJSON-1439242857 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:27:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-28742929',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8a8ac9d-ef51-41f8-8b5d-04379b1eca75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f5bf310484843569241cc5e394fac51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:27:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:27:32Z,use_quota=True,user_id='2694b7c0de194dc489a50bb3f8b516fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:27:32 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-c4c3f7a8-f8fa-45b5-b21e-24efb4a54b82 tempest-VolumesSnapshotListTestJSON-1439242857 None] Creating volume e8a8ac9d-ef51-41f8-8b5d-04379b1eca75 {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:27:32 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-c4c3f7a8-f8fa-45b5-b21e-24efb4a54b82 tempest-VolumesSnapshotListTestJSON-1439242857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:27:32 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-c4c3f7a8-f8fa-45b5-b21e-24efb4a54b82 tempest-VolumesSnapshotListTestJSON-1439242857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:27:32 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-c4c3f7a8-f8fa-45b5-b21e-24efb4a54b82 tempest-VolumesSnapshotListTestJSON-1439242857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:27:32 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-c4c3f7a8-f8fa-45b5-b21e-24efb4a54b82 tempest-VolumesSnapshotListTestJSON-1439242857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:27:32 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-c4c3f7a8-f8fa-45b5-b21e-24efb4a54b82 tempest-VolumesSnapshotListTestJSON-1439242857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:27:32 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-c4c3f7a8-f8fa-45b5-b21e-24efb4a54b82 tempest-VolumesSnapshotListTestJSON-1439242857 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:27:32 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-c4c3f7a8-f8fa-45b5-b21e-24efb4a54b82 tempest-VolumesSnapshotListTestJSON-1439242857 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:27:32 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-c4c3f7a8-f8fa-45b5-b21e-24efb4a54b82 tempest-VolumesSnapshotListTestJSON-1439242857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e8a8ac9d-ef51-41f8-8b5d-04379b1eca75 1073741824 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:27:32 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-941acfd4-9f5b-4531-8690-ca013fcec57f tempest-VolumesDeleteCascade-1806251197 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-97991c77-d4d5-4e22-a3cf-2fb233a850e6.910776ee-e943-4ee7-a291-10a10e01ea9e" returned: 0 in 0.603s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:27:32 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-941acfd4-9f5b-4531-8690-ca013fcec57f tempest-VolumesDeleteCascade-1806251197 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-97991c77-d4d5-4e22-a3cf-2fb233a850e6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86120) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 18:27:32 devstack sudo[93043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e8a8ac9d-ef51-41f8-8b5d-04379b1eca75 1073741824
Nov 03 18:27:32 devstack sudo[93043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:27:32 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dc68710-821b-4b46-9ebd-81fc86c37e45]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:27:32 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-941acfd4-9f5b-4531-8690-ca013fcec57f tempest-VolumesDeleteCascade-1806251197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-97991c77-d4d5-4e22-a3cf-2fb233a850e6 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:27:32 devstack sudo[93045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-97991c77-d4d5-4e22-a3cf-2fb233a850e6
Nov 03 18:27:32 devstack sudo[93045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:27:32 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-0bb5a36f-4fcc-400d-a785-189c1a2febc8 tempest-ServerRescueNegativeTestJSON-923794999 None] Acquiring lock "cinder-a59fa1fe-7520-4fc2-a1c1-5a21bcf43c05-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:27:32 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-0bb5a36f-4fcc-400d-a785-189c1a2febc8 tempest-ServerRescueNegativeTestJSON-923794999 None] Lock "cinder-a59fa1fe-7520-4fc2-a1c1-5a21bcf43c05-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:27:32 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-0bb5a36f-4fcc-400d-a785-189c1a2febc8 tempest-ServerRescueNegativeTestJSON-923794999 None] Acquiring lock "cinder-quobyte-a59fa1fe-7520-4fc2-a1c1-5a21bcf43c05" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:27:32 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-0bb5a36f-4fcc-400d-a785-189c1a2febc8 tempest-ServerRescueNegativeTestJSON-923794999 None] Lock "cinder-quobyte-a59fa1fe-7520-4fc2-a1c1-5a21bcf43c05" acquired by "delete_volume" :: waited 0.026s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:27:32 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[59fd2ae7-bff6-4ae5-a353-7e89895652ac]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:27:32 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-0bb5a36f-4fcc-400d-a785-189c1a2febc8 tempest-ServerRescueNegativeTestJSON-923794999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-a59fa1fe-7520-4fc2-a1c1-5a21bcf43c05 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:27:32 devstack sudo[93043]: pam_unix(sudo:session): session closed for user root
Nov 03 18:27:32 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-c4c3f7a8-f8fa-45b5-b21e-24efb4a54b82 tempest-VolumesSnapshotListTestJSON-1439242857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e8a8ac9d-ef51-41f8-8b5d-04379b1eca75 1073741824" returned: 0 in 0.723s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:27:33 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-c4c3f7a8-f8fa-45b5-b21e-24efb4a54b82 tempest-VolumesSnapshotListTestJSON-1439242857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e8a8ac9d-ef51-41f8-8b5d-04379b1eca75 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:27:33 devstack sudo[93053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-a59fa1fe-7520-4fc2-a1c1-5a21bcf43c05
Nov 03 18:27:33 devstack sudo[93053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:27:33 devstack sudo[93054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e8a8ac9d-ef51-41f8-8b5d-04379b1eca75
Nov 03 18:27:33 devstack sudo[93054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:27:33 devstack sudo[93045]: pam_unix(sudo:session): session closed for user root
Nov 03 18:27:33 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-941acfd4-9f5b-4531-8690-ca013fcec57f tempest-VolumesDeleteCascade-1806251197 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-97991c77-d4d5-4e22-a3cf-2fb233a850e6" returned: 0 in 0.942s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:27:33 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-941acfd4-9f5b-4531-8690-ca013fcec57f tempest-VolumesDeleteCascade-1806251197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-97991c77-d4d5-4e22-a3cf-2fb233a850e6.910776ee-e943-4ee7-a291-10a10e01ea9e {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:27:33 devstack sudo[93058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-97991c77-d4d5-4e22-a3cf-2fb233a850e6.910776ee-e943-4ee7-a291-10a10e01ea9e
Nov 03 18:27:33 devstack sudo[93058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:27:33 devstack sudo[93053]: pam_unix(sudo:session): session closed for user root
Nov 03 18:27:33 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-0bb5a36f-4fcc-400d-a785-189c1a2febc8 tempest-ServerRescueNegativeTestJSON-923794999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-a59fa1fe-7520-4fc2-a1c1-5a21bcf43c05" returned: 0 in 0.620s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:27:33 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-0bb5a36f-4fcc-400d-a785-189c1a2febc8 tempest-ServerRescueNegativeTestJSON-923794999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-a59fa1fe-7520-4fc2-a1c1-5a21bcf43c05 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:27:33 devstack sudo[93054]: pam_unix(sudo:session): session closed for user root
Nov 03 18:27:33 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-c4c3f7a8-f8fa-45b5-b21e-24efb4a54b82 tempest-VolumesSnapshotListTestJSON-1439242857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e8a8ac9d-ef51-41f8-8b5d-04379b1eca75" returned: 0 in 0.475s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:27:33 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-c4c3f7a8-f8fa-45b5-b21e-24efb4a54b82 tempest-VolumesSnapshotListTestJSON-1439242857 None] <== create_volume: return (1300ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:27:33 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-c4c3f7a8-f8fa-45b5-b21e-24efb4a54b82 tempest-VolumesSnapshotListTestJSON-1439242857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.303s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:27:33 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-c4c3f7a8-f8fa-45b5-b21e-24efb4a54b82 tempest-VolumesSnapshotListTestJSON-1439242857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d119a63-52b2-4974-832c-327505c133d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8a8ac9d-ef51-41f8-8b5d-04379b1eca75', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:27:33 devstack sudo[93065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-a59fa1fe-7520-4fc2-a1c1-5a21bcf43c05
Nov 03 18:27:33 devstack sudo[93065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:27:33 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-c4c3f7a8-f8fa-45b5-b21e-24efb4a54b82 tempest-VolumesSnapshotListTestJSON-1439242857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41976356-6396-4069-b522-44dfc827869d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:27:33 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-c4c3f7a8-f8fa-45b5-b21e-24efb4a54b82 tempest-VolumesSnapshotListTestJSON-1439242857 None] Volume volume-e8a8ac9d-ef51-41f8-8b5d-04379b1eca75 (e8a8ac9d-ef51-41f8-8b5d-04379b1eca75): created successfully
Nov 03 18:27:33 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-c4c3f7a8-f8fa-45b5-b21e-24efb4a54b82 tempest-VolumesSnapshotListTestJSON-1439242857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41976356-6396-4069-b522-44dfc827869d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:27:33 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-c4c3f7a8-f8fa-45b5-b21e-24efb4a54b82 tempest-VolumesSnapshotListTestJSON-1439242857 None] Flow 'volume_create_manager' (9106b594-ffaf-4b6a-9a15-852be260f1ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:27:33 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-c4c3f7a8-f8fa-45b5-b21e-24efb4a54b82 tempest-VolumesSnapshotListTestJSON-1439242857 None] Created volume successfully.
Nov 03 18:27:33 devstack sudo[93058]: pam_unix(sudo:session): session closed for user root
Nov 03 18:27:33 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-941acfd4-9f5b-4531-8690-ca013fcec57f tempest-VolumesDeleteCascade-1806251197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-97991c77-d4d5-4e22-a3cf-2fb233a850e6.910776ee-e943-4ee7-a291-10a10e01ea9e" returned: 0 in 0.515s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:27:33 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-941acfd4-9f5b-4531-8690-ca013fcec57f tempest-VolumesDeleteCascade-1806251197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-97991c77-d4d5-4e22-a3cf-2fb233a850e6.910776ee-e943-4ee7-a291-10a10e01ea9e {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:27:33 devstack sudo[93070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-97991c77-d4d5-4e22-a3cf-2fb233a850e6.910776ee-e943-4ee7-a291-10a10e01ea9e
Nov 03 18:27:33 devstack sudo[93070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:27:33 devstack sudo[93065]: pam_unix(sudo:session): session closed for user root
Nov 03 18:27:33 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-0bb5a36f-4fcc-400d-a785-189c1a2febc8 tempest-ServerRescueNegativeTestJSON-923794999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-a59fa1fe-7520-4fc2-a1c1-5a21bcf43c05" returned: 0 in 0.417s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:27:33 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-0bb5a36f-4fcc-400d-a785-189c1a2febc8 tempest-ServerRescueNegativeTestJSON-923794999 None] Lock "cinder-quobyte-a59fa1fe-7520-4fc2-a1c1-5a21bcf43c05" released by "delete_volume" :: held 1.108s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:27:33 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-0bb5a36f-4fcc-400d-a785-189c1a2febc8 tempest-ServerRescueNegativeTestJSON-923794999 None] Created reservations ['a2facdf7-0e52-4492-9761-38e0136446bf', '3eb9bbcc-51de-4b9c-8f51-2fb0ae433697', '4e32378e-6461-4a06-b518-49a404f80877', '09c1eaf5-72ae-49b8-a9ec-8f32f030458d'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:27:34 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-0bb5a36f-4fcc-400d-a785-189c1a2febc8 tempest-ServerRescueNegativeTestJSON-923794999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:27:34 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-0bb5a36f-4fcc-400d-a785-189c1a2febc8 tempest-ServerRescueNegativeTestJSON-923794999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:27:34 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-0bb5a36f-4fcc-400d-a785-189c1a2febc8 tempest-ServerRescueNegativeTestJSON-923794999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:27:34 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-0bb5a36f-4fcc-400d-a785-189c1a2febc8 tempest-ServerRescueNegativeTestJSON-923794999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:27:34 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-0bb5a36f-4fcc-400d-a785-189c1a2febc8 tempest-ServerRescueNegativeTestJSON-923794999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:27:34 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-0bb5a36f-4fcc-400d-a785-189c1a2febc8 tempest-ServerRescueNegativeTestJSON-923794999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:27:34 devstack sudo[93074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:27:34 devstack sudo[93074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:27:34 devstack sudo[93070]: pam_unix(sudo:session): session closed for user root
Nov 03 18:27:34 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-941acfd4-9f5b-4531-8690-ca013fcec57f tempest-VolumesDeleteCascade-1806251197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-97991c77-d4d5-4e22-a3cf-2fb233a850e6.910776ee-e943-4ee7-a291-10a10e01ea9e" returned: 0 in 0.418s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:27:34 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-941acfd4-9f5b-4531-8690-ca013fcec57f tempest-VolumesDeleteCascade-1806251197 None] Lock "cinder-quobyte-910776ee-e943-4ee7-a291-10a10e01ea9e" released by "_delete_snapshot" :: held 2.674s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:27:34 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-941acfd4-9f5b-4531-8690-ca013fcec57f tempest-VolumesDeleteCascade-1806251197 None] Lock "cinder-quobyte-97991c77-d4d5-4e22-a3cf-2fb233a850e6" released by "delete_snapshot" :: held 2.727s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:27:34 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-941acfd4-9f5b-4531-8690-ca013fcec57f tempest-VolumesDeleteCascade-1806251197 None] Created reservations ['97b63cec-02fc-444d-9aef-530651981ba8', '1cb8ddba-d09f-4905-9550-28880df5493a', 'f11c41f0-128e-41b6-92e4-82227ca23a29', '3bb236cf-97a9-415f-bd31-0f1273a65cdd'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:27:34 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-941acfd4-9f5b-4531-8690-ca013fcec57f tempest-VolumesDeleteCascade-1806251197 None] Delete snapshot completed successfully.
Nov 03 18:27:34 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-941acfd4-9f5b-4531-8690-ca013fcec57f tempest-VolumesDeleteCascade-1806251197 None] Lock "cinder-910776ee-e943-4ee7-a291-10a10e01ea9e-delete_snapshot" released by "delete_snapshot" :: held 3.061s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:27:34 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-941acfd4-9f5b-4531-8690-ca013fcec57f tempest-VolumesDeleteCascade-1806251197 None] Snapshots deleted, issuing volume delete {{(pid=86120) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Nov 03 18:27:34 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-941acfd4-9f5b-4531-8690-ca013fcec57f tempest-VolumesDeleteCascade-1806251197 None] Acquiring lock "cinder-quobyte-97991c77-d4d5-4e22-a3cf-2fb233a850e6" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:27:34 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-941acfd4-9f5b-4531-8690-ca013fcec57f tempest-VolumesDeleteCascade-1806251197 None] Lock "cinder-quobyte-97991c77-d4d5-4e22-a3cf-2fb233a850e6" acquired by "delete_volume" :: waited 0.031s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:27:34 devstack sudo[93074]: pam_unix(sudo:session): session closed for user root
Nov 03 18:27:34 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-0bb5a36f-4fcc-400d-a785-189c1a2febc8 tempest-ServerRescueNegativeTestJSON-923794999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.543s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:27:34 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-0bb5a36f-4fcc-400d-a785-189c1a2febc8 tempest-ServerRescueNegativeTestJSON-923794999 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:27:34 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-0bb5a36f-4fcc-400d-a785-189c1a2febc8 tempest-ServerRescueNegativeTestJSON-923794999 None] Deleted volume successfully.
Nov 03 18:27:34 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[60676db5-49b4-4930-842c-7145d9c0ac2a]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:27:34 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-941acfd4-9f5b-4531-8690-ca013fcec57f tempest-VolumesDeleteCascade-1806251197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-97991c77-d4d5-4e22-a3cf-2fb233a850e6 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:27:34 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-01afb62b-c2ad-4c98-b965-71fbe5fe0042 tempest-VolumesSnapshotListTestJSON-1439242857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:27:34 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-01afb62b-c2ad-4c98-b965-71fbe5fe0042 tempest-VolumesSnapshotListTestJSON-1439242857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:27:34 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-01afb62b-c2ad-4c98-b965-71fbe5fe0042 tempest-VolumesSnapshotListTestJSON-1439242857 None] Creating offline snapshot 304ef93f-86cf-4630-9e98-6ebb5226ad2f of volume e8a8ac9d-ef51-41f8-8b5d-04379b1eca75 {{(pid=86120) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 18:27:34 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-0bb5a36f-4fcc-400d-a785-189c1a2febc8 tempest-ServerRescueNegativeTestJSON-923794999 None] Lock "cinder-a59fa1fe-7520-4fc2-a1c1-5a21bcf43c05-delete_volume" released by "delete_volume" :: held 2.052s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:27:34 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[383cb8fc-4289-4633-9343-bccfb0ec1d61]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:27:34 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-01afb62b-c2ad-4c98-b965-71fbe5fe0042 tempest-VolumesSnapshotListTestJSON-1439242857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e8a8ac9d-ef51-41f8-8b5d-04379b1eca75 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:27:34 devstack sudo[93077]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-97991c77-d4d5-4e22-a3cf-2fb233a850e6
Nov 03 18:27:34 devstack sudo[93077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:27:34 devstack sudo[93078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e8a8ac9d-ef51-41f8-8b5d-04379b1eca75
Nov 03 18:27:34 devstack sudo[93078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:27:35 devstack sudo[93078]: pam_unix(sudo:session): session closed for user root
Nov 03 18:27:35 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-01afb62b-c2ad-4c98-b965-71fbe5fe0042 tempest-VolumesSnapshotListTestJSON-1439242857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e8a8ac9d-ef51-41f8-8b5d-04379b1eca75" returned: 0 in 0.733s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:27:35 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-01afb62b-c2ad-4c98-b965-71fbe5fe0042 tempest-VolumesSnapshotListTestJSON-1439242857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e8a8ac9d-ef51-41f8-8b5d-04379b1eca75,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e8a8ac9d-ef51-41f8-8b5d-04379b1eca75.304ef93f-86cf-4630-9e98-6ebb5226ad2f 1G {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:27:35 devstack sudo[93077]: pam_unix(sudo:session): session closed for user root
Nov 03 18:27:35 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-941acfd4-9f5b-4531-8690-ca013fcec57f tempest-VolumesDeleteCascade-1806251197 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-97991c77-d4d5-4e22-a3cf-2fb233a850e6" returned: 0 in 0.824s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:27:35 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-941acfd4-9f5b-4531-8690-ca013fcec57f tempest-VolumesDeleteCascade-1806251197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-97991c77-d4d5-4e22-a3cf-2fb233a850e6 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:27:35 devstack sudo[93089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e8a8ac9d-ef51-41f8-8b5d-04379b1eca75,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e8a8ac9d-ef51-41f8-8b5d-04379b1eca75.304ef93f-86cf-4630-9e98-6ebb5226ad2f 1G
Nov 03 18:27:35 devstack sudo[93089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:27:35 devstack sudo[93090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-97991c77-d4d5-4e22-a3cf-2fb233a850e6
Nov 03 18:27:35 devstack sudo[93090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:27:36 devstack sudo[93090]: pam_unix(sudo:session): session closed for user root
Nov 03 18:27:36 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-941acfd4-9f5b-4531-8690-ca013fcec57f tempest-VolumesDeleteCascade-1806251197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-97991c77-d4d5-4e22-a3cf-2fb233a850e6" returned: 0 in 0.768s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:27:36 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-941acfd4-9f5b-4531-8690-ca013fcec57f tempest-VolumesDeleteCascade-1806251197 None] Lock "cinder-quobyte-97991c77-d4d5-4e22-a3cf-2fb233a850e6" released by "delete_volume" :: held 1.753s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:27:36 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-941acfd4-9f5b-4531-8690-ca013fcec57f tempest-VolumesDeleteCascade-1806251197 None] Created reservations ['d32fee16-18f6-467c-89ef-76d646765e3d', 'e7cab264-1860-4509-8f92-b920d01699cf', 'b9a4cf1d-8b01-4a4f-a1d6-d3ede54b9f62', '06b2ef2e-5120-4e57-85c2-ad600caa3176'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:27:36 devstack sudo[93089]: pam_unix(sudo:session): session closed for user root
Nov 03 18:27:36 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-01afb62b-c2ad-4c98-b965-71fbe5fe0042 tempest-VolumesSnapshotListTestJSON-1439242857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e8a8ac9d-ef51-41f8-8b5d-04379b1eca75,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e8a8ac9d-ef51-41f8-8b5d-04379b1eca75.304ef93f-86cf-4630-9e98-6ebb5226ad2f 1G" returned: 0 in 1.241s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:27:36 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-01afb62b-c2ad-4c98-b965-71fbe5fe0042 tempest-VolumesSnapshotListTestJSON-1439242857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8a8ac9d-ef51-41f8-8b5d-04379b1eca75 -F qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e8a8ac9d-ef51-41f8-8b5d-04379b1eca75.304ef93f-86cf-4630-9e98-6ebb5226ad2f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:27:36 devstack sudo[93125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8a8ac9d-ef51-41f8-8b5d-04379b1eca75 -F qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e8a8ac9d-ef51-41f8-8b5d-04379b1eca75.304ef93f-86cf-4630-9e98-6ebb5226ad2f
Nov 03 18:27:36 devstack sudo[93125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:27:36 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-941acfd4-9f5b-4531-8690-ca013fcec57f tempest-VolumesDeleteCascade-1806251197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:27:36 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-941acfd4-9f5b-4531-8690-ca013fcec57f tempest-VolumesDeleteCascade-1806251197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:27:36 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-941acfd4-9f5b-4531-8690-ca013fcec57f tempest-VolumesDeleteCascade-1806251197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:27:36 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-941acfd4-9f5b-4531-8690-ca013fcec57f tempest-VolumesDeleteCascade-1806251197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:27:36 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-941acfd4-9f5b-4531-8690-ca013fcec57f tempest-VolumesDeleteCascade-1806251197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:27:36 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-941acfd4-9f5b-4531-8690-ca013fcec57f tempest-VolumesDeleteCascade-1806251197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:27:36 devstack sudo[93127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:27:37 devstack sudo[93127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:27:37 devstack sudo[93127]: pam_unix(sudo:session): session closed for user root
Nov 03 18:27:37 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-941acfd4-9f5b-4531-8690-ca013fcec57f tempest-VolumesDeleteCascade-1806251197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.527s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:27:37 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-941acfd4-9f5b-4531-8690-ca013fcec57f tempest-VolumesDeleteCascade-1806251197 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:27:37 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-941acfd4-9f5b-4531-8690-ca013fcec57f tempest-VolumesDeleteCascade-1806251197 None] Deleted volume successfully.
Nov 03 18:27:37 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-941acfd4-9f5b-4531-8690-ca013fcec57f tempest-VolumesDeleteCascade-1806251197 None] Lock "cinder-97991c77-d4d5-4e22-a3cf-2fb233a850e6-delete_volume" released by "delete_volume" :: held 6.192s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:27:37 devstack sudo[93125]: pam_unix(sudo:session): session closed for user root
Nov 03 18:27:37 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-01afb62b-c2ad-4c98-b965-71fbe5fe0042 tempest-VolumesSnapshotListTestJSON-1439242857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8a8ac9d-ef51-41f8-8b5d-04379b1eca75 -F qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e8a8ac9d-ef51-41f8-8b5d-04379b1eca75.304ef93f-86cf-4630-9e98-6ebb5226ad2f" returned: 0 in 0.888s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:27:37 devstack cinder-volume[86120]: WARNING cinder.volume.drivers.remotefs [None req-01afb62b-c2ad-4c98-b965-71fbe5fe0042 tempest-VolumesSnapshotListTestJSON-1439242857 None] /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e8a8ac9d-ef51-41f8-8b5d-04379b1eca75.304ef93f-86cf-4630-9e98-6ebb5226ad2f is being set with open permissions: ugo+rw
Nov 03 18:27:37 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-01afb62b-c2ad-4c98-b965-71fbe5fe0042 tempest-VolumesSnapshotListTestJSON-1439242857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e8a8ac9d-ef51-41f8-8b5d-04379b1eca75.304ef93f-86cf-4630-9e98-6ebb5226ad2f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:27:37 devstack sudo[93133]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e8a8ac9d-ef51-41f8-8b5d-04379b1eca75.304ef93f-86cf-4630-9e98-6ebb5226ad2f
Nov 03 18:27:37 devstack sudo[93133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:27:37 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-20d56d88-67d6-4caf-a4a8-d8aa1e3c469f tempest-AttachVolumeShelveTestJSON-629024950 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:27:37 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-20d56d88-67d6-4caf-a4a8-d8aa1e3c469f tempest-AttachVolumeShelveTestJSON-629024950 None] Flow 'volume_create_manager' (168cae57-ce5c-4b00-91da-4b2e4629b34a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:27:37 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-20d56d88-67d6-4caf-a4a8-d8aa1e3c469f tempest-AttachVolumeShelveTestJSON-629024950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cb194a7-3e06-43d1-beef-d4762e4bcfea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:27:37 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-3eeb798f-cdc1-4354-86d0-5cf96965cb80 tempest-VolumesDeleteCascade-1806251197 None] Acquiring lock "cinder-84298105-9eca-45ea-be26-9028982677e1-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:27:37 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-20d56d88-67d6-4caf-a4a8-d8aa1e3c469f tempest-AttachVolumeShelveTestJSON-629024950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cb194a7-3e06-43d1-beef-d4762e4bcfea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:27:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1635622898',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=178794a7-a450-4f80-b6b1-a151864e7e1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17a1452783b64c8b9fdf3a04898ba83f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:27:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:27:38Z,use_quota=True,user_id='be3374cd751d4d119af64bddc309d8fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:27:37 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-20d56d88-67d6-4caf-a4a8-d8aa1e3c469f tempest-AttachVolumeShelveTestJSON-629024950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1440e73a-62fc-47f6-bc67-f47ee83f0b8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:27:37 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-20d56d88-67d6-4caf-a4a8-d8aa1e3c469f tempest-AttachVolumeShelveTestJSON-629024950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1440e73a-62fc-47f6-bc67-f47ee83f0b8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:27:37 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-20d56d88-67d6-4caf-a4a8-d8aa1e3c469f tempest-AttachVolumeShelveTestJSON-629024950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0069c2d1-a811-49a2-ae3c-a770c8ff36df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:27:38 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-20d56d88-67d6-4caf-a4a8-d8aa1e3c469f tempest-AttachVolumeShelveTestJSON-629024950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0069c2d1-a811-49a2-ae3c-a770c8ff36df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '178794a7-a450-4f80-b6b1-a151864e7e1e', 'volume_name': 'volume-178794a7-a450-4f80-b6b1-a151864e7e1e', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:27:38 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-20d56d88-67d6-4caf-a4a8-d8aa1e3c469f tempest-AttachVolumeShelveTestJSON-629024950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0fe544d-154e-48b4-81cc-af9b91cf34d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:27:38 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-20d56d88-67d6-4caf-a4a8-d8aa1e3c469f tempest-AttachVolumeShelveTestJSON-629024950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0fe544d-154e-48b4-81cc-af9b91cf34d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:27:38 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-20d56d88-67d6-4caf-a4a8-d8aa1e3c469f tempest-AttachVolumeShelveTestJSON-629024950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54f105fd-ca55-4227-9eb2-1325a4568b6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:27:38 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-20d56d88-67d6-4caf-a4a8-d8aa1e3c469f tempest-AttachVolumeShelveTestJSON-629024950 None] Volume 178794a7-a450-4f80-b6b1-a151864e7e1e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-178794a7-a450-4f80-b6b1-a151864e7e1e', 'volume_size': 1}
Nov 03 18:27:38 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-20d56d88-67d6-4caf-a4a8-d8aa1e3c469f tempest-AttachVolumeShelveTestJSON-629024950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:27:38 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-3eeb798f-cdc1-4354-86d0-5cf96965cb80 tempest-VolumesDeleteCascade-1806251197 None] Lock "cinder-84298105-9eca-45ea-be26-9028982677e1-delete_volume" acquired by "delete_volume" :: waited 0.112s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:27:38 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-3eeb798f-cdc1-4354-86d0-5cf96965cb80 tempest-VolumesDeleteCascade-1806251197 None] Acquiring lock "cinder-quobyte-84298105-9eca-45ea-be26-9028982677e1" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:27:38 devstack sudo[93133]: pam_unix(sudo:session): session closed for user root
Nov 03 18:27:38 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-01afb62b-c2ad-4c98-b965-71fbe5fe0042 tempest-VolumesSnapshotListTestJSON-1439242857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e8a8ac9d-ef51-41f8-8b5d-04379b1eca75.304ef93f-86cf-4630-9e98-6ebb5226ad2f" returned: 0 in 0.526s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:27:38 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-3eeb798f-cdc1-4354-86d0-5cf96965cb80 tempest-VolumesDeleteCascade-1806251197 None] Lock "cinder-quobyte-84298105-9eca-45ea-be26-9028982677e1" acquired by "delete_volume" :: waited 0.045s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:27:38 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b062342-22b0-46d3-a51b-30f8a7d0af12]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:27:38 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-3eeb798f-cdc1-4354-86d0-5cf96965cb80 tempest-VolumesDeleteCascade-1806251197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-84298105-9eca-45ea-be26-9028982677e1 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:27:38 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-01afb62b-c2ad-4c98-b965-71fbe5fe0042 tempest-VolumesSnapshotListTestJSON-1439242857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e8a8ac9d-ef51-41f8-8b5d-04379b1eca75.info {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:27:38 devstack sudo[93139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e8a8ac9d-ef51-41f8-8b5d-04379b1eca75.info
Nov 03 18:27:38 devstack sudo[93139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:27:38 devstack sudo[93138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-84298105-9eca-45ea-be26-9028982677e1
Nov 03 18:27:38 devstack sudo[93138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:27:38 devstack sudo[93139]: pam_unix(sudo:session): session closed for user root
Nov 03 18:27:38 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-01afb62b-c2ad-4c98-b965-71fbe5fe0042 tempest-VolumesSnapshotListTestJSON-1439242857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e8a8ac9d-ef51-41f8-8b5d-04379b1eca75.info" returned: 0 in 0.404s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:27:38 devstack cinder-volume[86120]: WARNING cinder.volume.drivers.remotefs [None req-01afb62b-c2ad-4c98-b965-71fbe5fe0042 tempest-VolumesSnapshotListTestJSON-1439242857 None] /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e8a8ac9d-ef51-41f8-8b5d-04379b1eca75.info is being set with open permissions: ugo+rw
Nov 03 18:27:38 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-01afb62b-c2ad-4c98-b965-71fbe5fe0042 tempest-VolumesSnapshotListTestJSON-1439242857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e8a8ac9d-ef51-41f8-8b5d-04379b1eca75.info {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:27:38 devstack sudo[93138]: pam_unix(sudo:session): session closed for user root
Nov 03 18:27:38 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-3eeb798f-cdc1-4354-86d0-5cf96965cb80 tempest-VolumesDeleteCascade-1806251197 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-84298105-9eca-45ea-be26-9028982677e1" returned: 0 in 0.469s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:27:38 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-3eeb798f-cdc1-4354-86d0-5cf96965cb80 tempest-VolumesDeleteCascade-1806251197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-84298105-9eca-45ea-be26-9028982677e1 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:27:38 devstack sudo[93147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e8a8ac9d-ef51-41f8-8b5d-04379b1eca75.info
Nov 03 18:27:38 devstack sudo[93147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:27:38 devstack sudo[93148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-84298105-9eca-45ea-be26-9028982677e1
Nov 03 18:27:38 devstack sudo[93148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:27:38 devstack sudo[93148]: pam_unix(sudo:session): session closed for user root
Nov 03 18:27:38 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-3eeb798f-cdc1-4354-86d0-5cf96965cb80 tempest-VolumesDeleteCascade-1806251197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-84298105-9eca-45ea-be26-9028982677e1" returned: 0 in 0.251s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:27:38 devstack sudo[93147]: pam_unix(sudo:session): session closed for user root
Nov 03 18:27:38 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-3eeb798f-cdc1-4354-86d0-5cf96965cb80 tempest-VolumesDeleteCascade-1806251197 None] Lock "cinder-quobyte-84298105-9eca-45ea-be26-9028982677e1" released by "delete_volume" :: held 0.800s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:27:38 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-01afb62b-c2ad-4c98-b965-71fbe5fe0042 tempest-VolumesSnapshotListTestJSON-1439242857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e8a8ac9d-ef51-41f8-8b5d-04379b1eca75.info" returned: 0 in 0.317s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:27:38 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-01afb62b-c2ad-4c98-b965-71fbe5fe0042 tempest-VolumesSnapshotListTestJSON-1439242857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.295s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:27:38 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-20d56d88-67d6-4caf-a4a8-d8aa1e3c469f tempest-AttachVolumeShelveTestJSON-629024950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.956s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:27:38 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-20d56d88-67d6-4caf-a4a8-d8aa1e3c469f tempest-AttachVolumeShelveTestJSON-629024950 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:27:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1635622898',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=178794a7-a450-4f80-b6b1-a151864e7e1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17a1452783b64c8b9fdf3a04898ba83f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:27:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:27:38Z,use_quota=True,user_id='be3374cd751d4d119af64bddc309d8fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:27:38 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-20d56d88-67d6-4caf-a4a8-d8aa1e3c469f tempest-AttachVolumeShelveTestJSON-629024950 None] Creating volume 178794a7-a450-4f80-b6b1-a151864e7e1e {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:27:38 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-20d56d88-67d6-4caf-a4a8-d8aa1e3c469f tempest-AttachVolumeShelveTestJSON-629024950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:27:39 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-20d56d88-67d6-4caf-a4a8-d8aa1e3c469f tempest-AttachVolumeShelveTestJSON-629024950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:27:39 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-20d56d88-67d6-4caf-a4a8-d8aa1e3c469f tempest-AttachVolumeShelveTestJSON-629024950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:27:39 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-20d56d88-67d6-4caf-a4a8-d8aa1e3c469f tempest-AttachVolumeShelveTestJSON-629024950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:27:39 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-20d56d88-67d6-4caf-a4a8-d8aa1e3c469f tempest-AttachVolumeShelveTestJSON-629024950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:27:39 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-20d56d88-67d6-4caf-a4a8-d8aa1e3c469f tempest-AttachVolumeShelveTestJSON-629024950 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:27:39 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-20d56d88-67d6-4caf-a4a8-d8aa1e3c469f tempest-AttachVolumeShelveTestJSON-629024950 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:27:39 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-20d56d88-67d6-4caf-a4a8-d8aa1e3c469f tempest-AttachVolumeShelveTestJSON-629024950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-178794a7-a450-4f80-b6b1-a151864e7e1e 1073741824 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:27:39 devstack sudo[93153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-178794a7-a450-4f80-b6b1-a151864e7e1e 1073741824
Nov 03 18:27:39 devstack sudo[93153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:27:39 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-01afb62b-c2ad-4c98-b965-71fbe5fe0042 tempest-VolumesSnapshotListTestJSON-1439242857 None] Create snapshot completed successfully
Nov 03 18:27:39 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-3eeb798f-cdc1-4354-86d0-5cf96965cb80 tempest-VolumesDeleteCascade-1806251197 None] Created reservations ['625c5b6e-772b-480c-acd1-6994d5905abd', '72a51330-4d8a-4c02-9a43-566675723952', '957dbcdf-2bbc-4d0f-bc3f-d6ac681c4c7b', 'dd0a4194-b61d-452d-bfd6-17c197ee4aa9'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:27:39 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-3eeb798f-cdc1-4354-86d0-5cf96965cb80 tempest-VolumesDeleteCascade-1806251197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:27:39 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-3eeb798f-cdc1-4354-86d0-5cf96965cb80 tempest-VolumesDeleteCascade-1806251197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:27:39 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-3eeb798f-cdc1-4354-86d0-5cf96965cb80 tempest-VolumesDeleteCascade-1806251197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:27:39 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-3eeb798f-cdc1-4354-86d0-5cf96965cb80 tempest-VolumesDeleteCascade-1806251197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:27:39 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-3eeb798f-cdc1-4354-86d0-5cf96965cb80 tempest-VolumesDeleteCascade-1806251197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:27:39 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-3eeb798f-cdc1-4354-86d0-5cf96965cb80 tempest-VolumesDeleteCascade-1806251197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:27:39 devstack sudo[93158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:27:39 devstack sudo[93158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:27:39 devstack sudo[93158]: pam_unix(sudo:session): session closed for user root
Nov 03 18:27:39 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-3eeb798f-cdc1-4354-86d0-5cf96965cb80 tempest-VolumesDeleteCascade-1806251197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.296s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:27:39 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-3eeb798f-cdc1-4354-86d0-5cf96965cb80 tempest-VolumesDeleteCascade-1806251197 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:27:39 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-3eeb798f-cdc1-4354-86d0-5cf96965cb80 tempest-VolumesDeleteCascade-1806251197 None] Deleted volume successfully.
Nov 03 18:27:39 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-3eeb798f-cdc1-4354-86d0-5cf96965cb80 tempest-VolumesDeleteCascade-1806251197 None] Lock "cinder-84298105-9eca-45ea-be26-9028982677e1-delete_volume" released by "delete_volume" :: held 1.661s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:27:39 devstack sudo[93153]: pam_unix(sudo:session): session closed for user root
Nov 03 18:27:39 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-20d56d88-67d6-4caf-a4a8-d8aa1e3c469f tempest-AttachVolumeShelveTestJSON-629024950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-178794a7-a450-4f80-b6b1-a151864e7e1e 1073741824" returned: 0 in 0.745s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:27:39 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-20d56d88-67d6-4caf-a4a8-d8aa1e3c469f tempest-AttachVolumeShelveTestJSON-629024950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-178794a7-a450-4f80-b6b1-a151864e7e1e {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:27:39 devstack sudo[93184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-178794a7-a450-4f80-b6b1-a151864e7e1e
Nov 03 18:27:39 devstack sudo[93184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:27:40 devstack sudo[93184]: pam_unix(sudo:session): session closed for user root
Nov 03 18:27:40 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-20d56d88-67d6-4caf-a4a8-d8aa1e3c469f tempest-AttachVolumeShelveTestJSON-629024950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-178794a7-a450-4f80-b6b1-a151864e7e1e" returned: 0 in 0.303s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:27:40 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-20d56d88-67d6-4caf-a4a8-d8aa1e3c469f tempest-AttachVolumeShelveTestJSON-629024950 None] <== create_volume: return (1097ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:27:40 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-20d56d88-67d6-4caf-a4a8-d8aa1e3c469f tempest-AttachVolumeShelveTestJSON-629024950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.105s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:27:40 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-20d56d88-67d6-4caf-a4a8-d8aa1e3c469f tempest-AttachVolumeShelveTestJSON-629024950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54f105fd-ca55-4227-9eb2-1325a4568b6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-178794a7-a450-4f80-b6b1-a151864e7e1e', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:27:40 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-20d56d88-67d6-4caf-a4a8-d8aa1e3c469f tempest-AttachVolumeShelveTestJSON-629024950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76a1a2ee-2210-4423-a7e4-26fa4bee0936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:27:40 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-20d56d88-67d6-4caf-a4a8-d8aa1e3c469f tempest-AttachVolumeShelveTestJSON-629024950 None] Volume volume-178794a7-a450-4f80-b6b1-a151864e7e1e (178794a7-a450-4f80-b6b1-a151864e7e1e): created successfully
Nov 03 18:27:40 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-20d56d88-67d6-4caf-a4a8-d8aa1e3c469f tempest-AttachVolumeShelveTestJSON-629024950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76a1a2ee-2210-4423-a7e4-26fa4bee0936) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:27:40 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-20d56d88-67d6-4caf-a4a8-d8aa1e3c469f tempest-AttachVolumeShelveTestJSON-629024950 None] Flow 'volume_create_manager' (168cae57-ce5c-4b00-91da-4b2e4629b34a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:27:40 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-20d56d88-67d6-4caf-a4a8-d8aa1e3c469f tempest-AttachVolumeShelveTestJSON-629024950 None] Created volume successfully.
Nov 03 18:27:40 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-51870d0d-38e7-4a4d-872b-3168e4e86d36 tempest-VolumesSnapshotListTestJSON-1439242857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:27:40 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-51870d0d-38e7-4a4d-872b-3168e4e86d36 tempest-VolumesSnapshotListTestJSON-1439242857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:27:40 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-51870d0d-38e7-4a4d-872b-3168e4e86d36 tempest-VolumesSnapshotListTestJSON-1439242857 None] Creating offline snapshot 4da7d60f-e62a-4947-9d82-4a8acf964a45 of volume e8a8ac9d-ef51-41f8-8b5d-04379b1eca75 {{(pid=86120) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 18:27:40 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[166e2d88-6470-4608-b834-da518ae615c0]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:27:40 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-51870d0d-38e7-4a4d-872b-3168e4e86d36 tempest-VolumesSnapshotListTestJSON-1439242857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e8a8ac9d-ef51-41f8-8b5d-04379b1eca75.304ef93f-86cf-4630-9e98-6ebb5226ad2f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:27:40 devstack sudo[93189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e8a8ac9d-ef51-41f8-8b5d-04379b1eca75.304ef93f-86cf-4630-9e98-6ebb5226ad2f
Nov 03 18:27:40 devstack sudo[93189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:27:40 devstack sudo[93189]: pam_unix(sudo:session): session closed for user root
Nov 03 18:27:40 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-51870d0d-38e7-4a4d-872b-3168e4e86d36 tempest-VolumesSnapshotListTestJSON-1439242857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e8a8ac9d-ef51-41f8-8b5d-04379b1eca75.304ef93f-86cf-4630-9e98-6ebb5226ad2f" returned: 0 in 0.536s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:27:40 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-51870d0d-38e7-4a4d-872b-3168e4e86d36 tempest-VolumesSnapshotListTestJSON-1439242857 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e8a8ac9d-ef51-41f8-8b5d-04379b1eca75(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86120) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 18:27:40 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-51870d0d-38e7-4a4d-872b-3168e4e86d36 tempest-VolumesSnapshotListTestJSON-1439242857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e8a8ac9d-ef51-41f8-8b5d-04379b1eca75.304ef93f-86cf-4630-9e98-6ebb5226ad2f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e8a8ac9d-ef51-41f8-8b5d-04379b1eca75.4da7d60f-e62a-4947-9d82-4a8acf964a45 1G {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:27:40 devstack sudo[93199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e8a8ac9d-ef51-41f8-8b5d-04379b1eca75.304ef93f-86cf-4630-9e98-6ebb5226ad2f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e8a8ac9d-ef51-41f8-8b5d-04379b1eca75.4da7d60f-e62a-4947-9d82-4a8acf964a45 1G
Nov 03 18:27:40 devstack sudo[93199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:27:41 devstack sudo[93199]: pam_unix(sudo:session): session closed for user root
Nov 03 18:27:41 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-51870d0d-38e7-4a4d-872b-3168e4e86d36 tempest-VolumesSnapshotListTestJSON-1439242857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e8a8ac9d-ef51-41f8-8b5d-04379b1eca75.304ef93f-86cf-4630-9e98-6ebb5226ad2f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e8a8ac9d-ef51-41f8-8b5d-04379b1eca75.4da7d60f-e62a-4947-9d82-4a8acf964a45 1G" returned: 0 in 0.630s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:27:41 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-51870d0d-38e7-4a4d-872b-3168e4e86d36 tempest-VolumesSnapshotListTestJSON-1439242857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8a8ac9d-ef51-41f8-8b5d-04379b1eca75.304ef93f-86cf-4630-9e98-6ebb5226ad2f -F qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e8a8ac9d-ef51-41f8-8b5d-04379b1eca75.4da7d60f-e62a-4947-9d82-4a8acf964a45 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:27:41 devstack sudo[93207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8a8ac9d-ef51-41f8-8b5d-04379b1eca75.304ef93f-86cf-4630-9e98-6ebb5226ad2f -F qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e8a8ac9d-ef51-41f8-8b5d-04379b1eca75.4da7d60f-e62a-4947-9d82-4a8acf964a45
Nov 03 18:27:41 devstack sudo[93207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:27:41 devstack sudo[93207]: pam_unix(sudo:session): session closed for user root
Nov 03 18:27:41 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-51870d0d-38e7-4a4d-872b-3168e4e86d36 tempest-VolumesSnapshotListTestJSON-1439242857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8a8ac9d-ef51-41f8-8b5d-04379b1eca75.304ef93f-86cf-4630-9e98-6ebb5226ad2f -F qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e8a8ac9d-ef51-41f8-8b5d-04379b1eca75.4da7d60f-e62a-4947-9d82-4a8acf964a45" returned: 0 in 0.384s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:27:41 devstack cinder-volume[86120]: WARNING cinder.volume.drivers.remotefs [None req-51870d0d-38e7-4a4d-872b-3168e4e86d36 tempest-VolumesSnapshotListTestJSON-1439242857 None] /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e8a8ac9d-ef51-41f8-8b5d-04379b1eca75.4da7d60f-e62a-4947-9d82-4a8acf964a45 is being set with open permissions: ugo+rw
Nov 03 18:27:41 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-51870d0d-38e7-4a4d-872b-3168e4e86d36 tempest-VolumesSnapshotListTestJSON-1439242857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e8a8ac9d-ef51-41f8-8b5d-04379b1eca75.4da7d60f-e62a-4947-9d82-4a8acf964a45 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:27:42 devstack sudo[93213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e8a8ac9d-ef51-41f8-8b5d-04379b1eca75.4da7d60f-e62a-4947-9d82-4a8acf964a45
Nov 03 18:27:42 devstack sudo[93213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:27:42 devstack sudo[93213]: pam_unix(sudo:session): session closed for user root
Nov 03 18:27:42 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-51870d0d-38e7-4a4d-872b-3168e4e86d36 tempest-VolumesSnapshotListTestJSON-1439242857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e8a8ac9d-ef51-41f8-8b5d-04379b1eca75.4da7d60f-e62a-4947-9d82-4a8acf964a45" returned: 0 in 0.300s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:27:42 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-51870d0d-38e7-4a4d-872b-3168e4e86d36 tempest-VolumesSnapshotListTestJSON-1439242857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.996s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:27:42 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-51870d0d-38e7-4a4d-872b-3168e4e86d36 tempest-VolumesSnapshotListTestJSON-1439242857 None] Create snapshot completed successfully
Nov 03 18:27:43 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-d66e2339-ca17-4d4e-9d4a-9167de362ad3 tempest-VolumesSnapshotListTestJSON-1439242857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:27:43 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-d66e2339-ca17-4d4e-9d4a-9167de362ad3 tempest-VolumesSnapshotListTestJSON-1439242857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:27:43 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-d66e2339-ca17-4d4e-9d4a-9167de362ad3 tempest-VolumesSnapshotListTestJSON-1439242857 None] Creating offline snapshot 2ccea956-db71-4a4d-b7ed-bcb0b9e1c72d of volume e8a8ac9d-ef51-41f8-8b5d-04379b1eca75 {{(pid=86120) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 18:27:43 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bf12aa6-3038-4738-8d2b-ab97c5848349]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:27:43 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-d66e2339-ca17-4d4e-9d4a-9167de362ad3 tempest-VolumesSnapshotListTestJSON-1439242857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e8a8ac9d-ef51-41f8-8b5d-04379b1eca75.4da7d60f-e62a-4947-9d82-4a8acf964a45 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:27:44 devstack sudo[93229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e8a8ac9d-ef51-41f8-8b5d-04379b1eca75.4da7d60f-e62a-4947-9d82-4a8acf964a45
Nov 03 18:27:44 devstack sudo[93229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:27:44 devstack sudo[93229]: pam_unix(sudo:session): session closed for user root
Nov 03 18:27:44 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-d66e2339-ca17-4d4e-9d4a-9167de362ad3 tempest-VolumesSnapshotListTestJSON-1439242857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e8a8ac9d-ef51-41f8-8b5d-04379b1eca75.4da7d60f-e62a-4947-9d82-4a8acf964a45" returned: 0 in 0.551s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:27:44 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-d66e2339-ca17-4d4e-9d4a-9167de362ad3 tempest-VolumesSnapshotListTestJSON-1439242857 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e8a8ac9d-ef51-41f8-8b5d-04379b1eca75(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86120) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 18:27:44 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-d66e2339-ca17-4d4e-9d4a-9167de362ad3 tempest-VolumesSnapshotListTestJSON-1439242857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e8a8ac9d-ef51-41f8-8b5d-04379b1eca75.4da7d60f-e62a-4947-9d82-4a8acf964a45,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e8a8ac9d-ef51-41f8-8b5d-04379b1eca75.2ccea956-db71-4a4d-b7ed-bcb0b9e1c72d 1G {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:27:44 devstack sudo[93235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e8a8ac9d-ef51-41f8-8b5d-04379b1eca75.4da7d60f-e62a-4947-9d82-4a8acf964a45,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e8a8ac9d-ef51-41f8-8b5d-04379b1eca75.2ccea956-db71-4a4d-b7ed-bcb0b9e1c72d 1G
Nov 03 18:27:44 devstack sudo[93235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:27:45 devstack sudo[93235]: pam_unix(sudo:session): session closed for user root
Nov 03 18:27:45 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-d66e2339-ca17-4d4e-9d4a-9167de362ad3 tempest-VolumesSnapshotListTestJSON-1439242857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e8a8ac9d-ef51-41f8-8b5d-04379b1eca75.4da7d60f-e62a-4947-9d82-4a8acf964a45,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e8a8ac9d-ef51-41f8-8b5d-04379b1eca75.2ccea956-db71-4a4d-b7ed-bcb0b9e1c72d 1G" returned: 0 in 0.644s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:27:45 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-d66e2339-ca17-4d4e-9d4a-9167de362ad3 tempest-VolumesSnapshotListTestJSON-1439242857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8a8ac9d-ef51-41f8-8b5d-04379b1eca75.4da7d60f-e62a-4947-9d82-4a8acf964a45 -F qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e8a8ac9d-ef51-41f8-8b5d-04379b1eca75.2ccea956-db71-4a4d-b7ed-bcb0b9e1c72d {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:27:45 devstack sudo[93241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8a8ac9d-ef51-41f8-8b5d-04379b1eca75.4da7d60f-e62a-4947-9d82-4a8acf964a45 -F qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e8a8ac9d-ef51-41f8-8b5d-04379b1eca75.2ccea956-db71-4a4d-b7ed-bcb0b9e1c72d
Nov 03 18:27:45 devstack sudo[93241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:27:45 devstack sudo[93241]: pam_unix(sudo:session): session closed for user root
Nov 03 18:27:45 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-d66e2339-ca17-4d4e-9d4a-9167de362ad3 tempest-VolumesSnapshotListTestJSON-1439242857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8a8ac9d-ef51-41f8-8b5d-04379b1eca75.4da7d60f-e62a-4947-9d82-4a8acf964a45 -F qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e8a8ac9d-ef51-41f8-8b5d-04379b1eca75.2ccea956-db71-4a4d-b7ed-bcb0b9e1c72d" returned: 0 in 0.378s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:27:45 devstack cinder-volume[86120]: WARNING cinder.volume.drivers.remotefs [None req-d66e2339-ca17-4d4e-9d4a-9167de362ad3 tempest-VolumesSnapshotListTestJSON-1439242857 None] /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e8a8ac9d-ef51-41f8-8b5d-04379b1eca75.2ccea956-db71-4a4d-b7ed-bcb0b9e1c72d is being set with open permissions: ugo+rw
Nov 03 18:27:45 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-d66e2339-ca17-4d4e-9d4a-9167de362ad3 tempest-VolumesSnapshotListTestJSON-1439242857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e8a8ac9d-ef51-41f8-8b5d-04379b1eca75.2ccea956-db71-4a4d-b7ed-bcb0b9e1c72d {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:27:45 devstack sudo[93246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e8a8ac9d-ef51-41f8-8b5d-04379b1eca75.2ccea956-db71-4a4d-b7ed-bcb0b9e1c72d
Nov 03 18:27:45 devstack sudo[93246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:27:45 devstack sudo[93246]: pam_unix(sudo:session): session closed for user root
Nov 03 18:27:45 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-d66e2339-ca17-4d4e-9d4a-9167de362ad3 tempest-VolumesSnapshotListTestJSON-1439242857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e8a8ac9d-ef51-41f8-8b5d-04379b1eca75.2ccea956-db71-4a4d-b7ed-bcb0b9e1c72d" returned: 0 in 0.340s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:27:45 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-d66e2339-ca17-4d4e-9d4a-9167de362ad3 tempest-VolumesSnapshotListTestJSON-1439242857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.090s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:27:45 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-d66e2339-ca17-4d4e-9d4a-9167de362ad3 tempest-VolumesSnapshotListTestJSON-1439242857 None] Create snapshot completed successfully
Nov 03 18:27:47 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-1bd66435-6756-4ec0-bd22-ccd1969c3d81 tempest-VolumesTransfersV355Test-1165703128 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:27:47 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-1bd66435-6756-4ec0-bd22-ccd1969c3d81 tempest-VolumesTransfersV355Test-1165703128 None] Flow 'volume_create_manager' (919ce181-0b5f-4229-aa6a-9b1467bdc9be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:27:47 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-1bd66435-6756-4ec0-bd22-ccd1969c3d81 tempest-VolumesTransfersV355Test-1165703128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c7a56cf-2eaf-4f14-a3ae-5bf3f5fe3e56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:27:47 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-1bd66435-6756-4ec0-bd22-ccd1969c3d81 tempest-VolumesTransfersV355Test-1165703128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c7a56cf-2eaf-4f14-a3ae-5bf3f5fe3e56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:27:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1332974343',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ec48731-febc-4061-928e-916f11b14918,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a4594a1b292433b9e0a5a6791a58755',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:27:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:27:47Z,use_quota=True,user_id='6abdacc1c7aa417f9df4f7a0d9d5e82d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:27:47 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-1bd66435-6756-4ec0-bd22-ccd1969c3d81 tempest-VolumesTransfersV355Test-1165703128 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d218ea6c-609e-41fb-b6fb-3c0fe602dbb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:27:47 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-1bd66435-6756-4ec0-bd22-ccd1969c3d81 tempest-VolumesTransfersV355Test-1165703128 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d218ea6c-609e-41fb-b6fb-3c0fe602dbb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:27:47 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-1bd66435-6756-4ec0-bd22-ccd1969c3d81 tempest-VolumesTransfersV355Test-1165703128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee4e85c2-c82d-49d6-a5f5-6e8e185b0cf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:27:47 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-1bd66435-6756-4ec0-bd22-ccd1969c3d81 tempest-VolumesTransfersV355Test-1165703128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee4e85c2-c82d-49d6-a5f5-6e8e185b0cf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ec48731-febc-4061-928e-916f11b14918', 'volume_name': 'volume-5ec48731-febc-4061-928e-916f11b14918', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:27:47 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-1bd66435-6756-4ec0-bd22-ccd1969c3d81 tempest-VolumesTransfersV355Test-1165703128 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (680f8f4d-0b3b-4e0a-a068-56773000f76a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:27:47 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-1bd66435-6756-4ec0-bd22-ccd1969c3d81 tempest-VolumesTransfersV355Test-1165703128 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (680f8f4d-0b3b-4e0a-a068-56773000f76a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:27:47 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-1bd66435-6756-4ec0-bd22-ccd1969c3d81 tempest-VolumesTransfersV355Test-1165703128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (099540e0-6f22-4cf6-8145-5b2e6d1bb7f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:27:47 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-1bd66435-6756-4ec0-bd22-ccd1969c3d81 tempest-VolumesTransfersV355Test-1165703128 None] Volume 5ec48731-febc-4061-928e-916f11b14918: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ec48731-febc-4061-928e-916f11b14918', 'volume_size': 1}
Nov 03 18:27:47 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-1bd66435-6756-4ec0-bd22-ccd1969c3d81 tempest-VolumesTransfersV355Test-1165703128 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:27:47 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-1bd66435-6756-4ec0-bd22-ccd1969c3d81 tempest-VolumesTransfersV355Test-1165703128 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:27:47 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-1bd66435-6756-4ec0-bd22-ccd1969c3d81 tempest-VolumesTransfersV355Test-1165703128 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:27:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1332974343',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ec48731-febc-4061-928e-916f11b14918,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a4594a1b292433b9e0a5a6791a58755',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:27:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:27:47Z,use_quota=True,user_id='6abdacc1c7aa417f9df4f7a0d9d5e82d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:27:47 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-1bd66435-6756-4ec0-bd22-ccd1969c3d81 tempest-VolumesTransfersV355Test-1165703128 None] Creating volume 5ec48731-febc-4061-928e-916f11b14918 {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:27:47 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-1bd66435-6756-4ec0-bd22-ccd1969c3d81 tempest-VolumesTransfersV355Test-1165703128 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:27:47 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-1bd66435-6756-4ec0-bd22-ccd1969c3d81 tempest-VolumesTransfersV355Test-1165703128 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:27:47 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-1bd66435-6756-4ec0-bd22-ccd1969c3d81 tempest-VolumesTransfersV355Test-1165703128 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:27:47 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-1bd66435-6756-4ec0-bd22-ccd1969c3d81 tempest-VolumesTransfersV355Test-1165703128 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:27:47 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-1bd66435-6756-4ec0-bd22-ccd1969c3d81 tempest-VolumesTransfersV355Test-1165703128 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:27:47 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-1bd66435-6756-4ec0-bd22-ccd1969c3d81 tempest-VolumesTransfersV355Test-1165703128 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:27:47 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-1bd66435-6756-4ec0-bd22-ccd1969c3d81 tempest-VolumesTransfersV355Test-1165703128 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:27:47 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-1bd66435-6756-4ec0-bd22-ccd1969c3d81 tempest-VolumesTransfersV355Test-1165703128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-5ec48731-febc-4061-928e-916f11b14918 1073741824 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:27:47 devstack sudo[93249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-5ec48731-febc-4061-928e-916f11b14918 1073741824
Nov 03 18:27:47 devstack sudo[93249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:27:47 devstack sudo[93249]: pam_unix(sudo:session): session closed for user root
Nov 03 18:27:47 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-1bd66435-6756-4ec0-bd22-ccd1969c3d81 tempest-VolumesTransfersV355Test-1165703128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-5ec48731-febc-4061-928e-916f11b14918 1073741824" returned: 0 in 0.706s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:27:47 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-1bd66435-6756-4ec0-bd22-ccd1969c3d81 tempest-VolumesTransfersV355Test-1165703128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-5ec48731-febc-4061-928e-916f11b14918 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:27:47 devstack sudo[93257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-5ec48731-febc-4061-928e-916f11b14918
Nov 03 18:27:47 devstack sudo[93257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:27:48 devstack sudo[93257]: pam_unix(sudo:session): session closed for user root
Nov 03 18:27:48 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-1bd66435-6756-4ec0-bd22-ccd1969c3d81 tempest-VolumesTransfersV355Test-1165703128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-5ec48731-febc-4061-928e-916f11b14918" returned: 0 in 0.363s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:27:48 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-1bd66435-6756-4ec0-bd22-ccd1969c3d81 tempest-VolumesTransfersV355Test-1165703128 None] <== create_volume: return (1142ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:27:48 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-1bd66435-6756-4ec0-bd22-ccd1969c3d81 tempest-VolumesTransfersV355Test-1165703128 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.146s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:27:48 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-1bd66435-6756-4ec0-bd22-ccd1969c3d81 tempest-VolumesTransfersV355Test-1165703128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (099540e0-6f22-4cf6-8145-5b2e6d1bb7f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ec48731-febc-4061-928e-916f11b14918', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:27:48 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-1bd66435-6756-4ec0-bd22-ccd1969c3d81 tempest-VolumesTransfersV355Test-1165703128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ced0fc2-75c9-4077-89cf-d9128f43a707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:27:48 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-1bd66435-6756-4ec0-bd22-ccd1969c3d81 tempest-VolumesTransfersV355Test-1165703128 None] Volume volume-5ec48731-febc-4061-928e-916f11b14918 (5ec48731-febc-4061-928e-916f11b14918): created successfully
Nov 03 18:27:48 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-1bd66435-6756-4ec0-bd22-ccd1969c3d81 tempest-VolumesTransfersV355Test-1165703128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ced0fc2-75c9-4077-89cf-d9128f43a707) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:27:48 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-1bd66435-6756-4ec0-bd22-ccd1969c3d81 tempest-VolumesTransfersV355Test-1165703128 None] Flow 'volume_create_manager' (919ce181-0b5f-4229-aa6a-9b1467bdc9be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:27:48 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-1bd66435-6756-4ec0-bd22-ccd1969c3d81 tempest-VolumesTransfersV355Test-1165703128 None] Created volume successfully.
Nov 03 18:27:48 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-e73bb829-9fa4-425d-acc6-e2ee4579a2e8 tempest-VolumesSnapshotListTestJSON-1439242857 None] Acquiring lock "cinder-2ccea956-db71-4a4d-b7ed-bcb0b9e1c72d-delete_snapshot" by "delete_snapshot" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:27:48 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-e73bb829-9fa4-425d-acc6-e2ee4579a2e8 tempest-VolumesSnapshotListTestJSON-1439242857 None] Lock "cinder-2ccea956-db71-4a4d-b7ed-bcb0b9e1c72d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:27:48 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-e73bb829-9fa4-425d-acc6-e2ee4579a2e8 tempest-VolumesSnapshotListTestJSON-1439242857 None] Acquiring lock "cinder-quobyte-e8a8ac9d-ef51-41f8-8b5d-04379b1eca75" by "delete_snapshot" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:27:48 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-e73bb829-9fa4-425d-acc6-e2ee4579a2e8 tempest-VolumesSnapshotListTestJSON-1439242857 None] Lock "cinder-quobyte-e8a8ac9d-ef51-41f8-8b5d-04379b1eca75" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:27:48 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-e73bb829-9fa4-425d-acc6-e2ee4579a2e8 tempest-VolumesSnapshotListTestJSON-1439242857 None] Acquiring lock "cinder-quobyte-2ccea956-db71-4a4d-b7ed-bcb0b9e1c72d" by "_delete_snapshot" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:27:48 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-e73bb829-9fa4-425d-acc6-e2ee4579a2e8 tempest-VolumesSnapshotListTestJSON-1439242857 None] Lock "cinder-quobyte-2ccea956-db71-4a4d-b7ed-bcb0b9e1c72d" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:27:48 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-e73bb829-9fa4-425d-acc6-e2ee4579a2e8 tempest-VolumesSnapshotListTestJSON-1439242857 None] Deleting offline snapshot 2ccea956-db71-4a4d-b7ed-bcb0b9e1c72d of volume e8a8ac9d-ef51-41f8-8b5d-04379b1eca75 {{(pid=86120) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 18:27:48 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-e73bb829-9fa4-425d-acc6-e2ee4579a2e8 tempest-VolumesSnapshotListTestJSON-1439242857 None] snapshot_file for this snap is: volume-e8a8ac9d-ef51-41f8-8b5d-04379b1eca75.2ccea956-db71-4a4d-b7ed-bcb0b9e1c72d {{(pid=86120) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 18:27:48 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd2f10dd-22ba-445b-a618-36e9011b6d9f]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:27:48 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-e73bb829-9fa4-425d-acc6-e2ee4579a2e8 tempest-VolumesSnapshotListTestJSON-1439242857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e8a8ac9d-ef51-41f8-8b5d-04379b1eca75.2ccea956-db71-4a4d-b7ed-bcb0b9e1c72d {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:27:48 devstack sudo[93261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e8a8ac9d-ef51-41f8-8b5d-04379b1eca75.2ccea956-db71-4a4d-b7ed-bcb0b9e1c72d
Nov 03 18:27:48 devstack sudo[93261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:27:49 devstack sudo[93261]: pam_unix(sudo:session): session closed for user root
Nov 03 18:27:49 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-e73bb829-9fa4-425d-acc6-e2ee4579a2e8 tempest-VolumesSnapshotListTestJSON-1439242857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e8a8ac9d-ef51-41f8-8b5d-04379b1eca75.2ccea956-db71-4a4d-b7ed-bcb0b9e1c72d" returned: 0 in 0.484s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:27:49 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-e73bb829-9fa4-425d-acc6-e2ee4579a2e8 tempest-VolumesSnapshotListTestJSON-1439242857 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e8a8ac9d-ef51-41f8-8b5d-04379b1eca75(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86120) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 18:27:49 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3d34072-2867-46f1-8393-fc1a89aab37b]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:27:49 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-e73bb829-9fa4-425d-acc6-e2ee4579a2e8 tempest-VolumesSnapshotListTestJSON-1439242857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e8a8ac9d-ef51-41f8-8b5d-04379b1eca75.4da7d60f-e62a-4947-9d82-4a8acf964a45 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:27:49 devstack sudo[93268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e8a8ac9d-ef51-41f8-8b5d-04379b1eca75.4da7d60f-e62a-4947-9d82-4a8acf964a45
Nov 03 18:27:49 devstack sudo[93268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:27:49 devstack sudo[93268]: pam_unix(sudo:session): session closed for user root
Nov 03 18:27:49 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-e73bb829-9fa4-425d-acc6-e2ee4579a2e8 tempest-VolumesSnapshotListTestJSON-1439242857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e8a8ac9d-ef51-41f8-8b5d-04379b1eca75.4da7d60f-e62a-4947-9d82-4a8acf964a45" returned: 0 in 0.646s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:27:49 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-e73bb829-9fa4-425d-acc6-e2ee4579a2e8 tempest-VolumesSnapshotListTestJSON-1439242857 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e8a8ac9d-ef51-41f8-8b5d-04379b1eca75(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86120) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 18:27:49 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-e73bb829-9fa4-425d-acc6-e2ee4579a2e8 tempest-VolumesSnapshotListTestJSON-1439242857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e8a8ac9d-ef51-41f8-8b5d-04379b1eca75.2ccea956-db71-4a4d-b7ed-bcb0b9e1c72d {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:27:49 devstack sudo[93291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e8a8ac9d-ef51-41f8-8b5d-04379b1eca75.2ccea956-db71-4a4d-b7ed-bcb0b9e1c72d
Nov 03 18:27:49 devstack sudo[93291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:27:50 devstack sudo[93291]: pam_unix(sudo:session): session closed for user root
Nov 03 18:27:50 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-e73bb829-9fa4-425d-acc6-e2ee4579a2e8 tempest-VolumesSnapshotListTestJSON-1439242857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e8a8ac9d-ef51-41f8-8b5d-04379b1eca75.2ccea956-db71-4a4d-b7ed-bcb0b9e1c72d" returned: 0 in 0.620s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:27:50 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-e73bb829-9fa4-425d-acc6-e2ee4579a2e8 tempest-VolumesSnapshotListTestJSON-1439242857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e8a8ac9d-ef51-41f8-8b5d-04379b1eca75.2ccea956-db71-4a4d-b7ed-bcb0b9e1c72d {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:27:50 devstack sudo[93298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e8a8ac9d-ef51-41f8-8b5d-04379b1eca75.2ccea956-db71-4a4d-b7ed-bcb0b9e1c72d
Nov 03 18:27:50 devstack sudo[93298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:27:50 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-b44e5b6f-042e-4551-88f6-a0f12d1babcb tempest-VolumesTransfersV355Test-416609329 None] Transfer volume completed successfully.
Nov 03 18:27:50 devstack sudo[93298]: pam_unix(sudo:session): session closed for user root
Nov 03 18:27:50 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-e73bb829-9fa4-425d-acc6-e2ee4579a2e8 tempest-VolumesSnapshotListTestJSON-1439242857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e8a8ac9d-ef51-41f8-8b5d-04379b1eca75.2ccea956-db71-4a4d-b7ed-bcb0b9e1c72d" returned: 0 in 0.319s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:27:50 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-e73bb829-9fa4-425d-acc6-e2ee4579a2e8 tempest-VolumesSnapshotListTestJSON-1439242857 None] Lock "cinder-quobyte-2ccea956-db71-4a4d-b7ed-bcb0b9e1c72d" released by "_delete_snapshot" :: held 2.210s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:27:50 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-e73bb829-9fa4-425d-acc6-e2ee4579a2e8 tempest-VolumesSnapshotListTestJSON-1439242857 None] Lock "cinder-quobyte-e8a8ac9d-ef51-41f8-8b5d-04379b1eca75" released by "delete_snapshot" :: held 2.243s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:27:50 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-e73bb829-9fa4-425d-acc6-e2ee4579a2e8 tempest-VolumesSnapshotListTestJSON-1439242857 None] Created reservations ['be42ad4d-542b-4b7f-a5ff-5c72f39457e3', '7b7ee388-1102-4b36-aa76-d2554d723e75', 'cc919724-d699-4b74-afb1-38bb8d0f7ebb', '616255bc-7a76-41ac-a60c-0556ee1a66c6'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:27:51 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-e73bb829-9fa4-425d-acc6-e2ee4579a2e8 tempest-VolumesSnapshotListTestJSON-1439242857 None] Delete snapshot completed successfully.
Nov 03 18:27:51 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-e73bb829-9fa4-425d-acc6-e2ee4579a2e8 tempest-VolumesSnapshotListTestJSON-1439242857 None] Lock "cinder-2ccea956-db71-4a4d-b7ed-bcb0b9e1c72d-delete_snapshot" released by "delete_snapshot" :: held 2.427s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:27:51 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-c98921e5-6f09-49a6-9314-f68ad5ac08e1 tempest-VolumesTransfersV355Test-54772842 None] Acquiring lock "cinder-5ec48731-febc-4061-928e-916f11b14918-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:27:51 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-c98921e5-6f09-49a6-9314-f68ad5ac08e1 tempest-VolumesTransfersV355Test-54772842 None] Lock "cinder-5ec48731-febc-4061-928e-916f11b14918-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:27:51 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-c98921e5-6f09-49a6-9314-f68ad5ac08e1 tempest-VolumesTransfersV355Test-54772842 None] Acquiring lock "cinder-quobyte-5ec48731-febc-4061-928e-916f11b14918" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:27:51 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-c98921e5-6f09-49a6-9314-f68ad5ac08e1 tempest-VolumesTransfersV355Test-54772842 None] Lock "cinder-quobyte-5ec48731-febc-4061-928e-916f11b14918" acquired by "delete_volume" :: waited 0.032s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:27:51 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[45bd0c56-e3ef-475c-800f-4665d972c497]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:27:51 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-c98921e5-6f09-49a6-9314-f68ad5ac08e1 tempest-VolumesTransfersV355Test-54772842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-5ec48731-febc-4061-928e-916f11b14918 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:27:51 devstack sudo[93302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-5ec48731-febc-4061-928e-916f11b14918
Nov 03 18:27:51 devstack sudo[93302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:27:51 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-c2084ee3-853d-456e-80e7-7bfa99233a29 tempest-VolumesSnapshotListTestJSON-1439242857 None] Acquiring lock "cinder-4da7d60f-e62a-4947-9d82-4a8acf964a45-delete_snapshot" by "delete_snapshot" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:27:51 devstack sudo[93302]: pam_unix(sudo:session): session closed for user root
Nov 03 18:27:51 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-c98921e5-6f09-49a6-9314-f68ad5ac08e1 tempest-VolumesTransfersV355Test-54772842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-5ec48731-febc-4061-928e-916f11b14918" returned: 0 in 0.458s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:27:51 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-c98921e5-6f09-49a6-9314-f68ad5ac08e1 tempest-VolumesTransfersV355Test-54772842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-5ec48731-febc-4061-928e-916f11b14918 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:27:51 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-c2084ee3-853d-456e-80e7-7bfa99233a29 tempest-VolumesSnapshotListTestJSON-1439242857 None] Lock "cinder-4da7d60f-e62a-4947-9d82-4a8acf964a45-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:27:51 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-c2084ee3-853d-456e-80e7-7bfa99233a29 tempest-VolumesSnapshotListTestJSON-1439242857 None] Acquiring lock "cinder-quobyte-e8a8ac9d-ef51-41f8-8b5d-04379b1eca75" by "delete_snapshot" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:27:51 devstack sudo[93307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-5ec48731-febc-4061-928e-916f11b14918
Nov 03 18:27:51 devstack sudo[93307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:27:51 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-c2084ee3-853d-456e-80e7-7bfa99233a29 tempest-VolumesSnapshotListTestJSON-1439242857 None] Lock "cinder-quobyte-e8a8ac9d-ef51-41f8-8b5d-04379b1eca75" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:27:51 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-c2084ee3-853d-456e-80e7-7bfa99233a29 tempest-VolumesSnapshotListTestJSON-1439242857 None] Acquiring lock "cinder-quobyte-4da7d60f-e62a-4947-9d82-4a8acf964a45" by "_delete_snapshot" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:27:51 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-c2084ee3-853d-456e-80e7-7bfa99233a29 tempest-VolumesSnapshotListTestJSON-1439242857 None] Lock "cinder-quobyte-4da7d60f-e62a-4947-9d82-4a8acf964a45" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:27:51 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-c2084ee3-853d-456e-80e7-7bfa99233a29 tempest-VolumesSnapshotListTestJSON-1439242857 None] Deleting offline snapshot 4da7d60f-e62a-4947-9d82-4a8acf964a45 of volume e8a8ac9d-ef51-41f8-8b5d-04379b1eca75 {{(pid=86120) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 18:27:52 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-c2084ee3-853d-456e-80e7-7bfa99233a29 tempest-VolumesSnapshotListTestJSON-1439242857 None] snapshot_file for this snap is: volume-e8a8ac9d-ef51-41f8-8b5d-04379b1eca75.4da7d60f-e62a-4947-9d82-4a8acf964a45 {{(pid=86120) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 18:27:52 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9c3d280-97c8-4005-b188-4f0cc56fa68a]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:27:52 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-c2084ee3-853d-456e-80e7-7bfa99233a29 tempest-VolumesSnapshotListTestJSON-1439242857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e8a8ac9d-ef51-41f8-8b5d-04379b1eca75.4da7d60f-e62a-4947-9d82-4a8acf964a45 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:27:52 devstack sudo[93309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e8a8ac9d-ef51-41f8-8b5d-04379b1eca75.4da7d60f-e62a-4947-9d82-4a8acf964a45
Nov 03 18:27:52 devstack sudo[93309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:27:52 devstack sudo[93307]: pam_unix(sudo:session): session closed for user root
Nov 03 18:27:52 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-c98921e5-6f09-49a6-9314-f68ad5ac08e1 tempest-VolumesTransfersV355Test-54772842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-5ec48731-febc-4061-928e-916f11b14918" returned: 0 in 0.350s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:27:52 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-c98921e5-6f09-49a6-9314-f68ad5ac08e1 tempest-VolumesTransfersV355Test-54772842 None] Lock "cinder-quobyte-5ec48731-febc-4061-928e-916f11b14918" released by "delete_volume" :: held 0.873s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:27:52 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-c98921e5-6f09-49a6-9314-f68ad5ac08e1 tempest-VolumesTransfersV355Test-54772842 None] Created reservations ['65dc1b99-5b34-4508-b449-fe4e9b199129', '74e66c43-bb45-4ecc-a82a-cc1edf2d19ad', '0499e33e-5c2a-4c32-b1ec-5c4fababeec4', 'a4ac4add-2928-4184-a362-07443848e557'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:27:52 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-c98921e5-6f09-49a6-9314-f68ad5ac08e1 tempest-VolumesTransfersV355Test-54772842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:27:52 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-c98921e5-6f09-49a6-9314-f68ad5ac08e1 tempest-VolumesTransfersV355Test-54772842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:27:52 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-c98921e5-6f09-49a6-9314-f68ad5ac08e1 tempest-VolumesTransfersV355Test-54772842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:27:52 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-c98921e5-6f09-49a6-9314-f68ad5ac08e1 tempest-VolumesTransfersV355Test-54772842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:27:52 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-c98921e5-6f09-49a6-9314-f68ad5ac08e1 tempest-VolumesTransfersV355Test-54772842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:27:52 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-c98921e5-6f09-49a6-9314-f68ad5ac08e1 tempest-VolumesTransfersV355Test-54772842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:27:52 devstack sudo[93312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:27:52 devstack sudo[93312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:27:52 devstack sudo[93309]: pam_unix(sudo:session): session closed for user root
Nov 03 18:27:52 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-c2084ee3-853d-456e-80e7-7bfa99233a29 tempest-VolumesSnapshotListTestJSON-1439242857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e8a8ac9d-ef51-41f8-8b5d-04379b1eca75.4da7d60f-e62a-4947-9d82-4a8acf964a45" returned: 0 in 0.567s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:27:52 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-c2084ee3-853d-456e-80e7-7bfa99233a29 tempest-VolumesSnapshotListTestJSON-1439242857 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e8a8ac9d-ef51-41f8-8b5d-04379b1eca75(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86120) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 18:27:52 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[35189fb1-37cc-40ba-a306-3fe747a4363a]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:27:52 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-c2084ee3-853d-456e-80e7-7bfa99233a29 tempest-VolumesSnapshotListTestJSON-1439242857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e8a8ac9d-ef51-41f8-8b5d-04379b1eca75.304ef93f-86cf-4630-9e98-6ebb5226ad2f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:27:52 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [req-39db4380-692c-478a-a231-fd4ecfd80d3b req-8663e708-280f-4ecd-b4af-0e5d0362595c tempest-AttachVolumeShelveTestJSON-629024950 None] No connector for attachment e179497f-0a0f-4793-a03d-2d74b441369a; skipping storage backend terminate_connection call. {{(pid=86120) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}}
Nov 03 18:27:52 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [req-39db4380-692c-478a-a231-fd4ecfd80d3b req-8663e708-280f-4ecd-b4af-0e5d0362595c tempest-AttachVolumeShelveTestJSON-629024950 None] Deleting attachment e179497f-0a0f-4793-a03d-2d74b441369a. {{(pid=86120) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 03 18:27:52 devstack sudo[93312]: pam_unix(sudo:session): session closed for user root
Nov 03 18:27:52 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-c98921e5-6f09-49a6-9314-f68ad5ac08e1 tempest-VolumesTransfersV355Test-54772842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.321s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:27:52 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-c98921e5-6f09-49a6-9314-f68ad5ac08e1 tempest-VolumesTransfersV355Test-54772842 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:27:52 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-c98921e5-6f09-49a6-9314-f68ad5ac08e1 tempest-VolumesTransfersV355Test-54772842 None] Deleted volume successfully.
Nov 03 18:27:52 devstack sudo[93317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e8a8ac9d-ef51-41f8-8b5d-04379b1eca75.304ef93f-86cf-4630-9e98-6ebb5226ad2f
Nov 03 18:27:52 devstack sudo[93317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:27:52 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-c98921e5-6f09-49a6-9314-f68ad5ac08e1 tempest-VolumesTransfersV355Test-54772842 None] Lock "cinder-5ec48731-febc-4061-928e-916f11b14918-delete_volume" released by "delete_volume" :: held 1.487s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:27:53 devstack sudo[93317]: pam_unix(sudo:session): session closed for user root
Nov 03 18:27:53 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-c2084ee3-853d-456e-80e7-7bfa99233a29 tempest-VolumesSnapshotListTestJSON-1439242857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e8a8ac9d-ef51-41f8-8b5d-04379b1eca75.304ef93f-86cf-4630-9e98-6ebb5226ad2f" returned: 0 in 0.490s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:27:53 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-c2084ee3-853d-456e-80e7-7bfa99233a29 tempest-VolumesSnapshotListTestJSON-1439242857 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e8a8ac9d-ef51-41f8-8b5d-04379b1eca75(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86120) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 18:27:53 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-c2084ee3-853d-456e-80e7-7bfa99233a29 tempest-VolumesSnapshotListTestJSON-1439242857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e8a8ac9d-ef51-41f8-8b5d-04379b1eca75.4da7d60f-e62a-4947-9d82-4a8acf964a45 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:27:53 devstack sudo[93323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e8a8ac9d-ef51-41f8-8b5d-04379b1eca75.4da7d60f-e62a-4947-9d82-4a8acf964a45
Nov 03 18:27:53 devstack sudo[93323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:27:53 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0ca0598-b66c-4cb0-b9ce-0efbbd3891d9 tempest-VolumesTransfersV355Test-1165703128 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:27:53 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-e0ca0598-b66c-4cb0-b9ce-0efbbd3891d9 tempest-VolumesTransfersV355Test-1165703128 None] Flow 'volume_create_manager' (528c62f8-0a8f-4167-8435-83422d938525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:27:53 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-e0ca0598-b66c-4cb0-b9ce-0efbbd3891d9 tempest-VolumesTransfersV355Test-1165703128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d2edcbd-7477-4c25-8d3b-c3105a6ee4c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:27:53 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-e0ca0598-b66c-4cb0-b9ce-0efbbd3891d9 tempest-VolumesTransfersV355Test-1165703128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d2edcbd-7477-4c25-8d3b-c3105a6ee4c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:27:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-580266811',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9fe1915-52dc-462c-b7b5-1d015b677242,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a4594a1b292433b9e0a5a6791a58755',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:27:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:27:53Z,use_quota=True,user_id='6abdacc1c7aa417f9df4f7a0d9d5e82d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:27:53 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-e0ca0598-b66c-4cb0-b9ce-0efbbd3891d9 tempest-VolumesTransfersV355Test-1165703128 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (293a2eab-28af-4974-985e-a381524fcbb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:27:53 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-e0ca0598-b66c-4cb0-b9ce-0efbbd3891d9 tempest-VolumesTransfersV355Test-1165703128 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (293a2eab-28af-4974-985e-a381524fcbb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:27:53 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-e0ca0598-b66c-4cb0-b9ce-0efbbd3891d9 tempest-VolumesTransfersV355Test-1165703128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c20ea513-6a57-429d-9b0c-05392ca1903a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:27:53 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-e0ca0598-b66c-4cb0-b9ce-0efbbd3891d9 tempest-VolumesTransfersV355Test-1165703128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c20ea513-6a57-429d-9b0c-05392ca1903a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9fe1915-52dc-462c-b7b5-1d015b677242', 'volume_name': 'volume-f9fe1915-52dc-462c-b7b5-1d015b677242', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:27:53 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-e0ca0598-b66c-4cb0-b9ce-0efbbd3891d9 tempest-VolumesTransfersV355Test-1165703128 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89fda052-94d6-43d3-9b28-43e38736a15d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:27:53 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-e0ca0598-b66c-4cb0-b9ce-0efbbd3891d9 tempest-VolumesTransfersV355Test-1165703128 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89fda052-94d6-43d3-9b28-43e38736a15d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:27:53 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-e0ca0598-b66c-4cb0-b9ce-0efbbd3891d9 tempest-VolumesTransfersV355Test-1165703128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45cc9ad0-e6bd-4330-b49b-f8af75edd705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:27:53 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-e0ca0598-b66c-4cb0-b9ce-0efbbd3891d9 tempest-VolumesTransfersV355Test-1165703128 None] Volume f9fe1915-52dc-462c-b7b5-1d015b677242: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9fe1915-52dc-462c-b7b5-1d015b677242', 'volume_size': 1}
Nov 03 18:27:53 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-e0ca0598-b66c-4cb0-b9ce-0efbbd3891d9 tempest-VolumesTransfersV355Test-1165703128 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:27:53 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-e0ca0598-b66c-4cb0-b9ce-0efbbd3891d9 tempest-VolumesTransfersV355Test-1165703128 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:27:53 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-e0ca0598-b66c-4cb0-b9ce-0efbbd3891d9 tempest-VolumesTransfersV355Test-1165703128 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:27:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-580266811',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9fe1915-52dc-462c-b7b5-1d015b677242,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a4594a1b292433b9e0a5a6791a58755',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:27:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:27:53Z,use_quota=True,user_id='6abdacc1c7aa417f9df4f7a0d9d5e82d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:27:53 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-e0ca0598-b66c-4cb0-b9ce-0efbbd3891d9 tempest-VolumesTransfersV355Test-1165703128 None] Creating volume f9fe1915-52dc-462c-b7b5-1d015b677242 {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:27:53 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-e0ca0598-b66c-4cb0-b9ce-0efbbd3891d9 tempest-VolumesTransfersV355Test-1165703128 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:27:53 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-e0ca0598-b66c-4cb0-b9ce-0efbbd3891d9 tempest-VolumesTransfersV355Test-1165703128 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:27:53 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-e0ca0598-b66c-4cb0-b9ce-0efbbd3891d9 tempest-VolumesTransfersV355Test-1165703128 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:27:53 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-e0ca0598-b66c-4cb0-b9ce-0efbbd3891d9 tempest-VolumesTransfersV355Test-1165703128 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:27:53 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-e0ca0598-b66c-4cb0-b9ce-0efbbd3891d9 tempest-VolumesTransfersV355Test-1165703128 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:27:53 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-e0ca0598-b66c-4cb0-b9ce-0efbbd3891d9 tempest-VolumesTransfersV355Test-1165703128 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:27:53 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-e0ca0598-b66c-4cb0-b9ce-0efbbd3891d9 tempest-VolumesTransfersV355Test-1165703128 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:27:53 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-e0ca0598-b66c-4cb0-b9ce-0efbbd3891d9 tempest-VolumesTransfersV355Test-1165703128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f9fe1915-52dc-462c-b7b5-1d015b677242 1073741824 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:27:53 devstack sudo[93329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f9fe1915-52dc-462c-b7b5-1d015b677242 1073741824
Nov 03 18:27:53 devstack sudo[93329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:27:53 devstack sudo[93323]: pam_unix(sudo:session): session closed for user root
Nov 03 18:27:53 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-c2084ee3-853d-456e-80e7-7bfa99233a29 tempest-VolumesSnapshotListTestJSON-1439242857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e8a8ac9d-ef51-41f8-8b5d-04379b1eca75.4da7d60f-e62a-4947-9d82-4a8acf964a45" returned: 0 in 0.546s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:27:53 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-c2084ee3-853d-456e-80e7-7bfa99233a29 tempest-VolumesSnapshotListTestJSON-1439242857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e8a8ac9d-ef51-41f8-8b5d-04379b1eca75.4da7d60f-e62a-4947-9d82-4a8acf964a45 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:27:53 devstack sudo[93332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e8a8ac9d-ef51-41f8-8b5d-04379b1eca75.4da7d60f-e62a-4947-9d82-4a8acf964a45
Nov 03 18:27:53 devstack sudo[93332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:27:54 devstack sudo[93332]: pam_unix(sudo:session): session closed for user root
Nov 03 18:27:54 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-c2084ee3-853d-456e-80e7-7bfa99233a29 tempest-VolumesSnapshotListTestJSON-1439242857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e8a8ac9d-ef51-41f8-8b5d-04379b1eca75.4da7d60f-e62a-4947-9d82-4a8acf964a45" returned: 0 in 0.384s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:27:54 devstack sudo[93329]: pam_unix(sudo:session): session closed for user root
Nov 03 18:27:54 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-e0ca0598-b66c-4cb0-b9ce-0efbbd3891d9 tempest-VolumesTransfersV355Test-1165703128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f9fe1915-52dc-462c-b7b5-1d015b677242 1073741824" returned: 0 in 0.649s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:27:54 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-c2084ee3-853d-456e-80e7-7bfa99233a29 tempest-VolumesSnapshotListTestJSON-1439242857 None] Lock "cinder-quobyte-4da7d60f-e62a-4947-9d82-4a8acf964a45" released by "_delete_snapshot" :: held 2.145s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:27:54 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-c2084ee3-853d-456e-80e7-7bfa99233a29 tempest-VolumesSnapshotListTestJSON-1439242857 None] Lock "cinder-quobyte-e8a8ac9d-ef51-41f8-8b5d-04379b1eca75" released by "delete_snapshot" :: held 2.183s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:27:54 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-e0ca0598-b66c-4cb0-b9ce-0efbbd3891d9 tempest-VolumesTransfersV355Test-1165703128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f9fe1915-52dc-462c-b7b5-1d015b677242 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:27:54 devstack sudo[93341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f9fe1915-52dc-462c-b7b5-1d015b677242
Nov 03 18:27:54 devstack sudo[93341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:27:54 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-c2084ee3-853d-456e-80e7-7bfa99233a29 tempest-VolumesSnapshotListTestJSON-1439242857 None] Created reservations ['c31e7bc9-65f4-4d7f-ae36-a24c1675a444', '76d0b9fc-b895-42ad-b7de-593bcfdf7b20', '1cfefe18-9127-4161-855e-ae20ed5333c3', '1729586d-bfb2-451f-ae45-b40541b13f82'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:27:54 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-c2084ee3-853d-456e-80e7-7bfa99233a29 tempest-VolumesSnapshotListTestJSON-1439242857 None] Delete snapshot completed successfully.
Nov 03 18:27:54 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-c2084ee3-853d-456e-80e7-7bfa99233a29 tempest-VolumesSnapshotListTestJSON-1439242857 None] Lock "cinder-4da7d60f-e62a-4947-9d82-4a8acf964a45-delete_snapshot" released by "delete_snapshot" :: held 2.440s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:27:54 devstack sudo[93341]: pam_unix(sudo:session): session closed for user root
Nov 03 18:27:54 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-e0ca0598-b66c-4cb0-b9ce-0efbbd3891d9 tempest-VolumesTransfersV355Test-1165703128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f9fe1915-52dc-462c-b7b5-1d015b677242" returned: 0 in 0.335s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:27:54 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-e0ca0598-b66c-4cb0-b9ce-0efbbd3891d9 tempest-VolumesTransfersV355Test-1165703128 None] <== create_volume: return (1060ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:27:54 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-e0ca0598-b66c-4cb0-b9ce-0efbbd3891d9 tempest-VolumesTransfersV355Test-1165703128 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.063s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:27:54 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-e0ca0598-b66c-4cb0-b9ce-0efbbd3891d9 tempest-VolumesTransfersV355Test-1165703128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45cc9ad0-e6bd-4330-b49b-f8af75edd705) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9fe1915-52dc-462c-b7b5-1d015b677242', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:27:54 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-e0ca0598-b66c-4cb0-b9ce-0efbbd3891d9 tempest-VolumesTransfersV355Test-1165703128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c835e23f-7f39-421a-b309-65f180840a65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:27:54 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-e0ca0598-b66c-4cb0-b9ce-0efbbd3891d9 tempest-VolumesTransfersV355Test-1165703128 None] Volume volume-f9fe1915-52dc-462c-b7b5-1d015b677242 (f9fe1915-52dc-462c-b7b5-1d015b677242): created successfully
Nov 03 18:27:54 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-e0ca0598-b66c-4cb0-b9ce-0efbbd3891d9 tempest-VolumesTransfersV355Test-1165703128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c835e23f-7f39-421a-b309-65f180840a65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:27:54 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-e0ca0598-b66c-4cb0-b9ce-0efbbd3891d9 tempest-VolumesTransfersV355Test-1165703128 None] Flow 'volume_create_manager' (528c62f8-0a8f-4167-8435-83422d938525) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:27:54 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-e0ca0598-b66c-4cb0-b9ce-0efbbd3891d9 tempest-VolumesTransfersV355Test-1165703128 None] Created volume successfully.
Nov 03 18:27:55 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-6bcf4b72-9bc4-4d46-ae67-258543f08b84 tempest-VolumesSnapshotListTestJSON-1439242857 None] Acquiring lock "cinder-304ef93f-86cf-4630-9e98-6ebb5226ad2f-delete_snapshot" by "delete_snapshot" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:27:55 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-6bcf4b72-9bc4-4d46-ae67-258543f08b84 tempest-VolumesSnapshotListTestJSON-1439242857 None] Lock "cinder-304ef93f-86cf-4630-9e98-6ebb5226ad2f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:27:55 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-6bcf4b72-9bc4-4d46-ae67-258543f08b84 tempest-VolumesSnapshotListTestJSON-1439242857 None] Acquiring lock "cinder-quobyte-e8a8ac9d-ef51-41f8-8b5d-04379b1eca75" by "delete_snapshot" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:27:55 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-6bcf4b72-9bc4-4d46-ae67-258543f08b84 tempest-VolumesSnapshotListTestJSON-1439242857 None] Lock "cinder-quobyte-e8a8ac9d-ef51-41f8-8b5d-04379b1eca75" acquired by "delete_snapshot" :: waited 0.070s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:27:55 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-6bcf4b72-9bc4-4d46-ae67-258543f08b84 tempest-VolumesSnapshotListTestJSON-1439242857 None] Acquiring lock "cinder-quobyte-304ef93f-86cf-4630-9e98-6ebb5226ad2f" by "_delete_snapshot" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:27:55 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-6bcf4b72-9bc4-4d46-ae67-258543f08b84 tempest-VolumesSnapshotListTestJSON-1439242857 None] Lock "cinder-quobyte-304ef93f-86cf-4630-9e98-6ebb5226ad2f" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:27:55 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-6bcf4b72-9bc4-4d46-ae67-258543f08b84 tempest-VolumesSnapshotListTestJSON-1439242857 None] Deleting offline snapshot 304ef93f-86cf-4630-9e98-6ebb5226ad2f of volume e8a8ac9d-ef51-41f8-8b5d-04379b1eca75 {{(pid=86120) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 18:27:55 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-6bcf4b72-9bc4-4d46-ae67-258543f08b84 tempest-VolumesSnapshotListTestJSON-1439242857 None] snapshot_file for this snap is: volume-e8a8ac9d-ef51-41f8-8b5d-04379b1eca75.304ef93f-86cf-4630-9e98-6ebb5226ad2f {{(pid=86120) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 18:27:55 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[eec28c3e-e2bc-4645-a6ed-92f40f4d0e95]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:27:55 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-6bcf4b72-9bc4-4d46-ae67-258543f08b84 tempest-VolumesSnapshotListTestJSON-1439242857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e8a8ac9d-ef51-41f8-8b5d-04379b1eca75.304ef93f-86cf-4630-9e98-6ebb5226ad2f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:27:55 devstack sudo[93345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e8a8ac9d-ef51-41f8-8b5d-04379b1eca75.304ef93f-86cf-4630-9e98-6ebb5226ad2f
Nov 03 18:27:55 devstack sudo[93345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:27:55 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-d3bade59-e762-4cfe-9cf8-d63d48508f21 tempest-VolumesTransfersV355Test-54772842 None] Acquiring lock "cinder-f9fe1915-52dc-462c-b7b5-1d015b677242-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:27:55 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-d3bade59-e762-4cfe-9cf8-d63d48508f21 tempest-VolumesTransfersV355Test-54772842 None] Lock "cinder-f9fe1915-52dc-462c-b7b5-1d015b677242-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:27:55 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-d3bade59-e762-4cfe-9cf8-d63d48508f21 tempest-VolumesTransfersV355Test-54772842 None] Acquiring lock "cinder-quobyte-f9fe1915-52dc-462c-b7b5-1d015b677242" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:27:55 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-d3bade59-e762-4cfe-9cf8-d63d48508f21 tempest-VolumesTransfersV355Test-54772842 None] Lock "cinder-quobyte-f9fe1915-52dc-462c-b7b5-1d015b677242" acquired by "delete_volume" :: waited 0.021s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:27:55 devstack sudo[93345]: pam_unix(sudo:session): session closed for user root
Nov 03 18:27:55 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-6bcf4b72-9bc4-4d46-ae67-258543f08b84 tempest-VolumesSnapshotListTestJSON-1439242857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e8a8ac9d-ef51-41f8-8b5d-04379b1eca75.304ef93f-86cf-4630-9e98-6ebb5226ad2f" returned: 0 in 0.473s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:27:55 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-6bcf4b72-9bc4-4d46-ae67-258543f08b84 tempest-VolumesSnapshotListTestJSON-1439242857 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e8a8ac9d-ef51-41f8-8b5d-04379b1eca75(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86120) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 18:27:55 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c162f55-29d0-4418-ba2a-5bbee8f6bafc]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:27:55 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-d3bade59-e762-4cfe-9cf8-d63d48508f21 tempest-VolumesTransfersV355Test-54772842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f9fe1915-52dc-462c-b7b5-1d015b677242 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:27:55 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d2bf6fe-70ee-4aa8-9520-981b249dcf14]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:27:55 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-6bcf4b72-9bc4-4d46-ae67-258543f08b84 tempest-VolumesSnapshotListTestJSON-1439242857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e8a8ac9d-ef51-41f8-8b5d-04379b1eca75 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:27:56 devstack sudo[93350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f9fe1915-52dc-462c-b7b5-1d015b677242
Nov 03 18:27:56 devstack sudo[93350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:27:56 devstack sudo[93351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e8a8ac9d-ef51-41f8-8b5d-04379b1eca75
Nov 03 18:27:56 devstack sudo[93351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:27:56 devstack sudo[93350]: pam_unix(sudo:session): session closed for user root
Nov 03 18:27:56 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-d3bade59-e762-4cfe-9cf8-d63d48508f21 tempest-VolumesTransfersV355Test-54772842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f9fe1915-52dc-462c-b7b5-1d015b677242" returned: 0 in 0.500s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:27:56 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-d3bade59-e762-4cfe-9cf8-d63d48508f21 tempest-VolumesTransfersV355Test-54772842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f9fe1915-52dc-462c-b7b5-1d015b677242 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:27:56 devstack sudo[93351]: pam_unix(sudo:session): session closed for user root
Nov 03 18:27:56 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-6bcf4b72-9bc4-4d46-ae67-258543f08b84 tempest-VolumesSnapshotListTestJSON-1439242857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e8a8ac9d-ef51-41f8-8b5d-04379b1eca75" returned: 0 in 0.498s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:27:56 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-6bcf4b72-9bc4-4d46-ae67-258543f08b84 tempest-VolumesSnapshotListTestJSON-1439242857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e8a8ac9d-ef51-41f8-8b5d-04379b1eca75.304ef93f-86cf-4630-9e98-6ebb5226ad2f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:27:56 devstack sudo[93360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f9fe1915-52dc-462c-b7b5-1d015b677242
Nov 03 18:27:56 devstack sudo[93360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:27:56 devstack sudo[93361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e8a8ac9d-ef51-41f8-8b5d-04379b1eca75.304ef93f-86cf-4630-9e98-6ebb5226ad2f
Nov 03 18:27:56 devstack sudo[93361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:27:56 devstack sudo[93360]: pam_unix(sudo:session): session closed for user root
Nov 03 18:27:56 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-d3bade59-e762-4cfe-9cf8-d63d48508f21 tempest-VolumesTransfersV355Test-54772842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f9fe1915-52dc-462c-b7b5-1d015b677242" returned: 0 in 0.316s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:27:56 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-d3bade59-e762-4cfe-9cf8-d63d48508f21 tempest-VolumesTransfersV355Test-54772842 None] Lock "cinder-quobyte-f9fe1915-52dc-462c-b7b5-1d015b677242" released by "delete_volume" :: held 0.881s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:27:56 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-d3bade59-e762-4cfe-9cf8-d63d48508f21 tempest-VolumesTransfersV355Test-54772842 None] Created reservations ['4afee826-a675-4df1-9780-6c42ed06e0ea', 'f1f72f31-f2ec-4721-a56a-9b4165a2949a', 'ac4e7be5-f180-4288-bfe1-48f35c4ca666', '85cc619e-7a48-44b1-99dc-8169d45e6ece'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:27:56 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-d3bade59-e762-4cfe-9cf8-d63d48508f21 tempest-VolumesTransfersV355Test-54772842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:27:56 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-d3bade59-e762-4cfe-9cf8-d63d48508f21 tempest-VolumesTransfersV355Test-54772842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:27:56 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-d3bade59-e762-4cfe-9cf8-d63d48508f21 tempest-VolumesTransfersV355Test-54772842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:27:56 devstack sudo[93361]: pam_unix(sudo:session): session closed for user root
Nov 03 18:27:56 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-d3bade59-e762-4cfe-9cf8-d63d48508f21 tempest-VolumesTransfersV355Test-54772842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:27:56 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-d3bade59-e762-4cfe-9cf8-d63d48508f21 tempest-VolumesTransfersV355Test-54772842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:27:56 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-d3bade59-e762-4cfe-9cf8-d63d48508f21 tempest-VolumesTransfersV355Test-54772842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:27:56 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-6bcf4b72-9bc4-4d46-ae67-258543f08b84 tempest-VolumesSnapshotListTestJSON-1439242857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e8a8ac9d-ef51-41f8-8b5d-04379b1eca75.304ef93f-86cf-4630-9e98-6ebb5226ad2f" returned: 0 in 0.543s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:27:56 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-6bcf4b72-9bc4-4d46-ae67-258543f08b84 tempest-VolumesSnapshotListTestJSON-1439242857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e8a8ac9d-ef51-41f8-8b5d-04379b1eca75.304ef93f-86cf-4630-9e98-6ebb5226ad2f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:27:57 devstack sudo[93371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e8a8ac9d-ef51-41f8-8b5d-04379b1eca75.304ef93f-86cf-4630-9e98-6ebb5226ad2f
Nov 03 18:27:57 devstack sudo[93371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:27:57 devstack sudo[93370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:27:57 devstack sudo[93370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:27:57 devstack sudo[93370]: pam_unix(sudo:session): session closed for user root
Nov 03 18:27:57 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-d3bade59-e762-4cfe-9cf8-d63d48508f21 tempest-VolumesTransfersV355Test-54772842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.406s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:27:57 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-d3bade59-e762-4cfe-9cf8-d63d48508f21 tempest-VolumesTransfersV355Test-54772842 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:27:57 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-d3bade59-e762-4cfe-9cf8-d63d48508f21 tempest-VolumesTransfersV355Test-54772842 None] Deleted volume successfully.
Nov 03 18:27:57 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-d3bade59-e762-4cfe-9cf8-d63d48508f21 tempest-VolumesTransfersV355Test-54772842 None] Lock "cinder-f9fe1915-52dc-462c-b7b5-1d015b677242-delete_volume" released by "delete_volume" :: held 1.612s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:27:57 devstack sudo[93371]: pam_unix(sudo:session): session closed for user root
Nov 03 18:27:57 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-6bcf4b72-9bc4-4d46-ae67-258543f08b84 tempest-VolumesSnapshotListTestJSON-1439242857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e8a8ac9d-ef51-41f8-8b5d-04379b1eca75.304ef93f-86cf-4630-9e98-6ebb5226ad2f" returned: 0 in 0.472s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:27:57 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-6bcf4b72-9bc4-4d46-ae67-258543f08b84 tempest-VolumesSnapshotListTestJSON-1439242857 None] Lock "cinder-quobyte-304ef93f-86cf-4630-9e98-6ebb5226ad2f" released by "_delete_snapshot" :: held 2.139s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:27:57 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-6bcf4b72-9bc4-4d46-ae67-258543f08b84 tempest-VolumesSnapshotListTestJSON-1439242857 None] Lock "cinder-quobyte-e8a8ac9d-ef51-41f8-8b5d-04379b1eca75" released by "delete_snapshot" :: held 2.171s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:27:57 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-6bcf4b72-9bc4-4d46-ae67-258543f08b84 tempest-VolumesSnapshotListTestJSON-1439242857 None] Created reservations ['3b94f85f-9930-4530-8838-bc5637157f56', 'b0a1e539-4842-41e5-9e56-d350b8417e3e', '3cee375d-9df4-4fbf-8741-d22b205a9d74', 'a3174a56-cd59-4e38-83a7-fd8dfb361d7f'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:27:57 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-6bcf4b72-9bc4-4d46-ae67-258543f08b84 tempest-VolumesSnapshotListTestJSON-1439242857 None] Delete snapshot completed successfully.
Nov 03 18:27:57 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-6bcf4b72-9bc4-4d46-ae67-258543f08b84 tempest-VolumesSnapshotListTestJSON-1439242857 None] Lock "cinder-304ef93f-86cf-4630-9e98-6ebb5226ad2f-delete_snapshot" released by "delete_snapshot" :: held 2.417s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:27:58 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-9b3be875-b83a-4b32-90bf-82d47feb0d80 tempest-VolumesSnapshotListTestJSON-1439242857 None] Acquiring lock "cinder-e8a8ac9d-ef51-41f8-8b5d-04379b1eca75-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:27:58 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-9b3be875-b83a-4b32-90bf-82d47feb0d80 tempest-VolumesSnapshotListTestJSON-1439242857 None] Lock "cinder-e8a8ac9d-ef51-41f8-8b5d-04379b1eca75-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:27:58 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-9b3be875-b83a-4b32-90bf-82d47feb0d80 tempest-VolumesSnapshotListTestJSON-1439242857 None] Acquiring lock "cinder-quobyte-e8a8ac9d-ef51-41f8-8b5d-04379b1eca75" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:27:58 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-9b3be875-b83a-4b32-90bf-82d47feb0d80 tempest-VolumesSnapshotListTestJSON-1439242857 None] Lock "cinder-quobyte-e8a8ac9d-ef51-41f8-8b5d-04379b1eca75" acquired by "delete_volume" :: waited 0.020s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:27:58 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[23fdbb22-5e99-46a5-bde1-bd8d5b2390f8]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:27:58 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-9b3be875-b83a-4b32-90bf-82d47feb0d80 tempest-VolumesSnapshotListTestJSON-1439242857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e8a8ac9d-ef51-41f8-8b5d-04379b1eca75 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:27:59 devstack sudo[93377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e8a8ac9d-ef51-41f8-8b5d-04379b1eca75
Nov 03 18:27:59 devstack sudo[93377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:27:59 devstack sudo[93377]: pam_unix(sudo:session): session closed for user root
Nov 03 18:27:59 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-9b3be875-b83a-4b32-90bf-82d47feb0d80 tempest-VolumesSnapshotListTestJSON-1439242857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e8a8ac9d-ef51-41f8-8b5d-04379b1eca75" returned: 0 in 0.476s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:27:59 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-9b3be875-b83a-4b32-90bf-82d47feb0d80 tempest-VolumesSnapshotListTestJSON-1439242857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e8a8ac9d-ef51-41f8-8b5d-04379b1eca75 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:27:59 devstack sudo[93382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e8a8ac9d-ef51-41f8-8b5d-04379b1eca75
Nov 03 18:27:59 devstack sudo[93382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:27:59 devstack sudo[93382]: pam_unix(sudo:session): session closed for user root
Nov 03 18:27:59 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-9b3be875-b83a-4b32-90bf-82d47feb0d80 tempest-VolumesSnapshotListTestJSON-1439242857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e8a8ac9d-ef51-41f8-8b5d-04379b1eca75" returned: 0 in 0.440s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:27:59 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-9b3be875-b83a-4b32-90bf-82d47feb0d80 tempest-VolumesSnapshotListTestJSON-1439242857 None] Lock "cinder-quobyte-e8a8ac9d-ef51-41f8-8b5d-04379b1eca75" released by "delete_volume" :: held 1.023s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:27:59 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-9b3be875-b83a-4b32-90bf-82d47feb0d80 tempest-VolumesSnapshotListTestJSON-1439242857 None] Created reservations ['1eb6581d-9740-4746-89d3-9b8a81844dc6', '5dd49f48-8777-43ac-85cc-0efc62a452c0', '6e00ef9a-c848-4820-ae5a-0d58e08c8633', 'df47b206-7b81-4a29-a187-c881ed2d3e54'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:28:00 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-9b3be875-b83a-4b32-90bf-82d47feb0d80 tempest-VolumesSnapshotListTestJSON-1439242857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:28:00 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-9b3be875-b83a-4b32-90bf-82d47feb0d80 tempest-VolumesSnapshotListTestJSON-1439242857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:28:00 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-9b3be875-b83a-4b32-90bf-82d47feb0d80 tempest-VolumesSnapshotListTestJSON-1439242857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:28:00 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-9b3be875-b83a-4b32-90bf-82d47feb0d80 tempest-VolumesSnapshotListTestJSON-1439242857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:28:00 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-9b3be875-b83a-4b32-90bf-82d47feb0d80 tempest-VolumesSnapshotListTestJSON-1439242857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:28:00 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-9b3be875-b83a-4b32-90bf-82d47feb0d80 tempest-VolumesSnapshotListTestJSON-1439242857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:28:00 devstack sudo[93386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:28:00 devstack sudo[93386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:28:00 devstack sudo[93386]: pam_unix(sudo:session): session closed for user root
Nov 03 18:28:00 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-9b3be875-b83a-4b32-90bf-82d47feb0d80 tempest-VolumesSnapshotListTestJSON-1439242857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.358s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:28:00 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-9b3be875-b83a-4b32-90bf-82d47feb0d80 tempest-VolumesSnapshotListTestJSON-1439242857 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:28:00 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-9b3be875-b83a-4b32-90bf-82d47feb0d80 tempest-VolumesSnapshotListTestJSON-1439242857 None] Deleted volume successfully.
Nov 03 18:28:00 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-9b3be875-b83a-4b32-90bf-82d47feb0d80 tempest-VolumesSnapshotListTestJSON-1439242857 None] Lock "cinder-e8a8ac9d-ef51-41f8-8b5d-04379b1eca75-delete_volume" released by "delete_volume" :: held 1.697s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:28:09 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-b24c2404-95c4-407a-bdde-baf54aa8b6da tempest-VolumesSnapshotNegativeTestJSON-1925929240 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:28:09 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-b24c2404-95c4-407a-bdde-baf54aa8b6da tempest-VolumesSnapshotNegativeTestJSON-1925929240 None] Flow 'volume_create_manager' (ccaae7de-6f83-4f85-88c7-78d7632f14c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:28:09 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-b24c2404-95c4-407a-bdde-baf54aa8b6da tempest-VolumesSnapshotNegativeTestJSON-1925929240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57fe651c-0479-4dd7-aa97-d25fc4376bcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:28:09 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-b24c2404-95c4-407a-bdde-baf54aa8b6da tempest-VolumesSnapshotNegativeTestJSON-1925929240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57fe651c-0479-4dd7-aa97-d25fc4376bcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:28:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1041482056',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e51d7b4-1258-46d7-a1af-d77665c2443d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40be736a1a6149d2bc7008ef3b9ec122',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:28:09Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:28:09Z,use_quota=True,user_id='32d69d10790047b3a3207b4b7221a550',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:28:09 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-b24c2404-95c4-407a-bdde-baf54aa8b6da tempest-VolumesSnapshotNegativeTestJSON-1925929240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dedb1514-3251-4217-8d82-830d78aa9f05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:28:09 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-b24c2404-95c4-407a-bdde-baf54aa8b6da tempest-VolumesSnapshotNegativeTestJSON-1925929240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dedb1514-3251-4217-8d82-830d78aa9f05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:28:09 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-b24c2404-95c4-407a-bdde-baf54aa8b6da tempest-VolumesSnapshotNegativeTestJSON-1925929240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa950bc6-809a-4de6-8c51-de489c05611b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:28:09 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-b24c2404-95c4-407a-bdde-baf54aa8b6da tempest-VolumesSnapshotNegativeTestJSON-1925929240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa950bc6-809a-4de6-8c51-de489c05611b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e51d7b4-1258-46d7-a1af-d77665c2443d', 'volume_name': 'volume-6e51d7b4-1258-46d7-a1af-d77665c2443d', 'volume_size': 2}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:28:09 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-b24c2404-95c4-407a-bdde-baf54aa8b6da tempest-VolumesSnapshotNegativeTestJSON-1925929240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2e8a61a-2047-4bfa-8890-dccd9ff132b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:28:09 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-b24c2404-95c4-407a-bdde-baf54aa8b6da tempest-VolumesSnapshotNegativeTestJSON-1925929240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2e8a61a-2047-4bfa-8890-dccd9ff132b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:28:09 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-b24c2404-95c4-407a-bdde-baf54aa8b6da tempest-VolumesSnapshotNegativeTestJSON-1925929240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7450be0-fa87-4260-b668-a371d00a1e26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:28:09 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-b24c2404-95c4-407a-bdde-baf54aa8b6da tempest-VolumesSnapshotNegativeTestJSON-1925929240 None] Volume 6e51d7b4-1258-46d7-a1af-d77665c2443d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e51d7b4-1258-46d7-a1af-d77665c2443d', 'volume_size': 2}
Nov 03 18:28:09 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-b24c2404-95c4-407a-bdde-baf54aa8b6da tempest-VolumesSnapshotNegativeTestJSON-1925929240 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:28:09 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-b24c2404-95c4-407a-bdde-baf54aa8b6da tempest-VolumesSnapshotNegativeTestJSON-1925929240 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:28:09 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-b24c2404-95c4-407a-bdde-baf54aa8b6da tempest-VolumesSnapshotNegativeTestJSON-1925929240 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:28:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1041482056',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e51d7b4-1258-46d7-a1af-d77665c2443d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40be736a1a6149d2bc7008ef3b9ec122',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:28:09Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:28:09Z,use_quota=True,user_id='32d69d10790047b3a3207b4b7221a550',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:28:09 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-b24c2404-95c4-407a-bdde-baf54aa8b6da tempest-VolumesSnapshotNegativeTestJSON-1925929240 None] Creating volume 6e51d7b4-1258-46d7-a1af-d77665c2443d {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:28:09 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-b24c2404-95c4-407a-bdde-baf54aa8b6da tempest-VolumesSnapshotNegativeTestJSON-1925929240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:28:09 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-b24c2404-95c4-407a-bdde-baf54aa8b6da tempest-VolumesSnapshotNegativeTestJSON-1925929240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:28:09 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-b24c2404-95c4-407a-bdde-baf54aa8b6da tempest-VolumesSnapshotNegativeTestJSON-1925929240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:28:09 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-b24c2404-95c4-407a-bdde-baf54aa8b6da tempest-VolumesSnapshotNegativeTestJSON-1925929240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:28:09 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-b24c2404-95c4-407a-bdde-baf54aa8b6da tempest-VolumesSnapshotNegativeTestJSON-1925929240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:28:09 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-b24c2404-95c4-407a-bdde-baf54aa8b6da tempest-VolumesSnapshotNegativeTestJSON-1925929240 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:28:09 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-b24c2404-95c4-407a-bdde-baf54aa8b6da tempest-VolumesSnapshotNegativeTestJSON-1925929240 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:28:09 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b24c2404-95c4-407a-bdde-baf54aa8b6da tempest-VolumesSnapshotNegativeTestJSON-1925929240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6e51d7b4-1258-46d7-a1af-d77665c2443d 2147483648 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:28:09 devstack sudo[93496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6e51d7b4-1258-46d7-a1af-d77665c2443d 2147483648
Nov 03 18:28:09 devstack sudo[93496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:28:10 devstack sudo[93496]: pam_unix(sudo:session): session closed for user root
Nov 03 18:28:10 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b24c2404-95c4-407a-bdde-baf54aa8b6da tempest-VolumesSnapshotNegativeTestJSON-1925929240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6e51d7b4-1258-46d7-a1af-d77665c2443d 2147483648" returned: 0 in 0.655s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:28:10 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b24c2404-95c4-407a-bdde-baf54aa8b6da tempest-VolumesSnapshotNegativeTestJSON-1925929240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6e51d7b4-1258-46d7-a1af-d77665c2443d {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:28:10 devstack sudo[93503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6e51d7b4-1258-46d7-a1af-d77665c2443d
Nov 03 18:28:10 devstack sudo[93503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:28:10 devstack sudo[93503]: pam_unix(sudo:session): session closed for user root
Nov 03 18:28:10 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b24c2404-95c4-407a-bdde-baf54aa8b6da tempest-VolumesSnapshotNegativeTestJSON-1925929240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6e51d7b4-1258-46d7-a1af-d77665c2443d" returned: 0 in 0.437s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:28:10 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-b24c2404-95c4-407a-bdde-baf54aa8b6da tempest-VolumesSnapshotNegativeTestJSON-1925929240 None] <== create_volume: return (1170ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:28:10 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-b24c2404-95c4-407a-bdde-baf54aa8b6da tempest-VolumesSnapshotNegativeTestJSON-1925929240 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.175s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:28:10 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-b24c2404-95c4-407a-bdde-baf54aa8b6da tempest-VolumesSnapshotNegativeTestJSON-1925929240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7450be0-fa87-4260-b668-a371d00a1e26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e51d7b4-1258-46d7-a1af-d77665c2443d', 'volume_size': 2}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:28:10 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-b24c2404-95c4-407a-bdde-baf54aa8b6da tempest-VolumesSnapshotNegativeTestJSON-1925929240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ae780b9-ed48-4602-8b73-5e11d57347b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:28:10 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-b24c2404-95c4-407a-bdde-baf54aa8b6da tempest-VolumesSnapshotNegativeTestJSON-1925929240 None] Volume volume-6e51d7b4-1258-46d7-a1af-d77665c2443d (6e51d7b4-1258-46d7-a1af-d77665c2443d): created successfully
Nov 03 18:28:10 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-b24c2404-95c4-407a-bdde-baf54aa8b6da tempest-VolumesSnapshotNegativeTestJSON-1925929240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ae780b9-ed48-4602-8b73-5e11d57347b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:28:10 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-b24c2404-95c4-407a-bdde-baf54aa8b6da tempest-VolumesSnapshotNegativeTestJSON-1925929240 None] Flow 'volume_create_manager' (ccaae7de-6f83-4f85-88c7-78d7632f14c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:28:10 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-b24c2404-95c4-407a-bdde-baf54aa8b6da tempest-VolumesSnapshotNegativeTestJSON-1925929240 None] Created volume successfully.
Nov 03 18:28:11 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-32ba0ad3-e79c-40b0-82a0-3c99ec98b105 tempest-VolumesSnapshotNegativeTestJSON-1925929240 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:28:11 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-32ba0ad3-e79c-40b0-82a0-3c99ec98b105 tempest-VolumesSnapshotNegativeTestJSON-1925929240 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:28:11 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-32ba0ad3-e79c-40b0-82a0-3c99ec98b105 tempest-VolumesSnapshotNegativeTestJSON-1925929240 None] Creating offline snapshot a7091e99-29fe-42d5-8e0b-f51da15f602d of volume 6e51d7b4-1258-46d7-a1af-d77665c2443d {{(pid=86120) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 18:28:11 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[d109bd01-668d-41ac-a6ef-37459e9fe5fa]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:28:11 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-32ba0ad3-e79c-40b0-82a0-3c99ec98b105 tempest-VolumesSnapshotNegativeTestJSON-1925929240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6e51d7b4-1258-46d7-a1af-d77665c2443d {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:28:12 devstack sudo[93510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6e51d7b4-1258-46d7-a1af-d77665c2443d
Nov 03 18:28:12 devstack sudo[93510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:28:12 devstack sudo[93510]: pam_unix(sudo:session): session closed for user root
Nov 03 18:28:12 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-32ba0ad3-e79c-40b0-82a0-3c99ec98b105 tempest-VolumesSnapshotNegativeTestJSON-1925929240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6e51d7b4-1258-46d7-a1af-d77665c2443d" returned: 0 in 0.720s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:28:12 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-32ba0ad3-e79c-40b0-82a0-3c99ec98b105 tempest-VolumesSnapshotNegativeTestJSON-1925929240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6e51d7b4-1258-46d7-a1af-d77665c2443d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6e51d7b4-1258-46d7-a1af-d77665c2443d.a7091e99-29fe-42d5-8e0b-f51da15f602d 2G {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:28:12 devstack sudo[93522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6e51d7b4-1258-46d7-a1af-d77665c2443d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6e51d7b4-1258-46d7-a1af-d77665c2443d.a7091e99-29fe-42d5-8e0b-f51da15f602d 2G
Nov 03 18:28:12 devstack sudo[93522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:28:13 devstack sudo[93522]: pam_unix(sudo:session): session closed for user root
Nov 03 18:28:13 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-32ba0ad3-e79c-40b0-82a0-3c99ec98b105 tempest-VolumesSnapshotNegativeTestJSON-1925929240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6e51d7b4-1258-46d7-a1af-d77665c2443d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6e51d7b4-1258-46d7-a1af-d77665c2443d.a7091e99-29fe-42d5-8e0b-f51da15f602d 2G" returned: 0 in 0.858s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:28:13 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-32ba0ad3-e79c-40b0-82a0-3c99ec98b105 tempest-VolumesSnapshotNegativeTestJSON-1925929240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e51d7b4-1258-46d7-a1af-d77665c2443d -F qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6e51d7b4-1258-46d7-a1af-d77665c2443d.a7091e99-29fe-42d5-8e0b-f51da15f602d {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:28:13 devstack sudo[93537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e51d7b4-1258-46d7-a1af-d77665c2443d -F qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6e51d7b4-1258-46d7-a1af-d77665c2443d.a7091e99-29fe-42d5-8e0b-f51da15f602d
Nov 03 18:28:13 devstack sudo[93537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:28:13 devstack sudo[93537]: pam_unix(sudo:session): session closed for user root
Nov 03 18:28:13 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-32ba0ad3-e79c-40b0-82a0-3c99ec98b105 tempest-VolumesSnapshotNegativeTestJSON-1925929240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e51d7b4-1258-46d7-a1af-d77665c2443d -F qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6e51d7b4-1258-46d7-a1af-d77665c2443d.a7091e99-29fe-42d5-8e0b-f51da15f602d" returned: 0 in 0.413s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:28:13 devstack cinder-volume[86120]: WARNING cinder.volume.drivers.remotefs [None req-32ba0ad3-e79c-40b0-82a0-3c99ec98b105 tempest-VolumesSnapshotNegativeTestJSON-1925929240 None] /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6e51d7b4-1258-46d7-a1af-d77665c2443d.a7091e99-29fe-42d5-8e0b-f51da15f602d is being set with open permissions: ugo+rw
Nov 03 18:28:13 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-32ba0ad3-e79c-40b0-82a0-3c99ec98b105 tempest-VolumesSnapshotNegativeTestJSON-1925929240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6e51d7b4-1258-46d7-a1af-d77665c2443d.a7091e99-29fe-42d5-8e0b-f51da15f602d {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:28:13 devstack sudo[93548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6e51d7b4-1258-46d7-a1af-d77665c2443d.a7091e99-29fe-42d5-8e0b-f51da15f602d
Nov 03 18:28:13 devstack sudo[93548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:28:14 devstack sudo[93548]: pam_unix(sudo:session): session closed for user root
Nov 03 18:28:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-32ba0ad3-e79c-40b0-82a0-3c99ec98b105 tempest-VolumesSnapshotNegativeTestJSON-1925929240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6e51d7b4-1258-46d7-a1af-d77665c2443d.a7091e99-29fe-42d5-8e0b-f51da15f602d" returned: 0 in 0.283s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:28:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-32ba0ad3-e79c-40b0-82a0-3c99ec98b105 tempest-VolumesSnapshotNegativeTestJSON-1925929240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6e51d7b4-1258-46d7-a1af-d77665c2443d.info {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:28:14 devstack sudo[93551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6e51d7b4-1258-46d7-a1af-d77665c2443d.info
Nov 03 18:28:14 devstack sudo[93551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:28:14 devstack sudo[93551]: pam_unix(sudo:session): session closed for user root
Nov 03 18:28:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-32ba0ad3-e79c-40b0-82a0-3c99ec98b105 tempest-VolumesSnapshotNegativeTestJSON-1925929240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6e51d7b4-1258-46d7-a1af-d77665c2443d.info" returned: 0 in 0.310s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:28:14 devstack cinder-volume[86120]: WARNING cinder.volume.drivers.remotefs [None req-32ba0ad3-e79c-40b0-82a0-3c99ec98b105 tempest-VolumesSnapshotNegativeTestJSON-1925929240 None] /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6e51d7b4-1258-46d7-a1af-d77665c2443d.info is being set with open permissions: ugo+rw
Nov 03 18:28:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-32ba0ad3-e79c-40b0-82a0-3c99ec98b105 tempest-VolumesSnapshotNegativeTestJSON-1925929240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6e51d7b4-1258-46d7-a1af-d77665c2443d.info {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:28:14 devstack sudo[93554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6e51d7b4-1258-46d7-a1af-d77665c2443d.info
Nov 03 18:28:14 devstack sudo[93554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:28:14 devstack cinder-volume[86120]: DEBUG oslo_service.periodic_task [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86120) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 18:28:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:28:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:28:14 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:28:14 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:28:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:28:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:28:15 devstack sudo[93558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:28:15 devstack sudo[93558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:28:15 devstack sudo[93554]: pam_unix(sudo:session): session closed for user root
Nov 03 18:28:15 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-32ba0ad3-e79c-40b0-82a0-3c99ec98b105 tempest-VolumesSnapshotNegativeTestJSON-1925929240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6e51d7b4-1258-46d7-a1af-d77665c2443d.info" returned: 0 in 0.530s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:28:15 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-32ba0ad3-e79c-40b0-82a0-3c99ec98b105 tempest-VolumesSnapshotNegativeTestJSON-1925929240 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.344s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:28:15 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-32ba0ad3-e79c-40b0-82a0-3c99ec98b105 tempest-VolumesSnapshotNegativeTestJSON-1925929240 None] Create snapshot completed successfully
Nov 03 18:28:15 devstack sudo[93558]: pam_unix(sudo:session): session closed for user root
Nov 03 18:28:15 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.579s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:28:15 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:28:15 devstack cinder-volume[86120]: DEBUG oslo_service.periodic_task [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Running periodic task VolumeManager._thread_info {{(pid=86120) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 18:28:15 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] thread count: 28 {{(pid=86120) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 03 18:28:15 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] thread info: [<_MainThread(MainThread, started 134747145822336)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134747033686336)>, <Thread(Thread-3 (stat_writer), started daemon 134747030828736)>, <Thread(Rabbit-heartbeat, started daemon 134747035433408)>, <Thread(Thread-5 (_runner), started daemon 134747029587392)>, <Thread(Thread-7 (_runner), started daemon 134747029784256)>, <Thread(fd_logger, started daemon 134747027909120)>, <Thread(privsep_reader, started daemon 134747027006592)>, <Thread(tpool_thread_0, started daemon 134747018950336)>, <Thread(tpool_thread_1, started daemon 134747010541248)>, <Thread(tpool_thread_2, started daemon 134747002132160)>, <Thread(tpool_thread_3, started daemon 134746993723072)>, <Thread(tpool_thread_4, started daemon 134746985313984)>, <Thread(tpool_thread_5, started daemon 134746976904896)>, <Thread(tpool_thread_6, started daemon 134746968495808)>, <Thread(tpool_thread_7, started daemon 134746960086720)>, <Thread(tpool_thread_8, started daemon 134746951677632)>, <Thread(tpool_thread_9, started daemon 134746943268544)>, <Thread(tpool_thread_10, started daemon 134746934859456)>, <Thread(tpool_thread_11, started daemon 134746926450368)>, <Thread(tpool_thread_12, started daemon 134746918041280)>, <Thread(tpool_thread_13, started daemon 134746909632192)>, <Thread(tpool_thread_14, started daemon 134746901223104)>, <Thread(tpool_thread_15, started daemon 134746892814016)>, <Thread(tpool_thread_16, started daemon 134746884404928)>, <Thread(tpool_thread_17, started daemon 134746875995840)>, <Thread(tpool_thread_18, started daemon 134746867586752)>, <Thread(tpool_thread_19, started daemon 134746859177664)>] {{(pid=86120) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 03 18:28:16 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-a1c323d5-9218-43a0-b972-c6f1dd8b4dd8 tempest-VolumesSnapshotNegativeTestJSON-1925929240 None] Acquiring lock "cinder-a7091e99-29fe-42d5-8e0b-f51da15f602d-delete_snapshot" by "delete_snapshot" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:28:16 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-a1c323d5-9218-43a0-b972-c6f1dd8b4dd8 tempest-VolumesSnapshotNegativeTestJSON-1925929240 None] Lock "cinder-a7091e99-29fe-42d5-8e0b-f51da15f602d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.056s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:28:16 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-a1c323d5-9218-43a0-b972-c6f1dd8b4dd8 tempest-VolumesSnapshotNegativeTestJSON-1925929240 None] Acquiring lock "cinder-quobyte-6e51d7b4-1258-46d7-a1af-d77665c2443d" by "delete_snapshot" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:28:16 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-a1c323d5-9218-43a0-b972-c6f1dd8b4dd8 tempest-VolumesSnapshotNegativeTestJSON-1925929240 None] Lock "cinder-quobyte-6e51d7b4-1258-46d7-a1af-d77665c2443d" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:28:16 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-a1c323d5-9218-43a0-b972-c6f1dd8b4dd8 tempest-VolumesSnapshotNegativeTestJSON-1925929240 None] Acquiring lock "cinder-quobyte-a7091e99-29fe-42d5-8e0b-f51da15f602d" by "_delete_snapshot" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:28:16 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-a1c323d5-9218-43a0-b972-c6f1dd8b4dd8 tempest-VolumesSnapshotNegativeTestJSON-1925929240 None] Lock "cinder-quobyte-a7091e99-29fe-42d5-8e0b-f51da15f602d" acquired by "_delete_snapshot" :: waited 0.042s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:28:16 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-a1c323d5-9218-43a0-b972-c6f1dd8b4dd8 tempest-VolumesSnapshotNegativeTestJSON-1925929240 None] Deleting offline snapshot a7091e99-29fe-42d5-8e0b-f51da15f602d of volume 6e51d7b4-1258-46d7-a1af-d77665c2443d {{(pid=86120) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 18:28:16 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-a1c323d5-9218-43a0-b972-c6f1dd8b4dd8 tempest-VolumesSnapshotNegativeTestJSON-1925929240 None] snapshot_file for this snap is: volume-6e51d7b4-1258-46d7-a1af-d77665c2443d.a7091e99-29fe-42d5-8e0b-f51da15f602d {{(pid=86120) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 18:28:16 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5ee0b1c-b04b-4789-a2c2-7ae1bf86f2cd]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:28:16 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-a1c323d5-9218-43a0-b972-c6f1dd8b4dd8 tempest-VolumesSnapshotNegativeTestJSON-1925929240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6e51d7b4-1258-46d7-a1af-d77665c2443d.a7091e99-29fe-42d5-8e0b-f51da15f602d {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:28:16 devstack sudo[93573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6e51d7b4-1258-46d7-a1af-d77665c2443d.a7091e99-29fe-42d5-8e0b-f51da15f602d
Nov 03 18:28:16 devstack sudo[93573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:28:17 devstack sudo[93573]: pam_unix(sudo:session): session closed for user root
Nov 03 18:28:17 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-a1c323d5-9218-43a0-b972-c6f1dd8b4dd8 tempest-VolumesSnapshotNegativeTestJSON-1925929240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6e51d7b4-1258-46d7-a1af-d77665c2443d.a7091e99-29fe-42d5-8e0b-f51da15f602d" returned: 0 in 1.067s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:28:17 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-a1c323d5-9218-43a0-b972-c6f1dd8b4dd8 tempest-VolumesSnapshotNegativeTestJSON-1925929240 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6e51d7b4-1258-46d7-a1af-d77665c2443d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86120) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 18:28:17 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cfd38b1-d1c9-4a03-bab4-43938f9c82d8]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:28:17 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-a1c323d5-9218-43a0-b972-c6f1dd8b4dd8 tempest-VolumesSnapshotNegativeTestJSON-1925929240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6e51d7b4-1258-46d7-a1af-d77665c2443d {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:28:18 devstack sudo[93628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6e51d7b4-1258-46d7-a1af-d77665c2443d
Nov 03 18:28:18 devstack sudo[93628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:28:18 devstack sudo[93628]: pam_unix(sudo:session): session closed for user root
Nov 03 18:28:18 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-a1c323d5-9218-43a0-b972-c6f1dd8b4dd8 tempest-VolumesSnapshotNegativeTestJSON-1925929240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6e51d7b4-1258-46d7-a1af-d77665c2443d" returned: 0 in 0.786s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:28:18 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-a1c323d5-9218-43a0-b972-c6f1dd8b4dd8 tempest-VolumesSnapshotNegativeTestJSON-1925929240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6e51d7b4-1258-46d7-a1af-d77665c2443d.a7091e99-29fe-42d5-8e0b-f51da15f602d {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:28:18 devstack sudo[93641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6e51d7b4-1258-46d7-a1af-d77665c2443d.a7091e99-29fe-42d5-8e0b-f51da15f602d
Nov 03 18:28:18 devstack sudo[93641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:28:19 devstack sudo[93641]: pam_unix(sudo:session): session closed for user root
Nov 03 18:28:19 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-a1c323d5-9218-43a0-b972-c6f1dd8b4dd8 tempest-VolumesSnapshotNegativeTestJSON-1925929240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6e51d7b4-1258-46d7-a1af-d77665c2443d.a7091e99-29fe-42d5-8e0b-f51da15f602d" returned: 0 in 0.485s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:28:19 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-a1c323d5-9218-43a0-b972-c6f1dd8b4dd8 tempest-VolumesSnapshotNegativeTestJSON-1925929240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6e51d7b4-1258-46d7-a1af-d77665c2443d.a7091e99-29fe-42d5-8e0b-f51da15f602d {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:28:19 devstack sudo[93648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6e51d7b4-1258-46d7-a1af-d77665c2443d.a7091e99-29fe-42d5-8e0b-f51da15f602d
Nov 03 18:28:19 devstack sudo[93648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:28:19 devstack sudo[93648]: pam_unix(sudo:session): session closed for user root
Nov 03 18:28:19 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-a1c323d5-9218-43a0-b972-c6f1dd8b4dd8 tempest-VolumesSnapshotNegativeTestJSON-1925929240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6e51d7b4-1258-46d7-a1af-d77665c2443d.a7091e99-29fe-42d5-8e0b-f51da15f602d" returned: 0 in 0.393s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:28:19 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-a1c323d5-9218-43a0-b972-c6f1dd8b4dd8 tempest-VolumesSnapshotNegativeTestJSON-1925929240 None] Lock "cinder-quobyte-a7091e99-29fe-42d5-8e0b-f51da15f602d" released by "_delete_snapshot" :: held 3.090s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:28:19 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-a1c323d5-9218-43a0-b972-c6f1dd8b4dd8 tempest-VolumesSnapshotNegativeTestJSON-1925929240 None] Lock "cinder-quobyte-6e51d7b4-1258-46d7-a1af-d77665c2443d" released by "delete_snapshot" :: held 3.155s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:28:19 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-a1c323d5-9218-43a0-b972-c6f1dd8b4dd8 tempest-VolumesSnapshotNegativeTestJSON-1925929240 None] Created reservations ['209c5571-a5c7-4bcd-a983-1b2069bc9cf3', '399389d4-4085-4f29-9310-dbf5f15b8902', '072ca727-9d17-4b5e-b674-10b49147be45', '16cdfaaf-7652-467c-a9fb-1be58864a236'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:28:19 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-a1c323d5-9218-43a0-b972-c6f1dd8b4dd8 tempest-VolumesSnapshotNegativeTestJSON-1925929240 None] Delete snapshot completed successfully.
Nov 03 18:28:19 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-a1c323d5-9218-43a0-b972-c6f1dd8b4dd8 tempest-VolumesSnapshotNegativeTestJSON-1925929240 None] Lock "cinder-a7091e99-29fe-42d5-8e0b-f51da15f602d-delete_snapshot" released by "delete_snapshot" :: held 3.505s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:28:20 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-bc363e41-83f4-46dd-bde7-898c2028c67f tempest-VolumesSnapshotNegativeTestJSON-1925929240 None] Acquiring lock "cinder-6e51d7b4-1258-46d7-a1af-d77665c2443d-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:28:20 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-bc363e41-83f4-46dd-bde7-898c2028c67f tempest-VolumesSnapshotNegativeTestJSON-1925929240 None] Lock "cinder-6e51d7b4-1258-46d7-a1af-d77665c2443d-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:28:20 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-bc363e41-83f4-46dd-bde7-898c2028c67f tempest-VolumesSnapshotNegativeTestJSON-1925929240 None] Acquiring lock "cinder-quobyte-6e51d7b4-1258-46d7-a1af-d77665c2443d" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:28:21 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-bc363e41-83f4-46dd-bde7-898c2028c67f tempest-VolumesSnapshotNegativeTestJSON-1925929240 None] Lock "cinder-quobyte-6e51d7b4-1258-46d7-a1af-d77665c2443d" acquired by "delete_volume" :: waited 0.022s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:28:21 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[40e7241f-d67e-4e1b-a87f-293f0fe42e73]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:28:21 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-bc363e41-83f4-46dd-bde7-898c2028c67f tempest-VolumesSnapshotNegativeTestJSON-1925929240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6e51d7b4-1258-46d7-a1af-d77665c2443d {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:28:21 devstack sudo[93655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6e51d7b4-1258-46d7-a1af-d77665c2443d
Nov 03 18:28:21 devstack sudo[93655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:28:21 devstack sudo[93655]: pam_unix(sudo:session): session closed for user root
Nov 03 18:28:21 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-bc363e41-83f4-46dd-bde7-898c2028c67f tempest-VolumesSnapshotNegativeTestJSON-1925929240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6e51d7b4-1258-46d7-a1af-d77665c2443d" returned: 0 in 0.597s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:28:21 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-bc363e41-83f4-46dd-bde7-898c2028c67f tempest-VolumesSnapshotNegativeTestJSON-1925929240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6e51d7b4-1258-46d7-a1af-d77665c2443d {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:28:21 devstack sudo[93660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6e51d7b4-1258-46d7-a1af-d77665c2443d
Nov 03 18:28:21 devstack sudo[93660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:28:22 devstack sudo[93660]: pam_unix(sudo:session): session closed for user root
Nov 03 18:28:22 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-bc363e41-83f4-46dd-bde7-898c2028c67f tempest-VolumesSnapshotNegativeTestJSON-1925929240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6e51d7b4-1258-46d7-a1af-d77665c2443d" returned: 0 in 0.550s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:28:22 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-bc363e41-83f4-46dd-bde7-898c2028c67f tempest-VolumesSnapshotNegativeTestJSON-1925929240 None] Lock "cinder-quobyte-6e51d7b4-1258-46d7-a1af-d77665c2443d" released by "delete_volume" :: held 1.290s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:28:22 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-bc363e41-83f4-46dd-bde7-898c2028c67f tempest-VolumesSnapshotNegativeTestJSON-1925929240 None] Created reservations ['2af7ac9b-a833-4c39-98ed-8bbb6ac36a58', 'acda31db-a50f-4940-a35f-a98640201c0d', '5a81562c-31e8-4941-9331-1bdde4a983c2', '1be41ead-5a4b-42b3-9aa3-3abc2301e5f0'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:28:22 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-bc363e41-83f4-46dd-bde7-898c2028c67f tempest-VolumesSnapshotNegativeTestJSON-1925929240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:28:22 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-bc363e41-83f4-46dd-bde7-898c2028c67f tempest-VolumesSnapshotNegativeTestJSON-1925929240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:28:22 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-bc363e41-83f4-46dd-bde7-898c2028c67f tempest-VolumesSnapshotNegativeTestJSON-1925929240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:28:22 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-bc363e41-83f4-46dd-bde7-898c2028c67f tempest-VolumesSnapshotNegativeTestJSON-1925929240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:28:22 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-bc363e41-83f4-46dd-bde7-898c2028c67f tempest-VolumesSnapshotNegativeTestJSON-1925929240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:28:22 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-bc363e41-83f4-46dd-bde7-898c2028c67f tempest-VolumesSnapshotNegativeTestJSON-1925929240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:28:22 devstack sudo[93663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:28:22 devstack sudo[93663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:28:22 devstack sudo[93663]: pam_unix(sudo:session): session closed for user root
Nov 03 18:28:22 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-bc363e41-83f4-46dd-bde7-898c2028c67f tempest-VolumesSnapshotNegativeTestJSON-1925929240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.431s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:28:22 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-bc363e41-83f4-46dd-bde7-898c2028c67f tempest-VolumesSnapshotNegativeTestJSON-1925929240 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:28:22 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-bc363e41-83f4-46dd-bde7-898c2028c67f tempest-VolumesSnapshotNegativeTestJSON-1925929240 None] Deleted volume successfully.
Nov 03 18:28:22 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-bc363e41-83f4-46dd-bde7-898c2028c67f tempest-VolumesSnapshotNegativeTestJSON-1925929240 None] Lock "cinder-6e51d7b4-1258-46d7-a1af-d77665c2443d-delete_volume" released by "delete_volume" :: held 2.030s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:28:24 devstack cinder-volume[86120]: DEBUG dbcounter [-] [86120] Writing DB stats cinder:SELECT=80,cinder:INSERT=29,cinder:UPDATE=106,cinder:DELETE=7 {{(pid=86120) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 18:28:24 devstack cinder-volume[86120]: DEBUG dbcounter [-] [86120] Writing DB stats cinder:SELECT=93,cinder:UPDATE=108,cinder:INSERT=27,cinder:DELETE=10 {{(pid=86120) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 18:28:24 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-7af15acd-3484-4a66-adbe-3f2050db0005 tempest-VolumesActionsTest-1478820281 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:28:24 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-7af15acd-3484-4a66-adbe-3f2050db0005 tempest-VolumesActionsTest-1478820281 None] Flow 'volume_create_manager' (7d1eb48d-df9b-4ccc-afbe-508ff1a1c8f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:28:24 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-7af15acd-3484-4a66-adbe-3f2050db0005 tempest-VolumesActionsTest-1478820281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f47ab013-a0a3-4052-9815-684f3e653f20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:28:24 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-7af15acd-3484-4a66-adbe-3f2050db0005 tempest-VolumesActionsTest-1478820281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f47ab013-a0a3-4052-9815-684f3e653f20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:28:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-112145892',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b91139a-7861-42ec-9f14-713c2ea95ebe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3713a26c66e0463092724bd388253b15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:28:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:28:25Z,use_quota=True,user_id='777de2e782894713b1fefc3a64c8ac5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:28:24 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-7af15acd-3484-4a66-adbe-3f2050db0005 tempest-VolumesActionsTest-1478820281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33e2b343-012b-4e82-89b4-f2bd45f4f5a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:28:24 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-7af15acd-3484-4a66-adbe-3f2050db0005 tempest-VolumesActionsTest-1478820281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33e2b343-012b-4e82-89b4-f2bd45f4f5a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:28:24 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-7af15acd-3484-4a66-adbe-3f2050db0005 tempest-VolumesActionsTest-1478820281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ba149c8-c92e-4794-a610-5823eebd3628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:28:24 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-7af15acd-3484-4a66-adbe-3f2050db0005 tempest-VolumesActionsTest-1478820281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ba149c8-c92e-4794-a610-5823eebd3628) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b91139a-7861-42ec-9f14-713c2ea95ebe', 'volume_name': 'volume-6b91139a-7861-42ec-9f14-713c2ea95ebe', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:28:24 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-7af15acd-3484-4a66-adbe-3f2050db0005 tempest-VolumesActionsTest-1478820281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48b2c4bc-774f-40c8-affd-d3cab567f9ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:28:24 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-7af15acd-3484-4a66-adbe-3f2050db0005 tempest-VolumesActionsTest-1478820281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48b2c4bc-774f-40c8-affd-d3cab567f9ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:28:24 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-7af15acd-3484-4a66-adbe-3f2050db0005 tempest-VolumesActionsTest-1478820281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3045d2d2-2b71-404d-9d23-f3b36a1c71c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:28:24 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-7af15acd-3484-4a66-adbe-3f2050db0005 tempest-VolumesActionsTest-1478820281 None] Volume 6b91139a-7861-42ec-9f14-713c2ea95ebe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b91139a-7861-42ec-9f14-713c2ea95ebe', 'volume_size': 1}
Nov 03 18:28:24 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-7af15acd-3484-4a66-adbe-3f2050db0005 tempest-VolumesActionsTest-1478820281 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:28:24 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-7af15acd-3484-4a66-adbe-3f2050db0005 tempest-VolumesActionsTest-1478820281 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:28:24 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-7af15acd-3484-4a66-adbe-3f2050db0005 tempest-VolumesActionsTest-1478820281 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:28:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-112145892',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b91139a-7861-42ec-9f14-713c2ea95ebe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3713a26c66e0463092724bd388253b15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:28:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:28:25Z,use_quota=True,user_id='777de2e782894713b1fefc3a64c8ac5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:28:24 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-7af15acd-3484-4a66-adbe-3f2050db0005 tempest-VolumesActionsTest-1478820281 None] Creating volume 6b91139a-7861-42ec-9f14-713c2ea95ebe {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:28:24 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-7af15acd-3484-4a66-adbe-3f2050db0005 tempest-VolumesActionsTest-1478820281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:28:24 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-7af15acd-3484-4a66-adbe-3f2050db0005 tempest-VolumesActionsTest-1478820281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:28:24 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-7af15acd-3484-4a66-adbe-3f2050db0005 tempest-VolumesActionsTest-1478820281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:28:24 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-7af15acd-3484-4a66-adbe-3f2050db0005 tempest-VolumesActionsTest-1478820281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:28:24 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-7af15acd-3484-4a66-adbe-3f2050db0005 tempest-VolumesActionsTest-1478820281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:28:24 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-7af15acd-3484-4a66-adbe-3f2050db0005 tempest-VolumesActionsTest-1478820281 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:28:24 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-7af15acd-3484-4a66-adbe-3f2050db0005 tempest-VolumesActionsTest-1478820281 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:28:24 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-7af15acd-3484-4a66-adbe-3f2050db0005 tempest-VolumesActionsTest-1478820281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6b91139a-7861-42ec-9f14-713c2ea95ebe 1073741824 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:28:24 devstack sudo[93704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6b91139a-7861-42ec-9f14-713c2ea95ebe 1073741824
Nov 03 18:28:24 devstack sudo[93704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:28:25 devstack sudo[93704]: pam_unix(sudo:session): session closed for user root
Nov 03 18:28:25 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-7af15acd-3484-4a66-adbe-3f2050db0005 tempest-VolumesActionsTest-1478820281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6b91139a-7861-42ec-9f14-713c2ea95ebe 1073741824" returned: 0 in 0.582s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:28:25 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-7af15acd-3484-4a66-adbe-3f2050db0005 tempest-VolumesActionsTest-1478820281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6b91139a-7861-42ec-9f14-713c2ea95ebe {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:28:25 devstack sudo[93710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6b91139a-7861-42ec-9f14-713c2ea95ebe
Nov 03 18:28:25 devstack sudo[93710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:28:25 devstack sudo[93710]: pam_unix(sudo:session): session closed for user root
Nov 03 18:28:25 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-7af15acd-3484-4a66-adbe-3f2050db0005 tempest-VolumesActionsTest-1478820281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6b91139a-7861-42ec-9f14-713c2ea95ebe" returned: 0 in 0.378s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:28:25 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-7af15acd-3484-4a66-adbe-3f2050db0005 tempest-VolumesActionsTest-1478820281 None] <== create_volume: return (1032ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:28:25 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-7af15acd-3484-4a66-adbe-3f2050db0005 tempest-VolumesActionsTest-1478820281 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.036s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:28:25 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-7af15acd-3484-4a66-adbe-3f2050db0005 tempest-VolumesActionsTest-1478820281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3045d2d2-2b71-404d-9d23-f3b36a1c71c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b91139a-7861-42ec-9f14-713c2ea95ebe', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:28:25 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-7af15acd-3484-4a66-adbe-3f2050db0005 tempest-VolumesActionsTest-1478820281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c758099-b69f-4521-a139-4193fb4b8c3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:28:25 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-7af15acd-3484-4a66-adbe-3f2050db0005 tempest-VolumesActionsTest-1478820281 None] Volume volume-6b91139a-7861-42ec-9f14-713c2ea95ebe (6b91139a-7861-42ec-9f14-713c2ea95ebe): created successfully
Nov 03 18:28:25 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-7af15acd-3484-4a66-adbe-3f2050db0005 tempest-VolumesActionsTest-1478820281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c758099-b69f-4521-a139-4193fb4b8c3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:28:25 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-7af15acd-3484-4a66-adbe-3f2050db0005 tempest-VolumesActionsTest-1478820281 None] Flow 'volume_create_manager' (7d1eb48d-df9b-4ccc-afbe-508ff1a1c8f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:28:25 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-7af15acd-3484-4a66-adbe-3f2050db0005 tempest-VolumesActionsTest-1478820281 None] Created volume successfully.
Nov 03 18:28:35 devstack cinder-volume[86120]: DEBUG dbcounter [-] [86120] Writing DB stats cinder:SELECT=1,cinder:UPDATE=4,cinder:INSERT=1 {{(pid=86120) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 18:28:35 devstack cinder-volume[86120]: DEBUG dbcounter [-] [86120] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1,cinder:DELETE=1 {{(pid=86120) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 18:28:38 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-86a78fdf-af55-4438-a5de-2c76b0ecd6ef tempest-AttachVolumeShelveTestJSON-629024950 None] Acquiring lock "cinder-178794a7-a450-4f80-b6b1-a151864e7e1e-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:28:38 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-86a78fdf-af55-4438-a5de-2c76b0ecd6ef tempest-AttachVolumeShelveTestJSON-629024950 None] Lock "cinder-178794a7-a450-4f80-b6b1-a151864e7e1e-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:28:38 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-86a78fdf-af55-4438-a5de-2c76b0ecd6ef tempest-AttachVolumeShelveTestJSON-629024950 None] Acquiring lock "cinder-quobyte-178794a7-a450-4f80-b6b1-a151864e7e1e" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:28:38 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-86a78fdf-af55-4438-a5de-2c76b0ecd6ef tempest-AttachVolumeShelveTestJSON-629024950 None] Lock "cinder-quobyte-178794a7-a450-4f80-b6b1-a151864e7e1e" acquired by "delete_volume" :: waited 0.041s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:28:39 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[52344b78-aef3-47b1-936a-e19c7a31ae85]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:28:39 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-86a78fdf-af55-4438-a5de-2c76b0ecd6ef tempest-AttachVolumeShelveTestJSON-629024950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-178794a7-a450-4f80-b6b1-a151864e7e1e {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:28:39 devstack sudo[93839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-178794a7-a450-4f80-b6b1-a151864e7e1e
Nov 03 18:28:39 devstack sudo[93839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:28:39 devstack sudo[93839]: pam_unix(sudo:session): session closed for user root
Nov 03 18:28:39 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-86a78fdf-af55-4438-a5de-2c76b0ecd6ef tempest-AttachVolumeShelveTestJSON-629024950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-178794a7-a450-4f80-b6b1-a151864e7e1e" returned: 0 in 0.624s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:28:39 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-86a78fdf-af55-4438-a5de-2c76b0ecd6ef tempest-AttachVolumeShelveTestJSON-629024950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-178794a7-a450-4f80-b6b1-a151864e7e1e {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:28:39 devstack sudo[93849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-178794a7-a450-4f80-b6b1-a151864e7e1e
Nov 03 18:28:39 devstack sudo[93849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:28:40 devstack sudo[93849]: pam_unix(sudo:session): session closed for user root
Nov 03 18:28:40 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-86a78fdf-af55-4438-a5de-2c76b0ecd6ef tempest-AttachVolumeShelveTestJSON-629024950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-178794a7-a450-4f80-b6b1-a151864e7e1e" returned: 0 in 0.450s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:28:40 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-86a78fdf-af55-4438-a5de-2c76b0ecd6ef tempest-AttachVolumeShelveTestJSON-629024950 None] Lock "cinder-quobyte-178794a7-a450-4f80-b6b1-a151864e7e1e" released by "delete_volume" :: held 1.184s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:28:40 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-86a78fdf-af55-4438-a5de-2c76b0ecd6ef tempest-AttachVolumeShelveTestJSON-629024950 None] Created reservations ['f7b3d67f-ae3c-4309-bb03-d702b3ccbd5a', '681e3844-d2e7-406a-b3f3-ddbd22a2a197', 'ba93f85f-6979-4509-9614-50b963df9be2', '1c62ca49-7b28-4779-aabf-852c483648a8'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:28:40 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-86a78fdf-af55-4438-a5de-2c76b0ecd6ef tempest-AttachVolumeShelveTestJSON-629024950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:28:40 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-86a78fdf-af55-4438-a5de-2c76b0ecd6ef tempest-AttachVolumeShelveTestJSON-629024950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:28:40 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-86a78fdf-af55-4438-a5de-2c76b0ecd6ef tempest-AttachVolumeShelveTestJSON-629024950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:28:40 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-86a78fdf-af55-4438-a5de-2c76b0ecd6ef tempest-AttachVolumeShelveTestJSON-629024950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:28:40 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-86a78fdf-af55-4438-a5de-2c76b0ecd6ef tempest-AttachVolumeShelveTestJSON-629024950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:28:40 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-86a78fdf-af55-4438-a5de-2c76b0ecd6ef tempest-AttachVolumeShelveTestJSON-629024950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:28:40 devstack sudo[93852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:28:40 devstack sudo[93852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:28:40 devstack sudo[93852]: pam_unix(sudo:session): session closed for user root
Nov 03 18:28:40 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-86a78fdf-af55-4438-a5de-2c76b0ecd6ef tempest-AttachVolumeShelveTestJSON-629024950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.322s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:28:40 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-86a78fdf-af55-4438-a5de-2c76b0ecd6ef tempest-AttachVolumeShelveTestJSON-629024950 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:28:40 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-86a78fdf-af55-4438-a5de-2c76b0ecd6ef tempest-AttachVolumeShelveTestJSON-629024950 None] Deleted volume successfully.
Nov 03 18:28:40 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-86a78fdf-af55-4438-a5de-2c76b0ecd6ef tempest-AttachVolumeShelveTestJSON-629024950 None] Lock "cinder-178794a7-a450-4f80-b6b1-a151864e7e1e-delete_volume" released by "delete_volume" :: held 1.956s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:28:43 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f15fdca-9110-4bb7-9913-a5b8b59334ef tempest-AttachVolumeTestJSON-374454512 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:28:43 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-5f15fdca-9110-4bb7-9913-a5b8b59334ef tempest-AttachVolumeTestJSON-374454512 None] Flow 'volume_create_manager' (9ffa3f2d-d0da-4232-89f7-f9962a097118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:28:43 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-5f15fdca-9110-4bb7-9913-a5b8b59334ef tempest-AttachVolumeTestJSON-374454512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b22cf20f-1b73-4910-9748-45ed46903a92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:28:43 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-5f15fdca-9110-4bb7-9913-a5b8b59334ef tempest-AttachVolumeTestJSON-374454512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b22cf20f-1b73-4910-9748-45ed46903a92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:28:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1765394603',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80bb7033-5c88-4baf-9011-d7b78515ee94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44080038429342c1b6a06a1c04699704',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:28:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:28:43Z,use_quota=True,user_id='84f64ec5568f4c32a950eaaaf709123b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:28:43 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-5f15fdca-9110-4bb7-9913-a5b8b59334ef tempest-AttachVolumeTestJSON-374454512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34baac74-caf3-4241-a9bb-7ce5bd1fb7c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:28:43 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-5f15fdca-9110-4bb7-9913-a5b8b59334ef tempest-AttachVolumeTestJSON-374454512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34baac74-caf3-4241-a9bb-7ce5bd1fb7c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:28:43 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-5f15fdca-9110-4bb7-9913-a5b8b59334ef tempest-AttachVolumeTestJSON-374454512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ebf49ae-dc52-445c-ab13-31b36a85f386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:28:43 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-5f15fdca-9110-4bb7-9913-a5b8b59334ef tempest-AttachVolumeTestJSON-374454512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ebf49ae-dc52-445c-ab13-31b36a85f386) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80bb7033-5c88-4baf-9011-d7b78515ee94', 'volume_name': 'volume-80bb7033-5c88-4baf-9011-d7b78515ee94', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:28:43 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-5f15fdca-9110-4bb7-9913-a5b8b59334ef tempest-AttachVolumeTestJSON-374454512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acad2e69-0a47-41ed-992c-a06877d4ec76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:28:43 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-5f15fdca-9110-4bb7-9913-a5b8b59334ef tempest-AttachVolumeTestJSON-374454512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acad2e69-0a47-41ed-992c-a06877d4ec76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:28:43 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-5f15fdca-9110-4bb7-9913-a5b8b59334ef tempest-AttachVolumeTestJSON-374454512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bb235e0-0224-4ef4-8118-875b328cf8b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:28:43 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-5f15fdca-9110-4bb7-9913-a5b8b59334ef tempest-AttachVolumeTestJSON-374454512 None] Volume 80bb7033-5c88-4baf-9011-d7b78515ee94: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80bb7033-5c88-4baf-9011-d7b78515ee94', 'volume_size': 1}
Nov 03 18:28:43 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-5f15fdca-9110-4bb7-9913-a5b8b59334ef tempest-AttachVolumeTestJSON-374454512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:28:43 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-5f15fdca-9110-4bb7-9913-a5b8b59334ef tempest-AttachVolumeTestJSON-374454512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:28:43 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-5f15fdca-9110-4bb7-9913-a5b8b59334ef tempest-AttachVolumeTestJSON-374454512 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:28:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1765394603',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80bb7033-5c88-4baf-9011-d7b78515ee94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44080038429342c1b6a06a1c04699704',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:28:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:28:43Z,use_quota=True,user_id='84f64ec5568f4c32a950eaaaf709123b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:28:43 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-5f15fdca-9110-4bb7-9913-a5b8b59334ef tempest-AttachVolumeTestJSON-374454512 None] Creating volume 80bb7033-5c88-4baf-9011-d7b78515ee94 {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:28:43 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-5f15fdca-9110-4bb7-9913-a5b8b59334ef tempest-AttachVolumeTestJSON-374454512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:28:43 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-5f15fdca-9110-4bb7-9913-a5b8b59334ef tempest-AttachVolumeTestJSON-374454512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:28:43 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-5f15fdca-9110-4bb7-9913-a5b8b59334ef tempest-AttachVolumeTestJSON-374454512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:28:43 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-5f15fdca-9110-4bb7-9913-a5b8b59334ef tempest-AttachVolumeTestJSON-374454512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:28:43 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-5f15fdca-9110-4bb7-9913-a5b8b59334ef tempest-AttachVolumeTestJSON-374454512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:28:43 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-5f15fdca-9110-4bb7-9913-a5b8b59334ef tempest-AttachVolumeTestJSON-374454512 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:28:43 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-5f15fdca-9110-4bb7-9913-a5b8b59334ef tempest-AttachVolumeTestJSON-374454512 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:28:43 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-5f15fdca-9110-4bb7-9913-a5b8b59334ef tempest-AttachVolumeTestJSON-374454512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-80bb7033-5c88-4baf-9011-d7b78515ee94 1073741824 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:28:43 devstack sudo[93868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-80bb7033-5c88-4baf-9011-d7b78515ee94 1073741824
Nov 03 18:28:43 devstack sudo[93868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:28:43 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-8b749450-78bb-4a37-a04c-e1a81609ddd4 tempest-VolumesActionsTest-1478820281 None] Acquiring lock "cinder-6b91139a-7861-42ec-9f14-713c2ea95ebe" by "attach_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:28:43 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-8b749450-78bb-4a37-a04c-e1a81609ddd4 tempest-VolumesActionsTest-1478820281 None] Lock "cinder-6b91139a-7861-42ec-9f14-713c2ea95ebe" acquired by "attach_volume" :: waited 0.041s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:28:43 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-8b749450-78bb-4a37-a04c-e1a81609ddd4 tempest-VolumesActionsTest-1478820281 None] Attaching volume 6b91139a-7861-42ec-9f14-713c2ea95ebe to instance 4f1e73f9-69d7-4a82-8d29-d1773b9a92f5 at mountpoint /dev/vdb on host None.
Nov 03 18:28:43 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-8b749450-78bb-4a37-a04c-e1a81609ddd4 tempest-VolumesActionsTest-1478820281 None] Attach volume completed successfully.
Nov 03 18:28:44 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-8b749450-78bb-4a37-a04c-e1a81609ddd4 tempest-VolumesActionsTest-1478820281 None] Lock "cinder-6b91139a-7861-42ec-9f14-713c2ea95ebe" released by "attach_volume" :: held 0.154s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:28:44 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-26f9f29a-c961-4421-a062-7268597895e8 tempest-VolumesActionsTest-1478820281 None] Acquiring lock "cinder-6b91139a-7861-42ec-9f14-713c2ea95ebe-detach_volume" by "detach_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:28:44 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-26f9f29a-c961-4421-a062-7268597895e8 tempest-VolumesActionsTest-1478820281 None] Lock "cinder-6b91139a-7861-42ec-9f14-713c2ea95ebe-detach_volume" acquired by "detach_volume" :: waited 0.026s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:28:44 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-26f9f29a-c961-4421-a062-7268597895e8 tempest-VolumesActionsTest-1478820281 None] Detaching volume 6b91139a-7861-42ec-9f14-713c2ea95ebe from instance 4f1e73f9-69d7-4a82-8d29-d1773b9a92f5.
Nov 03 18:28:44 devstack sudo[93868]: pam_unix(sudo:session): session closed for user root
Nov 03 18:28:44 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-5f15fdca-9110-4bb7-9913-a5b8b59334ef tempest-AttachVolumeTestJSON-374454512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-80bb7033-5c88-4baf-9011-d7b78515ee94 1073741824" returned: 0 in 0.852s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:28:44 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-26f9f29a-c961-4421-a062-7268597895e8 tempest-VolumesActionsTest-1478820281 None] Detach volume completed successfully.
Nov 03 18:28:44 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-26f9f29a-c961-4421-a062-7268597895e8 tempest-VolumesActionsTest-1478820281 None] Lock "cinder-6b91139a-7861-42ec-9f14-713c2ea95ebe-detach_volume" released by "detach_volume" :: held 0.121s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:28:44 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-5f15fdca-9110-4bb7-9913-a5b8b59334ef tempest-AttachVolumeTestJSON-374454512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-80bb7033-5c88-4baf-9011-d7b78515ee94 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:28:44 devstack sudo[93874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-80bb7033-5c88-4baf-9011-d7b78515ee94
Nov 03 18:28:44 devstack sudo[93874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:28:44 devstack sudo[93874]: pam_unix(sudo:session): session closed for user root
Nov 03 18:28:44 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-5f15fdca-9110-4bb7-9913-a5b8b59334ef tempest-AttachVolumeTestJSON-374454512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-80bb7033-5c88-4baf-9011-d7b78515ee94" returned: 0 in 0.330s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:28:44 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-5f15fdca-9110-4bb7-9913-a5b8b59334ef tempest-AttachVolumeTestJSON-374454512 None] <== create_volume: return (1260ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:28:44 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-5f15fdca-9110-4bb7-9913-a5b8b59334ef tempest-AttachVolumeTestJSON-374454512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.265s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:28:44 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-5f15fdca-9110-4bb7-9913-a5b8b59334ef tempest-AttachVolumeTestJSON-374454512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bb235e0-0224-4ef4-8118-875b328cf8b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80bb7033-5c88-4baf-9011-d7b78515ee94', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:28:44 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-5f15fdca-9110-4bb7-9913-a5b8b59334ef tempest-AttachVolumeTestJSON-374454512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20cfe609-18ee-4761-b731-92b4ffb17bdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:28:44 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-5f15fdca-9110-4bb7-9913-a5b8b59334ef tempest-AttachVolumeTestJSON-374454512 None] Volume volume-80bb7033-5c88-4baf-9011-d7b78515ee94 (80bb7033-5c88-4baf-9011-d7b78515ee94): created successfully
Nov 03 18:28:44 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-5f15fdca-9110-4bb7-9913-a5b8b59334ef tempest-AttachVolumeTestJSON-374454512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20cfe609-18ee-4761-b731-92b4ffb17bdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:28:44 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-5f15fdca-9110-4bb7-9913-a5b8b59334ef tempest-AttachVolumeTestJSON-374454512 None] Flow 'volume_create_manager' (9ffa3f2d-d0da-4232-89f7-f9962a097118) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:28:44 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-5f15fdca-9110-4bb7-9913-a5b8b59334ef tempest-AttachVolumeTestJSON-374454512 None] Created volume successfully.
Nov 03 18:28:46 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [req-dfccdd23-af14-4cc0-9f97-4a9dafe3d3d9 req-83ba1a5e-9566-41f6-aaeb-6a640f662ddc tempest-AttachVolumeTestJSON-374454512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:28:46 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [req-dfccdd23-af14-4cc0-9f97-4a9dafe3d3d9 req-83ba1a5e-9566-41f6-aaeb-6a640f662ddc tempest-AttachVolumeTestJSON-374454512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:28:46 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [req-dfccdd23-af14-4cc0-9f97-4a9dafe3d3d9 req-83ba1a5e-9566-41f6-aaeb-6a640f662ddc tempest-AttachVolumeTestJSON-374454512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:28:46 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [req-dfccdd23-af14-4cc0-9f97-4a9dafe3d3d9 req-83ba1a5e-9566-41f6-aaeb-6a640f662ddc tempest-AttachVolumeTestJSON-374454512 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c', 'name': 'volume-80bb7033-5c88-4baf-9011-d7b78515ee94', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e053ef7e-f66b-4471-8bfd-2999130f27fd', 'enforce_multipath': True} {{(pid=86120) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 03 18:28:46 devstack cinder-volume[86120]: INFO cinder.volume.manager [req-dfccdd23-af14-4cc0-9f97-4a9dafe3d3d9 req-83ba1a5e-9566-41f6-aaeb-6a640f662ddc tempest-AttachVolumeTestJSON-374454512 None] attachment_update completed successfully.
Nov 03 18:28:54 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-a76035f8-b2df-4467-97a9-38cda661da0d tempest-VolumesTestJSON-1647111425 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:28:54 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-a76035f8-b2df-4467-97a9-38cda661da0d tempest-VolumesTestJSON-1647111425 None] Flow 'volume_create_manager' (88ce7d6b-c783-49f3-ad61-97bed74bdc8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:28:54 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-a76035f8-b2df-4467-97a9-38cda661da0d tempest-VolumesTestJSON-1647111425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d412e167-ab52-4dd4-b52e-64641c500545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:28:54 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-a76035f8-b2df-4467-97a9-38cda661da0d tempest-VolumesTestJSON-1647111425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d412e167-ab52-4dd4-b52e-64641c500545) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:28:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-20425214',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce230949-a847-4f98-8c60-e9d11b7f13b1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='116e3989fa184b35a056d035aac2c87b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:28:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:28:55Z,use_quota=True,user_id='958e70385d514b42b5a3d9ac94ed1781',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:28:54 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-a76035f8-b2df-4467-97a9-38cda661da0d tempest-VolumesTestJSON-1647111425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69e59951-bf3f-4f62-8a14-d61b8e618cc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:28:54 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-a76035f8-b2df-4467-97a9-38cda661da0d tempest-VolumesTestJSON-1647111425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69e59951-bf3f-4f62-8a14-d61b8e618cc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:28:54 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-a76035f8-b2df-4467-97a9-38cda661da0d tempest-VolumesTestJSON-1647111425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdd697ce-fbef-488e-b950-9464ae53b49c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:28:54 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-a76035f8-b2df-4467-97a9-38cda661da0d tempest-VolumesTestJSON-1647111425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdd697ce-fbef-488e-b950-9464ae53b49c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce230949-a847-4f98-8c60-e9d11b7f13b1', 'volume_name': 'volume-ce230949-a847-4f98-8c60-e9d11b7f13b1', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:28:54 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-a76035f8-b2df-4467-97a9-38cda661da0d tempest-VolumesTestJSON-1647111425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (863cbfb4-4637-421d-a11d-9d2e84be898d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:28:54 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-a76035f8-b2df-4467-97a9-38cda661da0d tempest-VolumesTestJSON-1647111425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (863cbfb4-4637-421d-a11d-9d2e84be898d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:28:54 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-a76035f8-b2df-4467-97a9-38cda661da0d tempest-VolumesTestJSON-1647111425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e32b4725-e11b-48e3-a459-52b77c422c0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:28:54 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-a76035f8-b2df-4467-97a9-38cda661da0d tempest-VolumesTestJSON-1647111425 None] Volume ce230949-a847-4f98-8c60-e9d11b7f13b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce230949-a847-4f98-8c60-e9d11b7f13b1', 'volume_size': 1}
Nov 03 18:28:54 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-a76035f8-b2df-4467-97a9-38cda661da0d tempest-VolumesTestJSON-1647111425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:28:54 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-a76035f8-b2df-4467-97a9-38cda661da0d tempest-VolumesTestJSON-1647111425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:28:54 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-a76035f8-b2df-4467-97a9-38cda661da0d tempest-VolumesTestJSON-1647111425 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:28:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-20425214',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce230949-a847-4f98-8c60-e9d11b7f13b1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='116e3989fa184b35a056d035aac2c87b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:28:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:28:55Z,use_quota=True,user_id='958e70385d514b42b5a3d9ac94ed1781',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:28:54 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-a76035f8-b2df-4467-97a9-38cda661da0d tempest-VolumesTestJSON-1647111425 None] Creating volume ce230949-a847-4f98-8c60-e9d11b7f13b1 {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:28:54 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-a76035f8-b2df-4467-97a9-38cda661da0d tempest-VolumesTestJSON-1647111425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:28:54 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-a76035f8-b2df-4467-97a9-38cda661da0d tempest-VolumesTestJSON-1647111425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:28:54 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-a76035f8-b2df-4467-97a9-38cda661da0d tempest-VolumesTestJSON-1647111425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:28:54 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-a76035f8-b2df-4467-97a9-38cda661da0d tempest-VolumesTestJSON-1647111425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:28:54 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-a76035f8-b2df-4467-97a9-38cda661da0d tempest-VolumesTestJSON-1647111425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:28:54 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-a76035f8-b2df-4467-97a9-38cda661da0d tempest-VolumesTestJSON-1647111425 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:28:54 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-a76035f8-b2df-4467-97a9-38cda661da0d tempest-VolumesTestJSON-1647111425 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:28:54 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-a76035f8-b2df-4467-97a9-38cda661da0d tempest-VolumesTestJSON-1647111425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ce230949-a847-4f98-8c60-e9d11b7f13b1 1073741824 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:28:54 devstack sudo[94352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ce230949-a847-4f98-8c60-e9d11b7f13b1 1073741824
Nov 03 18:28:54 devstack sudo[94352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:28:55 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1bf25db-cd3b-4c60-833d-dd2ab363af68 tempest-TestServerVolumeAttachmentScenario-290524599 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:28:55 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-e1bf25db-cd3b-4c60-833d-dd2ab363af68 tempest-TestServerVolumeAttachmentScenario-290524599 None] Flow 'volume_create_manager' (3cd9fa6b-868a-419c-b2f7-cfefc7d2c5c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:28:55 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-e1bf25db-cd3b-4c60-833d-dd2ab363af68 tempest-TestServerVolumeAttachmentScenario-290524599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d894d55d-5233-4d9c-9a01-99974274768b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:28:55 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-e1bf25db-cd3b-4c60-833d-dd2ab363af68 tempest-TestServerVolumeAttachmentScenario-290524599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d894d55d-5233-4d9c-9a01-99974274768b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:28:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1463387170',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=953af810-f12c-458c-95df-164c55a028e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='478e6b95f973429fad9e4b4e1887a3a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:28:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:28:55Z,use_quota=True,user_id='7c499b64f8184b1f98f903b5e1c48995',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:28:55 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-e1bf25db-cd3b-4c60-833d-dd2ab363af68 tempest-TestServerVolumeAttachmentScenario-290524599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a43df0e7-61f8-4bbb-9867-407f4c4e7dee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:28:55 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-e1bf25db-cd3b-4c60-833d-dd2ab363af68 tempest-TestServerVolumeAttachmentScenario-290524599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a43df0e7-61f8-4bbb-9867-407f4c4e7dee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:28:55 devstack sudo[94352]: pam_unix(sudo:session): session closed for user root
Nov 03 18:28:55 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-e1bf25db-cd3b-4c60-833d-dd2ab363af68 tempest-TestServerVolumeAttachmentScenario-290524599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37b60bf7-b17b-4dfa-8108-35cece641d6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:28:55 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-e1bf25db-cd3b-4c60-833d-dd2ab363af68 tempest-TestServerVolumeAttachmentScenario-290524599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37b60bf7-b17b-4dfa-8108-35cece641d6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '953af810-f12c-458c-95df-164c55a028e1', 'volume_name': 'volume-953af810-f12c-458c-95df-164c55a028e1', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:28:55 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-e1bf25db-cd3b-4c60-833d-dd2ab363af68 tempest-TestServerVolumeAttachmentScenario-290524599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aab16563-1b0b-4a90-90cf-87049ead1017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:28:55 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-e1bf25db-cd3b-4c60-833d-dd2ab363af68 tempest-TestServerVolumeAttachmentScenario-290524599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aab16563-1b0b-4a90-90cf-87049ead1017) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:28:55 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-e1bf25db-cd3b-4c60-833d-dd2ab363af68 tempest-TestServerVolumeAttachmentScenario-290524599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (daac4959-e94f-452e-8c9a-2963c1b28cbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:28:55 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-e1bf25db-cd3b-4c60-833d-dd2ab363af68 tempest-TestServerVolumeAttachmentScenario-290524599 None] Volume 953af810-f12c-458c-95df-164c55a028e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-953af810-f12c-458c-95df-164c55a028e1', 'volume_size': 1}
Nov 03 18:28:55 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-e1bf25db-cd3b-4c60-833d-dd2ab363af68 tempest-TestServerVolumeAttachmentScenario-290524599 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:28:55 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-a76035f8-b2df-4467-97a9-38cda661da0d tempest-VolumesTestJSON-1647111425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ce230949-a847-4f98-8c60-e9d11b7f13b1 1073741824" returned: 0 in 1.055s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:28:56 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-a76035f8-b2df-4467-97a9-38cda661da0d tempest-VolumesTestJSON-1647111425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ce230949-a847-4f98-8c60-e9d11b7f13b1 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:28:56 devstack sudo[94429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ce230949-a847-4f98-8c60-e9d11b7f13b1
Nov 03 18:28:56 devstack sudo[94429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:28:56 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-5316319c-c0d6-4545-9673-07775851628b tempest-TestServerVolumeAttachmentScenario-290524599 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:28:56 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-5316319c-c0d6-4545-9673-07775851628b tempest-TestServerVolumeAttachmentScenario-290524599 None] Flow 'volume_create_manager' (1e4f52c6-5d68-4bae-9212-676e6935c9b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:28:56 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-5316319c-c0d6-4545-9673-07775851628b tempest-TestServerVolumeAttachmentScenario-290524599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd29a0f1-65d2-4d2e-a226-0493435d9429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:28:56 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-5316319c-c0d6-4545-9673-07775851628b tempest-TestServerVolumeAttachmentScenario-290524599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd29a0f1-65d2-4d2e-a226-0493435d9429) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:28:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-2110733486',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff530d44-28b5-4b79-bed8-04f2276bf196,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='478e6b95f973429fad9e4b4e1887a3a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:28:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:28:56Z,use_quota=True,user_id='7c499b64f8184b1f98f903b5e1c48995',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:28:56 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-5316319c-c0d6-4545-9673-07775851628b tempest-TestServerVolumeAttachmentScenario-290524599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71f4a48a-902c-4188-9537-439f28ea44e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:28:56 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-5316319c-c0d6-4545-9673-07775851628b tempest-TestServerVolumeAttachmentScenario-290524599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71f4a48a-902c-4188-9537-439f28ea44e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:28:56 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-5316319c-c0d6-4545-9673-07775851628b tempest-TestServerVolumeAttachmentScenario-290524599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c2a5706-ea09-4a05-995c-7f211011447b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:28:56 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-5316319c-c0d6-4545-9673-07775851628b tempest-TestServerVolumeAttachmentScenario-290524599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c2a5706-ea09-4a05-995c-7f211011447b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff530d44-28b5-4b79-bed8-04f2276bf196', 'volume_name': 'volume-ff530d44-28b5-4b79-bed8-04f2276bf196', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:28:56 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-5316319c-c0d6-4545-9673-07775851628b tempest-TestServerVolumeAttachmentScenario-290524599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (556a4d2a-7aee-42e9-aa30-8c90314ba34b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:28:56 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-5316319c-c0d6-4545-9673-07775851628b tempest-TestServerVolumeAttachmentScenario-290524599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (556a4d2a-7aee-42e9-aa30-8c90314ba34b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:28:56 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-5316319c-c0d6-4545-9673-07775851628b tempest-TestServerVolumeAttachmentScenario-290524599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b071504-989a-46d0-8926-522f021f9d7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:28:56 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-5316319c-c0d6-4545-9673-07775851628b tempest-TestServerVolumeAttachmentScenario-290524599 None] Volume ff530d44-28b5-4b79-bed8-04f2276bf196: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff530d44-28b5-4b79-bed8-04f2276bf196', 'volume_size': 1}
Nov 03 18:28:56 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-5316319c-c0d6-4545-9673-07775851628b tempest-TestServerVolumeAttachmentScenario-290524599 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:28:56 devstack sudo[94429]: pam_unix(sudo:session): session closed for user root
Nov 03 18:28:56 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-a76035f8-b2df-4467-97a9-38cda661da0d tempest-VolumesTestJSON-1647111425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ce230949-a847-4f98-8c60-e9d11b7f13b1" returned: 0 in 0.535s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:28:56 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-a76035f8-b2df-4467-97a9-38cda661da0d tempest-VolumesTestJSON-1647111425 None] <== create_volume: return (1672ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:28:56 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-a76035f8-b2df-4467-97a9-38cda661da0d tempest-VolumesTestJSON-1647111425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.675s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:28:56 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-e1bf25db-cd3b-4c60-833d-dd2ab363af68 tempest-TestServerVolumeAttachmentScenario-290524599 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.610s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:28:56 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-e1bf25db-cd3b-4c60-833d-dd2ab363af68 tempest-TestServerVolumeAttachmentScenario-290524599 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:28:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1463387170',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=953af810-f12c-458c-95df-164c55a028e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='478e6b95f973429fad9e4b4e1887a3a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:28:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:28:55Z,use_quota=True,user_id='7c499b64f8184b1f98f903b5e1c48995',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:28:56 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-e1bf25db-cd3b-4c60-833d-dd2ab363af68 tempest-TestServerVolumeAttachmentScenario-290524599 None] Creating volume 953af810-f12c-458c-95df-164c55a028e1 {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:28:56 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-e1bf25db-cd3b-4c60-833d-dd2ab363af68 tempest-TestServerVolumeAttachmentScenario-290524599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:28:56 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-e1bf25db-cd3b-4c60-833d-dd2ab363af68 tempest-TestServerVolumeAttachmentScenario-290524599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:28:56 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-e1bf25db-cd3b-4c60-833d-dd2ab363af68 tempest-TestServerVolumeAttachmentScenario-290524599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:28:56 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-e1bf25db-cd3b-4c60-833d-dd2ab363af68 tempest-TestServerVolumeAttachmentScenario-290524599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:28:56 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-e1bf25db-cd3b-4c60-833d-dd2ab363af68 tempest-TestServerVolumeAttachmentScenario-290524599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:28:56 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-e1bf25db-cd3b-4c60-833d-dd2ab363af68 tempest-TestServerVolumeAttachmentScenario-290524599 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:28:56 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-e1bf25db-cd3b-4c60-833d-dd2ab363af68 tempest-TestServerVolumeAttachmentScenario-290524599 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:28:56 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-e1bf25db-cd3b-4c60-833d-dd2ab363af68 tempest-TestServerVolumeAttachmentScenario-290524599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-953af810-f12c-458c-95df-164c55a028e1 1073741824 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:28:56 devstack sudo[94517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-953af810-f12c-458c-95df-164c55a028e1 1073741824
Nov 03 18:28:56 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-a76035f8-b2df-4467-97a9-38cda661da0d tempest-VolumesTestJSON-1647111425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e32b4725-e11b-48e3-a459-52b77c422c0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce230949-a847-4f98-8c60-e9d11b7f13b1', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:28:56 devstack sudo[94517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:28:56 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-a76035f8-b2df-4467-97a9-38cda661da0d tempest-VolumesTestJSON-1647111425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b7b36c5-2794-42ea-bf0b-543535e4eac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:28:56 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-a76035f8-b2df-4467-97a9-38cda661da0d tempest-VolumesTestJSON-1647111425 None] Volume volume-ce230949-a847-4f98-8c60-e9d11b7f13b1 (ce230949-a847-4f98-8c60-e9d11b7f13b1): created successfully
Nov 03 18:28:56 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-a76035f8-b2df-4467-97a9-38cda661da0d tempest-VolumesTestJSON-1647111425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b7b36c5-2794-42ea-bf0b-543535e4eac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:28:56 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-a76035f8-b2df-4467-97a9-38cda661da0d tempest-VolumesTestJSON-1647111425 None] Flow 'volume_create_manager' (88ce7d6b-c783-49f3-ad61-97bed74bdc8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:28:56 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-a76035f8-b2df-4467-97a9-38cda661da0d tempest-VolumesTestJSON-1647111425 None] Created volume successfully.
Nov 03 18:28:57 devstack sudo[94517]: pam_unix(sudo:session): session closed for user root
Nov 03 18:28:57 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-e1bf25db-cd3b-4c60-833d-dd2ab363af68 tempest-TestServerVolumeAttachmentScenario-290524599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-953af810-f12c-458c-95df-164c55a028e1 1073741824" returned: 0 in 0.895s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:28:57 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-e1bf25db-cd3b-4c60-833d-dd2ab363af68 tempest-TestServerVolumeAttachmentScenario-290524599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-953af810-f12c-458c-95df-164c55a028e1 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:28:57 devstack sudo[94537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-953af810-f12c-458c-95df-164c55a028e1
Nov 03 18:28:57 devstack sudo[94537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:28:58 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-49bbe979-2b3b-4df8-ad56-50732cd1a1a1 tempest-VolumesTestJSON-1647111425 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:28:58 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-49bbe979-2b3b-4df8-ad56-50732cd1a1a1 tempest-VolumesTestJSON-1647111425 None] Flow 'volume_create_manager' (62c15cc1-f5b2-4a57-ae21-23c0a9158503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:28:58 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-49bbe979-2b3b-4df8-ad56-50732cd1a1a1 tempest-VolumesTestJSON-1647111425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a882c6c4-8ef3-47f5-a724-adba72b9f8bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:28:58 devstack sudo[94537]: pam_unix(sudo:session): session closed for user root
Nov 03 18:28:58 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-e1bf25db-cd3b-4c60-833d-dd2ab363af68 tempest-TestServerVolumeAttachmentScenario-290524599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-953af810-f12c-458c-95df-164c55a028e1" returned: 0 in 0.619s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:28:58 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-e1bf25db-cd3b-4c60-833d-dd2ab363af68 tempest-TestServerVolumeAttachmentScenario-290524599 None] <== create_volume: return (1575ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:28:58 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-e1bf25db-cd3b-4c60-833d-dd2ab363af68 tempest-TestServerVolumeAttachmentScenario-290524599 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.582s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:28:58 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-5316319c-c0d6-4545-9673-07775851628b tempest-TestServerVolumeAttachmentScenario-290524599 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.742s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:28:58 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-5316319c-c0d6-4545-9673-07775851628b tempest-TestServerVolumeAttachmentScenario-290524599 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:28:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-2110733486',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff530d44-28b5-4b79-bed8-04f2276bf196,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='478e6b95f973429fad9e4b4e1887a3a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:28:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:28:56Z,use_quota=True,user_id='7c499b64f8184b1f98f903b5e1c48995',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:28:58 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-5316319c-c0d6-4545-9673-07775851628b tempest-TestServerVolumeAttachmentScenario-290524599 None] Creating volume ff530d44-28b5-4b79-bed8-04f2276bf196 {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:28:58 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-5316319c-c0d6-4545-9673-07775851628b tempest-TestServerVolumeAttachmentScenario-290524599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:28:58 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-5316319c-c0d6-4545-9673-07775851628b tempest-TestServerVolumeAttachmentScenario-290524599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:28:58 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-5316319c-c0d6-4545-9673-07775851628b tempest-TestServerVolumeAttachmentScenario-290524599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:28:58 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-5316319c-c0d6-4545-9673-07775851628b tempest-TestServerVolumeAttachmentScenario-290524599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:28:58 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-5316319c-c0d6-4545-9673-07775851628b tempest-TestServerVolumeAttachmentScenario-290524599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:28:58 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-5316319c-c0d6-4545-9673-07775851628b tempest-TestServerVolumeAttachmentScenario-290524599 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:28:58 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-5316319c-c0d6-4545-9673-07775851628b tempest-TestServerVolumeAttachmentScenario-290524599 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:28:58 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-5316319c-c0d6-4545-9673-07775851628b tempest-TestServerVolumeAttachmentScenario-290524599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ff530d44-28b5-4b79-bed8-04f2276bf196 1073741824 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:28:58 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-49bbe979-2b3b-4df8-ad56-50732cd1a1a1 tempest-VolumesTestJSON-1647111425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a882c6c4-8ef3-47f5-a724-adba72b9f8bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:28:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1781596590',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=841e053c-bcd6-4901-81ca-c045b17823a2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='116e3989fa184b35a056d035aac2c87b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:28:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:28:58Z,use_quota=True,user_id='958e70385d514b42b5a3d9ac94ed1781',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:28:58 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-49bbe979-2b3b-4df8-ad56-50732cd1a1a1 tempest-VolumesTestJSON-1647111425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de7794ca-2f86-4142-9d29-75c5c77fd05b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:28:58 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-49bbe979-2b3b-4df8-ad56-50732cd1a1a1 tempest-VolumesTestJSON-1647111425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de7794ca-2f86-4142-9d29-75c5c77fd05b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:28:58 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-49bbe979-2b3b-4df8-ad56-50732cd1a1a1 tempest-VolumesTestJSON-1647111425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20cca057-60e1-45b7-8bf5-6ff0d0874bd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:28:58 devstack sudo[94890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ff530d44-28b5-4b79-bed8-04f2276bf196 1073741824
Nov 03 18:28:58 devstack sudo[94890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:28:58 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-49bbe979-2b3b-4df8-ad56-50732cd1a1a1 tempest-VolumesTestJSON-1647111425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20cca057-60e1-45b7-8bf5-6ff0d0874bd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '841e053c-bcd6-4901-81ca-c045b17823a2', 'volume_name': 'volume-841e053c-bcd6-4901-81ca-c045b17823a2', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:28:58 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-49bbe979-2b3b-4df8-ad56-50732cd1a1a1 tempest-VolumesTestJSON-1647111425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebbcf0ea-2e3a-459d-b606-279f06cd84c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:28:58 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-49bbe979-2b3b-4df8-ad56-50732cd1a1a1 tempest-VolumesTestJSON-1647111425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebbcf0ea-2e3a-459d-b606-279f06cd84c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:28:58 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-49bbe979-2b3b-4df8-ad56-50732cd1a1a1 tempest-VolumesTestJSON-1647111425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b66545d8-7fc1-4564-a166-9a7d5367706e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:28:58 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-49bbe979-2b3b-4df8-ad56-50732cd1a1a1 tempest-VolumesTestJSON-1647111425 None] Volume 841e053c-bcd6-4901-81ca-c045b17823a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-841e053c-bcd6-4901-81ca-c045b17823a2', 'volume_size': 1}
Nov 03 18:28:58 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-49bbe979-2b3b-4df8-ad56-50732cd1a1a1 tempest-VolumesTestJSON-1647111425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:28:58 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-e1bf25db-cd3b-4c60-833d-dd2ab363af68 tempest-TestServerVolumeAttachmentScenario-290524599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (daac4959-e94f-452e-8c9a-2963c1b28cbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-953af810-f12c-458c-95df-164c55a028e1', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:28:58 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-e1bf25db-cd3b-4c60-833d-dd2ab363af68 tempest-TestServerVolumeAttachmentScenario-290524599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (871fb3fa-56dc-43e8-bf98-12fe4e146036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:28:58 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-e1bf25db-cd3b-4c60-833d-dd2ab363af68 tempest-TestServerVolumeAttachmentScenario-290524599 None] Volume volume-953af810-f12c-458c-95df-164c55a028e1 (953af810-f12c-458c-95df-164c55a028e1): created successfully
Nov 03 18:28:58 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-e1bf25db-cd3b-4c60-833d-dd2ab363af68 tempest-TestServerVolumeAttachmentScenario-290524599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (871fb3fa-56dc-43e8-bf98-12fe4e146036) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:28:58 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-e1bf25db-cd3b-4c60-833d-dd2ab363af68 tempest-TestServerVolumeAttachmentScenario-290524599 None] Flow 'volume_create_manager' (3cd9fa6b-868a-419c-b2f7-cfefc7d2c5c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:28:58 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-e1bf25db-cd3b-4c60-833d-dd2ab363af68 tempest-TestServerVolumeAttachmentScenario-290524599 None] Created volume successfully.
Nov 03 18:28:58 devstack sudo[94890]: pam_unix(sudo:session): session closed for user root
Nov 03 18:28:58 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-5316319c-c0d6-4545-9673-07775851628b tempest-TestServerVolumeAttachmentScenario-290524599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ff530d44-28b5-4b79-bed8-04f2276bf196 1073741824" returned: 0 in 0.816s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:28:59 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-5316319c-c0d6-4545-9673-07775851628b tempest-TestServerVolumeAttachmentScenario-290524599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ff530d44-28b5-4b79-bed8-04f2276bf196 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:28:59 devstack sudo[94923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ff530d44-28b5-4b79-bed8-04f2276bf196
Nov 03 18:28:59 devstack sudo[94923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:28:59 devstack sudo[94923]: pam_unix(sudo:session): session closed for user root
Nov 03 18:28:59 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-5316319c-c0d6-4545-9673-07775851628b tempest-TestServerVolumeAttachmentScenario-290524599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ff530d44-28b5-4b79-bed8-04f2276bf196" returned: 0 in 0.457s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:28:59 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-5316319c-c0d6-4545-9673-07775851628b tempest-TestServerVolumeAttachmentScenario-290524599 None] <== create_volume: return (1350ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:28:59 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-5316319c-c0d6-4545-9673-07775851628b tempest-TestServerVolumeAttachmentScenario-290524599 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.354s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:28:59 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-49bbe979-2b3b-4df8-ad56-50732cd1a1a1 tempest-VolumesTestJSON-1647111425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.256s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:28:59 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-49bbe979-2b3b-4df8-ad56-50732cd1a1a1 tempest-VolumesTestJSON-1647111425 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:28:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1781596590',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=841e053c-bcd6-4901-81ca-c045b17823a2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='116e3989fa184b35a056d035aac2c87b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:28:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:28:58Z,use_quota=True,user_id='958e70385d514b42b5a3d9ac94ed1781',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:28:59 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-49bbe979-2b3b-4df8-ad56-50732cd1a1a1 tempest-VolumesTestJSON-1647111425 None] Creating volume 841e053c-bcd6-4901-81ca-c045b17823a2 {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:28:59 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-49bbe979-2b3b-4df8-ad56-50732cd1a1a1 tempest-VolumesTestJSON-1647111425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:28:59 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-49bbe979-2b3b-4df8-ad56-50732cd1a1a1 tempest-VolumesTestJSON-1647111425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:28:59 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-49bbe979-2b3b-4df8-ad56-50732cd1a1a1 tempest-VolumesTestJSON-1647111425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:28:59 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-49bbe979-2b3b-4df8-ad56-50732cd1a1a1 tempest-VolumesTestJSON-1647111425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:28:59 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-49bbe979-2b3b-4df8-ad56-50732cd1a1a1 tempest-VolumesTestJSON-1647111425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:28:59 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-49bbe979-2b3b-4df8-ad56-50732cd1a1a1 tempest-VolumesTestJSON-1647111425 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:28:59 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-49bbe979-2b3b-4df8-ad56-50732cd1a1a1 tempest-VolumesTestJSON-1647111425 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:28:59 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-49bbe979-2b3b-4df8-ad56-50732cd1a1a1 tempest-VolumesTestJSON-1647111425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-841e053c-bcd6-4901-81ca-c045b17823a2 1073741824 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:28:59 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-5316319c-c0d6-4545-9673-07775851628b tempest-TestServerVolumeAttachmentScenario-290524599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b071504-989a-46d0-8926-522f021f9d7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff530d44-28b5-4b79-bed8-04f2276bf196', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:28:59 devstack sudo[94927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-841e053c-bcd6-4901-81ca-c045b17823a2 1073741824
Nov 03 18:28:59 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-5316319c-c0d6-4545-9673-07775851628b tempest-TestServerVolumeAttachmentScenario-290524599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3eb97f48-0333-40ed-83cf-fc98bf2bf69a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:28:59 devstack sudo[94927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:28:59 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-5316319c-c0d6-4545-9673-07775851628b tempest-TestServerVolumeAttachmentScenario-290524599 None] Volume volume-ff530d44-28b5-4b79-bed8-04f2276bf196 (ff530d44-28b5-4b79-bed8-04f2276bf196): created successfully
Nov 03 18:28:59 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-5316319c-c0d6-4545-9673-07775851628b tempest-TestServerVolumeAttachmentScenario-290524599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3eb97f48-0333-40ed-83cf-fc98bf2bf69a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:28:59 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-5316319c-c0d6-4545-9673-07775851628b tempest-TestServerVolumeAttachmentScenario-290524599 None] Flow 'volume_create_manager' (1e4f52c6-5d68-4bae-9212-676e6935c9b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:28:59 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-5316319c-c0d6-4545-9673-07775851628b tempest-TestServerVolumeAttachmentScenario-290524599 None] Created volume successfully.
Nov 03 18:29:00 devstack sudo[94927]: pam_unix(sudo:session): session closed for user root
Nov 03 18:29:00 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-49bbe979-2b3b-4df8-ad56-50732cd1a1a1 tempest-VolumesTestJSON-1647111425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-841e053c-bcd6-4901-81ca-c045b17823a2 1073741824" returned: 0 in 0.871s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:29:00 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-49bbe979-2b3b-4df8-ad56-50732cd1a1a1 tempest-VolumesTestJSON-1647111425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-841e053c-bcd6-4901-81ca-c045b17823a2 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:29:00 devstack sudo[94935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-841e053c-bcd6-4901-81ca-c045b17823a2
Nov 03 18:29:00 devstack sudo[94935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:29:00 devstack sudo[94935]: pam_unix(sudo:session): session closed for user root
Nov 03 18:29:00 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-49bbe979-2b3b-4df8-ad56-50732cd1a1a1 tempest-VolumesTestJSON-1647111425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-841e053c-bcd6-4901-81ca-c045b17823a2" returned: 0 in 0.348s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:29:00 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-49bbe979-2b3b-4df8-ad56-50732cd1a1a1 tempest-VolumesTestJSON-1647111425 None] <== create_volume: return (1295ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:29:00 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-49bbe979-2b3b-4df8-ad56-50732cd1a1a1 tempest-VolumesTestJSON-1647111425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.298s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:29:00 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-49bbe979-2b3b-4df8-ad56-50732cd1a1a1 tempest-VolumesTestJSON-1647111425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b66545d8-7fc1-4564-a166-9a7d5367706e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-841e053c-bcd6-4901-81ca-c045b17823a2', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:29:00 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-49bbe979-2b3b-4df8-ad56-50732cd1a1a1 tempest-VolumesTestJSON-1647111425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c29ae783-bc4e-4c80-bfe4-a2021e2e0ae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:29:00 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-49bbe979-2b3b-4df8-ad56-50732cd1a1a1 tempest-VolumesTestJSON-1647111425 None] Volume volume-841e053c-bcd6-4901-81ca-c045b17823a2 (841e053c-bcd6-4901-81ca-c045b17823a2): created successfully
Nov 03 18:29:00 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-49bbe979-2b3b-4df8-ad56-50732cd1a1a1 tempest-VolumesTestJSON-1647111425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c29ae783-bc4e-4c80-bfe4-a2021e2e0ae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:29:00 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-49bbe979-2b3b-4df8-ad56-50732cd1a1a1 tempest-VolumesTestJSON-1647111425 None] Flow 'volume_create_manager' (62c15cc1-f5b2-4a57-ae21-23c0a9158503) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:29:00 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-49bbe979-2b3b-4df8-ad56-50732cd1a1a1 tempest-VolumesTestJSON-1647111425 None] Created volume successfully.
Nov 03 18:29:02 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b1ef30a-7693-4ca1-aa0d-70ee016c00e8 tempest-VolumesTestJSON-1647111425 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:29:02 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-2b1ef30a-7693-4ca1-aa0d-70ee016c00e8 tempest-VolumesTestJSON-1647111425 None] Flow 'volume_create_manager' (87278363-6473-4110-809a-145b604d35d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:29:02 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-2b1ef30a-7693-4ca1-aa0d-70ee016c00e8 tempest-VolumesTestJSON-1647111425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea32d8ca-2ce2-412a-bdb7-d0bba91a5118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:29:02 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-2b1ef30a-7693-4ca1-aa0d-70ee016c00e8 tempest-VolumesTestJSON-1647111425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea32d8ca-2ce2-412a-bdb7-d0bba91a5118) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:29:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1905499948',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=277db583-e7e2-4d0d-819d-b4764c1942b4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='116e3989fa184b35a056d035aac2c87b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:29:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:29:03Z,use_quota=True,user_id='958e70385d514b42b5a3d9ac94ed1781',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:29:02 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-2b1ef30a-7693-4ca1-aa0d-70ee016c00e8 tempest-VolumesTestJSON-1647111425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbd20ad2-89d2-44d8-adb7-fe13ec3325b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:29:02 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-2b1ef30a-7693-4ca1-aa0d-70ee016c00e8 tempest-VolumesTestJSON-1647111425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbd20ad2-89d2-44d8-adb7-fe13ec3325b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:29:02 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-2b1ef30a-7693-4ca1-aa0d-70ee016c00e8 tempest-VolumesTestJSON-1647111425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (824cd667-a415-4b27-a4a6-ffa2c0a960a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:29:02 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-2b1ef30a-7693-4ca1-aa0d-70ee016c00e8 tempest-VolumesTestJSON-1647111425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (824cd667-a415-4b27-a4a6-ffa2c0a960a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '277db583-e7e2-4d0d-819d-b4764c1942b4', 'volume_name': 'volume-277db583-e7e2-4d0d-819d-b4764c1942b4', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:29:02 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-2b1ef30a-7693-4ca1-aa0d-70ee016c00e8 tempest-VolumesTestJSON-1647111425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0578c97-22fa-4420-878c-7c6323726deb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:29:03 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-2b1ef30a-7693-4ca1-aa0d-70ee016c00e8 tempest-VolumesTestJSON-1647111425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0578c97-22fa-4420-878c-7c6323726deb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:29:03 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-2b1ef30a-7693-4ca1-aa0d-70ee016c00e8 tempest-VolumesTestJSON-1647111425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78c13cbd-35fc-4fb5-bf58-a7320a1930c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:29:03 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-2b1ef30a-7693-4ca1-aa0d-70ee016c00e8 tempest-VolumesTestJSON-1647111425 None] Volume 277db583-e7e2-4d0d-819d-b4764c1942b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-277db583-e7e2-4d0d-819d-b4764c1942b4', 'volume_size': 1}
Nov 03 18:29:03 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-2b1ef30a-7693-4ca1-aa0d-70ee016c00e8 tempest-VolumesTestJSON-1647111425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:29:03 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-2b1ef30a-7693-4ca1-aa0d-70ee016c00e8 tempest-VolumesTestJSON-1647111425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:29:03 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-2b1ef30a-7693-4ca1-aa0d-70ee016c00e8 tempest-VolumesTestJSON-1647111425 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:29:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1905499948',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=277db583-e7e2-4d0d-819d-b4764c1942b4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='116e3989fa184b35a056d035aac2c87b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:29:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:29:03Z,use_quota=True,user_id='958e70385d514b42b5a3d9ac94ed1781',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:29:03 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-2b1ef30a-7693-4ca1-aa0d-70ee016c00e8 tempest-VolumesTestJSON-1647111425 None] Creating volume 277db583-e7e2-4d0d-819d-b4764c1942b4 {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:29:03 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-2b1ef30a-7693-4ca1-aa0d-70ee016c00e8 tempest-VolumesTestJSON-1647111425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:29:03 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-2b1ef30a-7693-4ca1-aa0d-70ee016c00e8 tempest-VolumesTestJSON-1647111425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:29:03 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-2b1ef30a-7693-4ca1-aa0d-70ee016c00e8 tempest-VolumesTestJSON-1647111425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:29:03 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-2b1ef30a-7693-4ca1-aa0d-70ee016c00e8 tempest-VolumesTestJSON-1647111425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:29:03 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-2b1ef30a-7693-4ca1-aa0d-70ee016c00e8 tempest-VolumesTestJSON-1647111425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.042s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:29:03 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-2b1ef30a-7693-4ca1-aa0d-70ee016c00e8 tempest-VolumesTestJSON-1647111425 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:29:03 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-2b1ef30a-7693-4ca1-aa0d-70ee016c00e8 tempest-VolumesTestJSON-1647111425 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:29:03 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-2b1ef30a-7693-4ca1-aa0d-70ee016c00e8 tempest-VolumesTestJSON-1647111425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-277db583-e7e2-4d0d-819d-b4764c1942b4 1073741824 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:29:03 devstack sudo[94999]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-277db583-e7e2-4d0d-819d-b4764c1942b4 1073741824
Nov 03 18:29:03 devstack sudo[94999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:29:03 devstack sudo[94999]: pam_unix(sudo:session): session closed for user root
Nov 03 18:29:03 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-2b1ef30a-7693-4ca1-aa0d-70ee016c00e8 tempest-VolumesTestJSON-1647111425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-277db583-e7e2-4d0d-819d-b4764c1942b4 1073741824" returned: 0 in 0.887s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:29:04 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-2b1ef30a-7693-4ca1-aa0d-70ee016c00e8 tempest-VolumesTestJSON-1647111425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-277db583-e7e2-4d0d-819d-b4764c1942b4 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:29:04 devstack sudo[95012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-277db583-e7e2-4d0d-819d-b4764c1942b4
Nov 03 18:29:04 devstack sudo[95012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:29:04 devstack sudo[95012]: pam_unix(sudo:session): session closed for user root
Nov 03 18:29:04 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-2b1ef30a-7693-4ca1-aa0d-70ee016c00e8 tempest-VolumesTestJSON-1647111425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-277db583-e7e2-4d0d-819d-b4764c1942b4" returned: 0 in 0.459s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:29:04 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-2b1ef30a-7693-4ca1-aa0d-70ee016c00e8 tempest-VolumesTestJSON-1647111425 None] <== create_volume: return (1477ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:29:04 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-2b1ef30a-7693-4ca1-aa0d-70ee016c00e8 tempest-VolumesTestJSON-1647111425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.487s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:29:04 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-2b1ef30a-7693-4ca1-aa0d-70ee016c00e8 tempest-VolumesTestJSON-1647111425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78c13cbd-35fc-4fb5-bf58-a7320a1930c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-277db583-e7e2-4d0d-819d-b4764c1942b4', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:29:04 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-2b1ef30a-7693-4ca1-aa0d-70ee016c00e8 tempest-VolumesTestJSON-1647111425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (789f2d84-1ff7-4fe5-961d-1b75bdea900f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:29:04 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-2b1ef30a-7693-4ca1-aa0d-70ee016c00e8 tempest-VolumesTestJSON-1647111425 None] Volume volume-277db583-e7e2-4d0d-819d-b4764c1942b4 (277db583-e7e2-4d0d-819d-b4764c1942b4): created successfully
Nov 03 18:29:04 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-2b1ef30a-7693-4ca1-aa0d-70ee016c00e8 tempest-VolumesTestJSON-1647111425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (789f2d84-1ff7-4fe5-961d-1b75bdea900f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:29:04 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-2b1ef30a-7693-4ca1-aa0d-70ee016c00e8 tempest-VolumesTestJSON-1647111425 None] Flow 'volume_create_manager' (87278363-6473-4110-809a-145b604d35d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:29:04 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-2b1ef30a-7693-4ca1-aa0d-70ee016c00e8 tempest-VolumesTestJSON-1647111425 None] Created volume successfully.
Nov 03 18:29:06 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-600e3c69-5d58-43e6-b985-31010aa61300 tempest-VolumesActionsTest-1478820281 None] Acquiring lock "cinder-6b91139a-7861-42ec-9f14-713c2ea95ebe" by "attach_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:29:06 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-600e3c69-5d58-43e6-b985-31010aa61300 tempest-VolumesActionsTest-1478820281 None] Lock "cinder-6b91139a-7861-42ec-9f14-713c2ea95ebe" acquired by "attach_volume" :: waited 0.047s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:29:06 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-600e3c69-5d58-43e6-b985-31010aa61300 tempest-VolumesActionsTest-1478820281 None] Attaching volume 6b91139a-7861-42ec-9f14-713c2ea95ebe to instance fbfa97a7-58c3-4016-86db-86c7e25f55a2 at mountpoint /dev/vdb on host None.
Nov 03 18:29:06 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-600e3c69-5d58-43e6-b985-31010aa61300 tempest-VolumesActionsTest-1478820281 None] Attach volume completed successfully.
Nov 03 18:29:06 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-600e3c69-5d58-43e6-b985-31010aa61300 tempest-VolumesActionsTest-1478820281 None] Lock "cinder-6b91139a-7861-42ec-9f14-713c2ea95ebe" released by "attach_volume" :: held 0.192s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:29:07 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-290a6a05-db25-43e2-8cc6-ad897bd75ca3 tempest-VolumesActionsTest-1478820281 None] Acquiring lock "cinder-6b91139a-7861-42ec-9f14-713c2ea95ebe-detach_volume" by "detach_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:29:07 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-290a6a05-db25-43e2-8cc6-ad897bd75ca3 tempest-VolumesActionsTest-1478820281 None] Lock "cinder-6b91139a-7861-42ec-9f14-713c2ea95ebe-detach_volume" acquired by "detach_volume" :: waited 0.039s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:29:07 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-290a6a05-db25-43e2-8cc6-ad897bd75ca3 tempest-VolumesActionsTest-1478820281 None] Detaching volume 6b91139a-7861-42ec-9f14-713c2ea95ebe from instance fbfa97a7-58c3-4016-86db-86c7e25f55a2.
Nov 03 18:29:07 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-290a6a05-db25-43e2-8cc6-ad897bd75ca3 tempest-VolumesActionsTest-1478820281 None] Detach volume completed successfully.
Nov 03 18:29:07 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-290a6a05-db25-43e2-8cc6-ad897bd75ca3 tempest-VolumesActionsTest-1478820281 None] Lock "cinder-6b91139a-7861-42ec-9f14-713c2ea95ebe-detach_volume" released by "detach_volume" :: held 0.105s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:29:07 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-a4fe5d10-b897-461e-aad3-323d79afa167 tempest-VolumesTestJSON-1647111425 None] Acquiring lock "cinder-277db583-e7e2-4d0d-819d-b4764c1942b4-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:29:07 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-a4fe5d10-b897-461e-aad3-323d79afa167 tempest-VolumesTestJSON-1647111425 None] Lock "cinder-277db583-e7e2-4d0d-819d-b4764c1942b4-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:29:07 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-a4fe5d10-b897-461e-aad3-323d79afa167 tempest-VolumesTestJSON-1647111425 None] Acquiring lock "cinder-quobyte-277db583-e7e2-4d0d-819d-b4764c1942b4" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:29:07 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-a4fe5d10-b897-461e-aad3-323d79afa167 tempest-VolumesTestJSON-1647111425 None] Lock "cinder-quobyte-277db583-e7e2-4d0d-819d-b4764c1942b4" acquired by "delete_volume" :: waited 0.056s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:29:07 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[39c428c3-d377-40c1-b14e-73478972c4b2]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:29:07 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-a4fe5d10-b897-461e-aad3-323d79afa167 tempest-VolumesTestJSON-1647111425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-277db583-e7e2-4d0d-819d-b4764c1942b4 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:29:08 devstack sudo[95036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-277db583-e7e2-4d0d-819d-b4764c1942b4
Nov 03 18:29:08 devstack sudo[95036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:29:08 devstack sudo[95036]: pam_unix(sudo:session): session closed for user root
Nov 03 18:29:08 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-a4fe5d10-b897-461e-aad3-323d79afa167 tempest-VolumesTestJSON-1647111425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-277db583-e7e2-4d0d-819d-b4764c1942b4" returned: 0 in 0.685s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:29:08 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-a4fe5d10-b897-461e-aad3-323d79afa167 tempest-VolumesTestJSON-1647111425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-277db583-e7e2-4d0d-819d-b4764c1942b4 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:29:08 devstack sudo[95057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-277db583-e7e2-4d0d-819d-b4764c1942b4
Nov 03 18:29:08 devstack sudo[95057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:29:09 devstack sudo[95057]: pam_unix(sudo:session): session closed for user root
Nov 03 18:29:09 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-a4fe5d10-b897-461e-aad3-323d79afa167 tempest-VolumesTestJSON-1647111425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-277db583-e7e2-4d0d-819d-b4764c1942b4" returned: 0 in 0.379s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:29:09 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-a4fe5d10-b897-461e-aad3-323d79afa167 tempest-VolumesTestJSON-1647111425 None] Lock "cinder-quobyte-277db583-e7e2-4d0d-819d-b4764c1942b4" released by "delete_volume" :: held 1.156s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:29:09 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-a4fe5d10-b897-461e-aad3-323d79afa167 tempest-VolumesTestJSON-1647111425 None] Created reservations ['dbe226cf-957a-4ea2-ae41-1cd780a54436', 'db18dc4d-7574-4d35-bd9f-5161dd72e2fa', '4bd5b8e6-9905-42b9-9f8c-10dfec3657aa', '5f2b79e8-8606-42ee-8652-9e1715bf3d5f'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:29:09 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-a4fe5d10-b897-461e-aad3-323d79afa167 tempest-VolumesTestJSON-1647111425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:29:09 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-a4fe5d10-b897-461e-aad3-323d79afa167 tempest-VolumesTestJSON-1647111425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:29:09 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-a4fe5d10-b897-461e-aad3-323d79afa167 tempest-VolumesTestJSON-1647111425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:29:09 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-a4fe5d10-b897-461e-aad3-323d79afa167 tempest-VolumesTestJSON-1647111425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:29:09 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-a4fe5d10-b897-461e-aad3-323d79afa167 tempest-VolumesTestJSON-1647111425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:29:09 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-a4fe5d10-b897-461e-aad3-323d79afa167 tempest-VolumesTestJSON-1647111425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:29:09 devstack sudo[95067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:29:09 devstack sudo[95067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:29:09 devstack sudo[95067]: pam_unix(sudo:session): session closed for user root
Nov 03 18:29:09 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-a4fe5d10-b897-461e-aad3-323d79afa167 tempest-VolumesTestJSON-1647111425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.362s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:29:09 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-a4fe5d10-b897-461e-aad3-323d79afa167 tempest-VolumesTestJSON-1647111425 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:29:09 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-a4fe5d10-b897-461e-aad3-323d79afa167 tempest-VolumesTestJSON-1647111425 None] Deleted volume successfully.
Nov 03 18:29:09 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-a4fe5d10-b897-461e-aad3-323d79afa167 tempest-VolumesTestJSON-1647111425 None] Lock "cinder-277db583-e7e2-4d0d-819d-b4764c1942b4-delete_volume" released by "delete_volume" :: held 1.947s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:29:10 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-1c5420cf-400d-47bc-9f0c-f411ab3d881b tempest-VolumesTestJSON-1647111425 None] Acquiring lock "cinder-841e053c-bcd6-4901-81ca-c045b17823a2-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:29:10 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-1c5420cf-400d-47bc-9f0c-f411ab3d881b tempest-VolumesTestJSON-1647111425 None] Lock "cinder-841e053c-bcd6-4901-81ca-c045b17823a2-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:29:10 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-1c5420cf-400d-47bc-9f0c-f411ab3d881b tempest-VolumesTestJSON-1647111425 None] Acquiring lock "cinder-quobyte-841e053c-bcd6-4901-81ca-c045b17823a2" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:29:10 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-1c5420cf-400d-47bc-9f0c-f411ab3d881b tempest-VolumesTestJSON-1647111425 None] Lock "cinder-quobyte-841e053c-bcd6-4901-81ca-c045b17823a2" acquired by "delete_volume" :: waited 0.029s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:29:10 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d1134f6-26c7-4323-adde-bbbce0774515]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:29:10 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-1c5420cf-400d-47bc-9f0c-f411ab3d881b tempest-VolumesTestJSON-1647111425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-841e053c-bcd6-4901-81ca-c045b17823a2 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:29:10 devstack sudo[95082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-841e053c-bcd6-4901-81ca-c045b17823a2
Nov 03 18:29:10 devstack sudo[95082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:29:11 devstack sudo[95082]: pam_unix(sudo:session): session closed for user root
Nov 03 18:29:11 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-1c5420cf-400d-47bc-9f0c-f411ab3d881b tempest-VolumesTestJSON-1647111425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-841e053c-bcd6-4901-81ca-c045b17823a2" returned: 0 in 1.114s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:29:11 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-1c5420cf-400d-47bc-9f0c-f411ab3d881b tempest-VolumesTestJSON-1647111425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-841e053c-bcd6-4901-81ca-c045b17823a2 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:29:11 devstack sudo[95137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-841e053c-bcd6-4901-81ca-c045b17823a2
Nov 03 18:29:11 devstack sudo[95137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:29:12 devstack sudo[95137]: pam_unix(sudo:session): session closed for user root
Nov 03 18:29:12 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-1c5420cf-400d-47bc-9f0c-f411ab3d881b tempest-VolumesTestJSON-1647111425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-841e053c-bcd6-4901-81ca-c045b17823a2" returned: 0 in 0.656s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:29:12 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-1c5420cf-400d-47bc-9f0c-f411ab3d881b tempest-VolumesTestJSON-1647111425 None] Lock "cinder-quobyte-841e053c-bcd6-4901-81ca-c045b17823a2" released by "delete_volume" :: held 1.906s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:29:12 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-1c5420cf-400d-47bc-9f0c-f411ab3d881b tempest-VolumesTestJSON-1647111425 None] Created reservations ['432b0af1-5654-4968-8eab-b6800d533aa0', '7334ad33-ad96-4012-b4a1-903144122707', '7c16eef3-0505-4e29-8901-8bdb68669aa5', '18e6906e-fc40-4e98-863b-9552f5084f49'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:29:12 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-1c5420cf-400d-47bc-9f0c-f411ab3d881b tempest-VolumesTestJSON-1647111425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:29:12 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-1c5420cf-400d-47bc-9f0c-f411ab3d881b tempest-VolumesTestJSON-1647111425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:29:12 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-1c5420cf-400d-47bc-9f0c-f411ab3d881b tempest-VolumesTestJSON-1647111425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:29:12 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-1c5420cf-400d-47bc-9f0c-f411ab3d881b tempest-VolumesTestJSON-1647111425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:29:12 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-1c5420cf-400d-47bc-9f0c-f411ab3d881b tempest-VolumesTestJSON-1647111425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:29:12 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-1c5420cf-400d-47bc-9f0c-f411ab3d881b tempest-VolumesTestJSON-1647111425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:29:12 devstack sudo[95146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:29:12 devstack sudo[95146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:29:12 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-258e3dc3-a949-469a-822e-45c97c4deef6 tempest-VolumesTestJSON-1647111425 None] Acquiring lock "cinder-ce230949-a847-4f98-8c60-e9d11b7f13b1-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:29:12 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-258e3dc3-a949-469a-822e-45c97c4deef6 tempest-VolumesTestJSON-1647111425 None] Lock "cinder-ce230949-a847-4f98-8c60-e9d11b7f13b1-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:29:13 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-258e3dc3-a949-469a-822e-45c97c4deef6 tempest-VolumesTestJSON-1647111425 None] Acquiring lock "cinder-quobyte-ce230949-a847-4f98-8c60-e9d11b7f13b1" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:29:13 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-258e3dc3-a949-469a-822e-45c97c4deef6 tempest-VolumesTestJSON-1647111425 None] Lock "cinder-quobyte-ce230949-a847-4f98-8c60-e9d11b7f13b1" acquired by "delete_volume" :: waited 0.022s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:29:13 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[92baedc6-6a60-49a8-aaa4-0219d92676e7]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:29:13 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-258e3dc3-a949-469a-822e-45c97c4deef6 tempest-VolumesTestJSON-1647111425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ce230949-a847-4f98-8c60-e9d11b7f13b1 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:29:13 devstack sudo[95146]: pam_unix(sudo:session): session closed for user root
Nov 03 18:29:13 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-1c5420cf-400d-47bc-9f0c-f411ab3d881b tempest-VolumesTestJSON-1647111425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.644s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:29:13 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-1c5420cf-400d-47bc-9f0c-f411ab3d881b tempest-VolumesTestJSON-1647111425 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:29:13 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-1c5420cf-400d-47bc-9f0c-f411ab3d881b tempest-VolumesTestJSON-1647111425 None] Deleted volume successfully.
Nov 03 18:29:13 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-1c5420cf-400d-47bc-9f0c-f411ab3d881b tempest-VolumesTestJSON-1647111425 None] Lock "cinder-841e053c-bcd6-4901-81ca-c045b17823a2-delete_volume" released by "delete_volume" :: held 3.066s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:29:13 devstack sudo[95151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ce230949-a847-4f98-8c60-e9d11b7f13b1
Nov 03 18:29:13 devstack sudo[95151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:29:13 devstack sudo[95151]: pam_unix(sudo:session): session closed for user root
Nov 03 18:29:13 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-258e3dc3-a949-469a-822e-45c97c4deef6 tempest-VolumesTestJSON-1647111425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ce230949-a847-4f98-8c60-e9d11b7f13b1" returned: 0 in 0.827s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:29:13 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-258e3dc3-a949-469a-822e-45c97c4deef6 tempest-VolumesTestJSON-1647111425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ce230949-a847-4f98-8c60-e9d11b7f13b1 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:29:14 devstack sudo[95162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ce230949-a847-4f98-8c60-e9d11b7f13b1
Nov 03 18:29:14 devstack sudo[95162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:29:14 devstack sudo[95162]: pam_unix(sudo:session): session closed for user root
Nov 03 18:29:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-258e3dc3-a949-469a-822e-45c97c4deef6 tempest-VolumesTestJSON-1647111425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ce230949-a847-4f98-8c60-e9d11b7f13b1" returned: 0 in 0.400s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:29:14 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-258e3dc3-a949-469a-822e-45c97c4deef6 tempest-VolumesTestJSON-1647111425 None] Lock "cinder-quobyte-ce230949-a847-4f98-8c60-e9d11b7f13b1" released by "delete_volume" :: held 1.321s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:29:14 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-258e3dc3-a949-469a-822e-45c97c4deef6 tempest-VolumesTestJSON-1647111425 None] Created reservations ['396463d8-9419-4897-b39e-185dc35277bd', '13345713-948d-4d0c-9a0a-02ec01cc92ee', 'c1e24eb3-4c5f-49fe-855c-bcff75182f70', '7c560976-109a-4729-bfa8-8de2ef05bd77'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:29:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-258e3dc3-a949-469a-822e-45c97c4deef6 tempest-VolumesTestJSON-1647111425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:29:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-258e3dc3-a949-469a-822e-45c97c4deef6 tempest-VolumesTestJSON-1647111425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:29:14 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-258e3dc3-a949-469a-822e-45c97c4deef6 tempest-VolumesTestJSON-1647111425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:29:14 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-258e3dc3-a949-469a-822e-45c97c4deef6 tempest-VolumesTestJSON-1647111425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:29:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-258e3dc3-a949-469a-822e-45c97c4deef6 tempest-VolumesTestJSON-1647111425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:29:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-258e3dc3-a949-469a-822e-45c97c4deef6 tempest-VolumesTestJSON-1647111425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:29:14 devstack sudo[95184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:29:14 devstack sudo[95184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:29:14 devstack sudo[95184]: pam_unix(sudo:session): session closed for user root
Nov 03 18:29:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-258e3dc3-a949-469a-822e-45c97c4deef6 tempest-VolumesTestJSON-1647111425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.327s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:29:14 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-258e3dc3-a949-469a-822e-45c97c4deef6 tempest-VolumesTestJSON-1647111425 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:29:14 devstack cinder-volume[86120]: DEBUG oslo_service.periodic_task [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86120) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 18:29:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:29:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:29:14 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:29:14 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:29:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:29:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:29:14 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-258e3dc3-a949-469a-822e-45c97c4deef6 tempest-VolumesTestJSON-1647111425 None] Deleted volume successfully.
Nov 03 18:29:15 devstack sudo[95188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:29:15 devstack sudo[95188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:29:15 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-258e3dc3-a949-469a-822e-45c97c4deef6 tempest-VolumesTestJSON-1647111425 None] Lock "cinder-ce230949-a847-4f98-8c60-e9d11b7f13b1-delete_volume" released by "delete_volume" :: held 2.099s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:29:15 devstack sudo[95188]: pam_unix(sudo:session): session closed for user root
Nov 03 18:29:15 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.377s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:29:15 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:29:15 devstack cinder-volume[86120]: DEBUG oslo_service.periodic_task [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Running periodic task VolumeManager._thread_info {{(pid=86120) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 18:29:15 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] thread count: 28 {{(pid=86120) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 03 18:29:15 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] thread info: [<_MainThread(MainThread, started 134747145822336)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134747033686336)>, <Thread(Thread-3 (stat_writer), started daemon 134747030828736)>, <Thread(Rabbit-heartbeat, started daemon 134747035433408)>, <Thread(Thread-5 (_runner), started daemon 134747029587392)>, <Thread(Thread-7 (_runner), started daemon 134747029784256)>, <Thread(fd_logger, started daemon 134747027909120)>, <Thread(privsep_reader, started daemon 134747027006592)>, <Thread(tpool_thread_0, started daemon 134747018950336)>, <Thread(tpool_thread_1, started daemon 134747010541248)>, <Thread(tpool_thread_2, started daemon 134747002132160)>, <Thread(tpool_thread_3, started daemon 134746993723072)>, <Thread(tpool_thread_4, started daemon 134746985313984)>, <Thread(tpool_thread_5, started daemon 134746976904896)>, <Thread(tpool_thread_6, started daemon 134746968495808)>, <Thread(tpool_thread_7, started daemon 134746960086720)>, <Thread(tpool_thread_8, started daemon 134746951677632)>, <Thread(tpool_thread_9, started daemon 134746943268544)>, <Thread(tpool_thread_10, started daemon 134746934859456)>, <Thread(tpool_thread_11, started daemon 134746926450368)>, <Thread(tpool_thread_12, started daemon 134746918041280)>, <Thread(tpool_thread_13, started daemon 134746909632192)>, <Thread(tpool_thread_14, started daemon 134746901223104)>, <Thread(tpool_thread_15, started daemon 134746892814016)>, <Thread(tpool_thread_16, started daemon 134746884404928)>, <Thread(tpool_thread_17, started daemon 134746875995840)>, <Thread(tpool_thread_18, started daemon 134746867586752)>, <Thread(tpool_thread_19, started daemon 134746859177664)>] {{(pid=86120) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 03 18:29:16 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-d223c658-5513-42c0-9226-31da50c37f51 tempest-VolumesActionsTest-1478820281 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:29:16 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-d223c658-5513-42c0-9226-31da50c37f51 tempest-VolumesActionsTest-1478820281 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:29:16 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7546dc8-7f64-41a4-96b8-cefcb9ec3d0c]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:29:16 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-d223c658-5513-42c0-9226-31da50c37f51 tempest-VolumesActionsTest-1478820281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6b91139a-7861-42ec-9f14-713c2ea95ebe {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:29:16 devstack sudo[95217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6b91139a-7861-42ec-9f14-713c2ea95ebe
Nov 03 18:29:16 devstack sudo[95217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:29:16 devstack sudo[95217]: pam_unix(sudo:session): session closed for user root
Nov 03 18:29:16 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-d223c658-5513-42c0-9226-31da50c37f51 tempest-VolumesActionsTest-1478820281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6b91139a-7861-42ec-9f14-713c2ea95ebe" returned: 0 in 0.393s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:29:16 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[53351e3c-80d0-4856-a049-86f48c65a095]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:29:16 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-d223c658-5513-42c0-9226-31da50c37f51 tempest-VolumesActionsTest-1478820281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6b91139a-7861-42ec-9f14-713c2ea95ebe {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:29:17 devstack sudo[95223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6b91139a-7861-42ec-9f14-713c2ea95ebe
Nov 03 18:29:17 devstack sudo[95223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:29:17 devstack sudo[95223]: pam_unix(sudo:session): session closed for user root
Nov 03 18:29:17 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-d223c658-5513-42c0-9226-31da50c37f51 tempest-VolumesActionsTest-1478820281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6b91139a-7861-42ec-9f14-713c2ea95ebe" returned: 0 in 0.408s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:29:17 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-d223c658-5513-42c0-9226-31da50c37f51 tempest-VolumesActionsTest-1478820281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6b91139a-7861-42ec-9f14-713c2ea95ebe /opt/stack/data/cinder/conversion/6b91139a-7861-42ec-9f14-713c2ea95ebe.temp_image.a6196e09-7c52-4bf1-b5cb-396215acd019wwpqrmtj.img {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:29:17 devstack sudo[95229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6b91139a-7861-42ec-9f14-713c2ea95ebe /opt/stack/data/cinder/conversion/6b91139a-7861-42ec-9f14-713c2ea95ebe.temp_image.a6196e09-7c52-4bf1-b5cb-396215acd019wwpqrmtj.img
Nov 03 18:29:17 devstack sudo[95229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:29:23 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-a391f230-313f-46ad-96ef-9a9fb7909211 tempest-BackendsCapabilitiesAdminTestsJSON-801997806 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.6699981689453, 'free_capacity_gb': 1773.6699981689453, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86120) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Nov 03 18:29:23 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-73c0f992-f7b6-40bf-81bb-f98b7ba5f6c2 tempest-BackendsCapabilitiesAdminTestsJSON-801997806 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.6699981689453, 'free_capacity_gb': 1773.6699981689453, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86120) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Nov 03 18:29:25 devstack cinder-volume[86120]: DEBUG dbcounter [-] [86120] Writing DB stats cinder:SELECT=53,cinder:INSERT=16,cinder:UPDATE=50,cinder:DELETE=6 {{(pid=86120) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 18:29:26 devstack cinder-volume[86120]: DEBUG dbcounter [-] [86120] Writing DB stats cinder:UPDATE=65,cinder:SELECT=51,cinder:INSERT=10,cinder:DELETE=4 {{(pid=86120) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 18:29:26 devstack sudo[95229]: pam_unix(sudo:session): session closed for user root
Nov 03 18:29:26 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-d223c658-5513-42c0-9226-31da50c37f51 tempest-VolumesActionsTest-1478820281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6b91139a-7861-42ec-9f14-713c2ea95ebe /opt/stack/data/cinder/conversion/6b91139a-7861-42ec-9f14-713c2ea95ebe.temp_image.a6196e09-7c52-4bf1-b5cb-396215acd019wwpqrmtj.img" returned: 0 in 9.168s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:29:26 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d837248-dbac-43e7-a8df-fe3cb13641c0]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:29:26 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-d223c658-5513-42c0-9226-31da50c37f51 tempest-VolumesActionsTest-1478820281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6b91139a-7861-42ec-9f14-713c2ea95ebe {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:29:26 devstack sudo[95295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6b91139a-7861-42ec-9f14-713c2ea95ebe
Nov 03 18:29:26 devstack sudo[95295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:29:27 devstack sudo[95295]: pam_unix(sudo:session): session closed for user root
Nov 03 18:29:27 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-d223c658-5513-42c0-9226-31da50c37f51 tempest-VolumesActionsTest-1478820281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6b91139a-7861-42ec-9f14-713c2ea95ebe" returned: 0 in 0.593s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:29:27 devstack cinder-volume[86120]: DEBUG cinder.image.image_utils [None req-d223c658-5513-42c0-9226-31da50c37f51 tempest-VolumesActionsTest-1478820281 None] Image conversion details: src /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6b91139a-7861-42ec-9f14-713c2ea95ebe, size 1024.00 MB, duration 9.17 sec, destination /opt/stack/data/cinder/conversion/6b91139a-7861-42ec-9f14-713c2ea95ebe.temp_image.a6196e09-7c52-4bf1-b5cb-396215acd019wwpqrmtj.img {{(pid=86120) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 03 18:29:27 devstack cinder-volume[86120]: INFO cinder.image.image_utils [None req-d223c658-5513-42c0-9226-31da50c37f51 tempest-VolumesActionsTest-1478820281 None] Converted 1024.00 MB image at 111.68 MB/s
Nov 03 18:29:27 devstack cinder-volume[86120]: DEBUG cinder.image.image_utils [None req-d223c658-5513-42c0-9226-31da50c37f51 tempest-VolumesActionsTest-1478820281 None] a6196e09-7c52-4bf1-b5cb-396215acd019 was raw, no need to convert to raw {{(pid=86120) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}}
Nov 03 18:29:37 devstack cinder-volume[86120]: DEBUG dbcounter [-] [86120] Writing DB stats cinder:SELECT=1 {{(pid=86120) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 18:29:37 devstack cinder-volume[86120]: DEBUG dbcounter [-] [86120] Writing DB stats cinder:SELECT=1 {{(pid=86120) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 18:29:37 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [req-9c5b9fbd-31f5-4e19-8171-9502e1674031 req-1f29fe4d-7a14-4c87-9aa5-4244f7ccbfc6 tempest-TestServerVolumeAttachmentScenario-290524599 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:29:37 devstack cinder-volume[86120]: INFO cinder.volume.manager [req-2c361ca0-da95-4ce6-b1e5-4acf14457116 req-27a936ed-eff4-435f-9786-262940bf4416 tempest-AttachVolumeTestJSON-374454512 None] Terminate volume connection completed successfully.
Nov 03 18:29:37 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [req-2c361ca0-da95-4ce6-b1e5-4acf14457116 req-27a936ed-eff4-435f-9786-262940bf4416 tempest-AttachVolumeTestJSON-374454512 None] Deleting attachment e053ef7e-f66b-4471-8bfd-2999130f27fd. {{(pid=86120) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 03 18:29:38 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-4e401f94-0ccb-4b86-8b12-7f051f61a60a tempest-GroupsTest-2029762573 None] Group tempest-Group1-60864623: creating
Nov 03 18:29:38 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-4e401f94-0ccb-4b86-8b12-7f051f61a60a tempest-GroupsTest-2029762573 None] Group tempest-Group1-60864623: created successfully
Nov 03 18:29:38 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-4e401f94-0ccb-4b86-8b12-7f051f61a60a tempest-GroupsTest-2029762573 None] Create group completed successfully.
Nov 03 18:29:39 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-6efd7168-1255-457e-8bd6-e088b34e890c tempest-GroupsTest-2029762573 None] Group tempest-Group2-1103379892: creating
Nov 03 18:29:39 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-6efd7168-1255-457e-8bd6-e088b34e890c tempest-GroupsTest-2029762573 None] Group tempest-Group2-1103379892: created successfully
Nov 03 18:29:39 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-6efd7168-1255-457e-8bd6-e088b34e890c tempest-GroupsTest-2029762573 None] Create group completed successfully.
Nov 03 18:29:41 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-12d2163c-b385-4486-a075-639407d741b0 tempest-GroupsTest-2029762573 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:29:41 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-12d2163c-b385-4486-a075-639407d741b0 tempest-GroupsTest-2029762573 None] Flow 'volume_create_manager' (d3350506-19b3-4910-b4d3-c9616dfe114e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:29:41 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-12d2163c-b385-4486-a075-639407d741b0 tempest-GroupsTest-2029762573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68b7c669-60a8-4441-a9fd-d13528317fd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:29:41 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-12d2163c-b385-4486-a075-639407d741b0 tempest-GroupsTest-2029762573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68b7c669-60a8-4441-a9fd-d13528317fd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:29:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1215928471',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=c0e7a7bb-a5a7-4198-8915-22fbbc628137,host='devstack@QuobyteHD#QuobyteHD',id=5721ee08-d07a-4216-9edd-43ebf2cbd79e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a644fe54bab8466f8a7a82c0a9f1f577',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:29:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:29:42Z,use_quota=True,user_id='2b6fb20fb242429e847ce30e245b9861',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f762d0-828e-403c-9441-f7e9fff8bf05),volume_type_id=00f762d0-828e-403c-9441-f7e9fff8bf05)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:29:41 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-12d2163c-b385-4486-a075-639407d741b0 tempest-GroupsTest-2029762573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e581c7a2-2ada-4487-81f3-84353cdb2ebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:29:41 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-12d2163c-b385-4486-a075-639407d741b0 tempest-GroupsTest-2029762573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e581c7a2-2ada-4487-81f3-84353cdb2ebc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:29:41 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-12d2163c-b385-4486-a075-639407d741b0 tempest-GroupsTest-2029762573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9824a9f-e659-47fd-b0ed-c15ab141f991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:29:41 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-12d2163c-b385-4486-a075-639407d741b0 tempest-GroupsTest-2029762573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9824a9f-e659-47fd-b0ed-c15ab141f991) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5721ee08-d07a-4216-9edd-43ebf2cbd79e', 'volume_name': 'volume-5721ee08-d07a-4216-9edd-43ebf2cbd79e', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:29:41 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-12d2163c-b385-4486-a075-639407d741b0 tempest-GroupsTest-2029762573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64f0b9a8-ed5e-4e8d-a87c-dc33c0a84f9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:29:41 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-12d2163c-b385-4486-a075-639407d741b0 tempest-GroupsTest-2029762573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64f0b9a8-ed5e-4e8d-a87c-dc33c0a84f9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:29:41 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-12d2163c-b385-4486-a075-639407d741b0 tempest-GroupsTest-2029762573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18fe2210-02d3-4fc7-b2e7-1a9cd6804b50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:29:41 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-12d2163c-b385-4486-a075-639407d741b0 tempest-GroupsTest-2029762573 None] Volume 5721ee08-d07a-4216-9edd-43ebf2cbd79e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5721ee08-d07a-4216-9edd-43ebf2cbd79e', 'volume_size': 1}
Nov 03 18:29:41 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-12d2163c-b385-4486-a075-639407d741b0 tempest-GroupsTest-2029762573 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:29:50 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-d223c658-5513-42c0-9226-31da50c37f51 tempest-VolumesActionsTest-1478820281 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 33.615s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:29:50 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-d223c658-5513-42c0-9226-31da50c37f51 tempest-VolumesActionsTest-1478820281 None] Uploaded volume to glance image-id: a6196e09-7c52-4bf1-b5cb-396215acd019. {{(pid=86120) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Nov 03 18:29:50 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [req-9c5b9fbd-31f5-4e19-8171-9502e1674031 req-1f29fe4d-7a14-4c87-9aa5-4244f7ccbfc6 tempest-TestServerVolumeAttachmentScenario-290524599 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 12.744s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:29:50 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [req-9c5b9fbd-31f5-4e19-8171-9502e1674031 req-1f29fe4d-7a14-4c87-9aa5-4244f7ccbfc6 tempest-TestServerVolumeAttachmentScenario-290524599 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:29:50 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-12d2163c-b385-4486-a075-639407d741b0 tempest-GroupsTest-2029762573 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.171s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:29:50 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-12d2163c-b385-4486-a075-639407d741b0 tempest-GroupsTest-2029762573 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=c0e7a7bb-a5a7-4198-8915-22fbbc628137,created_at=2026-11-03T17:29:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1215928471',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=c0e7a7bb-a5a7-4198-8915-22fbbc628137,host='devstack@QuobyteHD#QuobyteHD',id=5721ee08-d07a-4216-9edd-43ebf2cbd79e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a644fe54bab8466f8a7a82c0a9f1f577',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:29:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:29:42Z,use_quota=True,user_id='2b6fb20fb242429e847ce30e245b9861',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f762d0-828e-403c-9441-f7e9fff8bf05),volume_type_id=00f762d0-828e-403c-9441-f7e9fff8bf05)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:29:50 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-12d2163c-b385-4486-a075-639407d741b0 tempest-GroupsTest-2029762573 None] Creating volume 5721ee08-d07a-4216-9edd-43ebf2cbd79e {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:29:50 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-12d2163c-b385-4486-a075-639407d741b0 tempest-GroupsTest-2029762573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:29:50 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-12d2163c-b385-4486-a075-639407d741b0 tempest-GroupsTest-2029762573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:29:50 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-12d2163c-b385-4486-a075-639407d741b0 tempest-GroupsTest-2029762573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:29:50 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-12d2163c-b385-4486-a075-639407d741b0 tempest-GroupsTest-2029762573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:29:50 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-12d2163c-b385-4486-a075-639407d741b0 tempest-GroupsTest-2029762573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:29:50 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-12d2163c-b385-4486-a075-639407d741b0 tempest-GroupsTest-2029762573 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:29:50 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-12d2163c-b385-4486-a075-639407d741b0 tempest-GroupsTest-2029762573 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:29:50 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-12d2163c-b385-4486-a075-639407d741b0 tempest-GroupsTest-2029762573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-5721ee08-d07a-4216-9edd-43ebf2cbd79e 1073741824 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:29:50 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-d223c658-5513-42c0-9226-31da50c37f51 tempest-VolumesActionsTest-1478820281 None] Copy volume to image completed successfully.
Nov 03 18:29:50 devstack sudo[95431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-5721ee08-d07a-4216-9edd-43ebf2cbd79e 1073741824
Nov 03 18:29:50 devstack sudo[95431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:29:50 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [req-9c5b9fbd-31f5-4e19-8171-9502e1674031 req-1f29fe4d-7a14-4c87-9aa5-4244f7ccbfc6 tempest-TestServerVolumeAttachmentScenario-290524599 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c', 'name': 'volume-953af810-f12c-458c-95df-164c55a028e1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9fefc823-4223-46f0-94e8-033b18774d8a', 'enforce_multipath': True} {{(pid=86120) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 03 18:29:50 devstack cinder-volume[86120]: INFO cinder.volume.manager [req-9c5b9fbd-31f5-4e19-8171-9502e1674031 req-1f29fe4d-7a14-4c87-9aa5-4244f7ccbfc6 tempest-TestServerVolumeAttachmentScenario-290524599 None] attachment_update completed successfully.
Nov 03 18:29:50 devstack sudo[95431]: pam_unix(sudo:session): session closed for user root
Nov 03 18:29:50 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-12d2163c-b385-4486-a075-639407d741b0 tempest-GroupsTest-2029762573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-5721ee08-d07a-4216-9edd-43ebf2cbd79e 1073741824" returned: 0 in 0.596s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:29:50 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-12d2163c-b385-4486-a075-639407d741b0 tempest-GroupsTest-2029762573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-5721ee08-d07a-4216-9edd-43ebf2cbd79e {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:29:50 devstack sudo[95852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-5721ee08-d07a-4216-9edd-43ebf2cbd79e
Nov 03 18:29:50 devstack sudo[95852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:29:51 devstack sudo[95852]: pam_unix(sudo:session): session closed for user root
Nov 03 18:29:51 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-12d2163c-b385-4486-a075-639407d741b0 tempest-GroupsTest-2029762573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-5721ee08-d07a-4216-9edd-43ebf2cbd79e" returned: 0 in 0.314s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:29:51 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-12d2163c-b385-4486-a075-639407d741b0 tempest-GroupsTest-2029762573 None] <== create_volume: return (958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:29:51 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-12d2163c-b385-4486-a075-639407d741b0 tempest-GroupsTest-2029762573 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.962s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:29:51 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-12d2163c-b385-4486-a075-639407d741b0 tempest-GroupsTest-2029762573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18fe2210-02d3-4fc7-b2e7-1a9cd6804b50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5721ee08-d07a-4216-9edd-43ebf2cbd79e', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:29:51 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-12d2163c-b385-4486-a075-639407d741b0 tempest-GroupsTest-2029762573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b976ac6-9130-46dc-9b64-961ec549684a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:29:51 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-12d2163c-b385-4486-a075-639407d741b0 tempest-GroupsTest-2029762573 None] Volume volume-5721ee08-d07a-4216-9edd-43ebf2cbd79e (5721ee08-d07a-4216-9edd-43ebf2cbd79e): created successfully
Nov 03 18:29:51 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-12d2163c-b385-4486-a075-639407d741b0 tempest-GroupsTest-2029762573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b976ac6-9130-46dc-9b64-961ec549684a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:29:51 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-12d2163c-b385-4486-a075-639407d741b0 tempest-GroupsTest-2029762573 None] Flow 'volume_create_manager' (d3350506-19b3-4910-b4d3-c9616dfe114e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:29:51 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-12d2163c-b385-4486-a075-639407d741b0 tempest-GroupsTest-2029762573 None] Created volume successfully.
Nov 03 18:29:52 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-a75634d5-52f8-434e-a0e4-0c960cd1ca93 tempest-VolumesActionsTest-1478820281 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:29:52 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-a75634d5-52f8-434e-a0e4-0c960cd1ca93 tempest-VolumesActionsTest-1478820281 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:29:52 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[917ed822-4221-4502-a0bb-d3dc596a13ff]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:29:52 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-a75634d5-52f8-434e-a0e4-0c960cd1ca93 tempest-VolumesActionsTest-1478820281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6b91139a-7861-42ec-9f14-713c2ea95ebe {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:29:52 devstack sudo[95869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6b91139a-7861-42ec-9f14-713c2ea95ebe
Nov 03 18:29:52 devstack sudo[95869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:29:53 devstack sudo[95869]: pam_unix(sudo:session): session closed for user root
Nov 03 18:29:53 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-a75634d5-52f8-434e-a0e4-0c960cd1ca93 tempest-VolumesActionsTest-1478820281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6b91139a-7861-42ec-9f14-713c2ea95ebe" returned: 0 in 0.565s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:29:53 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[13668944-f7a5-4a90-8ca0-1f6370407dda]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:29:53 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-a75634d5-52f8-434e-a0e4-0c960cd1ca93 tempest-VolumesActionsTest-1478820281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6b91139a-7861-42ec-9f14-713c2ea95ebe {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:29:53 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-aeceea00-2864-46ca-b70a-483549d211c8 tempest-GroupsTest-2029762573 None] Acquiring lock "cinder-quobyte-5721ee08-d07a-4216-9edd-43ebf2cbd79e" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:29:53 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-aeceea00-2864-46ca-b70a-483549d211c8 tempest-GroupsTest-2029762573 None] Lock "cinder-quobyte-5721ee08-d07a-4216-9edd-43ebf2cbd79e" acquired by "delete_volume" :: waited 0.034s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:29:53 devstack sudo[95874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6b91139a-7861-42ec-9f14-713c2ea95ebe
Nov 03 18:29:53 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd3df45d-908f-4700-83cb-7eb3be97ad9b]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:29:53 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-aeceea00-2864-46ca-b70a-483549d211c8 tempest-GroupsTest-2029762573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-5721ee08-d07a-4216-9edd-43ebf2cbd79e {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:29:53 devstack sudo[95874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:29:53 devstack sudo[95876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-5721ee08-d07a-4216-9edd-43ebf2cbd79e
Nov 03 18:29:53 devstack sudo[95876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:29:53 devstack sudo[95874]: pam_unix(sudo:session): session closed for user root
Nov 03 18:29:53 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-a75634d5-52f8-434e-a0e4-0c960cd1ca93 tempest-VolumesActionsTest-1478820281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6b91139a-7861-42ec-9f14-713c2ea95ebe" returned: 0 in 0.503s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:29:53 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-a75634d5-52f8-434e-a0e4-0c960cd1ca93 tempest-VolumesActionsTest-1478820281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6b91139a-7861-42ec-9f14-713c2ea95ebe /opt/stack/data/cinder/conversion/6b91139a-7861-42ec-9f14-713c2ea95ebe.temp_image.100a3aac-0363-4e3f-8c88-5b424485389avpuyn_0o.img {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:29:53 devstack sudo[95881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6b91139a-7861-42ec-9f14-713c2ea95ebe /opt/stack/data/cinder/conversion/6b91139a-7861-42ec-9f14-713c2ea95ebe.temp_image.100a3aac-0363-4e3f-8c88-5b424485389avpuyn_0o.img
Nov 03 18:29:53 devstack sudo[95881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:29:53 devstack sudo[95876]: pam_unix(sudo:session): session closed for user root
Nov 03 18:29:53 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-aeceea00-2864-46ca-b70a-483549d211c8 tempest-GroupsTest-2029762573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-5721ee08-d07a-4216-9edd-43ebf2cbd79e" returned: 0 in 0.527s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:29:53 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-aeceea00-2864-46ca-b70a-483549d211c8 tempest-GroupsTest-2029762573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-5721ee08-d07a-4216-9edd-43ebf2cbd79e {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:29:53 devstack sudo[95886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-5721ee08-d07a-4216-9edd-43ebf2cbd79e
Nov 03 18:29:53 devstack sudo[95886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:29:54 devstack sudo[95886]: pam_unix(sudo:session): session closed for user root
Nov 03 18:29:54 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-aeceea00-2864-46ca-b70a-483549d211c8 tempest-GroupsTest-2029762573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-5721ee08-d07a-4216-9edd-43ebf2cbd79e" returned: 0 in 0.910s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:29:54 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-aeceea00-2864-46ca-b70a-483549d211c8 tempest-GroupsTest-2029762573 None] Lock "cinder-quobyte-5721ee08-d07a-4216-9edd-43ebf2cbd79e" released by "delete_volume" :: held 1.530s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:29:55 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-aeceea00-2864-46ca-b70a-483549d211c8 tempest-GroupsTest-2029762573 None] Created reservations ['8cf44a48-e683-4e0e-9bd7-ecc20ae85e06'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:29:55 devstack cinder-volume[86120]: WARNING cinder.quota [None req-aeceea00-2864-46ca-b70a-483549d211c8 tempest-GroupsTest-2029762573 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-198448743 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-198448743, it is now deprecated. Please use the default quota class for default quota.
Nov 03 18:29:55 devstack cinder-volume[86120]: WARNING cinder.quota [None req-aeceea00-2864-46ca-b70a-483549d211c8 tempest-GroupsTest-2029762573 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-198448743 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-198448743, it is now deprecated. Please use the default quota class for default quota.
Nov 03 18:29:55 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-aeceea00-2864-46ca-b70a-483549d211c8 tempest-GroupsTest-2029762573 None] Created reservations ['a45677f1-03df-442d-86ce-a82be9d8f408', 'f1298e0c-a736-41c2-b7d3-8f9551015bb8', '96e8d87e-34bd-42a9-91c7-7ad5c9757e45', '513d8112-a8af-4472-9dae-ca69b3eccadb'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:29:55 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-aeceea00-2864-46ca-b70a-483549d211c8 tempest-GroupsTest-2029762573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:29:55 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-aeceea00-2864-46ca-b70a-483549d211c8 tempest-GroupsTest-2029762573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:29:55 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-aeceea00-2864-46ca-b70a-483549d211c8 tempest-GroupsTest-2029762573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:29:55 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-aeceea00-2864-46ca-b70a-483549d211c8 tempest-GroupsTest-2029762573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:29:55 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-aeceea00-2864-46ca-b70a-483549d211c8 tempest-GroupsTest-2029762573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:29:55 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-aeceea00-2864-46ca-b70a-483549d211c8 tempest-GroupsTest-2029762573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:29:55 devstack sudo[95900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:29:55 devstack sudo[95900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:29:56 devstack sudo[95900]: pam_unix(sudo:session): session closed for user root
Nov 03 18:29:56 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-aeceea00-2864-46ca-b70a-483549d211c8 tempest-GroupsTest-2029762573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.727s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:29:56 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-aeceea00-2864-46ca-b70a-483549d211c8 tempest-GroupsTest-2029762573 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:29:56 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-aeceea00-2864-46ca-b70a-483549d211c8 tempest-GroupsTest-2029762573 None] Delete group completed successfully.
Nov 03 18:29:57 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-677ba703-3ec9-4f54-9f34-61a973a715d1 tempest-GroupsTest-2029762573 None] Created reservations ['290965c3-0f59-423a-bb4a-fd7f6ce450e9'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:29:57 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-677ba703-3ec9-4f54-9f34-61a973a715d1 tempest-GroupsTest-2029762573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:29:57 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-677ba703-3ec9-4f54-9f34-61a973a715d1 tempest-GroupsTest-2029762573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:29:57 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-677ba703-3ec9-4f54-9f34-61a973a715d1 tempest-GroupsTest-2029762573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:29:57 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-677ba703-3ec9-4f54-9f34-61a973a715d1 tempest-GroupsTest-2029762573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:29:57 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-677ba703-3ec9-4f54-9f34-61a973a715d1 tempest-GroupsTest-2029762573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:29:57 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-677ba703-3ec9-4f54-9f34-61a973a715d1 tempest-GroupsTest-2029762573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:29:57 devstack sudo[95916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:29:57 devstack sudo[95916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:29:57 devstack sudo[95916]: pam_unix(sudo:session): session closed for user root
Nov 03 18:29:57 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-677ba703-3ec9-4f54-9f34-61a973a715d1 tempest-GroupsTest-2029762573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.514s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:29:57 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-677ba703-3ec9-4f54-9f34-61a973a715d1 tempest-GroupsTest-2029762573 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:29:57 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-677ba703-3ec9-4f54-9f34-61a973a715d1 tempest-GroupsTest-2029762573 None] Delete group completed successfully.
Nov 03 18:29:58 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [req-acbf66f4-36c8-4b00-a72a-4d272e4eec64 req-f8c637ab-1808-41a5-bf26-74de997a1472 tempest-TestServerVolumeAttachmentScenario-290524599 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:29:59 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-63b85977-9670-4bbf-8aae-a99a62b9c278 tempest-GroupsTest-2029762573 None] Group tempest-GroupsTest-Group-1342736822: creating
Nov 03 18:29:59 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-63b85977-9670-4bbf-8aae-a99a62b9c278 tempest-GroupsTest-2029762573 None] Group tempest-GroupsTest-Group-1342736822: created successfully
Nov 03 18:29:59 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-63b85977-9670-4bbf-8aae-a99a62b9c278 tempest-GroupsTest-2029762573 None] Create group completed successfully.
Nov 03 18:30:01 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea85e377-804b-4e7c-bcba-e3aa352cd903 tempest-GroupsTest-2029762573 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:30:01 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-ea85e377-804b-4e7c-bcba-e3aa352cd903 tempest-GroupsTest-2029762573 None] Flow 'volume_create_manager' (766e26d7-c1c9-4aea-960a-91879752b777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:30:01 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-ea85e377-804b-4e7c-bcba-e3aa352cd903 tempest-GroupsTest-2029762573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03e960a7-5da1-47e4-be9b-2fe3ae5e93d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:30:01 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-ea85e377-804b-4e7c-bcba-e3aa352cd903 tempest-GroupsTest-2029762573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03e960a7-5da1-47e4-be9b-2fe3ae5e93d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:30:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1132077838',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=65ad7da5-cddc-4967-bd4e-def113a759cc,host='devstack@QuobyteHD#QuobyteHD',id=65b31bc6-0eec-4d94-8f8e-15c97f4dcf2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a644fe54bab8466f8a7a82c0a9f1f577',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:30:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:30:02Z,use_quota=True,user_id='2b6fb20fb242429e847ce30e245b9861',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b9311779-14b0-439d-b35a-cd911644a708),volume_type_id=b9311779-14b0-439d-b35a-cd911644a708)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:30:01 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-ea85e377-804b-4e7c-bcba-e3aa352cd903 tempest-GroupsTest-2029762573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b8df099-ad77-422f-841c-f35056103459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:30:01 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-ea85e377-804b-4e7c-bcba-e3aa352cd903 tempest-GroupsTest-2029762573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b8df099-ad77-422f-841c-f35056103459) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:30:01 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-ea85e377-804b-4e7c-bcba-e3aa352cd903 tempest-GroupsTest-2029762573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (299d3f45-8259-4ec6-b93c-14b643491101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:30:01 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-ea85e377-804b-4e7c-bcba-e3aa352cd903 tempest-GroupsTest-2029762573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (299d3f45-8259-4ec6-b93c-14b643491101) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65b31bc6-0eec-4d94-8f8e-15c97f4dcf2f', 'volume_name': 'volume-65b31bc6-0eec-4d94-8f8e-15c97f4dcf2f', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:30:01 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-ea85e377-804b-4e7c-bcba-e3aa352cd903 tempest-GroupsTest-2029762573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2a983d6-7297-4ec2-9901-f4f6acd78edf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:30:01 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-ea85e377-804b-4e7c-bcba-e3aa352cd903 tempest-GroupsTest-2029762573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2a983d6-7297-4ec2-9901-f4f6acd78edf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:30:01 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-ea85e377-804b-4e7c-bcba-e3aa352cd903 tempest-GroupsTest-2029762573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9df40929-e344-49dd-a419-f5e7eaceb285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:30:01 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-ea85e377-804b-4e7c-bcba-e3aa352cd903 tempest-GroupsTest-2029762573 None] Volume 65b31bc6-0eec-4d94-8f8e-15c97f4dcf2f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65b31bc6-0eec-4d94-8f8e-15c97f4dcf2f', 'volume_size': 1}
Nov 03 18:30:01 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-ea85e377-804b-4e7c-bcba-e3aa352cd903 tempest-GroupsTest-2029762573 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:30:01 devstack sudo[95881]: pam_unix(sudo:session): session closed for user root
Nov 03 18:30:01 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-a75634d5-52f8-434e-a0e4-0c960cd1ca93 tempest-VolumesActionsTest-1478820281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6b91139a-7861-42ec-9f14-713c2ea95ebe /opt/stack/data/cinder/conversion/6b91139a-7861-42ec-9f14-713c2ea95ebe.temp_image.100a3aac-0363-4e3f-8c88-5b424485389avpuyn_0o.img" returned: 0 in 8.212s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:30:01 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[a87a5639-6e66-464f-90b8-57885b0c7411]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:30:01 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-a75634d5-52f8-434e-a0e4-0c960cd1ca93 tempest-VolumesActionsTest-1478820281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6b91139a-7861-42ec-9f14-713c2ea95ebe {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:30:01 devstack sudo[95933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6b91139a-7861-42ec-9f14-713c2ea95ebe
Nov 03 18:30:01 devstack sudo[95933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:30:02 devstack sudo[95933]: pam_unix(sudo:session): session closed for user root
Nov 03 18:30:02 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-a75634d5-52f8-434e-a0e4-0c960cd1ca93 tempest-VolumesActionsTest-1478820281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6b91139a-7861-42ec-9f14-713c2ea95ebe" returned: 0 in 0.524s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:30:02 devstack cinder-volume[86120]: DEBUG cinder.image.image_utils [None req-a75634d5-52f8-434e-a0e4-0c960cd1ca93 tempest-VolumesActionsTest-1478820281 None] Image conversion details: src /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6b91139a-7861-42ec-9f14-713c2ea95ebe, size 1024.00 MB, duration 8.21 sec, destination /opt/stack/data/cinder/conversion/6b91139a-7861-42ec-9f14-713c2ea95ebe.temp_image.100a3aac-0363-4e3f-8c88-5b424485389avpuyn_0o.img {{(pid=86120) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 03 18:30:02 devstack cinder-volume[86120]: INFO cinder.image.image_utils [None req-a75634d5-52f8-434e-a0e4-0c960cd1ca93 tempest-VolumesActionsTest-1478820281 None] Converted 1024.00 MB image at 124.67 MB/s
Nov 03 18:30:02 devstack cinder-volume[86120]: DEBUG cinder.image.image_utils [None req-a75634d5-52f8-434e-a0e4-0c960cd1ca93 tempest-VolumesActionsTest-1478820281 None] 100a3aac-0363-4e3f-8c88-5b424485389a was raw, converting to qcow2 {{(pid=86120) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1203}}
Nov 03 18:30:02 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[b524a13f-07b6-4a45-9ebe-5532967332f8]: (4, 'raw') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:30:02 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-a75634d5-52f8-434e-a0e4-0c960cd1ca93 tempest-VolumesActionsTest-1478820281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/6b91139a-7861-42ec-9f14-713c2ea95ebe.temp_image.100a3aac-0363-4e3f-8c88-5b424485389avpuyn_0o.img {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:30:02 devstack sudo[95938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/6b91139a-7861-42ec-9f14-713c2ea95ebe.temp_image.100a3aac-0363-4e3f-8c88-5b424485389avpuyn_0o.img
Nov 03 18:30:02 devstack sudo[95938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:30:02 devstack sudo[95938]: pam_unix(sudo:session): session closed for user root
Nov 03 18:30:02 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-a75634d5-52f8-434e-a0e4-0c960cd1ca93 tempest-VolumesActionsTest-1478820281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/6b91139a-7861-42ec-9f14-713c2ea95ebe.temp_image.100a3aac-0363-4e3f-8c88-5b424485389avpuyn_0o.img" returned: 0 in 0.330s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:30:02 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-a75634d5-52f8-434e-a0e4-0c960cd1ca93 tempest-VolumesActionsTest-1478820281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/6b91139a-7861-42ec-9f14-713c2ea95ebe.temp_image.100a3aac-0363-4e3f-8c88-5b424485389avpuyn_0o.img {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:30:02 devstack sudo[95942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/6b91139a-7861-42ec-9f14-713c2ea95ebe.temp_image.100a3aac-0363-4e3f-8c88-5b424485389avpuyn_0o.img
Nov 03 18:30:02 devstack sudo[95942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:30:03 devstack sudo[95942]: pam_unix(sudo:session): session closed for user root
Nov 03 18:30:03 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-a75634d5-52f8-434e-a0e4-0c960cd1ca93 tempest-VolumesActionsTest-1478820281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/6b91139a-7861-42ec-9f14-713c2ea95ebe.temp_image.100a3aac-0363-4e3f-8c88-5b424485389avpuyn_0o.img" returned: 1 in 0.325s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:30:03 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-a75634d5-52f8-434e-a0e4-0c960cd1ca93 tempest-VolumesActionsTest-1478820281 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/6b91139a-7861-42ec-9f14-713c2ea95ebe.temp_image.100a3aac-0363-4e3f-8c88-5b424485389avpuyn_0o.img' failed. Not Retrying. {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 03 18:30:03 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-a75634d5-52f8-434e-a0e4-0c960cd1ca93 tempest-VolumesActionsTest-1478820281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/6b91139a-7861-42ec-9f14-713c2ea95ebe.temp_image.100a3aac-0363-4e3f-8c88-5b424485389avpuyn_0o.img /opt/stack/data/cinder/conversion/vol_upload_rc190f6h {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:30:03 devstack sudo[95947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/6b91139a-7861-42ec-9f14-713c2ea95ebe.temp_image.100a3aac-0363-4e3f-8c88-5b424485389avpuyn_0o.img /opt/stack/data/cinder/conversion/vol_upload_rc190f6h
Nov 03 18:30:03 devstack sudo[95947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:30:03 devstack sudo[95947]: pam_unix(sudo:session): session closed for user root
Nov 03 18:30:03 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-a75634d5-52f8-434e-a0e4-0c960cd1ca93 tempest-VolumesActionsTest-1478820281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/6b91139a-7861-42ec-9f14-713c2ea95ebe.temp_image.100a3aac-0363-4e3f-8c88-5b424485389avpuyn_0o.img /opt/stack/data/cinder/conversion/vol_upload_rc190f6h" returned: 0 in 0.248s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:30:03 devstack cinder-volume[86120]: DEBUG cinder.image.image_utils [None req-a75634d5-52f8-434e-a0e4-0c960cd1ca93 tempest-VolumesActionsTest-1478820281 None] Image conversion details: src /opt/stack/data/cinder/conversion/6b91139a-7861-42ec-9f14-713c2ea95ebe.temp_image.100a3aac-0363-4e3f-8c88-5b424485389avpuyn_0o.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_rc190f6h {{(pid=86120) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 03 18:30:03 devstack cinder-volume[86120]: INFO cinder.image.image_utils [None req-a75634d5-52f8-434e-a0e4-0c960cd1ca93 tempest-VolumesActionsTest-1478820281 None] Converted 1024.00 MB image at 1024.00 MB/s
Nov 03 18:30:03 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[a46ef011-635b-4d21-8276-5e7689b6a78d]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:30:03 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-a75634d5-52f8-434e-a0e4-0c960cd1ca93 tempest-VolumesActionsTest-1478820281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_rc190f6h {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:30:03 devstack sudo[95953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_rc190f6h
Nov 03 18:30:03 devstack sudo[95953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:30:03 devstack sudo[95953]: pam_unix(sudo:session): session closed for user root
Nov 03 18:30:03 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-a75634d5-52f8-434e-a0e4-0c960cd1ca93 tempest-VolumesActionsTest-1478820281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_rc190f6h" returned: 0 in 0.350s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:30:05 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-a75634d5-52f8-434e-a0e4-0c960cd1ca93 tempest-VolumesActionsTest-1478820281 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 12.746s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:30:05 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-a75634d5-52f8-434e-a0e4-0c960cd1ca93 tempest-VolumesActionsTest-1478820281 None] Uploaded volume to glance image-id: 100a3aac-0363-4e3f-8c88-5b424485389a. {{(pid=86120) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Nov 03 18:30:05 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [req-acbf66f4-36c8-4b00-a72a-4d272e4eec64 req-f8c637ab-1808-41a5-bf26-74de997a1472 tempest-TestServerVolumeAttachmentScenario-290524599 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 6.767s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:30:05 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [req-acbf66f4-36c8-4b00-a72a-4d272e4eec64 req-f8c637ab-1808-41a5-bf26-74de997a1472 tempest-TestServerVolumeAttachmentScenario-290524599 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:30:05 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-ea85e377-804b-4e7c-bcba-e3aa352cd903 tempest-GroupsTest-2029762573 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.478s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:30:05 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-ea85e377-804b-4e7c-bcba-e3aa352cd903 tempest-GroupsTest-2029762573 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=65ad7da5-cddc-4967-bd4e-def113a759cc,created_at=2026-11-03T17:30:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1132077838',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=65ad7da5-cddc-4967-bd4e-def113a759cc,host='devstack@QuobyteHD#QuobyteHD',id=65b31bc6-0eec-4d94-8f8e-15c97f4dcf2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a644fe54bab8466f8a7a82c0a9f1f577',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:30:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:30:02Z,use_quota=True,user_id='2b6fb20fb242429e847ce30e245b9861',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b9311779-14b0-439d-b35a-cd911644a708),volume_type_id=b9311779-14b0-439d-b35a-cd911644a708)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:30:05 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-ea85e377-804b-4e7c-bcba-e3aa352cd903 tempest-GroupsTest-2029762573 None] Creating volume 65b31bc6-0eec-4d94-8f8e-15c97f4dcf2f {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:30:05 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-ea85e377-804b-4e7c-bcba-e3aa352cd903 tempest-GroupsTest-2029762573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:30:05 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-ea85e377-804b-4e7c-bcba-e3aa352cd903 tempest-GroupsTest-2029762573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:30:05 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-ea85e377-804b-4e7c-bcba-e3aa352cd903 tempest-GroupsTest-2029762573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:30:05 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-ea85e377-804b-4e7c-bcba-e3aa352cd903 tempest-GroupsTest-2029762573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:30:05 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-ea85e377-804b-4e7c-bcba-e3aa352cd903 tempest-GroupsTest-2029762573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:30:05 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-ea85e377-804b-4e7c-bcba-e3aa352cd903 tempest-GroupsTest-2029762573 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:30:05 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-ea85e377-804b-4e7c-bcba-e3aa352cd903 tempest-GroupsTest-2029762573 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:30:05 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-ea85e377-804b-4e7c-bcba-e3aa352cd903 tempest-GroupsTest-2029762573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-65b31bc6-0eec-4d94-8f8e-15c97f4dcf2f 1073741824 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:30:05 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-a75634d5-52f8-434e-a0e4-0c960cd1ca93 tempest-VolumesActionsTest-1478820281 None] Copy volume to image completed successfully.
Nov 03 18:30:05 devstack sudo[95962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-65b31bc6-0eec-4d94-8f8e-15c97f4dcf2f 1073741824
Nov 03 18:30:05 devstack sudo[95962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:30:05 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [req-acbf66f4-36c8-4b00-a72a-4d272e4eec64 req-f8c637ab-1808-41a5-bf26-74de997a1472 tempest-TestServerVolumeAttachmentScenario-290524599 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c', 'name': 'volume-ff530d44-28b5-4b79-bed8-04f2276bf196', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd2c26bf8-be78-4c4c-9e2c-d04fa9969b53', 'enforce_multipath': True} {{(pid=86120) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 03 18:30:05 devstack cinder-volume[86120]: INFO cinder.volume.manager [req-acbf66f4-36c8-4b00-a72a-4d272e4eec64 req-f8c637ab-1808-41a5-bf26-74de997a1472 tempest-TestServerVolumeAttachmentScenario-290524599 None] attachment_update completed successfully.
Nov 03 18:30:06 devstack sudo[95962]: pam_unix(sudo:session): session closed for user root
Nov 03 18:30:06 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-ea85e377-804b-4e7c-bcba-e3aa352cd903 tempest-GroupsTest-2029762573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-65b31bc6-0eec-4d94-8f8e-15c97f4dcf2f 1073741824" returned: 0 in 0.908s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:30:06 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-ea85e377-804b-4e7c-bcba-e3aa352cd903 tempest-GroupsTest-2029762573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-65b31bc6-0eec-4d94-8f8e-15c97f4dcf2f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:30:06 devstack sudo[95992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-65b31bc6-0eec-4d94-8f8e-15c97f4dcf2f
Nov 03 18:30:06 devstack sudo[95992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:30:06 devstack sudo[95992]: pam_unix(sudo:session): session closed for user root
Nov 03 18:30:06 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-ea85e377-804b-4e7c-bcba-e3aa352cd903 tempest-GroupsTest-2029762573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-65b31bc6-0eec-4d94-8f8e-15c97f4dcf2f" returned: 0 in 0.400s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:30:06 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-ea85e377-804b-4e7c-bcba-e3aa352cd903 tempest-GroupsTest-2029762573 None] <== create_volume: return (1373ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:30:06 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-ea85e377-804b-4e7c-bcba-e3aa352cd903 tempest-GroupsTest-2029762573 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.377s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:30:06 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-ea85e377-804b-4e7c-bcba-e3aa352cd903 tempest-GroupsTest-2029762573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9df40929-e344-49dd-a419-f5e7eaceb285) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65b31bc6-0eec-4d94-8f8e-15c97f4dcf2f', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:30:06 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-ea85e377-804b-4e7c-bcba-e3aa352cd903 tempest-GroupsTest-2029762573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d558d4b-0af2-4aaa-95f3-dcd26387ceb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:30:06 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-ea85e377-804b-4e7c-bcba-e3aa352cd903 tempest-GroupsTest-2029762573 None] Volume volume-65b31bc6-0eec-4d94-8f8e-15c97f4dcf2f (65b31bc6-0eec-4d94-8f8e-15c97f4dcf2f): created successfully
Nov 03 18:30:06 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-ea85e377-804b-4e7c-bcba-e3aa352cd903 tempest-GroupsTest-2029762573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d558d4b-0af2-4aaa-95f3-dcd26387ceb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:30:06 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-ea85e377-804b-4e7c-bcba-e3aa352cd903 tempest-GroupsTest-2029762573 None] Flow 'volume_create_manager' (766e26d7-c1c9-4aea-960a-91879752b777) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:30:06 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-ea85e377-804b-4e7c-bcba-e3aa352cd903 tempest-GroupsTest-2029762573 None] Created volume successfully.
Nov 03 18:30:06 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-0c5be793-1d9c-4e50-a8b6-c81d6678e485 tempest-VolumesActionsTest-1478820281 None] Acquiring lock "cinder-6b91139a-7861-42ec-9f14-713c2ea95ebe-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:30:06 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-0c5be793-1d9c-4e50-a8b6-c81d6678e485 tempest-VolumesActionsTest-1478820281 None] Lock "cinder-6b91139a-7861-42ec-9f14-713c2ea95ebe-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:30:06 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-0c5be793-1d9c-4e50-a8b6-c81d6678e485 tempest-VolumesActionsTest-1478820281 None] Acquiring lock "cinder-quobyte-6b91139a-7861-42ec-9f14-713c2ea95ebe" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:30:06 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-0c5be793-1d9c-4e50-a8b6-c81d6678e485 tempest-VolumesActionsTest-1478820281 None] Lock "cinder-quobyte-6b91139a-7861-42ec-9f14-713c2ea95ebe" acquired by "delete_volume" :: waited 0.021s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:30:06 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[f27c76f6-37fb-478c-93d2-9cc789f25d2e]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:30:06 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-0c5be793-1d9c-4e50-a8b6-c81d6678e485 tempest-VolumesActionsTest-1478820281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6b91139a-7861-42ec-9f14-713c2ea95ebe {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:30:07 devstack sudo[95996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6b91139a-7861-42ec-9f14-713c2ea95ebe
Nov 03 18:30:07 devstack sudo[95996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:30:07 devstack sudo[95996]: pam_unix(sudo:session): session closed for user root
Nov 03 18:30:07 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-0c5be793-1d9c-4e50-a8b6-c81d6678e485 tempest-VolumesActionsTest-1478820281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6b91139a-7861-42ec-9f14-713c2ea95ebe" returned: 0 in 0.408s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:30:07 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-0c5be793-1d9c-4e50-a8b6-c81d6678e485 tempest-VolumesActionsTest-1478820281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6b91139a-7861-42ec-9f14-713c2ea95ebe {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:30:07 devstack sudo[96002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6b91139a-7861-42ec-9f14-713c2ea95ebe
Nov 03 18:30:07 devstack sudo[96002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:30:07 devstack sudo[96002]: pam_unix(sudo:session): session closed for user root
Nov 03 18:30:07 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-0c5be793-1d9c-4e50-a8b6-c81d6678e485 tempest-VolumesActionsTest-1478820281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6b91139a-7861-42ec-9f14-713c2ea95ebe" returned: 0 in 0.321s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:30:07 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-0c5be793-1d9c-4e50-a8b6-c81d6678e485 tempest-VolumesActionsTest-1478820281 None] Lock "cinder-quobyte-6b91139a-7861-42ec-9f14-713c2ea95ebe" released by "delete_volume" :: held 0.794s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:30:07 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-0c5be793-1d9c-4e50-a8b6-c81d6678e485 tempest-VolumesActionsTest-1478820281 None] Created reservations ['30b48b9d-8cb6-409d-aa77-9c8fb394fe0c', 'aef97b96-8b57-4885-baa6-cf56116d7983', '8aec8e68-d081-4edc-bf9a-911617e31afc', '95e79fde-b204-4d69-a850-0112e0b2a642'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:30:07 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-0c5be793-1d9c-4e50-a8b6-c81d6678e485 tempest-VolumesActionsTest-1478820281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:30:07 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-0c5be793-1d9c-4e50-a8b6-c81d6678e485 tempest-VolumesActionsTest-1478820281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:30:07 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-0c5be793-1d9c-4e50-a8b6-c81d6678e485 tempest-VolumesActionsTest-1478820281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:30:07 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-0c5be793-1d9c-4e50-a8b6-c81d6678e485 tempest-VolumesActionsTest-1478820281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:30:07 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-0c5be793-1d9c-4e50-a8b6-c81d6678e485 tempest-VolumesActionsTest-1478820281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:30:07 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-0c5be793-1d9c-4e50-a8b6-c81d6678e485 tempest-VolumesActionsTest-1478820281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:30:07 devstack sudo[96009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:30:07 devstack sudo[96009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:30:07 devstack cinder-volume[86120]: INFO cinder.volume.manager [req-af144011-f0df-4a2b-b753-fdf9e5e1ec13 req-d3ab3b02-b0ef-486b-9a50-0ce4083a3a2a tempest-TestServerVolumeAttachmentScenario-290524599 None] Terminate volume connection completed successfully.
Nov 03 18:30:07 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [req-af144011-f0df-4a2b-b753-fdf9e5e1ec13 req-d3ab3b02-b0ef-486b-9a50-0ce4083a3a2a tempest-TestServerVolumeAttachmentScenario-290524599 None] Deleting attachment d2c26bf8-be78-4c4c-9e2c-d04fa9969b53. {{(pid=86120) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 03 18:30:08 devstack sudo[96009]: pam_unix(sudo:session): session closed for user root
Nov 03 18:30:08 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-0c5be793-1d9c-4e50-a8b6-c81d6678e485 tempest-VolumesActionsTest-1478820281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.472s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:30:08 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-0c5be793-1d9c-4e50-a8b6-c81d6678e485 tempest-VolumesActionsTest-1478820281 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:30:08 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-0c5be793-1d9c-4e50-a8b6-c81d6678e485 tempest-VolumesActionsTest-1478820281 None] Deleted volume successfully.
Nov 03 18:30:08 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-0c5be793-1d9c-4e50-a8b6-c81d6678e485 tempest-VolumesActionsTest-1478820281 None] Lock "cinder-6b91139a-7861-42ec-9f14-713c2ea95ebe-delete_volume" released by "delete_volume" :: held 1.573s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:30:08 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-73f00d31-b7d0-45a3-af85-fe2ad3996306 tempest-GroupsTest-2029762573 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:30:08 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-73f00d31-b7d0-45a3-af85-fe2ad3996306 tempest-GroupsTest-2029762573 None] Flow 'volume_create_manager' (573dee49-61b5-460a-9ad2-f7c543d868c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:30:08 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-73f00d31-b7d0-45a3-af85-fe2ad3996306 tempest-GroupsTest-2029762573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (020b14d9-a366-4b30-83ae-43d2914c7d50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:30:08 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-73f00d31-b7d0-45a3-af85-fe2ad3996306 tempest-GroupsTest-2029762573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (020b14d9-a366-4b30-83ae-43d2914c7d50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:30:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2119518639',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=65ad7da5-cddc-4967-bd4e-def113a759cc,host='devstack@QuobyteHD#QuobyteHD',id=d54dfa54-6370-4059-8d8c-1855f07d232f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a644fe54bab8466f8a7a82c0a9f1f577',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:30:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:30:09Z,use_quota=True,user_id='2b6fb20fb242429e847ce30e245b9861',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b9311779-14b0-439d-b35a-cd911644a708),volume_type_id=b9311779-14b0-439d-b35a-cd911644a708)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:30:08 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-73f00d31-b7d0-45a3-af85-fe2ad3996306 tempest-GroupsTest-2029762573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24ad07c4-2309-4e01-9e7a-b1b348e04aa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:30:08 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-73f00d31-b7d0-45a3-af85-fe2ad3996306 tempest-GroupsTest-2029762573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24ad07c4-2309-4e01-9e7a-b1b348e04aa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:30:08 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-73f00d31-b7d0-45a3-af85-fe2ad3996306 tempest-GroupsTest-2029762573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47d5ed78-3052-4800-91dc-49d7326a5a63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:30:08 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-73f00d31-b7d0-45a3-af85-fe2ad3996306 tempest-GroupsTest-2029762573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47d5ed78-3052-4800-91dc-49d7326a5a63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd54dfa54-6370-4059-8d8c-1855f07d232f', 'volume_name': 'volume-d54dfa54-6370-4059-8d8c-1855f07d232f', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:30:08 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-73f00d31-b7d0-45a3-af85-fe2ad3996306 tempest-GroupsTest-2029762573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3afc811-f456-4f2d-89b6-b49f5873dfad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:30:08 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-73f00d31-b7d0-45a3-af85-fe2ad3996306 tempest-GroupsTest-2029762573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3afc811-f456-4f2d-89b6-b49f5873dfad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:30:08 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-73f00d31-b7d0-45a3-af85-fe2ad3996306 tempest-GroupsTest-2029762573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bab3735c-2bc8-456f-8f8e-e7b345f34ef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:30:08 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-73f00d31-b7d0-45a3-af85-fe2ad3996306 tempest-GroupsTest-2029762573 None] Volume d54dfa54-6370-4059-8d8c-1855f07d232f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d54dfa54-6370-4059-8d8c-1855f07d232f', 'volume_size': 1}
Nov 03 18:30:08 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-73f00d31-b7d0-45a3-af85-fe2ad3996306 tempest-GroupsTest-2029762573 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:30:08 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-73f00d31-b7d0-45a3-af85-fe2ad3996306 tempest-GroupsTest-2029762573 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:30:08 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-73f00d31-b7d0-45a3-af85-fe2ad3996306 tempest-GroupsTest-2029762573 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=65ad7da5-cddc-4967-bd4e-def113a759cc,created_at=2026-11-03T17:30:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2119518639',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=65ad7da5-cddc-4967-bd4e-def113a759cc,host='devstack@QuobyteHD#QuobyteHD',id=d54dfa54-6370-4059-8d8c-1855f07d232f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a644fe54bab8466f8a7a82c0a9f1f577',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:30:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:30:09Z,use_quota=True,user_id='2b6fb20fb242429e847ce30e245b9861',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b9311779-14b0-439d-b35a-cd911644a708),volume_type_id=b9311779-14b0-439d-b35a-cd911644a708)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:30:08 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-73f00d31-b7d0-45a3-af85-fe2ad3996306 tempest-GroupsTest-2029762573 None] Creating volume d54dfa54-6370-4059-8d8c-1855f07d232f {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:30:08 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-73f00d31-b7d0-45a3-af85-fe2ad3996306 tempest-GroupsTest-2029762573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:30:08 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-73f00d31-b7d0-45a3-af85-fe2ad3996306 tempest-GroupsTest-2029762573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:30:08 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-73f00d31-b7d0-45a3-af85-fe2ad3996306 tempest-GroupsTest-2029762573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:30:08 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-73f00d31-b7d0-45a3-af85-fe2ad3996306 tempest-GroupsTest-2029762573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:30:08 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-73f00d31-b7d0-45a3-af85-fe2ad3996306 tempest-GroupsTest-2029762573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:30:08 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-73f00d31-b7d0-45a3-af85-fe2ad3996306 tempest-GroupsTest-2029762573 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:30:08 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-73f00d31-b7d0-45a3-af85-fe2ad3996306 tempest-GroupsTest-2029762573 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:30:08 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-73f00d31-b7d0-45a3-af85-fe2ad3996306 tempest-GroupsTest-2029762573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d54dfa54-6370-4059-8d8c-1855f07d232f 1073741824 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:30:08 devstack sudo[96013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d54dfa54-6370-4059-8d8c-1855f07d232f 1073741824
Nov 03 18:30:08 devstack sudo[96013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:30:09 devstack sudo[96013]: pam_unix(sudo:session): session closed for user root
Nov 03 18:30:09 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-73f00d31-b7d0-45a3-af85-fe2ad3996306 tempest-GroupsTest-2029762573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d54dfa54-6370-4059-8d8c-1855f07d232f 1073741824" returned: 0 in 0.538s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:30:09 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-73f00d31-b7d0-45a3-af85-fe2ad3996306 tempest-GroupsTest-2029762573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d54dfa54-6370-4059-8d8c-1855f07d232f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:30:09 devstack sudo[96023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d54dfa54-6370-4059-8d8c-1855f07d232f
Nov 03 18:30:09 devstack sudo[96023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:30:09 devstack cinder-volume[86120]: INFO cinder.volume.manager [req-ca1a2340-a59d-4f7b-a9c3-598f76bd8355 req-db0d88d2-dd96-40b1-b955-395ce0a8aef3 tempest-TestServerVolumeAttachmentScenario-290524599 None] Terminate volume connection completed successfully.
Nov 03 18:30:09 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [req-ca1a2340-a59d-4f7b-a9c3-598f76bd8355 req-db0d88d2-dd96-40b1-b955-395ce0a8aef3 tempest-TestServerVolumeAttachmentScenario-290524599 None] Deleting attachment 9fefc823-4223-46f0-94e8-033b18774d8a. {{(pid=86120) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 03 18:30:09 devstack sudo[96023]: pam_unix(sudo:session): session closed for user root
Nov 03 18:30:09 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-73f00d31-b7d0-45a3-af85-fe2ad3996306 tempest-GroupsTest-2029762573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d54dfa54-6370-4059-8d8c-1855f07d232f" returned: 0 in 0.405s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:30:09 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-73f00d31-b7d0-45a3-af85-fe2ad3996306 tempest-GroupsTest-2029762573 None] <== create_volume: return (1016ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:30:09 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-73f00d31-b7d0-45a3-af85-fe2ad3996306 tempest-GroupsTest-2029762573 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.020s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:30:09 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-73f00d31-b7d0-45a3-af85-fe2ad3996306 tempest-GroupsTest-2029762573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bab3735c-2bc8-456f-8f8e-e7b345f34ef3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d54dfa54-6370-4059-8d8c-1855f07d232f', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:30:09 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-73f00d31-b7d0-45a3-af85-fe2ad3996306 tempest-GroupsTest-2029762573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c293adc-a2d4-4260-ac89-4c440fa44a08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:30:09 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-73f00d31-b7d0-45a3-af85-fe2ad3996306 tempest-GroupsTest-2029762573 None] Volume volume-d54dfa54-6370-4059-8d8c-1855f07d232f (d54dfa54-6370-4059-8d8c-1855f07d232f): created successfully
Nov 03 18:30:09 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-73f00d31-b7d0-45a3-af85-fe2ad3996306 tempest-GroupsTest-2029762573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c293adc-a2d4-4260-ac89-4c440fa44a08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:30:09 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-73f00d31-b7d0-45a3-af85-fe2ad3996306 tempest-GroupsTest-2029762573 None] Flow 'volume_create_manager' (573dee49-61b5-460a-9ad2-f7c543d868c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:30:09 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-73f00d31-b7d0-45a3-af85-fe2ad3996306 tempest-GroupsTest-2029762573 None] Created volume successfully.
Nov 03 18:30:11 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-320f7b28-1a7a-4438-b600-834fd0a96451 tempest-GroupsTest-2029762573 None] Update group completed successfully.
Nov 03 18:30:12 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-5fddc124-83ad-4b64-a3bd-da3086ec3e44 tempest-GroupsTest-2029762573 None] Update group completed successfully.
Nov 03 18:30:14 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-12cd2fff-b1b8-4ce3-9856-b2547ebd7c0b tempest-GroupsTest-2029762573 None] Acquiring lock "cinder-quobyte-65b31bc6-0eec-4d94-8f8e-15c97f4dcf2f" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:30:14 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-12cd2fff-b1b8-4ce3-9856-b2547ebd7c0b tempest-GroupsTest-2029762573 None] Lock "cinder-quobyte-65b31bc6-0eec-4d94-8f8e-15c97f4dcf2f" acquired by "delete_volume" :: waited 0.023s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:30:14 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[57406ca5-15d8-43dd-a041-ce7086cf143d]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:30:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-12cd2fff-b1b8-4ce3-9856-b2547ebd7c0b tempest-GroupsTest-2029762573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-65b31bc6-0eec-4d94-8f8e-15c97f4dcf2f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:30:14 devstack sudo[96084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-65b31bc6-0eec-4d94-8f8e-15c97f4dcf2f
Nov 03 18:30:14 devstack sudo[96084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:30:14 devstack cinder-volume[86120]: DEBUG oslo_service.periodic_task [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86120) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 18:30:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:30:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:30:14 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:30:14 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:30:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:30:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:30:15 devstack sudo[96086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:30:15 devstack sudo[96086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:30:15 devstack sudo[96084]: pam_unix(sudo:session): session closed for user root
Nov 03 18:30:15 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-12cd2fff-b1b8-4ce3-9856-b2547ebd7c0b tempest-GroupsTest-2029762573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-65b31bc6-0eec-4d94-8f8e-15c97f4dcf2f" returned: 0 in 0.508s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:30:15 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-12cd2fff-b1b8-4ce3-9856-b2547ebd7c0b tempest-GroupsTest-2029762573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-65b31bc6-0eec-4d94-8f8e-15c97f4dcf2f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:30:15 devstack sudo[96091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-65b31bc6-0eec-4d94-8f8e-15c97f4dcf2f
Nov 03 18:30:15 devstack sudo[96091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:30:15 devstack sudo[96086]: pam_unix(sudo:session): session closed for user root
Nov 03 18:30:15 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.444s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:30:15 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:30:15 devstack cinder-volume[86120]: DEBUG oslo_service.periodic_task [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Running periodic task VolumeManager._thread_info {{(pid=86120) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 18:30:15 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] thread count: 28 {{(pid=86120) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 03 18:30:15 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] thread info: [<_MainThread(MainThread, started 134747145822336)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134747033686336)>, <Thread(Thread-3 (stat_writer), started daemon 134747030828736)>, <Thread(Rabbit-heartbeat, started daemon 134747035433408)>, <Thread(Thread-5 (_runner), started daemon 134747029587392)>, <Thread(Thread-7 (_runner), started daemon 134747029784256)>, <Thread(fd_logger, started daemon 134747027909120)>, <Thread(privsep_reader, started daemon 134747027006592)>, <Thread(tpool_thread_0, started daemon 134747018950336)>, <Thread(tpool_thread_1, started daemon 134747010541248)>, <Thread(tpool_thread_2, started daemon 134747002132160)>, <Thread(tpool_thread_3, started daemon 134746993723072)>, <Thread(tpool_thread_4, started daemon 134746985313984)>, <Thread(tpool_thread_5, started daemon 134746976904896)>, <Thread(tpool_thread_6, started daemon 134746968495808)>, <Thread(tpool_thread_7, started daemon 134746960086720)>, <Thread(tpool_thread_8, started daemon 134746951677632)>, <Thread(tpool_thread_9, started daemon 134746943268544)>, <Thread(tpool_thread_10, started daemon 134746934859456)>, <Thread(tpool_thread_11, started daemon 134746926450368)>, <Thread(tpool_thread_12, started daemon 134746918041280)>, <Thread(tpool_thread_13, started daemon 134746909632192)>, <Thread(tpool_thread_14, started daemon 134746901223104)>, <Thread(tpool_thread_15, started daemon 134746892814016)>, <Thread(tpool_thread_16, started daemon 134746884404928)>, <Thread(tpool_thread_17, started daemon 134746875995840)>, <Thread(tpool_thread_18, started daemon 134746867586752)>, <Thread(tpool_thread_19, started daemon 134746859177664)>] {{(pid=86120) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 03 18:30:15 devstack sudo[96091]: pam_unix(sudo:session): session closed for user root
Nov 03 18:30:15 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-12cd2fff-b1b8-4ce3-9856-b2547ebd7c0b tempest-GroupsTest-2029762573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-65b31bc6-0eec-4d94-8f8e-15c97f4dcf2f" returned: 0 in 0.402s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:30:15 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-12cd2fff-b1b8-4ce3-9856-b2547ebd7c0b tempest-GroupsTest-2029762573 None] Lock "cinder-quobyte-65b31bc6-0eec-4d94-8f8e-15c97f4dcf2f" released by "delete_volume" :: held 1.018s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:30:15 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-12cd2fff-b1b8-4ce3-9856-b2547ebd7c0b tempest-GroupsTest-2029762573 None] Acquiring lock "cinder-quobyte-d54dfa54-6370-4059-8d8c-1855f07d232f" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:30:15 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-12cd2fff-b1b8-4ce3-9856-b2547ebd7c0b tempest-GroupsTest-2029762573 None] Lock "cinder-quobyte-d54dfa54-6370-4059-8d8c-1855f07d232f" acquired by "delete_volume" :: waited 0.023s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:30:15 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[1869eaa8-3a32-4c32-8469-50d92bdc8594]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:30:15 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-12cd2fff-b1b8-4ce3-9856-b2547ebd7c0b tempest-GroupsTest-2029762573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d54dfa54-6370-4059-8d8c-1855f07d232f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:30:15 devstack sudo[96098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d54dfa54-6370-4059-8d8c-1855f07d232f
Nov 03 18:30:15 devstack sudo[96098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:30:16 devstack sudo[96098]: pam_unix(sudo:session): session closed for user root
Nov 03 18:30:16 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-12cd2fff-b1b8-4ce3-9856-b2547ebd7c0b tempest-GroupsTest-2029762573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d54dfa54-6370-4059-8d8c-1855f07d232f" returned: 0 in 0.552s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:30:16 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-12cd2fff-b1b8-4ce3-9856-b2547ebd7c0b tempest-GroupsTest-2029762573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d54dfa54-6370-4059-8d8c-1855f07d232f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:30:16 devstack sudo[96103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d54dfa54-6370-4059-8d8c-1855f07d232f
Nov 03 18:30:16 devstack sudo[96103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:30:16 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-eb56119a-f98b-4487-b211-777ea159b91c tempest-TestServerVolumeAttachmentScenario-290524599 None] Acquiring lock "cinder-ff530d44-28b5-4b79-bed8-04f2276bf196-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:30:16 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-eb56119a-f98b-4487-b211-777ea159b91c tempest-TestServerVolumeAttachmentScenario-290524599 None] Lock "cinder-ff530d44-28b5-4b79-bed8-04f2276bf196-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:30:16 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-eb56119a-f98b-4487-b211-777ea159b91c tempest-TestServerVolumeAttachmentScenario-290524599 None] Acquiring lock "cinder-quobyte-ff530d44-28b5-4b79-bed8-04f2276bf196" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:30:16 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-eb56119a-f98b-4487-b211-777ea159b91c tempest-TestServerVolumeAttachmentScenario-290524599 None] Lock "cinder-quobyte-ff530d44-28b5-4b79-bed8-04f2276bf196" acquired by "delete_volume" :: waited 0.047s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:30:16 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[41f29cb4-661b-403c-bd15-2587be81c30a]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:30:16 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-eb56119a-f98b-4487-b211-777ea159b91c tempest-TestServerVolumeAttachmentScenario-290524599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ff530d44-28b5-4b79-bed8-04f2276bf196 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:30:16 devstack sudo[96106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ff530d44-28b5-4b79-bed8-04f2276bf196
Nov 03 18:30:16 devstack sudo[96106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:30:16 devstack sudo[96103]: pam_unix(sudo:session): session closed for user root
Nov 03 18:30:16 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-12cd2fff-b1b8-4ce3-9856-b2547ebd7c0b tempest-GroupsTest-2029762573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d54dfa54-6370-4059-8d8c-1855f07d232f" returned: 0 in 0.544s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:30:16 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-12cd2fff-b1b8-4ce3-9856-b2547ebd7c0b tempest-GroupsTest-2029762573 None] Lock "cinder-quobyte-d54dfa54-6370-4059-8d8c-1855f07d232f" released by "delete_volume" :: held 1.172s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:30:17 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-12cd2fff-b1b8-4ce3-9856-b2547ebd7c0b tempest-GroupsTest-2029762573 None] Created reservations ['2be25e8a-2a37-4b6f-895b-f5a04a1dc47b'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:30:17 devstack cinder-volume[86120]: WARNING cinder.quota [None req-12cd2fff-b1b8-4ce3-9856-b2547ebd7c0b tempest-GroupsTest-2029762573 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-115641154 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-115641154, it is now deprecated. Please use the default quota class for default quota.
Nov 03 18:30:17 devstack cinder-volume[86120]: WARNING cinder.quota [None req-12cd2fff-b1b8-4ce3-9856-b2547ebd7c0b tempest-GroupsTest-2029762573 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-115641154 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-115641154, it is now deprecated. Please use the default quota class for default quota.
Nov 03 18:30:17 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-12cd2fff-b1b8-4ce3-9856-b2547ebd7c0b tempest-GroupsTest-2029762573 None] Created reservations ['2082a52c-7ff3-42b8-907e-714635e7b25f', '699dc383-016c-4d69-a053-08b20eafe67f', 'e8e0a1b7-73ad-4ff7-9ba9-b73b4490eba2', '1685650a-554a-4f0f-84f8-acfc026cb35f'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:30:17 devstack sudo[96106]: pam_unix(sudo:session): session closed for user root
Nov 03 18:30:17 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-eb56119a-f98b-4487-b211-777ea159b91c tempest-TestServerVolumeAttachmentScenario-290524599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ff530d44-28b5-4b79-bed8-04f2276bf196" returned: 0 in 0.538s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:30:17 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-eb56119a-f98b-4487-b211-777ea159b91c tempest-TestServerVolumeAttachmentScenario-290524599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ff530d44-28b5-4b79-bed8-04f2276bf196 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:30:17 devstack sudo[96112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ff530d44-28b5-4b79-bed8-04f2276bf196
Nov 03 18:30:17 devstack sudo[96112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:30:17 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-12cd2fff-b1b8-4ce3-9856-b2547ebd7c0b tempest-GroupsTest-2029762573 None] Created reservations ['33134777-a08d-421d-bf01-f724298c91e0', '949fae5d-af85-490e-ac01-16ffd6e8eaa5', 'c9b5bfcf-d950-4604-b4d3-6f868cbe73b0', '77b732b4-d045-4b19-bbdb-153bc2d56a0e'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:30:17 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-12cd2fff-b1b8-4ce3-9856-b2547ebd7c0b tempest-GroupsTest-2029762573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:30:17 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-12cd2fff-b1b8-4ce3-9856-b2547ebd7c0b tempest-GroupsTest-2029762573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:30:17 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-12cd2fff-b1b8-4ce3-9856-b2547ebd7c0b tempest-GroupsTest-2029762573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:30:17 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-12cd2fff-b1b8-4ce3-9856-b2547ebd7c0b tempest-GroupsTest-2029762573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:30:17 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-12cd2fff-b1b8-4ce3-9856-b2547ebd7c0b tempest-GroupsTest-2029762573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:30:17 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-12cd2fff-b1b8-4ce3-9856-b2547ebd7c0b tempest-GroupsTest-2029762573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:30:17 devstack sudo[96115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:30:17 devstack sudo[96115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:30:17 devstack sudo[96112]: pam_unix(sudo:session): session closed for user root
Nov 03 18:30:17 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-eb56119a-f98b-4487-b211-777ea159b91c tempest-TestServerVolumeAttachmentScenario-290524599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ff530d44-28b5-4b79-bed8-04f2276bf196" returned: 0 in 0.495s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:30:17 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-eb56119a-f98b-4487-b211-777ea159b91c tempest-TestServerVolumeAttachmentScenario-290524599 None] Lock "cinder-quobyte-ff530d44-28b5-4b79-bed8-04f2276bf196" released by "delete_volume" :: held 1.134s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:30:17 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-eb56119a-f98b-4487-b211-777ea159b91c tempest-TestServerVolumeAttachmentScenario-290524599 None] Created reservations ['c5c06101-8e5b-4b70-b89e-e06f4e6dade6', '091ed711-2987-4f96-8f8e-d13691f78e37', 'be8abda3-7ccb-449f-b372-0f499cd5eeed', '1de49e51-35d9-495c-b43e-e7f5625c5ab0'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:30:17 devstack sudo[96115]: pam_unix(sudo:session): session closed for user root
Nov 03 18:30:17 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-12cd2fff-b1b8-4ce3-9856-b2547ebd7c0b tempest-GroupsTest-2029762573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.325s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:30:17 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-12cd2fff-b1b8-4ce3-9856-b2547ebd7c0b tempest-GroupsTest-2029762573 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:30:17 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-12cd2fff-b1b8-4ce3-9856-b2547ebd7c0b tempest-GroupsTest-2029762573 None] Delete group completed successfully.
Nov 03 18:30:17 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-eb56119a-f98b-4487-b211-777ea159b91c tempest-TestServerVolumeAttachmentScenario-290524599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:30:17 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-eb56119a-f98b-4487-b211-777ea159b91c tempest-TestServerVolumeAttachmentScenario-290524599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:30:17 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-eb56119a-f98b-4487-b211-777ea159b91c tempest-TestServerVolumeAttachmentScenario-290524599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:30:18 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-eb56119a-f98b-4487-b211-777ea159b91c tempest-TestServerVolumeAttachmentScenario-290524599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:30:18 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-eb56119a-f98b-4487-b211-777ea159b91c tempest-TestServerVolumeAttachmentScenario-290524599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:30:18 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-eb56119a-f98b-4487-b211-777ea159b91c tempest-TestServerVolumeAttachmentScenario-290524599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:30:18 devstack sudo[96119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:30:18 devstack sudo[96119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:30:18 devstack sudo[96119]: pam_unix(sudo:session): session closed for user root
Nov 03 18:30:18 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-eb56119a-f98b-4487-b211-777ea159b91c tempest-TestServerVolumeAttachmentScenario-290524599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.447s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:30:18 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-eb56119a-f98b-4487-b211-777ea159b91c tempest-TestServerVolumeAttachmentScenario-290524599 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:30:18 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-eb56119a-f98b-4487-b211-777ea159b91c tempest-TestServerVolumeAttachmentScenario-290524599 None] Deleted volume successfully.
Nov 03 18:30:18 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-eb56119a-f98b-4487-b211-777ea159b91c tempest-TestServerVolumeAttachmentScenario-290524599 None] Lock "cinder-ff530d44-28b5-4b79-bed8-04f2276bf196-delete_volume" released by "delete_volume" :: held 2.076s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:30:18 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-e4173189-93ed-4ae1-9bcf-1651d796cbb0 tempest-TestServerVolumeAttachmentScenario-290524599 None] Acquiring lock "cinder-953af810-f12c-458c-95df-164c55a028e1-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:30:18 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-e4173189-93ed-4ae1-9bcf-1651d796cbb0 tempest-TestServerVolumeAttachmentScenario-290524599 None] Lock "cinder-953af810-f12c-458c-95df-164c55a028e1-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:30:18 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-e4173189-93ed-4ae1-9bcf-1651d796cbb0 tempest-TestServerVolumeAttachmentScenario-290524599 None] Acquiring lock "cinder-quobyte-953af810-f12c-458c-95df-164c55a028e1" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:30:18 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-e4173189-93ed-4ae1-9bcf-1651d796cbb0 tempest-TestServerVolumeAttachmentScenario-290524599 None] Lock "cinder-quobyte-953af810-f12c-458c-95df-164c55a028e1" acquired by "delete_volume" :: waited 0.030s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:30:19 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeb5b543-7825-4732-a317-ce582836bd3f]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:30:19 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-e4173189-93ed-4ae1-9bcf-1651d796cbb0 tempest-TestServerVolumeAttachmentScenario-290524599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-953af810-f12c-458c-95df-164c55a028e1 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:30:19 devstack sudo[96138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-953af810-f12c-458c-95df-164c55a028e1
Nov 03 18:30:19 devstack sudo[96138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:30:19 devstack sudo[96138]: pam_unix(sudo:session): session closed for user root
Nov 03 18:30:19 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-e4173189-93ed-4ae1-9bcf-1651d796cbb0 tempest-TestServerVolumeAttachmentScenario-290524599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-953af810-f12c-458c-95df-164c55a028e1" returned: 0 in 0.598s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:30:19 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-e4173189-93ed-4ae1-9bcf-1651d796cbb0 tempest-TestServerVolumeAttachmentScenario-290524599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-953af810-f12c-458c-95df-164c55a028e1 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:30:19 devstack sudo[96143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-953af810-f12c-458c-95df-164c55a028e1
Nov 03 18:30:19 devstack sudo[96143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:30:20 devstack sudo[96143]: pam_unix(sudo:session): session closed for user root
Nov 03 18:30:20 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-e4173189-93ed-4ae1-9bcf-1651d796cbb0 tempest-TestServerVolumeAttachmentScenario-290524599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-953af810-f12c-458c-95df-164c55a028e1" returned: 0 in 0.543s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:30:20 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-e4173189-93ed-4ae1-9bcf-1651d796cbb0 tempest-TestServerVolumeAttachmentScenario-290524599 None] Lock "cinder-quobyte-953af810-f12c-458c-95df-164c55a028e1" released by "delete_volume" :: held 1.248s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:30:20 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-e4173189-93ed-4ae1-9bcf-1651d796cbb0 tempest-TestServerVolumeAttachmentScenario-290524599 None] Created reservations ['40ec238b-a084-4c0a-873e-b6413c3575d6', 'e2d1d46b-be66-449e-ae51-326f2fd8fc61', 'abd6651d-b13e-4aff-b5a7-818ed1b715b4', '71226af5-0210-4015-961e-d9140d346253'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:30:20 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-e4173189-93ed-4ae1-9bcf-1651d796cbb0 tempest-TestServerVolumeAttachmentScenario-290524599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:30:20 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-e4173189-93ed-4ae1-9bcf-1651d796cbb0 tempest-TestServerVolumeAttachmentScenario-290524599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:30:20 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-e4173189-93ed-4ae1-9bcf-1651d796cbb0 tempest-TestServerVolumeAttachmentScenario-290524599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:30:20 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-e4173189-93ed-4ae1-9bcf-1651d796cbb0 tempest-TestServerVolumeAttachmentScenario-290524599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:30:20 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-e4173189-93ed-4ae1-9bcf-1651d796cbb0 tempest-TestServerVolumeAttachmentScenario-290524599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:30:20 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-e4173189-93ed-4ae1-9bcf-1651d796cbb0 tempest-TestServerVolumeAttachmentScenario-290524599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:30:20 devstack sudo[96146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:30:20 devstack sudo[96146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:30:20 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-b64b88df-8200-426e-9992-6c793c40042d tempest-VolumesGetTest-1058646393 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:30:20 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-b64b88df-8200-426e-9992-6c793c40042d tempest-VolumesGetTest-1058646393 None] Flow 'volume_create_manager' (7e343ea4-3173-4e3c-94da-202b55525311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:30:20 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-b64b88df-8200-426e-9992-6c793c40042d tempest-VolumesGetTest-1058646393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c74ef9a-6b36-4429-83c3-4ab25c444724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:30:20 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-b64b88df-8200-426e-9992-6c793c40042d tempest-VolumesGetTest-1058646393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c74ef9a-6b36-4429-83c3-4ab25c444724) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:30:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1813020191',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f1e9a31-8cc0-41b9-9b8f-bdb457f5e17c,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='7a2e9d719ed44e7d937af97c1006955b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:30:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:30:21Z,use_quota=True,user_id='9e6bb9b9d9e14369b45e0740337deeda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:30:20 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-b64b88df-8200-426e-9992-6c793c40042d tempest-VolumesGetTest-1058646393 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca298610-26a0-4e5d-bdb7-7cb1eb243453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:30:20 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-b64b88df-8200-426e-9992-6c793c40042d tempest-VolumesGetTest-1058646393 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca298610-26a0-4e5d-bdb7-7cb1eb243453) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:30:20 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-b64b88df-8200-426e-9992-6c793c40042d tempest-VolumesGetTest-1058646393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (034213a5-5d22-4def-9333-c3c75d43ac25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:30:20 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-b64b88df-8200-426e-9992-6c793c40042d tempest-VolumesGetTest-1058646393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (034213a5-5d22-4def-9333-c3c75d43ac25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f1e9a31-8cc0-41b9-9b8f-bdb457f5e17c', 'volume_name': 'volume-3f1e9a31-8cc0-41b9-9b8f-bdb457f5e17c', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:30:20 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-b64b88df-8200-426e-9992-6c793c40042d tempest-VolumesGetTest-1058646393 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87ac18f5-8cdd-45e8-bb30-dc44e829a179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:30:20 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-b64b88df-8200-426e-9992-6c793c40042d tempest-VolumesGetTest-1058646393 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87ac18f5-8cdd-45e8-bb30-dc44e829a179) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:30:20 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-b64b88df-8200-426e-9992-6c793c40042d tempest-VolumesGetTest-1058646393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a657094-472f-41a5-965b-d74fd862d8ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:30:20 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-b64b88df-8200-426e-9992-6c793c40042d tempest-VolumesGetTest-1058646393 None] Volume 3f1e9a31-8cc0-41b9-9b8f-bdb457f5e17c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f1e9a31-8cc0-41b9-9b8f-bdb457f5e17c', 'volume_size': 1}
Nov 03 18:30:20 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-b64b88df-8200-426e-9992-6c793c40042d tempest-VolumesGetTest-1058646393 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:30:20 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-b64b88df-8200-426e-9992-6c793c40042d tempest-VolumesGetTest-1058646393 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:30:20 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-b64b88df-8200-426e-9992-6c793c40042d tempest-VolumesGetTest-1058646393 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:30:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1813020191',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f1e9a31-8cc0-41b9-9b8f-bdb457f5e17c,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='7a2e9d719ed44e7d937af97c1006955b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:30:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:30:21Z,use_quota=True,user_id='9e6bb9b9d9e14369b45e0740337deeda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:30:20 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-b64b88df-8200-426e-9992-6c793c40042d tempest-VolumesGetTest-1058646393 None] Creating volume 3f1e9a31-8cc0-41b9-9b8f-bdb457f5e17c {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:30:20 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-b64b88df-8200-426e-9992-6c793c40042d tempest-VolumesGetTest-1058646393 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:30:20 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-b64b88df-8200-426e-9992-6c793c40042d tempest-VolumesGetTest-1058646393 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:30:20 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-b64b88df-8200-426e-9992-6c793c40042d tempest-VolumesGetTest-1058646393 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:30:20 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-b64b88df-8200-426e-9992-6c793c40042d tempest-VolumesGetTest-1058646393 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:30:20 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-b64b88df-8200-426e-9992-6c793c40042d tempest-VolumesGetTest-1058646393 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:30:20 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-b64b88df-8200-426e-9992-6c793c40042d tempest-VolumesGetTest-1058646393 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:30:20 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-b64b88df-8200-426e-9992-6c793c40042d tempest-VolumesGetTest-1058646393 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:30:20 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b64b88df-8200-426e-9992-6c793c40042d tempest-VolumesGetTest-1058646393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3f1e9a31-8cc0-41b9-9b8f-bdb457f5e17c 1073741824 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:30:20 devstack sudo[96148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3f1e9a31-8cc0-41b9-9b8f-bdb457f5e17c 1073741824
Nov 03 18:30:20 devstack sudo[96148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:30:20 devstack sudo[96146]: pam_unix(sudo:session): session closed for user root
Nov 03 18:30:20 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-e4173189-93ed-4ae1-9bcf-1651d796cbb0 tempest-TestServerVolumeAttachmentScenario-290524599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.305s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:30:20 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-e4173189-93ed-4ae1-9bcf-1651d796cbb0 tempest-TestServerVolumeAttachmentScenario-290524599 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:30:20 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-e4173189-93ed-4ae1-9bcf-1651d796cbb0 tempest-TestServerVolumeAttachmentScenario-290524599 None] Deleted volume successfully.
Nov 03 18:30:20 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-e4173189-93ed-4ae1-9bcf-1651d796cbb0 tempest-TestServerVolumeAttachmentScenario-290524599 None] Lock "cinder-953af810-f12c-458c-95df-164c55a028e1-delete_volume" released by "delete_volume" :: held 1.991s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:30:21 devstack sudo[96148]: pam_unix(sudo:session): session closed for user root
Nov 03 18:30:21 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b64b88df-8200-426e-9992-6c793c40042d tempest-VolumesGetTest-1058646393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3f1e9a31-8cc0-41b9-9b8f-bdb457f5e17c 1073741824" returned: 0 in 0.617s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:30:21 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b64b88df-8200-426e-9992-6c793c40042d tempest-VolumesGetTest-1058646393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3f1e9a31-8cc0-41b9-9b8f-bdb457f5e17c {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:30:21 devstack sudo[96156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3f1e9a31-8cc0-41b9-9b8f-bdb457f5e17c
Nov 03 18:30:21 devstack sudo[96156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:30:21 devstack sudo[96156]: pam_unix(sudo:session): session closed for user root
Nov 03 18:30:21 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b64b88df-8200-426e-9992-6c793c40042d tempest-VolumesGetTest-1058646393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3f1e9a31-8cc0-41b9-9b8f-bdb457f5e17c" returned: 0 in 0.328s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:30:21 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-b64b88df-8200-426e-9992-6c793c40042d tempest-VolumesGetTest-1058646393 None] <== create_volume: return (1009ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:30:21 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-b64b88df-8200-426e-9992-6c793c40042d tempest-VolumesGetTest-1058646393 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.013s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:30:21 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-b64b88df-8200-426e-9992-6c793c40042d tempest-VolumesGetTest-1058646393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a657094-472f-41a5-965b-d74fd862d8ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f1e9a31-8cc0-41b9-9b8f-bdb457f5e17c', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:30:21 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-b64b88df-8200-426e-9992-6c793c40042d tempest-VolumesGetTest-1058646393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84551e06-483d-48b9-a29b-009c5749d686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:30:21 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-b64b88df-8200-426e-9992-6c793c40042d tempest-VolumesGetTest-1058646393 None] Volume volume-3f1e9a31-8cc0-41b9-9b8f-bdb457f5e17c (3f1e9a31-8cc0-41b9-9b8f-bdb457f5e17c): created successfully
Nov 03 18:30:21 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-b64b88df-8200-426e-9992-6c793c40042d tempest-VolumesGetTest-1058646393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84551e06-483d-48b9-a29b-009c5749d686) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:30:21 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-b64b88df-8200-426e-9992-6c793c40042d tempest-VolumesGetTest-1058646393 None] Flow 'volume_create_manager' (7e343ea4-3173-4e3c-94da-202b55525311) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:30:21 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-b64b88df-8200-426e-9992-6c793c40042d tempest-VolumesGetTest-1058646393 None] Created volume successfully.
Nov 03 18:30:24 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-85f1d692-70c0-43d1-b0b2-c7f61c3feba1 tempest-VolumesGetTest-1058646393 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:30:24 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-85f1d692-70c0-43d1-b0b2-c7f61c3feba1 tempest-VolumesGetTest-1058646393 None] Flow 'volume_create_manager' (3483fea3-48c4-413e-880a-612520758c0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:30:24 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-85f1d692-70c0-43d1-b0b2-c7f61c3feba1 tempest-VolumesGetTest-1058646393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c80c2816-8832-4d74-9bf3-2552b13caf77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:30:24 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-85f1d692-70c0-43d1-b0b2-c7f61c3feba1 tempest-VolumesGetTest-1058646393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c80c2816-8832-4d74-9bf3-2552b13caf77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:30:23Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1073557255',display_name='tempest-VolumesGetTest-Volume-1483724415',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01fa621c-3f23-4ba9-b00e-d01b098de881,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a2e9d719ed44e7d937af97c1006955b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:30:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:30:24Z,use_quota=True,user_id='9e6bb9b9d9e14369b45e0740337deeda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:30:24 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-85f1d692-70c0-43d1-b0b2-c7f61c3feba1 tempest-VolumesGetTest-1058646393 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad1a1a0f-1e31-4c68-a0f9-734f0e099475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:30:24 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-85f1d692-70c0-43d1-b0b2-c7f61c3feba1 tempest-VolumesGetTest-1058646393 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad1a1a0f-1e31-4c68-a0f9-734f0e099475) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:30:24 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-85f1d692-70c0-43d1-b0b2-c7f61c3feba1 tempest-VolumesGetTest-1058646393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (481bfbc8-1517-4f9d-9d15-abe68b390174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:30:24 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-85f1d692-70c0-43d1-b0b2-c7f61c3feba1 tempest-VolumesGetTest-1058646393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (481bfbc8-1517-4f9d-9d15-abe68b390174) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01fa621c-3f23-4ba9-b00e-d01b098de881', 'volume_name': 'volume-01fa621c-3f23-4ba9-b00e-d01b098de881', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:30:24 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-85f1d692-70c0-43d1-b0b2-c7f61c3feba1 tempest-VolumesGetTest-1058646393 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8cddfef-89f6-4baa-9c45-4d6ebdfad5e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:30:24 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-85f1d692-70c0-43d1-b0b2-c7f61c3feba1 tempest-VolumesGetTest-1058646393 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8cddfef-89f6-4baa-9c45-4d6ebdfad5e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:30:24 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-85f1d692-70c0-43d1-b0b2-c7f61c3feba1 tempest-VolumesGetTest-1058646393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b317e730-19b1-4286-829d-a5cbde80bfcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:30:24 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-85f1d692-70c0-43d1-b0b2-c7f61c3feba1 tempest-VolumesGetTest-1058646393 None] Volume 01fa621c-3f23-4ba9-b00e-d01b098de881: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01fa621c-3f23-4ba9-b00e-d01b098de881', 'volume_size': 1}
Nov 03 18:30:24 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-85f1d692-70c0-43d1-b0b2-c7f61c3feba1 tempest-VolumesGetTest-1058646393 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:30:24 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-85f1d692-70c0-43d1-b0b2-c7f61c3feba1 tempest-VolumesGetTest-1058646393 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:30:24 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-85f1d692-70c0-43d1-b0b2-c7f61c3feba1 tempest-VolumesGetTest-1058646393 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:30:23Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1073557255',display_name='tempest-VolumesGetTest-Volume-1483724415',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01fa621c-3f23-4ba9-b00e-d01b098de881,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a2e9d719ed44e7d937af97c1006955b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:30:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:30:24Z,use_quota=True,user_id='9e6bb9b9d9e14369b45e0740337deeda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:30:24 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-85f1d692-70c0-43d1-b0b2-c7f61c3feba1 tempest-VolumesGetTest-1058646393 None] Creating volume 01fa621c-3f23-4ba9-b00e-d01b098de881 {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:30:24 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-85f1d692-70c0-43d1-b0b2-c7f61c3feba1 tempest-VolumesGetTest-1058646393 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:30:24 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-85f1d692-70c0-43d1-b0b2-c7f61c3feba1 tempest-VolumesGetTest-1058646393 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:30:24 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-85f1d692-70c0-43d1-b0b2-c7f61c3feba1 tempest-VolumesGetTest-1058646393 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:30:24 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-85f1d692-70c0-43d1-b0b2-c7f61c3feba1 tempest-VolumesGetTest-1058646393 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:30:24 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-85f1d692-70c0-43d1-b0b2-c7f61c3feba1 tempest-VolumesGetTest-1058646393 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:30:24 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-85f1d692-70c0-43d1-b0b2-c7f61c3feba1 tempest-VolumesGetTest-1058646393 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:30:24 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-85f1d692-70c0-43d1-b0b2-c7f61c3feba1 tempest-VolumesGetTest-1058646393 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:30:24 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-85f1d692-70c0-43d1-b0b2-c7f61c3feba1 tempest-VolumesGetTest-1058646393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-01fa621c-3f23-4ba9-b00e-d01b098de881 1073741824 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:30:24 devstack sudo[96212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-01fa621c-3f23-4ba9-b00e-d01b098de881 1073741824
Nov 03 18:30:24 devstack sudo[96212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:30:25 devstack sudo[96212]: pam_unix(sudo:session): session closed for user root
Nov 03 18:30:25 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-85f1d692-70c0-43d1-b0b2-c7f61c3feba1 tempest-VolumesGetTest-1058646393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-01fa621c-3f23-4ba9-b00e-d01b098de881 1073741824" returned: 0 in 1.061s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:30:25 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-85f1d692-70c0-43d1-b0b2-c7f61c3feba1 tempest-VolumesGetTest-1058646393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-01fa621c-3f23-4ba9-b00e-d01b098de881 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:30:25 devstack sudo[96234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-01fa621c-3f23-4ba9-b00e-d01b098de881
Nov 03 18:30:25 devstack sudo[96234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:30:26 devstack sudo[96234]: pam_unix(sudo:session): session closed for user root
Nov 03 18:30:26 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-85f1d692-70c0-43d1-b0b2-c7f61c3feba1 tempest-VolumesGetTest-1058646393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-01fa621c-3f23-4ba9-b00e-d01b098de881" returned: 0 in 0.728s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:30:26 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-85f1d692-70c0-43d1-b0b2-c7f61c3feba1 tempest-VolumesGetTest-1058646393 None] <== create_volume: return (1942ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:30:26 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-85f1d692-70c0-43d1-b0b2-c7f61c3feba1 tempest-VolumesGetTest-1058646393 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.948s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:30:26 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-85f1d692-70c0-43d1-b0b2-c7f61c3feba1 tempest-VolumesGetTest-1058646393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b317e730-19b1-4286-829d-a5cbde80bfcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01fa621c-3f23-4ba9-b00e-d01b098de881', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:30:26 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-85f1d692-70c0-43d1-b0b2-c7f61c3feba1 tempest-VolumesGetTest-1058646393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2e0e1be-1dd6-4a41-83cc-512788a34bcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:30:26 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-85f1d692-70c0-43d1-b0b2-c7f61c3feba1 tempest-VolumesGetTest-1058646393 None] Volume volume-01fa621c-3f23-4ba9-b00e-d01b098de881 (01fa621c-3f23-4ba9-b00e-d01b098de881): created successfully
Nov 03 18:30:26 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-85f1d692-70c0-43d1-b0b2-c7f61c3feba1 tempest-VolumesGetTest-1058646393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2e0e1be-1dd6-4a41-83cc-512788a34bcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:30:26 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-85f1d692-70c0-43d1-b0b2-c7f61c3feba1 tempest-VolumesGetTest-1058646393 None] Flow 'volume_create_manager' (3483fea3-48c4-413e-880a-612520758c0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:30:26 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-85f1d692-70c0-43d1-b0b2-c7f61c3feba1 tempest-VolumesGetTest-1058646393 None] Created volume successfully.
Nov 03 18:30:27 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-392f83cd-73ff-4053-ac46-c2e06af5833e tempest-VolumesGetTest-1058646393 None] Acquiring lock "cinder-01fa621c-3f23-4ba9-b00e-d01b098de881-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:30:27 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-392f83cd-73ff-4053-ac46-c2e06af5833e tempest-VolumesGetTest-1058646393 None] Lock "cinder-01fa621c-3f23-4ba9-b00e-d01b098de881-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:30:27 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-392f83cd-73ff-4053-ac46-c2e06af5833e tempest-VolumesGetTest-1058646393 None] Acquiring lock "cinder-quobyte-01fa621c-3f23-4ba9-b00e-d01b098de881" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:30:28 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-392f83cd-73ff-4053-ac46-c2e06af5833e tempest-VolumesGetTest-1058646393 None] Lock "cinder-quobyte-01fa621c-3f23-4ba9-b00e-d01b098de881" acquired by "delete_volume" :: waited 0.032s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:30:28 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[e53f8357-82d5-4e38-96b5-5b5232d2a0da]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:30:28 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-392f83cd-73ff-4053-ac46-c2e06af5833e tempest-VolumesGetTest-1058646393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-01fa621c-3f23-4ba9-b00e-d01b098de881 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:30:28 devstack sudo[96274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-01fa621c-3f23-4ba9-b00e-d01b098de881
Nov 03 18:30:28 devstack sudo[96274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:30:28 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-a065201b-28c1-45e6-8d3c-504ae6a2c9da tempest-GroupsV320Test-1834136100 None] Group tempest-GroupsV320Test-Group-1956840898: creating
Nov 03 18:30:28 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-a065201b-28c1-45e6-8d3c-504ae6a2c9da tempest-GroupsV320Test-1834136100 None] Group tempest-GroupsV320Test-Group-1956840898: created successfully
Nov 03 18:30:28 devstack sudo[96274]: pam_unix(sudo:session): session closed for user root
Nov 03 18:30:28 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-a065201b-28c1-45e6-8d3c-504ae6a2c9da tempest-GroupsV320Test-1834136100 None] Create group completed successfully.
Nov 03 18:30:28 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-392f83cd-73ff-4053-ac46-c2e06af5833e tempest-VolumesGetTest-1058646393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-01fa621c-3f23-4ba9-b00e-d01b098de881" returned: 0 in 0.811s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:30:28 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-392f83cd-73ff-4053-ac46-c2e06af5833e tempest-VolumesGetTest-1058646393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-01fa621c-3f23-4ba9-b00e-d01b098de881 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:30:28 devstack sudo[96281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-01fa621c-3f23-4ba9-b00e-d01b098de881
Nov 03 18:30:28 devstack sudo[96281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:30:29 devstack sudo[96281]: pam_unix(sudo:session): session closed for user root
Nov 03 18:30:29 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-392f83cd-73ff-4053-ac46-c2e06af5833e tempest-VolumesGetTest-1058646393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-01fa621c-3f23-4ba9-b00e-d01b098de881" returned: 0 in 0.370s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:30:29 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-392f83cd-73ff-4053-ac46-c2e06af5833e tempest-VolumesGetTest-1058646393 None] Lock "cinder-quobyte-01fa621c-3f23-4ba9-b00e-d01b098de881" released by "delete_volume" :: held 1.262s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:30:29 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-392f83cd-73ff-4053-ac46-c2e06af5833e tempest-VolumesGetTest-1058646393 None] Created reservations ['14a45f6c-e619-4889-96e4-1cea79728ac1', '1aa6344b-d7cd-416c-a072-899716c7ab8e', '0049838d-6a23-4169-8d7f-ded6e28c7674', '9a3fcb29-4318-4f58-aeb7-ca6b44120977'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:30:29 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-392f83cd-73ff-4053-ac46-c2e06af5833e tempest-VolumesGetTest-1058646393 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:30:29 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-392f83cd-73ff-4053-ac46-c2e06af5833e tempest-VolumesGetTest-1058646393 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:30:29 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-392f83cd-73ff-4053-ac46-c2e06af5833e tempest-VolumesGetTest-1058646393 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:30:29 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-392f83cd-73ff-4053-ac46-c2e06af5833e tempest-VolumesGetTest-1058646393 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:30:29 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-392f83cd-73ff-4053-ac46-c2e06af5833e tempest-VolumesGetTest-1058646393 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:30:29 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-392f83cd-73ff-4053-ac46-c2e06af5833e tempest-VolumesGetTest-1058646393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:30:29 devstack sudo[96286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:30:29 devstack sudo[96286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:30:29 devstack sudo[96286]: pam_unix(sudo:session): session closed for user root
Nov 03 18:30:29 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-392f83cd-73ff-4053-ac46-c2e06af5833e tempest-VolumesGetTest-1058646393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.362s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:30:29 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-392f83cd-73ff-4053-ac46-c2e06af5833e tempest-VolumesGetTest-1058646393 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:30:29 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-392f83cd-73ff-4053-ac46-c2e06af5833e tempest-VolumesGetTest-1058646393 None] Deleted volume successfully.
Nov 03 18:30:30 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-392f83cd-73ff-4053-ac46-c2e06af5833e tempest-VolumesGetTest-1058646393 None] Lock "cinder-01fa621c-3f23-4ba9-b00e-d01b098de881-delete_volume" released by "delete_volume" :: held 2.109s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:30:30 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-09c9ce45-1b63-447a-a31d-27020dd49999 tempest-VolumesGetTest-1058646393 None] Acquiring lock "cinder-3f1e9a31-8cc0-41b9-9b8f-bdb457f5e17c-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:30:30 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-09c9ce45-1b63-447a-a31d-27020dd49999 tempest-VolumesGetTest-1058646393 None] Lock "cinder-3f1e9a31-8cc0-41b9-9b8f-bdb457f5e17c-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:30:30 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-09c9ce45-1b63-447a-a31d-27020dd49999 tempest-VolumesGetTest-1058646393 None] Acquiring lock "cinder-quobyte-3f1e9a31-8cc0-41b9-9b8f-bdb457f5e17c" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:30:30 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-09c9ce45-1b63-447a-a31d-27020dd49999 tempest-VolumesGetTest-1058646393 None] Lock "cinder-quobyte-3f1e9a31-8cc0-41b9-9b8f-bdb457f5e17c" acquired by "delete_volume" :: waited 0.021s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:30:30 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[867a95c9-11b6-41c9-9322-a5f882c7dfb2]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:30:30 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-09c9ce45-1b63-447a-a31d-27020dd49999 tempest-VolumesGetTest-1058646393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3f1e9a31-8cc0-41b9-9b8f-bdb457f5e17c {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:30:30 devstack sudo[96289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3f1e9a31-8cc0-41b9-9b8f-bdb457f5e17c
Nov 03 18:30:30 devstack sudo[96289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:30:30 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-ad0a343d-93ca-485e-83a9-d3a7cf1fc940 tempest-GroupsV320Test-1834136100 None] Created reservations ['653b1d48-a530-4400-b70e-8bcb9b312158'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:30:30 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-ad0a343d-93ca-485e-83a9-d3a7cf1fc940 tempest-GroupsV320Test-1834136100 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:30:30 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-ad0a343d-93ca-485e-83a9-d3a7cf1fc940 tempest-GroupsV320Test-1834136100 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:30:30 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-ad0a343d-93ca-485e-83a9-d3a7cf1fc940 tempest-GroupsV320Test-1834136100 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:30:30 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-ad0a343d-93ca-485e-83a9-d3a7cf1fc940 tempest-GroupsV320Test-1834136100 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:30:30 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-ad0a343d-93ca-485e-83a9-d3a7cf1fc940 tempest-GroupsV320Test-1834136100 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:30:30 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-ad0a343d-93ca-485e-83a9-d3a7cf1fc940 tempest-GroupsV320Test-1834136100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:30:30 devstack sudo[96291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:30:30 devstack sudo[96291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:30:31 devstack sudo[96289]: pam_unix(sudo:session): session closed for user root
Nov 03 18:30:31 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-09c9ce45-1b63-447a-a31d-27020dd49999 tempest-VolumesGetTest-1058646393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3f1e9a31-8cc0-41b9-9b8f-bdb457f5e17c" returned: 0 in 0.527s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:30:31 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-09c9ce45-1b63-447a-a31d-27020dd49999 tempest-VolumesGetTest-1058646393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3f1e9a31-8cc0-41b9-9b8f-bdb457f5e17c {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:30:31 devstack sudo[96297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3f1e9a31-8cc0-41b9-9b8f-bdb457f5e17c
Nov 03 18:30:31 devstack sudo[96297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:30:31 devstack sudo[96291]: pam_unix(sudo:session): session closed for user root
Nov 03 18:30:31 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-ad0a343d-93ca-485e-83a9-d3a7cf1fc940 tempest-GroupsV320Test-1834136100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.359s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:30:31 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-ad0a343d-93ca-485e-83a9-d3a7cf1fc940 tempest-GroupsV320Test-1834136100 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:30:31 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-ad0a343d-93ca-485e-83a9-d3a7cf1fc940 tempest-GroupsV320Test-1834136100 None] Delete group completed successfully.
Nov 03 18:30:31 devstack sudo[96297]: pam_unix(sudo:session): session closed for user root
Nov 03 18:30:31 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-09c9ce45-1b63-447a-a31d-27020dd49999 tempest-VolumesGetTest-1058646393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3f1e9a31-8cc0-41b9-9b8f-bdb457f5e17c" returned: 0 in 0.314s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:30:31 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-09c9ce45-1b63-447a-a31d-27020dd49999 tempest-VolumesGetTest-1058646393 None] Lock "cinder-quobyte-3f1e9a31-8cc0-41b9-9b8f-bdb457f5e17c" released by "delete_volume" :: held 0.974s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:30:31 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-09c9ce45-1b63-447a-a31d-27020dd49999 tempest-VolumesGetTest-1058646393 None] Created reservations ['243253c9-aea4-4027-87fb-7dc1e9f03076', '078c0234-10cd-405e-abac-fc5dfabc3137', '23a92b3c-159b-42b2-b393-0a039045bc44', '63807808-9754-4c25-b75c-2d62390548e1'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:30:31 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-09c9ce45-1b63-447a-a31d-27020dd49999 tempest-VolumesGetTest-1058646393 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:30:31 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-09c9ce45-1b63-447a-a31d-27020dd49999 tempest-VolumesGetTest-1058646393 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:30:31 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-09c9ce45-1b63-447a-a31d-27020dd49999 tempest-VolumesGetTest-1058646393 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:30:31 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-09c9ce45-1b63-447a-a31d-27020dd49999 tempest-VolumesGetTest-1058646393 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:30:31 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-09c9ce45-1b63-447a-a31d-27020dd49999 tempest-VolumesGetTest-1058646393 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:30:31 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-09c9ce45-1b63-447a-a31d-27020dd49999 tempest-VolumesGetTest-1058646393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:30:31 devstack sudo[96302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:30:31 devstack sudo[96302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:30:31 devstack sudo[96302]: pam_unix(sudo:session): session closed for user root
Nov 03 18:30:31 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-09c9ce45-1b63-447a-a31d-27020dd49999 tempest-VolumesGetTest-1058646393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.285s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:30:31 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-09c9ce45-1b63-447a-a31d-27020dd49999 tempest-VolumesGetTest-1058646393 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:30:31 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-09c9ce45-1b63-447a-a31d-27020dd49999 tempest-VolumesGetTest-1058646393 None] Deleted volume successfully.
Nov 03 18:30:31 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-09c9ce45-1b63-447a-a31d-27020dd49999 tempest-VolumesGetTest-1058646393 None] Lock "cinder-3f1e9a31-8cc0-41b9-9b8f-bdb457f5e17c-delete_volume" released by "delete_volume" :: held 1.580s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:30:33 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-6418314b-6a16-43ab-a01c-87b7efabc675 tempest-VolumesGetTest-1058646393 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:30:33 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-6418314b-6a16-43ab-a01c-87b7efabc675 tempest-VolumesGetTest-1058646393 None] Flow 'volume_create_manager' (7c4b700a-7022-48e4-acaf-dedbdfe67d69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:30:33 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-6418314b-6a16-43ab-a01c-87b7efabc675 tempest-VolumesGetTest-1058646393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2808f86-802d-4939-a69d-b625ddfc7500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:30:33 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-6418314b-6a16-43ab-a01c-87b7efabc675 tempest-VolumesGetTest-1058646393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2808f86-802d-4939-a69d-b625ddfc7500) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:30:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-897481098',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98e1a1d1-0a16-432c-99dc-fea6b55236dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a2e9d719ed44e7d937af97c1006955b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:30:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:30:33Z,use_quota=True,user_id='9e6bb9b9d9e14369b45e0740337deeda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:30:33 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-6418314b-6a16-43ab-a01c-87b7efabc675 tempest-VolumesGetTest-1058646393 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01ae8bd2-59d6-447f-bc30-dd40441ef4da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:30:33 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-6418314b-6a16-43ab-a01c-87b7efabc675 tempest-VolumesGetTest-1058646393 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01ae8bd2-59d6-447f-bc30-dd40441ef4da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:30:33 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-6418314b-6a16-43ab-a01c-87b7efabc675 tempest-VolumesGetTest-1058646393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (506eb23a-3352-4d60-b96b-aa0ed82bd03e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:30:33 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-6418314b-6a16-43ab-a01c-87b7efabc675 tempest-VolumesGetTest-1058646393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (506eb23a-3352-4d60-b96b-aa0ed82bd03e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98e1a1d1-0a16-432c-99dc-fea6b55236dd', 'volume_name': 'volume-98e1a1d1-0a16-432c-99dc-fea6b55236dd', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:30:33 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-6418314b-6a16-43ab-a01c-87b7efabc675 tempest-VolumesGetTest-1058646393 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02649e5e-5ecc-4101-8e17-6cd6d2a59e3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:30:33 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-6418314b-6a16-43ab-a01c-87b7efabc675 tempest-VolumesGetTest-1058646393 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02649e5e-5ecc-4101-8e17-6cd6d2a59e3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:30:33 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-6418314b-6a16-43ab-a01c-87b7efabc675 tempest-VolumesGetTest-1058646393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47146efd-8d30-4f92-95fe-cf1e5a34326c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:30:33 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-6418314b-6a16-43ab-a01c-87b7efabc675 tempest-VolumesGetTest-1058646393 None] Volume 98e1a1d1-0a16-432c-99dc-fea6b55236dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98e1a1d1-0a16-432c-99dc-fea6b55236dd', 'volume_size': 1}
Nov 03 18:30:33 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-6418314b-6a16-43ab-a01c-87b7efabc675 tempest-VolumesGetTest-1058646393 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:30:33 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-6418314b-6a16-43ab-a01c-87b7efabc675 tempest-VolumesGetTest-1058646393 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:30:33 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-6418314b-6a16-43ab-a01c-87b7efabc675 tempest-VolumesGetTest-1058646393 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:30:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-897481098',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98e1a1d1-0a16-432c-99dc-fea6b55236dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a2e9d719ed44e7d937af97c1006955b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:30:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:30:33Z,use_quota=True,user_id='9e6bb9b9d9e14369b45e0740337deeda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:30:33 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-6418314b-6a16-43ab-a01c-87b7efabc675 tempest-VolumesGetTest-1058646393 None] Creating volume 98e1a1d1-0a16-432c-99dc-fea6b55236dd {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:30:33 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-6418314b-6a16-43ab-a01c-87b7efabc675 tempest-VolumesGetTest-1058646393 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:30:33 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-6418314b-6a16-43ab-a01c-87b7efabc675 tempest-VolumesGetTest-1058646393 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:30:33 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-6418314b-6a16-43ab-a01c-87b7efabc675 tempest-VolumesGetTest-1058646393 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:30:33 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-6418314b-6a16-43ab-a01c-87b7efabc675 tempest-VolumesGetTest-1058646393 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:30:33 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-6418314b-6a16-43ab-a01c-87b7efabc675 tempest-VolumesGetTest-1058646393 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:30:33 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-6418314b-6a16-43ab-a01c-87b7efabc675 tempest-VolumesGetTest-1058646393 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:30:33 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-6418314b-6a16-43ab-a01c-87b7efabc675 tempest-VolumesGetTest-1058646393 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:30:33 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-6418314b-6a16-43ab-a01c-87b7efabc675 tempest-VolumesGetTest-1058646393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-98e1a1d1-0a16-432c-99dc-fea6b55236dd 1073741824 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:30:33 devstack sudo[96305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-98e1a1d1-0a16-432c-99dc-fea6b55236dd 1073741824
Nov 03 18:30:33 devstack sudo[96305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:30:34 devstack sudo[96305]: pam_unix(sudo:session): session closed for user root
Nov 03 18:30:34 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-6418314b-6a16-43ab-a01c-87b7efabc675 tempest-VolumesGetTest-1058646393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-98e1a1d1-0a16-432c-99dc-fea6b55236dd 1073741824" returned: 0 in 0.774s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:30:34 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-6418314b-6a16-43ab-a01c-87b7efabc675 tempest-VolumesGetTest-1058646393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-98e1a1d1-0a16-432c-99dc-fea6b55236dd {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:30:34 devstack sudo[96311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-98e1a1d1-0a16-432c-99dc-fea6b55236dd
Nov 03 18:30:34 devstack sudo[96311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:30:34 devstack sudo[96311]: pam_unix(sudo:session): session closed for user root
Nov 03 18:30:34 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-6418314b-6a16-43ab-a01c-87b7efabc675 tempest-VolumesGetTest-1058646393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-98e1a1d1-0a16-432c-99dc-fea6b55236dd" returned: 0 in 0.329s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:30:34 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-6418314b-6a16-43ab-a01c-87b7efabc675 tempest-VolumesGetTest-1058646393 None] <== create_volume: return (1168ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:30:34 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-6418314b-6a16-43ab-a01c-87b7efabc675 tempest-VolumesGetTest-1058646393 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.173s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:30:34 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-6418314b-6a16-43ab-a01c-87b7efabc675 tempest-VolumesGetTest-1058646393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47146efd-8d30-4f92-95fe-cf1e5a34326c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98e1a1d1-0a16-432c-99dc-fea6b55236dd', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:30:34 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-6418314b-6a16-43ab-a01c-87b7efabc675 tempest-VolumesGetTest-1058646393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa247ba7-ef79-43ba-b5cf-2c0e868b22ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:30:34 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-6418314b-6a16-43ab-a01c-87b7efabc675 tempest-VolumesGetTest-1058646393 None] Volume volume-98e1a1d1-0a16-432c-99dc-fea6b55236dd (98e1a1d1-0a16-432c-99dc-fea6b55236dd): created successfully
Nov 03 18:30:34 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-6418314b-6a16-43ab-a01c-87b7efabc675 tempest-VolumesGetTest-1058646393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa247ba7-ef79-43ba-b5cf-2c0e868b22ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:30:34 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-6418314b-6a16-43ab-a01c-87b7efabc675 tempest-VolumesGetTest-1058646393 None] Flow 'volume_create_manager' (7c4b700a-7022-48e4-acaf-dedbdfe67d69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:30:34 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-6418314b-6a16-43ab-a01c-87b7efabc675 tempest-VolumesGetTest-1058646393 None] Created volume successfully.
Nov 03 18:30:36 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8155ddc-f815-4a8e-a78e-35d42392d87f tempest-VolumesGetTest-1058646393 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:30:36 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-e8155ddc-f815-4a8e-a78e-35d42392d87f tempest-VolumesGetTest-1058646393 None] Flow 'volume_create_manager' (1653906d-9340-449f-bb10-bfe7ca01f2f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:30:36 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-e8155ddc-f815-4a8e-a78e-35d42392d87f tempest-VolumesGetTest-1058646393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2deff11-578f-4cd0-989e-0179f4ee57d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:30:36 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-e8155ddc-f815-4a8e-a78e-35d42392d87f tempest-VolumesGetTest-1058646393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2deff11-578f-4cd0-989e-0179f4ee57d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:30:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-619688455',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00a2ede0-dbf8-42e9-8955-f3df683e2eb0,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='7a2e9d719ed44e7d937af97c1006955b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:30:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=98e1a1d1-0a16-432c-99dc-fea6b55236dd,status='creating',terminated_at=None,updated_at=2026-11-03T17:30:36Z,use_quota=True,user_id='9e6bb9b9d9e14369b45e0740337deeda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:30:36 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-e8155ddc-f815-4a8e-a78e-35d42392d87f tempest-VolumesGetTest-1058646393 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a551c5f1-390f-4108-b7ae-14aebc7783d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:30:36 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-e8155ddc-f815-4a8e-a78e-35d42392d87f tempest-VolumesGetTest-1058646393 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a551c5f1-390f-4108-b7ae-14aebc7783d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:30:36 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-e8155ddc-f815-4a8e-a78e-35d42392d87f tempest-VolumesGetTest-1058646393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcd34756-fa7b-402a-918f-60789c273320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:30:36 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-e8155ddc-f815-4a8e-a78e-35d42392d87f tempest-VolumesGetTest-1058646393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcd34756-fa7b-402a-918f-60789c273320) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '00a2ede0-dbf8-42e9-8955-f3df683e2eb0', 'volume_name': 'volume-00a2ede0-dbf8-42e9-8955-f3df683e2eb0', 'volume_size': 1, 'source_volid': '98e1a1d1-0a16-432c-99dc-fea6b55236dd', 'source_volstatus': 'available'}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:30:36 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-e8155ddc-f815-4a8e-a78e-35d42392d87f tempest-VolumesGetTest-1058646393 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27ba319b-6aab-4bf1-a954-26ac27811294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:30:36 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-e8155ddc-f815-4a8e-a78e-35d42392d87f tempest-VolumesGetTest-1058646393 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27ba319b-6aab-4bf1-a954-26ac27811294) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:30:36 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-e8155ddc-f815-4a8e-a78e-35d42392d87f tempest-VolumesGetTest-1058646393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1be32e5a-7c6c-4a18-9aef-aa2ddb2daaf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:30:36 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-e8155ddc-f815-4a8e-a78e-35d42392d87f tempest-VolumesGetTest-1058646393 None] Volume 00a2ede0-dbf8-42e9-8955-f3df683e2eb0: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-00a2ede0-dbf8-42e9-8955-f3df683e2eb0', 'volume_size': 1, 'source_volid': '98e1a1d1-0a16-432c-99dc-fea6b55236dd', 'source_volstatus': 'available'}
Nov 03 18:30:36 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-e8155ddc-f815-4a8e-a78e-35d42392d87f tempest-VolumesGetTest-1058646393 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:30:36 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-e8155ddc-f815-4a8e-a78e-35d42392d87f tempest-VolumesGetTest-1058646393 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:30:36 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-e8155ddc-f815-4a8e-a78e-35d42392d87f tempest-VolumesGetTest-1058646393 None] Cloning volume 98e1a1d1-0a16-432c-99dc-fea6b55236dd to volume 00a2ede0-dbf8-42e9-8955-f3df683e2eb0
Nov 03 18:30:36 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-e8155ddc-f815-4a8e-a78e-35d42392d87f tempest-VolumesGetTest-1058646393 None] Creating offline snapshot 57900bbd-ccf6-4cfc-8fa8-95dbf651157e of volume 98e1a1d1-0a16-432c-99dc-fea6b55236dd {{(pid=86120) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 18:30:36 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[98e9865f-77d7-412e-949c-30a6b227dd3d]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:30:36 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-e8155ddc-f815-4a8e-a78e-35d42392d87f tempest-VolumesGetTest-1058646393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-98e1a1d1-0a16-432c-99dc-fea6b55236dd {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:30:36 devstack sudo[96315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-98e1a1d1-0a16-432c-99dc-fea6b55236dd
Nov 03 18:30:36 devstack sudo[96315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:30:36 devstack sudo[96315]: pam_unix(sudo:session): session closed for user root
Nov 03 18:30:36 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-e8155ddc-f815-4a8e-a78e-35d42392d87f tempest-VolumesGetTest-1058646393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-98e1a1d1-0a16-432c-99dc-fea6b55236dd" returned: 0 in 0.559s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:30:36 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-e8155ddc-f815-4a8e-a78e-35d42392d87f tempest-VolumesGetTest-1058646393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-98e1a1d1-0a16-432c-99dc-fea6b55236dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-98e1a1d1-0a16-432c-99dc-fea6b55236dd.57900bbd-ccf6-4cfc-8fa8-95dbf651157e 1G {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:30:36 devstack sudo[96320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-98e1a1d1-0a16-432c-99dc-fea6b55236dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-98e1a1d1-0a16-432c-99dc-fea6b55236dd.57900bbd-ccf6-4cfc-8fa8-95dbf651157e 1G
Nov 03 18:30:36 devstack sudo[96320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:30:37 devstack sudo[96320]: pam_unix(sudo:session): session closed for user root
Nov 03 18:30:37 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-e8155ddc-f815-4a8e-a78e-35d42392d87f tempest-VolumesGetTest-1058646393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-98e1a1d1-0a16-432c-99dc-fea6b55236dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-98e1a1d1-0a16-432c-99dc-fea6b55236dd.57900bbd-ccf6-4cfc-8fa8-95dbf651157e 1G" returned: 0 in 0.576s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:30:37 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-e8155ddc-f815-4a8e-a78e-35d42392d87f tempest-VolumesGetTest-1058646393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-98e1a1d1-0a16-432c-99dc-fea6b55236dd -F qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-98e1a1d1-0a16-432c-99dc-fea6b55236dd.57900bbd-ccf6-4cfc-8fa8-95dbf651157e {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:30:37 devstack sudo[96326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-98e1a1d1-0a16-432c-99dc-fea6b55236dd -F qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-98e1a1d1-0a16-432c-99dc-fea6b55236dd.57900bbd-ccf6-4cfc-8fa8-95dbf651157e
Nov 03 18:30:37 devstack sudo[96326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:30:37 devstack sudo[96326]: pam_unix(sudo:session): session closed for user root
Nov 03 18:30:37 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-e8155ddc-f815-4a8e-a78e-35d42392d87f tempest-VolumesGetTest-1058646393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-98e1a1d1-0a16-432c-99dc-fea6b55236dd -F qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-98e1a1d1-0a16-432c-99dc-fea6b55236dd.57900bbd-ccf6-4cfc-8fa8-95dbf651157e" returned: 0 in 0.405s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:30:37 devstack cinder-volume[86120]: WARNING cinder.volume.drivers.remotefs [None req-e8155ddc-f815-4a8e-a78e-35d42392d87f tempest-VolumesGetTest-1058646393 None] /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-98e1a1d1-0a16-432c-99dc-fea6b55236dd.57900bbd-ccf6-4cfc-8fa8-95dbf651157e is being set with open permissions: ugo+rw
Nov 03 18:30:37 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-e8155ddc-f815-4a8e-a78e-35d42392d87f tempest-VolumesGetTest-1058646393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-98e1a1d1-0a16-432c-99dc-fea6b55236dd.57900bbd-ccf6-4cfc-8fa8-95dbf651157e {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:30:37 devstack sudo[96334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-98e1a1d1-0a16-432c-99dc-fea6b55236dd.57900bbd-ccf6-4cfc-8fa8-95dbf651157e
Nov 03 18:30:37 devstack sudo[96334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:30:38 devstack sudo[96334]: pam_unix(sudo:session): session closed for user root
Nov 03 18:30:38 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-e8155ddc-f815-4a8e-a78e-35d42392d87f tempest-VolumesGetTest-1058646393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-98e1a1d1-0a16-432c-99dc-fea6b55236dd.57900bbd-ccf6-4cfc-8fa8-95dbf651157e" returned: 0 in 0.314s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:30:38 devstack cinder-volume[86120]: DEBUG dbcounter [-] [86120] Writing DB stats cinder:SELECT=102,cinder:UPDATE=104,cinder:INSERT=22,cinder:DELETE=4 {{(pid=86120) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 18:30:38 devstack cinder-volume[86120]: DEBUG dbcounter [-] [86120] Writing DB stats cinder:SELECT=100,cinder:UPDATE=103,cinder:DELETE=7,cinder:INSERT=21 {{(pid=86120) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 18:30:38 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-e8155ddc-f815-4a8e-a78e-35d42392d87f tempest-VolumesGetTest-1058646393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-98e1a1d1-0a16-432c-99dc-fea6b55236dd.info {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:30:38 devstack sudo[96358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-98e1a1d1-0a16-432c-99dc-fea6b55236dd.info
Nov 03 18:30:38 devstack sudo[96358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:30:38 devstack sudo[96358]: pam_unix(sudo:session): session closed for user root
Nov 03 18:30:38 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-e8155ddc-f815-4a8e-a78e-35d42392d87f tempest-VolumesGetTest-1058646393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-98e1a1d1-0a16-432c-99dc-fea6b55236dd.info" returned: 0 in 0.375s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:30:38 devstack cinder-volume[86120]: WARNING cinder.volume.drivers.remotefs [None req-e8155ddc-f815-4a8e-a78e-35d42392d87f tempest-VolumesGetTest-1058646393 None] /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-98e1a1d1-0a16-432c-99dc-fea6b55236dd.info is being set with open permissions: ugo+rw
Nov 03 18:30:38 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-e8155ddc-f815-4a8e-a78e-35d42392d87f tempest-VolumesGetTest-1058646393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-98e1a1d1-0a16-432c-99dc-fea6b55236dd.info {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:30:38 devstack sudo[96361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-98e1a1d1-0a16-432c-99dc-fea6b55236dd.info
Nov 03 18:30:38 devstack sudo[96361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:30:38 devstack sudo[96361]: pam_unix(sudo:session): session closed for user root
Nov 03 18:30:38 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-e8155ddc-f815-4a8e-a78e-35d42392d87f tempest-VolumesGetTest-1058646393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-98e1a1d1-0a16-432c-99dc-fea6b55236dd.info" returned: 0 in 0.283s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:30:38 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-e8155ddc-f815-4a8e-a78e-35d42392d87f tempest-VolumesGetTest-1058646393 None] Acquiring lock "cinder-quobyte-00a2ede0-dbf8-42e9-8955-f3df683e2eb0" by "_copy_volume_from_snapshot" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:30:38 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-e8155ddc-f815-4a8e-a78e-35d42392d87f tempest-VolumesGetTest-1058646393 None] Lock "cinder-quobyte-00a2ede0-dbf8-42e9-8955-f3df683e2eb0" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:30:38 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-e8155ddc-f815-4a8e-a78e-35d42392d87f tempest-VolumesGetTest-1058646393 None] snapshot: 57900bbd-ccf6-4cfc-8fa8-95dbf651157e, volume: 00a2ede0-dbf8-42e9-8955-f3df683e2eb0,  {{(pid=86120) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 03 18:30:38 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-e8155ddc-f815-4a8e-a78e-35d42392d87f tempest-VolumesGetTest-1058646393 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:30:38 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-e8155ddc-f815-4a8e-a78e-35d42392d87f tempest-VolumesGetTest-1058646393 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:30:38 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-e8155ddc-f815-4a8e-a78e-35d42392d87f tempest-VolumesGetTest-1058646393 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:30:39 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-e8155ddc-f815-4a8e-a78e-35d42392d87f tempest-VolumesGetTest-1058646393 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:30:39 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-e8155ddc-f815-4a8e-a78e-35d42392d87f tempest-VolumesGetTest-1058646393 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:30:39 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f605a78-c5d2-43b9-b2b5-c584fcb45e96]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:30:39 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-e8155ddc-f815-4a8e-a78e-35d42392d87f tempest-VolumesGetTest-1058646393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-98e1a1d1-0a16-432c-99dc-fea6b55236dd.57900bbd-ccf6-4cfc-8fa8-95dbf651157e {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:30:39 devstack sudo[96365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-98e1a1d1-0a16-432c-99dc-fea6b55236dd.57900bbd-ccf6-4cfc-8fa8-95dbf651157e
Nov 03 18:30:39 devstack sudo[96365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:30:39 devstack sudo[96365]: pam_unix(sudo:session): session closed for user root
Nov 03 18:30:39 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-e8155ddc-f815-4a8e-a78e-35d42392d87f tempest-VolumesGetTest-1058646393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-98e1a1d1-0a16-432c-99dc-fea6b55236dd.57900bbd-ccf6-4cfc-8fa8-95dbf651157e" returned: 0 in 0.480s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:30:39 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-e8155ddc-f815-4a8e-a78e-35d42392d87f tempest-VolumesGetTest-1058646393 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-98e1a1d1-0a16-432c-99dc-fea6b55236dd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86120) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 18:30:39 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[606e0905-2a5b-481c-8a0b-a0e829c3204a]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:30:39 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-e8155ddc-f815-4a8e-a78e-35d42392d87f tempest-VolumesGetTest-1058646393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-98e1a1d1-0a16-432c-99dc-fea6b55236dd {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:30:39 devstack sudo[96371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-98e1a1d1-0a16-432c-99dc-fea6b55236dd
Nov 03 18:30:39 devstack sudo[96371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:30:39 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-62b55ef7-1887-441b-89a1-5113cc37204a tempest-CreateVolumesFromImageTest-190797813 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:30:39 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-62b55ef7-1887-441b-89a1-5113cc37204a tempest-CreateVolumesFromImageTest-190797813 None] Flow 'volume_create_manager' (aa2967b7-45c4-4225-81a5-36daa9c91c34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:30:39 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-62b55ef7-1887-441b-89a1-5113cc37204a tempest-CreateVolumesFromImageTest-190797813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5739798-c222-4b7c-aa26-f0d5b70306b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:30:39 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-62b55ef7-1887-441b-89a1-5113cc37204a tempest-CreateVolumesFromImageTest-190797813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5739798-c222-4b7c-aa26-f0d5b70306b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:30:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-978061166',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d8b58be-7eff-4fcd-9758-8e850cb34708,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7e717a0196941b08b7e4f0b3912481b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:30:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:30:40Z,use_quota=True,user_id='7b13eb5e3ddd43aba199fa4042382db8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:30:39 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-62b55ef7-1887-441b-89a1-5113cc37204a tempest-CreateVolumesFromImageTest-190797813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f78e7db4-19a8-4b63-82c9-c3ba254efbcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:30:39 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-62b55ef7-1887-441b-89a1-5113cc37204a tempest-CreateVolumesFromImageTest-190797813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f78e7db4-19a8-4b63-82c9-c3ba254efbcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:30:39 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-62b55ef7-1887-441b-89a1-5113cc37204a tempest-CreateVolumesFromImageTest-190797813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1670ae74-5ea8-4ad8-8df6-b6be3703fd1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:30:39 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-62b55ef7-1887-441b-89a1-5113cc37204a tempest-CreateVolumesFromImageTest-190797813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1670ae74-5ea8-4ad8-8df6-b6be3703fd1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d8b58be-7eff-4fcd-9758-8e850cb34708', 'volume_name': 'volume-7d8b58be-7eff-4fcd-9758-8e850cb34708', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:30:39 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-62b55ef7-1887-441b-89a1-5113cc37204a tempest-CreateVolumesFromImageTest-190797813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e8547b0-14fb-4e59-8a98-176919540579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:30:39 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-62b55ef7-1887-441b-89a1-5113cc37204a tempest-CreateVolumesFromImageTest-190797813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e8547b0-14fb-4e59-8a98-176919540579) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:30:39 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-62b55ef7-1887-441b-89a1-5113cc37204a tempest-CreateVolumesFromImageTest-190797813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6b9de1c-33d7-4495-8f45-fdb4dbf4b915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:30:39 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-62b55ef7-1887-441b-89a1-5113cc37204a tempest-CreateVolumesFromImageTest-190797813 None] Volume 7d8b58be-7eff-4fcd-9758-8e850cb34708: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d8b58be-7eff-4fcd-9758-8e850cb34708', 'volume_size': 1}
Nov 03 18:30:39 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-62b55ef7-1887-441b-89a1-5113cc37204a tempest-CreateVolumesFromImageTest-190797813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:30:39 devstack sudo[96371]: pam_unix(sudo:session): session closed for user root
Nov 03 18:30:39 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-e8155ddc-f815-4a8e-a78e-35d42392d87f tempest-VolumesGetTest-1058646393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-98e1a1d1-0a16-432c-99dc-fea6b55236dd" returned: 0 in 0.467s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:30:39 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-e8155ddc-f815-4a8e-a78e-35d42392d87f tempest-VolumesGetTest-1058646393 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-98e1a1d1-0a16-432c-99dc-fea6b55236dd {{(pid=86120) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 03 18:30:39 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-e8155ddc-f815-4a8e-a78e-35d42392d87f tempest-VolumesGetTest-1058646393 None] Creating direct copy from snapshot {{(pid=86120) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 03 18:30:40 devstack cinder-volume[86120]: DEBUG cinder.utils [None req-e8155ddc-f815-4a8e-a78e-35d42392d87f tempest-VolumesGetTest-1058646393 None] Path /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-00a2ede0-dbf8-42e9-8955-f3df683e2eb0 not found in is_blk_device check {{(pid=86120) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 03 18:30:40 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-e8155ddc-f815-4a8e-a78e-35d42392d87f tempest-VolumesGetTest-1058646393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-98e1a1d1-0a16-432c-99dc-fea6b55236dd /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-00a2ede0-dbf8-42e9-8955-f3df683e2eb0 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:30:40 devstack sudo[96377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-98e1a1d1-0a16-432c-99dc-fea6b55236dd /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-00a2ede0-dbf8-42e9-8955-f3df683e2eb0
Nov 03 18:30:40 devstack sudo[96377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:30:40 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e976d2a-df59-45f2-854d-0b86af64f7bc tempest-CreateVolumesFromImageTest-190797813 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:30:40 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-7e976d2a-df59-45f2-854d-0b86af64f7bc tempest-CreateVolumesFromImageTest-190797813 None] Flow 'volume_create_manager' (88b3a639-d660-412a-8b6a-204284794ae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:30:40 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-7e976d2a-df59-45f2-854d-0b86af64f7bc tempest-CreateVolumesFromImageTest-190797813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18fa4181-e0d9-4e37-9ae9-892e721a457d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:30:40 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-7e976d2a-df59-45f2-854d-0b86af64f7bc tempest-CreateVolumesFromImageTest-190797813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18fa4181-e0d9-4e37-9ae9-892e721a457d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:30:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1286087577',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae6dd2eb-5de3-44a6-b3ba-7b577553a3b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7e717a0196941b08b7e4f0b3912481b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:30:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:30:40Z,use_quota=True,user_id='7b13eb5e3ddd43aba199fa4042382db8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:30:40 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-7e976d2a-df59-45f2-854d-0b86af64f7bc tempest-CreateVolumesFromImageTest-190797813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93917c71-9e0b-4ad6-9557-9e17fe182e00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:30:40 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-7e976d2a-df59-45f2-854d-0b86af64f7bc tempest-CreateVolumesFromImageTest-190797813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93917c71-9e0b-4ad6-9557-9e17fe182e00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:30:40 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-7e976d2a-df59-45f2-854d-0b86af64f7bc tempest-CreateVolumesFromImageTest-190797813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8006003e-9c69-4248-8492-28ba6cc97575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:30:40 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-7e976d2a-df59-45f2-854d-0b86af64f7bc tempest-CreateVolumesFromImageTest-190797813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8006003e-9c69-4248-8492-28ba6cc97575) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae6dd2eb-5de3-44a6-b3ba-7b577553a3b3', 'volume_name': 'volume-ae6dd2eb-5de3-44a6-b3ba-7b577553a3b3', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:30:40 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-7e976d2a-df59-45f2-854d-0b86af64f7bc tempest-CreateVolumesFromImageTest-190797813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (820bb892-83e8-4bce-8428-b9bdd9fe2781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:30:40 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-7e976d2a-df59-45f2-854d-0b86af64f7bc tempest-CreateVolumesFromImageTest-190797813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (820bb892-83e8-4bce-8428-b9bdd9fe2781) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:30:40 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-7e976d2a-df59-45f2-854d-0b86af64f7bc tempest-CreateVolumesFromImageTest-190797813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5489ca1-16df-4337-9ad3-6f6a0915695e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:30:40 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-7e976d2a-df59-45f2-854d-0b86af64f7bc tempest-CreateVolumesFromImageTest-190797813 None] Volume ae6dd2eb-5de3-44a6-b3ba-7b577553a3b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae6dd2eb-5de3-44a6-b3ba-7b577553a3b3', 'volume_size': 1}
Nov 03 18:30:40 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-7e976d2a-df59-45f2-854d-0b86af64f7bc tempest-CreateVolumesFromImageTest-190797813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:30:40 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-8930027e-dca9-4304-bbcd-2cd916c35eb4 tempest-CreateVolumesFromImageTest-190797813 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:30:40 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-8930027e-dca9-4304-bbcd-2cd916c35eb4 tempest-CreateVolumesFromImageTest-190797813 None] Flow 'volume_create_manager' (d4cc2cf7-03ba-42b0-98b5-0db81ffcc687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:30:40 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-8930027e-dca9-4304-bbcd-2cd916c35eb4 tempest-CreateVolumesFromImageTest-190797813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f65a1a67-f14b-47c6-9924-52412e4a771b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:30:40 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-8930027e-dca9-4304-bbcd-2cd916c35eb4 tempest-CreateVolumesFromImageTest-190797813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f65a1a67-f14b-47c6-9924-52412e4a771b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:30:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2112513815',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a30f5bf-1081-4b27-8343-a5bda4c4fe0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7e717a0196941b08b7e4f0b3912481b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:30:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:30:41Z,use_quota=True,user_id='7b13eb5e3ddd43aba199fa4042382db8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:30:40 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-8930027e-dca9-4304-bbcd-2cd916c35eb4 tempest-CreateVolumesFromImageTest-190797813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1c6cefe-a7c5-4395-8b15-42d6510ea2b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:30:40 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-8930027e-dca9-4304-bbcd-2cd916c35eb4 tempest-CreateVolumesFromImageTest-190797813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1c6cefe-a7c5-4395-8b15-42d6510ea2b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:30:40 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-8930027e-dca9-4304-bbcd-2cd916c35eb4 tempest-CreateVolumesFromImageTest-190797813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc916147-2dac-4eca-a99f-5c7fbfbed31c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:30:40 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-8930027e-dca9-4304-bbcd-2cd916c35eb4 tempest-CreateVolumesFromImageTest-190797813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc916147-2dac-4eca-a99f-5c7fbfbed31c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a30f5bf-1081-4b27-8343-a5bda4c4fe0e', 'volume_name': 'volume-4a30f5bf-1081-4b27-8343-a5bda4c4fe0e', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:30:40 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-8930027e-dca9-4304-bbcd-2cd916c35eb4 tempest-CreateVolumesFromImageTest-190797813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75248dc7-3759-4bda-b655-c960175cda3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:30:40 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-8930027e-dca9-4304-bbcd-2cd916c35eb4 tempest-CreateVolumesFromImageTest-190797813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75248dc7-3759-4bda-b655-c960175cda3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:30:40 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-8930027e-dca9-4304-bbcd-2cd916c35eb4 tempest-CreateVolumesFromImageTest-190797813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3205b350-ab60-481f-89f5-5e92d7029dce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:30:40 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-8930027e-dca9-4304-bbcd-2cd916c35eb4 tempest-CreateVolumesFromImageTest-190797813 None] Volume 4a30f5bf-1081-4b27-8343-a5bda4c4fe0e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a30f5bf-1081-4b27-8343-a5bda4c4fe0e', 'volume_size': 1}
Nov 03 18:30:40 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-8930027e-dca9-4304-bbcd-2cd916c35eb4 tempest-CreateVolumesFromImageTest-190797813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:30:41 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-db5b3c15-166a-40b7-bedd-3afe433b2c4b tempest-CreateVolumesFromImageTest-190797813 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:30:41 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-db5b3c15-166a-40b7-bedd-3afe433b2c4b tempest-CreateVolumesFromImageTest-190797813 None] Flow 'volume_create_manager' (f42a60e8-27c4-4750-8c28-b1cb0602e0c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:30:41 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-db5b3c15-166a-40b7-bedd-3afe433b2c4b tempest-CreateVolumesFromImageTest-190797813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28affb4a-703b-4bfd-8907-1d65ac0a72d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:30:41 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-db5b3c15-166a-40b7-bedd-3afe433b2c4b tempest-CreateVolumesFromImageTest-190797813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28affb4a-703b-4bfd-8907-1d65ac0a72d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:30:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-630836136',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45869f08-07b0-4297-94bd-54fadc69dbb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7e717a0196941b08b7e4f0b3912481b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:30:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:30:41Z,use_quota=True,user_id='7b13eb5e3ddd43aba199fa4042382db8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:30:41 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-db5b3c15-166a-40b7-bedd-3afe433b2c4b tempest-CreateVolumesFromImageTest-190797813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbbbdaaa-2f1d-48fd-a162-50b3d671335e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:30:41 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-db5b3c15-166a-40b7-bedd-3afe433b2c4b tempest-CreateVolumesFromImageTest-190797813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbbbdaaa-2f1d-48fd-a162-50b3d671335e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:30:41 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-db5b3c15-166a-40b7-bedd-3afe433b2c4b tempest-CreateVolumesFromImageTest-190797813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (830b2274-01b7-401e-8244-7014730809c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:30:41 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-db5b3c15-166a-40b7-bedd-3afe433b2c4b tempest-CreateVolumesFromImageTest-190797813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (830b2274-01b7-401e-8244-7014730809c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45869f08-07b0-4297-94bd-54fadc69dbb7', 'volume_name': 'volume-45869f08-07b0-4297-94bd-54fadc69dbb7', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:30:41 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-db5b3c15-166a-40b7-bedd-3afe433b2c4b tempest-CreateVolumesFromImageTest-190797813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b84211a-e91f-4679-86a0-f4c90f19f034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:30:41 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-db5b3c15-166a-40b7-bedd-3afe433b2c4b tempest-CreateVolumesFromImageTest-190797813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b84211a-e91f-4679-86a0-f4c90f19f034) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:30:41 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-db5b3c15-166a-40b7-bedd-3afe433b2c4b tempest-CreateVolumesFromImageTest-190797813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3253eedf-dda6-4baa-8be7-08c6b56db220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:30:41 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-db5b3c15-166a-40b7-bedd-3afe433b2c4b tempest-CreateVolumesFromImageTest-190797813 None] Volume 45869f08-07b0-4297-94bd-54fadc69dbb7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45869f08-07b0-4297-94bd-54fadc69dbb7', 'volume_size': 1}
Nov 03 18:30:41 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-db5b3c15-166a-40b7-bedd-3afe433b2c4b tempest-CreateVolumesFromImageTest-190797813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:30:42 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e8810e0-020e-43dc-ad6a-236bf4b65724 tempest-CreateVolumesFromImageTest-190797813 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:30:42 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-5e8810e0-020e-43dc-ad6a-236bf4b65724 tempest-CreateVolumesFromImageTest-190797813 None] Flow 'volume_create_manager' (0a2db63f-3399-44fd-9afd-3dc75eb51032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:30:42 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-5e8810e0-020e-43dc-ad6a-236bf4b65724 tempest-CreateVolumesFromImageTest-190797813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed28aaa5-c079-4e5f-9ead-f1fc36cccf51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:30:42 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-5e8810e0-020e-43dc-ad6a-236bf4b65724 tempest-CreateVolumesFromImageTest-190797813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed28aaa5-c079-4e5f-9ead-f1fc36cccf51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:30:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1309791616',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f6711aa-a5cb-448c-bd48-05c4a96c00b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7e717a0196941b08b7e4f0b3912481b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:30:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:30:42Z,use_quota=True,user_id='7b13eb5e3ddd43aba199fa4042382db8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:30:42 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-5e8810e0-020e-43dc-ad6a-236bf4b65724 tempest-CreateVolumesFromImageTest-190797813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ed3441c-f830-41ff-9f53-2d8a6d0d97c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:30:42 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-5e8810e0-020e-43dc-ad6a-236bf4b65724 tempest-CreateVolumesFromImageTest-190797813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ed3441c-f830-41ff-9f53-2d8a6d0d97c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:30:42 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-5e8810e0-020e-43dc-ad6a-236bf4b65724 tempest-CreateVolumesFromImageTest-190797813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45d639a8-b34c-4150-9c4d-8e3c94630efd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:30:42 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-5e8810e0-020e-43dc-ad6a-236bf4b65724 tempest-CreateVolumesFromImageTest-190797813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45d639a8-b34c-4150-9c4d-8e3c94630efd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f6711aa-a5cb-448c-bd48-05c4a96c00b2', 'volume_name': 'volume-6f6711aa-a5cb-448c-bd48-05c4a96c00b2', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:30:42 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-5e8810e0-020e-43dc-ad6a-236bf4b65724 tempest-CreateVolumesFromImageTest-190797813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21b05350-7042-43e4-9a2f-6c210f5532a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:30:42 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-5e8810e0-020e-43dc-ad6a-236bf4b65724 tempest-CreateVolumesFromImageTest-190797813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21b05350-7042-43e4-9a2f-6c210f5532a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:30:42 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-5e8810e0-020e-43dc-ad6a-236bf4b65724 tempest-CreateVolumesFromImageTest-190797813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cad73621-ec38-4fa3-a63d-7ad45b19a301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:30:42 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-5e8810e0-020e-43dc-ad6a-236bf4b65724 tempest-CreateVolumesFromImageTest-190797813 None] Volume 6f6711aa-a5cb-448c-bd48-05c4a96c00b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f6711aa-a5cb-448c-bd48-05c4a96c00b2', 'volume_size': 1}
Nov 03 18:30:42 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-5e8810e0-020e-43dc-ad6a-236bf4b65724 tempest-CreateVolumesFromImageTest-190797813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:30:48 devstack sudo[96377]: pam_unix(sudo:session): session closed for user root
Nov 03 18:30:48 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-e8155ddc-f815-4a8e-a78e-35d42392d87f tempest-VolumesGetTest-1058646393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-98e1a1d1-0a16-432c-99dc-fea6b55236dd /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-00a2ede0-dbf8-42e9-8955-f3df683e2eb0" returned: 0 in 8.534s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:30:48 devstack cinder-volume[86120]: DEBUG cinder.image.image_utils [None req-e8155ddc-f815-4a8e-a78e-35d42392d87f tempest-VolumesGetTest-1058646393 None] Image conversion details: src /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-98e1a1d1-0a16-432c-99dc-fea6b55236dd, size 1024.00 MB, duration 8.53 sec, destination /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-00a2ede0-dbf8-42e9-8955-f3df683e2eb0 {{(pid=86120) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 03 18:30:48 devstack cinder-volume[86120]: INFO cinder.image.image_utils [None req-e8155ddc-f815-4a8e-a78e-35d42392d87f tempest-VolumesGetTest-1058646393 None] Converted 1024.00 MB image at 119.98 MB/s
Nov 03 18:30:48 devstack cinder-volume[86120]: WARNING cinder.volume.drivers.remotefs [None req-e8155ddc-f815-4a8e-a78e-35d42392d87f tempest-VolumesGetTest-1058646393 None] /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-00a2ede0-dbf8-42e9-8955-f3df683e2eb0 is being set with open permissions: ugo+rw
Nov 03 18:30:48 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-e8155ddc-f815-4a8e-a78e-35d42392d87f tempest-VolumesGetTest-1058646393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-00a2ede0-dbf8-42e9-8955-f3df683e2eb0 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:30:48 devstack sudo[96393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-00a2ede0-dbf8-42e9-8955-f3df683e2eb0
Nov 03 18:30:48 devstack sudo[96393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:30:48 devstack sudo[96393]: pam_unix(sudo:session): session closed for user root
Nov 03 18:30:48 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-e8155ddc-f815-4a8e-a78e-35d42392d87f tempest-VolumesGetTest-1058646393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-00a2ede0-dbf8-42e9-8955-f3df683e2eb0" returned: 0 in 0.284s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:30:48 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-e8155ddc-f815-4a8e-a78e-35d42392d87f tempest-VolumesGetTest-1058646393 None] Lock "cinder-quobyte-00a2ede0-dbf8-42e9-8955-f3df683e2eb0" released by "_copy_volume_from_snapshot" :: held 9.868s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:30:48 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-e8155ddc-f815-4a8e-a78e-35d42392d87f tempest-VolumesGetTest-1058646393 None] Acquiring lock "cinder-quobyte-57900bbd-ccf6-4cfc-8fa8-95dbf651157e" by "_delete_snapshot" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:30:48 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-e8155ddc-f815-4a8e-a78e-35d42392d87f tempest-VolumesGetTest-1058646393 None] Lock "cinder-quobyte-57900bbd-ccf6-4cfc-8fa8-95dbf651157e" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:30:48 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-e8155ddc-f815-4a8e-a78e-35d42392d87f tempest-VolumesGetTest-1058646393 None] Deleting offline snapshot 57900bbd-ccf6-4cfc-8fa8-95dbf651157e of volume 98e1a1d1-0a16-432c-99dc-fea6b55236dd {{(pid=86120) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 18:30:48 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-e8155ddc-f815-4a8e-a78e-35d42392d87f tempest-VolumesGetTest-1058646393 None] snapshot_file for this snap is: volume-98e1a1d1-0a16-432c-99dc-fea6b55236dd.57900bbd-ccf6-4cfc-8fa8-95dbf651157e {{(pid=86120) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 18:30:48 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[69bd3c48-01aa-4b3c-a5b2-0b7f2465b901]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:30:48 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-e8155ddc-f815-4a8e-a78e-35d42392d87f tempest-VolumesGetTest-1058646393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-98e1a1d1-0a16-432c-99dc-fea6b55236dd.57900bbd-ccf6-4cfc-8fa8-95dbf651157e {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:30:49 devstack sudo[96397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-98e1a1d1-0a16-432c-99dc-fea6b55236dd.57900bbd-ccf6-4cfc-8fa8-95dbf651157e
Nov 03 18:30:49 devstack sudo[96397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:30:49 devstack sudo[96397]: pam_unix(sudo:session): session closed for user root
Nov 03 18:30:49 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-e8155ddc-f815-4a8e-a78e-35d42392d87f tempest-VolumesGetTest-1058646393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-98e1a1d1-0a16-432c-99dc-fea6b55236dd.57900bbd-ccf6-4cfc-8fa8-95dbf651157e" returned: 0 in 0.419s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:30:49 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-e8155ddc-f815-4a8e-a78e-35d42392d87f tempest-VolumesGetTest-1058646393 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-98e1a1d1-0a16-432c-99dc-fea6b55236dd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86120) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 18:30:49 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdb8a87d-966d-47b3-8177-013d277853a7]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:30:49 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-e8155ddc-f815-4a8e-a78e-35d42392d87f tempest-VolumesGetTest-1058646393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-98e1a1d1-0a16-432c-99dc-fea6b55236dd {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:30:49 devstack sudo[96403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-98e1a1d1-0a16-432c-99dc-fea6b55236dd
Nov 03 18:30:49 devstack sudo[96403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:30:49 devstack sudo[96403]: pam_unix(sudo:session): session closed for user root
Nov 03 18:30:49 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-e8155ddc-f815-4a8e-a78e-35d42392d87f tempest-VolumesGetTest-1058646393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-98e1a1d1-0a16-432c-99dc-fea6b55236dd" returned: 0 in 0.596s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:30:49 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-e8155ddc-f815-4a8e-a78e-35d42392d87f tempest-VolumesGetTest-1058646393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-98e1a1d1-0a16-432c-99dc-fea6b55236dd.57900bbd-ccf6-4cfc-8fa8-95dbf651157e {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:30:49 devstack sudo[96409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-98e1a1d1-0a16-432c-99dc-fea6b55236dd.57900bbd-ccf6-4cfc-8fa8-95dbf651157e
Nov 03 18:30:49 devstack sudo[96409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:30:50 devstack sudo[96409]: pam_unix(sudo:session): session closed for user root
Nov 03 18:30:50 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-e8155ddc-f815-4a8e-a78e-35d42392d87f tempest-VolumesGetTest-1058646393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-98e1a1d1-0a16-432c-99dc-fea6b55236dd.57900bbd-ccf6-4cfc-8fa8-95dbf651157e" returned: 0 in 0.419s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:30:50 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-e8155ddc-f815-4a8e-a78e-35d42392d87f tempest-VolumesGetTest-1058646393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-98e1a1d1-0a16-432c-99dc-fea6b55236dd.57900bbd-ccf6-4cfc-8fa8-95dbf651157e {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:30:50 devstack sudo[96414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-98e1a1d1-0a16-432c-99dc-fea6b55236dd.57900bbd-ccf6-4cfc-8fa8-95dbf651157e
Nov 03 18:30:50 devstack sudo[96414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:30:50 devstack sudo[96414]: pam_unix(sudo:session): session closed for user root
Nov 03 18:30:50 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-e8155ddc-f815-4a8e-a78e-35d42392d87f tempest-VolumesGetTest-1058646393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-98e1a1d1-0a16-432c-99dc-fea6b55236dd.57900bbd-ccf6-4cfc-8fa8-95dbf651157e" returned: 0 in 0.267s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:30:50 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-e8155ddc-f815-4a8e-a78e-35d42392d87f tempest-VolumesGetTest-1058646393 None] Lock "cinder-quobyte-57900bbd-ccf6-4cfc-8fa8-95dbf651157e" released by "_delete_snapshot" :: held 1.822s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:30:50 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-e8155ddc-f815-4a8e-a78e-35d42392d87f tempest-VolumesGetTest-1058646393 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.452s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:30:50 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-62b55ef7-1887-441b-89a1-5113cc37204a tempest-CreateVolumesFromImageTest-190797813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.842s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:30:50 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-62b55ef7-1887-441b-89a1-5113cc37204a tempest-CreateVolumesFromImageTest-190797813 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:30:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-978061166',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d8b58be-7eff-4fcd-9758-8e850cb34708,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7e717a0196941b08b7e4f0b3912481b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:30:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:30:40Z,use_quota=True,user_id='7b13eb5e3ddd43aba199fa4042382db8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:30:50 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-62b55ef7-1887-441b-89a1-5113cc37204a tempest-CreateVolumesFromImageTest-190797813 None] Creating volume 7d8b58be-7eff-4fcd-9758-8e850cb34708 {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:30:50 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-62b55ef7-1887-441b-89a1-5113cc37204a tempest-CreateVolumesFromImageTest-190797813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:30:50 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-62b55ef7-1887-441b-89a1-5113cc37204a tempest-CreateVolumesFromImageTest-190797813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:30:50 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-62b55ef7-1887-441b-89a1-5113cc37204a tempest-CreateVolumesFromImageTest-190797813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:30:50 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-62b55ef7-1887-441b-89a1-5113cc37204a tempest-CreateVolumesFromImageTest-190797813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:30:50 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-62b55ef7-1887-441b-89a1-5113cc37204a tempest-CreateVolumesFromImageTest-190797813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:30:50 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-62b55ef7-1887-441b-89a1-5113cc37204a tempest-CreateVolumesFromImageTest-190797813 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:30:50 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-62b55ef7-1887-441b-89a1-5113cc37204a tempest-CreateVolumesFromImageTest-190797813 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:30:50 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-62b55ef7-1887-441b-89a1-5113cc37204a tempest-CreateVolumesFromImageTest-190797813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-7d8b58be-7eff-4fcd-9758-8e850cb34708 1073741824 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:30:50 devstack sudo[96417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-7d8b58be-7eff-4fcd-9758-8e850cb34708 1073741824
Nov 03 18:30:50 devstack sudo[96417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:30:50 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-e8155ddc-f815-4a8e-a78e-35d42392d87f tempest-VolumesGetTest-1058646393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1be32e5a-7c6c-4a18-9aef-aa2ddb2daaf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00a2ede0-dbf8-42e9-8955-f3df683e2eb0', 'volume_size': 1, 'source_volid': '98e1a1d1-0a16-432c-99dc-fea6b55236dd', 'source_volstatus': 'available'}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:30:50 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-e8155ddc-f815-4a8e-a78e-35d42392d87f tempest-VolumesGetTest-1058646393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0116bc6-67b3-4627-b78f-12d9fb958982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:30:50 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-e8155ddc-f815-4a8e-a78e-35d42392d87f tempest-VolumesGetTest-1058646393 None] Volume volume-00a2ede0-dbf8-42e9-8955-f3df683e2eb0 (00a2ede0-dbf8-42e9-8955-f3df683e2eb0): created successfully
Nov 03 18:30:50 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-e8155ddc-f815-4a8e-a78e-35d42392d87f tempest-VolumesGetTest-1058646393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0116bc6-67b3-4627-b78f-12d9fb958982) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:30:50 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-e8155ddc-f815-4a8e-a78e-35d42392d87f tempest-VolumesGetTest-1058646393 None] Flow 'volume_create_manager' (1653906d-9340-449f-bb10-bfe7ca01f2f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:30:50 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-e8155ddc-f815-4a8e-a78e-35d42392d87f tempest-VolumesGetTest-1058646393 None] Created volume successfully.
Nov 03 18:30:51 devstack sudo[96417]: pam_unix(sudo:session): session closed for user root
Nov 03 18:30:51 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-62b55ef7-1887-441b-89a1-5113cc37204a tempest-CreateVolumesFromImageTest-190797813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-7d8b58be-7eff-4fcd-9758-8e850cb34708 1073741824" returned: 0 in 0.555s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:30:51 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-62b55ef7-1887-441b-89a1-5113cc37204a tempest-CreateVolumesFromImageTest-190797813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-7d8b58be-7eff-4fcd-9758-8e850cb34708 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:30:51 devstack sudo[96425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-7d8b58be-7eff-4fcd-9758-8e850cb34708
Nov 03 18:30:51 devstack sudo[96425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:30:51 devstack sudo[96425]: pam_unix(sudo:session): session closed for user root
Nov 03 18:30:51 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-62b55ef7-1887-441b-89a1-5113cc37204a tempest-CreateVolumesFromImageTest-190797813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-7d8b58be-7eff-4fcd-9758-8e850cb34708" returned: 0 in 0.361s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:30:51 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-62b55ef7-1887-441b-89a1-5113cc37204a tempest-CreateVolumesFromImageTest-190797813 None] <== create_volume: return (997ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:30:51 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-62b55ef7-1887-441b-89a1-5113cc37204a tempest-CreateVolumesFromImageTest-190797813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.004s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:30:51 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-7e976d2a-df59-45f2-854d-0b86af64f7bc tempest-CreateVolumesFromImageTest-190797813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.414s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:30:51 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-7e976d2a-df59-45f2-854d-0b86af64f7bc tempest-CreateVolumesFromImageTest-190797813 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:30:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1286087577',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae6dd2eb-5de3-44a6-b3ba-7b577553a3b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7e717a0196941b08b7e4f0b3912481b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:30:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:30:40Z,use_quota=True,user_id='7b13eb5e3ddd43aba199fa4042382db8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:30:51 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-7e976d2a-df59-45f2-854d-0b86af64f7bc tempest-CreateVolumesFromImageTest-190797813 None] Creating volume ae6dd2eb-5de3-44a6-b3ba-7b577553a3b3 {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:30:51 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-7e976d2a-df59-45f2-854d-0b86af64f7bc tempest-CreateVolumesFromImageTest-190797813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:30:51 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-7e976d2a-df59-45f2-854d-0b86af64f7bc tempest-CreateVolumesFromImageTest-190797813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:30:51 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-7e976d2a-df59-45f2-854d-0b86af64f7bc tempest-CreateVolumesFromImageTest-190797813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:30:51 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-7e976d2a-df59-45f2-854d-0b86af64f7bc tempest-CreateVolumesFromImageTest-190797813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:30:51 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-7e976d2a-df59-45f2-854d-0b86af64f7bc tempest-CreateVolumesFromImageTest-190797813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:30:51 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-7e976d2a-df59-45f2-854d-0b86af64f7bc tempest-CreateVolumesFromImageTest-190797813 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:30:51 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-7e976d2a-df59-45f2-854d-0b86af64f7bc tempest-CreateVolumesFromImageTest-190797813 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:30:51 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-7e976d2a-df59-45f2-854d-0b86af64f7bc tempest-CreateVolumesFromImageTest-190797813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ae6dd2eb-5de3-44a6-b3ba-7b577553a3b3 1073741824 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:30:51 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-62b55ef7-1887-441b-89a1-5113cc37204a tempest-CreateVolumesFromImageTest-190797813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6b9de1c-33d7-4495-8f45-fdb4dbf4b915) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d8b58be-7eff-4fcd-9758-8e850cb34708', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:30:51 devstack sudo[96430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ae6dd2eb-5de3-44a6-b3ba-7b577553a3b3 1073741824
Nov 03 18:30:51 devstack sudo[96430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:30:51 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-62b55ef7-1887-441b-89a1-5113cc37204a tempest-CreateVolumesFromImageTest-190797813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33f16ab2-4bd9-476f-b264-0a2ce5668993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:30:51 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-62b55ef7-1887-441b-89a1-5113cc37204a tempest-CreateVolumesFromImageTest-190797813 None] Volume volume-7d8b58be-7eff-4fcd-9758-8e850cb34708 (7d8b58be-7eff-4fcd-9758-8e850cb34708): created successfully
Nov 03 18:30:51 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-62b55ef7-1887-441b-89a1-5113cc37204a tempest-CreateVolumesFromImageTest-190797813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33f16ab2-4bd9-476f-b264-0a2ce5668993) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:30:51 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-62b55ef7-1887-441b-89a1-5113cc37204a tempest-CreateVolumesFromImageTest-190797813 None] Flow 'volume_create_manager' (aa2967b7-45c4-4225-81a5-36daa9c91c34) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:30:51 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-62b55ef7-1887-441b-89a1-5113cc37204a tempest-CreateVolumesFromImageTest-190797813 None] Created volume successfully.
Nov 03 18:30:52 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7b6f954-5c1c-43b7-83de-f960339d12b0 tempest-AttachVolumeTestJSON-374454512 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:30:52 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-d7b6f954-5c1c-43b7-83de-f960339d12b0 tempest-AttachVolumeTestJSON-374454512 None] Flow 'volume_create_manager' (6b9db929-376d-4ff9-a14d-020f207e1133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:30:52 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-d7b6f954-5c1c-43b7-83de-f960339d12b0 tempest-AttachVolumeTestJSON-374454512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8388107-515d-4063-9e87-55c0c9631de8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:30:52 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-d7b6f954-5c1c-43b7-83de-f960339d12b0 tempest-AttachVolumeTestJSON-374454512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8388107-515d-4063-9e87-55c0c9631de8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:30:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1178253288',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93c46b04-ffc8-4e84-ada9-390c85ea3050,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44080038429342c1b6a06a1c04699704',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:30:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:30:52Z,use_quota=True,user_id='84f64ec5568f4c32a950eaaaf709123b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:30:52 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-d7b6f954-5c1c-43b7-83de-f960339d12b0 tempest-AttachVolumeTestJSON-374454512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a065f90a-7fe2-4c54-a569-4bfd852da570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:30:52 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-d7b6f954-5c1c-43b7-83de-f960339d12b0 tempest-AttachVolumeTestJSON-374454512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a065f90a-7fe2-4c54-a569-4bfd852da570) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:30:52 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-d7b6f954-5c1c-43b7-83de-f960339d12b0 tempest-AttachVolumeTestJSON-374454512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02ec22aa-eb70-4119-9672-228d21dbf689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:30:52 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-d7b6f954-5c1c-43b7-83de-f960339d12b0 tempest-AttachVolumeTestJSON-374454512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02ec22aa-eb70-4119-9672-228d21dbf689) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93c46b04-ffc8-4e84-ada9-390c85ea3050', 'volume_name': 'volume-93c46b04-ffc8-4e84-ada9-390c85ea3050', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:30:52 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-d7b6f954-5c1c-43b7-83de-f960339d12b0 tempest-AttachVolumeTestJSON-374454512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (766e0d6e-c34e-4af1-af30-3f826dac883c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:30:52 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-d7b6f954-5c1c-43b7-83de-f960339d12b0 tempest-AttachVolumeTestJSON-374454512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (766e0d6e-c34e-4af1-af30-3f826dac883c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:30:52 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-d7b6f954-5c1c-43b7-83de-f960339d12b0 tempest-AttachVolumeTestJSON-374454512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (144eb1b7-8ad5-427b-8329-b1ceb3e80b78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:30:52 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-d7b6f954-5c1c-43b7-83de-f960339d12b0 tempest-AttachVolumeTestJSON-374454512 None] Volume 93c46b04-ffc8-4e84-ada9-390c85ea3050: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93c46b04-ffc8-4e84-ada9-390c85ea3050', 'volume_size': 1}
Nov 03 18:30:52 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-d7b6f954-5c1c-43b7-83de-f960339d12b0 tempest-AttachVolumeTestJSON-374454512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:30:52 devstack sudo[96430]: pam_unix(sudo:session): session closed for user root
Nov 03 18:30:52 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-7e976d2a-df59-45f2-854d-0b86af64f7bc tempest-CreateVolumesFromImageTest-190797813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ae6dd2eb-5de3-44a6-b3ba-7b577553a3b3 1073741824" returned: 0 in 0.849s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:30:52 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-7e976d2a-df59-45f2-854d-0b86af64f7bc tempest-CreateVolumesFromImageTest-190797813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ae6dd2eb-5de3-44a6-b3ba-7b577553a3b3 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:30:52 devstack sudo[96446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ae6dd2eb-5de3-44a6-b3ba-7b577553a3b3
Nov 03 18:30:52 devstack sudo[96446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:30:52 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-d70d8450-c374-43f8-be6f-f79fcf34b258 tempest-VolumesGetTest-1058646393 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:30:52 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-d70d8450-c374-43f8-be6f-f79fcf34b258 tempest-VolumesGetTest-1058646393 None] Flow 'volume_create_manager' (0c406797-4129-4b8c-8584-fd689a822b42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:30:52 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-d70d8450-c374-43f8-be6f-f79fcf34b258 tempest-VolumesGetTest-1058646393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5020c930-1b20-4795-8a93-3df81a6a53b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:30:52 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-d70d8450-c374-43f8-be6f-f79fcf34b258 tempest-VolumesGetTest-1058646393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5020c930-1b20-4795-8a93-3df81a6a53b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:30:52Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-644198975',display_name='tempest-VolumesGetTest-Volume-835551845',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a681d563-38d6-4819-954d-52f4873fb935,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a2e9d719ed44e7d937af97c1006955b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:30:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:30:53Z,use_quota=True,user_id='9e6bb9b9d9e14369b45e0740337deeda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:30:52 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-d70d8450-c374-43f8-be6f-f79fcf34b258 tempest-VolumesGetTest-1058646393 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93d812c8-4708-46e9-a8a0-088c23d8c189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:30:52 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-d70d8450-c374-43f8-be6f-f79fcf34b258 tempest-VolumesGetTest-1058646393 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93d812c8-4708-46e9-a8a0-088c23d8c189) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:30:52 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-d70d8450-c374-43f8-be6f-f79fcf34b258 tempest-VolumesGetTest-1058646393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b60e0b75-9882-4f7d-81be-7fa7c7cb96fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:30:52 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-d70d8450-c374-43f8-be6f-f79fcf34b258 tempest-VolumesGetTest-1058646393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b60e0b75-9882-4f7d-81be-7fa7c7cb96fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a681d563-38d6-4819-954d-52f4873fb935', 'volume_name': 'volume-a681d563-38d6-4819-954d-52f4873fb935', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:30:52 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-d70d8450-c374-43f8-be6f-f79fcf34b258 tempest-VolumesGetTest-1058646393 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d43e41a3-e038-47a0-843c-abe0a640f6ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:30:52 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-d70d8450-c374-43f8-be6f-f79fcf34b258 tempest-VolumesGetTest-1058646393 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d43e41a3-e038-47a0-843c-abe0a640f6ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:30:52 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-d70d8450-c374-43f8-be6f-f79fcf34b258 tempest-VolumesGetTest-1058646393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff1d51eb-b605-40cc-a1b6-f23871520b87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:30:52 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-d70d8450-c374-43f8-be6f-f79fcf34b258 tempest-VolumesGetTest-1058646393 None] Volume a681d563-38d6-4819-954d-52f4873fb935: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a681d563-38d6-4819-954d-52f4873fb935', 'volume_size': 1}
Nov 03 18:30:52 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-d70d8450-c374-43f8-be6f-f79fcf34b258 tempest-VolumesGetTest-1058646393 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:30:52 devstack sudo[96446]: pam_unix(sudo:session): session closed for user root
Nov 03 18:30:52 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-7e976d2a-df59-45f2-854d-0b86af64f7bc tempest-CreateVolumesFromImageTest-190797813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ae6dd2eb-5de3-44a6-b3ba-7b577553a3b3" returned: 0 in 0.265s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:30:52 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-7e976d2a-df59-45f2-854d-0b86af64f7bc tempest-CreateVolumesFromImageTest-190797813 None] <== create_volume: return (1185ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:30:52 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-7e976d2a-df59-45f2-854d-0b86af64f7bc tempest-CreateVolumesFromImageTest-190797813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.189s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:30:52 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-8930027e-dca9-4304-bbcd-2cd916c35eb4 tempest-CreateVolumesFromImageTest-190797813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:30:52 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-8930027e-dca9-4304-bbcd-2cd916c35eb4 tempest-CreateVolumesFromImageTest-190797813 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:30:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2112513815',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a30f5bf-1081-4b27-8343-a5bda4c4fe0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7e717a0196941b08b7e4f0b3912481b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:30:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:30:41Z,use_quota=True,user_id='7b13eb5e3ddd43aba199fa4042382db8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:30:52 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-8930027e-dca9-4304-bbcd-2cd916c35eb4 tempest-CreateVolumesFromImageTest-190797813 None] Creating volume 4a30f5bf-1081-4b27-8343-a5bda4c4fe0e {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:30:52 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-8930027e-dca9-4304-bbcd-2cd916c35eb4 tempest-CreateVolumesFromImageTest-190797813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:30:52 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-8930027e-dca9-4304-bbcd-2cd916c35eb4 tempest-CreateVolumesFromImageTest-190797813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:30:52 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-8930027e-dca9-4304-bbcd-2cd916c35eb4 tempest-CreateVolumesFromImageTest-190797813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:30:52 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-8930027e-dca9-4304-bbcd-2cd916c35eb4 tempest-CreateVolumesFromImageTest-190797813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:30:52 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-8930027e-dca9-4304-bbcd-2cd916c35eb4 tempest-CreateVolumesFromImageTest-190797813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:30:52 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-8930027e-dca9-4304-bbcd-2cd916c35eb4 tempest-CreateVolumesFromImageTest-190797813 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:30:52 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-8930027e-dca9-4304-bbcd-2cd916c35eb4 tempest-CreateVolumesFromImageTest-190797813 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:30:52 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-8930027e-dca9-4304-bbcd-2cd916c35eb4 tempest-CreateVolumesFromImageTest-190797813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-4a30f5bf-1081-4b27-8343-a5bda4c4fe0e 1073741824 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:30:52 devstack sudo[96449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-4a30f5bf-1081-4b27-8343-a5bda4c4fe0e 1073741824
Nov 03 18:30:52 devstack sudo[96449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:30:52 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-7e976d2a-df59-45f2-854d-0b86af64f7bc tempest-CreateVolumesFromImageTest-190797813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5489ca1-16df-4337-9ad3-6f6a0915695e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae6dd2eb-5de3-44a6-b3ba-7b577553a3b3', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:30:52 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-7e976d2a-df59-45f2-854d-0b86af64f7bc tempest-CreateVolumesFromImageTest-190797813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a88a14b3-c655-4c23-8c08-7d2b23883443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:30:53 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-7e976d2a-df59-45f2-854d-0b86af64f7bc tempest-CreateVolumesFromImageTest-190797813 None] Volume volume-ae6dd2eb-5de3-44a6-b3ba-7b577553a3b3 (ae6dd2eb-5de3-44a6-b3ba-7b577553a3b3): created successfully
Nov 03 18:30:53 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-7e976d2a-df59-45f2-854d-0b86af64f7bc tempest-CreateVolumesFromImageTest-190797813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a88a14b3-c655-4c23-8c08-7d2b23883443) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:30:53 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-7e976d2a-df59-45f2-854d-0b86af64f7bc tempest-CreateVolumesFromImageTest-190797813 None] Flow 'volume_create_manager' (88b3a639-d660-412a-8b6a-204284794ae4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:30:53 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-7e976d2a-df59-45f2-854d-0b86af64f7bc tempest-CreateVolumesFromImageTest-190797813 None] Created volume successfully.
Nov 03 18:30:53 devstack sudo[96449]: pam_unix(sudo:session): session closed for user root
Nov 03 18:30:53 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-8930027e-dca9-4304-bbcd-2cd916c35eb4 tempest-CreateVolumesFromImageTest-190797813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-4a30f5bf-1081-4b27-8343-a5bda4c4fe0e 1073741824" returned: 0 in 0.495s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:30:53 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-8930027e-dca9-4304-bbcd-2cd916c35eb4 tempest-CreateVolumesFromImageTest-190797813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-4a30f5bf-1081-4b27-8343-a5bda4c4fe0e {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:30:53 devstack sudo[96455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-4a30f5bf-1081-4b27-8343-a5bda4c4fe0e
Nov 03 18:30:53 devstack sudo[96455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:30:53 devstack sudo[96455]: pam_unix(sudo:session): session closed for user root
Nov 03 18:30:53 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-8930027e-dca9-4304-bbcd-2cd916c35eb4 tempest-CreateVolumesFromImageTest-190797813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-4a30f5bf-1081-4b27-8343-a5bda4c4fe0e" returned: 0 in 0.261s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:30:53 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-8930027e-dca9-4304-bbcd-2cd916c35eb4 tempest-CreateVolumesFromImageTest-190797813 None] <== create_volume: return (802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:30:53 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-8930027e-dca9-4304-bbcd-2cd916c35eb4 tempest-CreateVolumesFromImageTest-190797813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.805s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:30:53 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-db5b3c15-166a-40b7-bedd-3afe433b2c4b tempest-CreateVolumesFromImageTest-190797813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.051s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:30:53 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-db5b3c15-166a-40b7-bedd-3afe433b2c4b tempest-CreateVolumesFromImageTest-190797813 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:30:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-630836136',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45869f08-07b0-4297-94bd-54fadc69dbb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7e717a0196941b08b7e4f0b3912481b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:30:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:30:41Z,use_quota=True,user_id='7b13eb5e3ddd43aba199fa4042382db8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:30:53 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-db5b3c15-166a-40b7-bedd-3afe433b2c4b tempest-CreateVolumesFromImageTest-190797813 None] Creating volume 45869f08-07b0-4297-94bd-54fadc69dbb7 {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:30:53 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-db5b3c15-166a-40b7-bedd-3afe433b2c4b tempest-CreateVolumesFromImageTest-190797813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:30:53 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-db5b3c15-166a-40b7-bedd-3afe433b2c4b tempest-CreateVolumesFromImageTest-190797813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:30:53 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-db5b3c15-166a-40b7-bedd-3afe433b2c4b tempest-CreateVolumesFromImageTest-190797813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:30:53 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-db5b3c15-166a-40b7-bedd-3afe433b2c4b tempest-CreateVolumesFromImageTest-190797813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:30:53 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-db5b3c15-166a-40b7-bedd-3afe433b2c4b tempest-CreateVolumesFromImageTest-190797813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:30:53 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-db5b3c15-166a-40b7-bedd-3afe433b2c4b tempest-CreateVolumesFromImageTest-190797813 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:30:53 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-db5b3c15-166a-40b7-bedd-3afe433b2c4b tempest-CreateVolumesFromImageTest-190797813 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:30:53 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-db5b3c15-166a-40b7-bedd-3afe433b2c4b tempest-CreateVolumesFromImageTest-190797813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-45869f08-07b0-4297-94bd-54fadc69dbb7 1073741824 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:30:53 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-8930027e-dca9-4304-bbcd-2cd916c35eb4 tempest-CreateVolumesFromImageTest-190797813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3205b350-ab60-481f-89f5-5e92d7029dce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a30f5bf-1081-4b27-8343-a5bda4c4fe0e', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:30:53 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-8930027e-dca9-4304-bbcd-2cd916c35eb4 tempest-CreateVolumesFromImageTest-190797813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1312de97-7ba3-46b8-973d-5d813102e9d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:30:53 devstack sudo[96458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-45869f08-07b0-4297-94bd-54fadc69dbb7 1073741824
Nov 03 18:30:53 devstack sudo[96458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:30:53 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-8930027e-dca9-4304-bbcd-2cd916c35eb4 tempest-CreateVolumesFromImageTest-190797813 None] Volume volume-4a30f5bf-1081-4b27-8343-a5bda4c4fe0e (4a30f5bf-1081-4b27-8343-a5bda4c4fe0e): created successfully
Nov 03 18:30:53 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-8930027e-dca9-4304-bbcd-2cd916c35eb4 tempest-CreateVolumesFromImageTest-190797813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1312de97-7ba3-46b8-973d-5d813102e9d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:30:53 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-8930027e-dca9-4304-bbcd-2cd916c35eb4 tempest-CreateVolumesFromImageTest-190797813 None] Flow 'volume_create_manager' (d4cc2cf7-03ba-42b0-98b5-0db81ffcc687) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:30:53 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-8930027e-dca9-4304-bbcd-2cd916c35eb4 tempest-CreateVolumesFromImageTest-190797813 None] Created volume successfully.
Nov 03 18:30:54 devstack sudo[96458]: pam_unix(sudo:session): session closed for user root
Nov 03 18:30:54 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-db5b3c15-166a-40b7-bedd-3afe433b2c4b tempest-CreateVolumesFromImageTest-190797813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-45869f08-07b0-4297-94bd-54fadc69dbb7 1073741824" returned: 0 in 0.446s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:30:54 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-db5b3c15-166a-40b7-bedd-3afe433b2c4b tempest-CreateVolumesFromImageTest-190797813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-45869f08-07b0-4297-94bd-54fadc69dbb7 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:30:54 devstack sudo[96464]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-45869f08-07b0-4297-94bd-54fadc69dbb7
Nov 03 18:30:54 devstack sudo[96464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:30:54 devstack sudo[96464]: pam_unix(sudo:session): session closed for user root
Nov 03 18:30:54 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-db5b3c15-166a-40b7-bedd-3afe433b2c4b tempest-CreateVolumesFromImageTest-190797813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-45869f08-07b0-4297-94bd-54fadc69dbb7" returned: 0 in 0.363s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:30:54 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-db5b3c15-166a-40b7-bedd-3afe433b2c4b tempest-CreateVolumesFromImageTest-190797813 None] <== create_volume: return (871ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:30:54 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-db5b3c15-166a-40b7-bedd-3afe433b2c4b tempest-CreateVolumesFromImageTest-190797813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.875s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:30:54 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-5e8810e0-020e-43dc-ad6a-236bf4b65724 tempest-CreateVolumesFromImageTest-190797813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.200s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:30:54 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-5e8810e0-020e-43dc-ad6a-236bf4b65724 tempest-CreateVolumesFromImageTest-190797813 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:30:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1309791616',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f6711aa-a5cb-448c-bd48-05c4a96c00b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7e717a0196941b08b7e4f0b3912481b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:30:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:30:42Z,use_quota=True,user_id='7b13eb5e3ddd43aba199fa4042382db8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:30:54 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-5e8810e0-020e-43dc-ad6a-236bf4b65724 tempest-CreateVolumesFromImageTest-190797813 None] Creating volume 6f6711aa-a5cb-448c-bd48-05c4a96c00b2 {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:30:54 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-5e8810e0-020e-43dc-ad6a-236bf4b65724 tempest-CreateVolumesFromImageTest-190797813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:30:54 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-5e8810e0-020e-43dc-ad6a-236bf4b65724 tempest-CreateVolumesFromImageTest-190797813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:30:54 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-5e8810e0-020e-43dc-ad6a-236bf4b65724 tempest-CreateVolumesFromImageTest-190797813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:30:54 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-5e8810e0-020e-43dc-ad6a-236bf4b65724 tempest-CreateVolumesFromImageTest-190797813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:30:54 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-5e8810e0-020e-43dc-ad6a-236bf4b65724 tempest-CreateVolumesFromImageTest-190797813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:30:54 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-5e8810e0-020e-43dc-ad6a-236bf4b65724 tempest-CreateVolumesFromImageTest-190797813 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:30:54 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-5e8810e0-020e-43dc-ad6a-236bf4b65724 tempest-CreateVolumesFromImageTest-190797813 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:30:54 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-5e8810e0-020e-43dc-ad6a-236bf4b65724 tempest-CreateVolumesFromImageTest-190797813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6f6711aa-a5cb-448c-bd48-05c4a96c00b2 1073741824 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:30:54 devstack sudo[96467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6f6711aa-a5cb-448c-bd48-05c4a96c00b2 1073741824
Nov 03 18:30:54 devstack sudo[96467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:30:54 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-db5b3c15-166a-40b7-bedd-3afe433b2c4b tempest-CreateVolumesFromImageTest-190797813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3253eedf-dda6-4baa-8be7-08c6b56db220) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45869f08-07b0-4297-94bd-54fadc69dbb7', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:30:54 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-db5b3c15-166a-40b7-bedd-3afe433b2c4b tempest-CreateVolumesFromImageTest-190797813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9741f6e-c9c8-4b3f-967c-c4f8f3b158d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:30:54 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-db5b3c15-166a-40b7-bedd-3afe433b2c4b tempest-CreateVolumesFromImageTest-190797813 None] Volume volume-45869f08-07b0-4297-94bd-54fadc69dbb7 (45869f08-07b0-4297-94bd-54fadc69dbb7): created successfully
Nov 03 18:30:54 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-db5b3c15-166a-40b7-bedd-3afe433b2c4b tempest-CreateVolumesFromImageTest-190797813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9741f6e-c9c8-4b3f-967c-c4f8f3b158d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:30:54 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-db5b3c15-166a-40b7-bedd-3afe433b2c4b tempest-CreateVolumesFromImageTest-190797813 None] Flow 'volume_create_manager' (f42a60e8-27c4-4750-8c28-b1cb0602e0c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:30:54 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-db5b3c15-166a-40b7-bedd-3afe433b2c4b tempest-CreateVolumesFromImageTest-190797813 None] Created volume successfully.
Nov 03 18:30:55 devstack sudo[96467]: pam_unix(sudo:session): session closed for user root
Nov 03 18:30:55 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-5e8810e0-020e-43dc-ad6a-236bf4b65724 tempest-CreateVolumesFromImageTest-190797813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6f6711aa-a5cb-448c-bd48-05c4a96c00b2 1073741824" returned: 0 in 0.496s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:30:55 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-5e8810e0-020e-43dc-ad6a-236bf4b65724 tempest-CreateVolumesFromImageTest-190797813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6f6711aa-a5cb-448c-bd48-05c4a96c00b2 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:30:55 devstack sudo[96473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6f6711aa-a5cb-448c-bd48-05c4a96c00b2
Nov 03 18:30:55 devstack sudo[96473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:30:55 devstack sudo[96473]: pam_unix(sudo:session): session closed for user root
Nov 03 18:30:55 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-5e8810e0-020e-43dc-ad6a-236bf4b65724 tempest-CreateVolumesFromImageTest-190797813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6f6711aa-a5cb-448c-bd48-05c4a96c00b2" returned: 0 in 0.250s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:30:55 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-5e8810e0-020e-43dc-ad6a-236bf4b65724 tempest-CreateVolumesFromImageTest-190797813 None] <== create_volume: return (791ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:30:55 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-5e8810e0-020e-43dc-ad6a-236bf4b65724 tempest-CreateVolumesFromImageTest-190797813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.797s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:30:55 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-d7b6f954-5c1c-43b7-83de-f960339d12b0 tempest-AttachVolumeTestJSON-374454512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.227s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:30:55 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-d7b6f954-5c1c-43b7-83de-f960339d12b0 tempest-AttachVolumeTestJSON-374454512 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:30:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1178253288',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93c46b04-ffc8-4e84-ada9-390c85ea3050,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44080038429342c1b6a06a1c04699704',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:30:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:30:52Z,use_quota=True,user_id='84f64ec5568f4c32a950eaaaf709123b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:30:55 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-d7b6f954-5c1c-43b7-83de-f960339d12b0 tempest-AttachVolumeTestJSON-374454512 None] Creating volume 93c46b04-ffc8-4e84-ada9-390c85ea3050 {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:30:55 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-d7b6f954-5c1c-43b7-83de-f960339d12b0 tempest-AttachVolumeTestJSON-374454512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:30:55 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-d7b6f954-5c1c-43b7-83de-f960339d12b0 tempest-AttachVolumeTestJSON-374454512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:30:55 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-d7b6f954-5c1c-43b7-83de-f960339d12b0 tempest-AttachVolumeTestJSON-374454512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:30:55 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-d7b6f954-5c1c-43b7-83de-f960339d12b0 tempest-AttachVolumeTestJSON-374454512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:30:55 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-d7b6f954-5c1c-43b7-83de-f960339d12b0 tempest-AttachVolumeTestJSON-374454512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:30:55 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-d7b6f954-5c1c-43b7-83de-f960339d12b0 tempest-AttachVolumeTestJSON-374454512 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:30:55 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-d7b6f954-5c1c-43b7-83de-f960339d12b0 tempest-AttachVolumeTestJSON-374454512 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:30:55 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-d7b6f954-5c1c-43b7-83de-f960339d12b0 tempest-AttachVolumeTestJSON-374454512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-93c46b04-ffc8-4e84-ada9-390c85ea3050 1073741824 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:30:55 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-5e8810e0-020e-43dc-ad6a-236bf4b65724 tempest-CreateVolumesFromImageTest-190797813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cad73621-ec38-4fa3-a63d-7ad45b19a301) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f6711aa-a5cb-448c-bd48-05c4a96c00b2', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:30:55 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-5e8810e0-020e-43dc-ad6a-236bf4b65724 tempest-CreateVolumesFromImageTest-190797813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58d60c95-0dbf-41f8-b573-49f41d3ff028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:30:55 devstack sudo[96476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-93c46b04-ffc8-4e84-ada9-390c85ea3050 1073741824
Nov 03 18:30:55 devstack sudo[96476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:30:55 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-5e8810e0-020e-43dc-ad6a-236bf4b65724 tempest-CreateVolumesFromImageTest-190797813 None] Volume volume-6f6711aa-a5cb-448c-bd48-05c4a96c00b2 (6f6711aa-a5cb-448c-bd48-05c4a96c00b2): created successfully
Nov 03 18:30:55 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-5e8810e0-020e-43dc-ad6a-236bf4b65724 tempest-CreateVolumesFromImageTest-190797813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58d60c95-0dbf-41f8-b573-49f41d3ff028) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:30:55 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-5e8810e0-020e-43dc-ad6a-236bf4b65724 tempest-CreateVolumesFromImageTest-190797813 None] Flow 'volume_create_manager' (0a2db63f-3399-44fd-9afd-3dc75eb51032) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:30:55 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-5e8810e0-020e-43dc-ad6a-236bf4b65724 tempest-CreateVolumesFromImageTest-190797813 None] Created volume successfully.
Nov 03 18:30:55 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-aff73b67-11d6-49dc-8240-4ecd2460d414 tempest-CreateVolumesFromImageTest-190797813 None] Acquiring lock "cinder-6f6711aa-a5cb-448c-bd48-05c4a96c00b2-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:30:55 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-aff73b67-11d6-49dc-8240-4ecd2460d414 tempest-CreateVolumesFromImageTest-190797813 None] Lock "cinder-6f6711aa-a5cb-448c-bd48-05c4a96c00b2-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:30:55 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-aff73b67-11d6-49dc-8240-4ecd2460d414 tempest-CreateVolumesFromImageTest-190797813 None] Acquiring lock "cinder-quobyte-6f6711aa-a5cb-448c-bd48-05c4a96c00b2" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:30:55 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-aff73b67-11d6-49dc-8240-4ecd2460d414 tempest-CreateVolumesFromImageTest-190797813 None] Lock "cinder-quobyte-6f6711aa-a5cb-448c-bd48-05c4a96c00b2" acquired by "delete_volume" :: waited 0.041s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:30:55 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b4940e3-7bb7-41e1-9106-94685122c29f]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:30:55 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-aff73b67-11d6-49dc-8240-4ecd2460d414 tempest-CreateVolumesFromImageTest-190797813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6f6711aa-a5cb-448c-bd48-05c4a96c00b2 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:30:55 devstack sudo[96481]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6f6711aa-a5cb-448c-bd48-05c4a96c00b2
Nov 03 18:30:55 devstack sudo[96481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:30:56 devstack sudo[96476]: pam_unix(sudo:session): session closed for user root
Nov 03 18:30:56 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-d7b6f954-5c1c-43b7-83de-f960339d12b0 tempest-AttachVolumeTestJSON-374454512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-93c46b04-ffc8-4e84-ada9-390c85ea3050 1073741824" returned: 0 in 0.660s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:30:56 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-d7b6f954-5c1c-43b7-83de-f960339d12b0 tempest-AttachVolumeTestJSON-374454512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-93c46b04-ffc8-4e84-ada9-390c85ea3050 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:30:56 devstack sudo[96485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-93c46b04-ffc8-4e84-ada9-390c85ea3050
Nov 03 18:30:56 devstack sudo[96485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:30:56 devstack sudo[96481]: pam_unix(sudo:session): session closed for user root
Nov 03 18:30:56 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-aff73b67-11d6-49dc-8240-4ecd2460d414 tempest-CreateVolumesFromImageTest-190797813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6f6711aa-a5cb-448c-bd48-05c4a96c00b2" returned: 0 in 0.445s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:30:56 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-aff73b67-11d6-49dc-8240-4ecd2460d414 tempest-CreateVolumesFromImageTest-190797813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6f6711aa-a5cb-448c-bd48-05c4a96c00b2 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:30:56 devstack sudo[96489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6f6711aa-a5cb-448c-bd48-05c4a96c00b2
Nov 03 18:30:56 devstack sudo[96489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:30:56 devstack sudo[96485]: pam_unix(sudo:session): session closed for user root
Nov 03 18:30:56 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-d7b6f954-5c1c-43b7-83de-f960339d12b0 tempest-AttachVolumeTestJSON-374454512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-93c46b04-ffc8-4e84-ada9-390c85ea3050" returned: 0 in 0.319s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:30:56 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-d7b6f954-5c1c-43b7-83de-f960339d12b0 tempest-AttachVolumeTestJSON-374454512 None] <== create_volume: return (1042ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:30:56 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-d7b6f954-5c1c-43b7-83de-f960339d12b0 tempest-AttachVolumeTestJSON-374454512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.045s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:30:56 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-d70d8450-c374-43f8-be6f-f79fcf34b258 tempest-VolumesGetTest-1058646393 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.697s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:30:56 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-d70d8450-c374-43f8-be6f-f79fcf34b258 tempest-VolumesGetTest-1058646393 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:30:52Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-644198975',display_name='tempest-VolumesGetTest-Volume-835551845',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a681d563-38d6-4819-954d-52f4873fb935,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a2e9d719ed44e7d937af97c1006955b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:30:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:30:53Z,use_quota=True,user_id='9e6bb9b9d9e14369b45e0740337deeda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:30:56 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-d70d8450-c374-43f8-be6f-f79fcf34b258 tempest-VolumesGetTest-1058646393 None] Creating volume a681d563-38d6-4819-954d-52f4873fb935 {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:30:56 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-d70d8450-c374-43f8-be6f-f79fcf34b258 tempest-VolumesGetTest-1058646393 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:30:56 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-d70d8450-c374-43f8-be6f-f79fcf34b258 tempest-VolumesGetTest-1058646393 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:30:56 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-d70d8450-c374-43f8-be6f-f79fcf34b258 tempest-VolumesGetTest-1058646393 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:30:56 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-d70d8450-c374-43f8-be6f-f79fcf34b258 tempest-VolumesGetTest-1058646393 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:30:56 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-d70d8450-c374-43f8-be6f-f79fcf34b258 tempest-VolumesGetTest-1058646393 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:30:56 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-d70d8450-c374-43f8-be6f-f79fcf34b258 tempest-VolumesGetTest-1058646393 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:30:56 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-d70d8450-c374-43f8-be6f-f79fcf34b258 tempest-VolumesGetTest-1058646393 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:30:56 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-d70d8450-c374-43f8-be6f-f79fcf34b258 tempest-VolumesGetTest-1058646393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-a681d563-38d6-4819-954d-52f4873fb935 1073741824 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:30:56 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-d7b6f954-5c1c-43b7-83de-f960339d12b0 tempest-AttachVolumeTestJSON-374454512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (144eb1b7-8ad5-427b-8329-b1ceb3e80b78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93c46b04-ffc8-4e84-ada9-390c85ea3050', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:30:56 devstack sudo[96492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-a681d563-38d6-4819-954d-52f4873fb935 1073741824
Nov 03 18:30:56 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-d7b6f954-5c1c-43b7-83de-f960339d12b0 tempest-AttachVolumeTestJSON-374454512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (610e6e7d-8a1e-462d-a6e2-88780045caa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:30:56 devstack sudo[96492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:30:56 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-d7b6f954-5c1c-43b7-83de-f960339d12b0 tempest-AttachVolumeTestJSON-374454512 None] Volume volume-93c46b04-ffc8-4e84-ada9-390c85ea3050 (93c46b04-ffc8-4e84-ada9-390c85ea3050): created successfully
Nov 03 18:30:56 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-d7b6f954-5c1c-43b7-83de-f960339d12b0 tempest-AttachVolumeTestJSON-374454512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (610e6e7d-8a1e-462d-a6e2-88780045caa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:30:56 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-d7b6f954-5c1c-43b7-83de-f960339d12b0 tempest-AttachVolumeTestJSON-374454512 None] Flow 'volume_create_manager' (6b9db929-376d-4ff9-a14d-020f207e1133) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:30:56 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-d7b6f954-5c1c-43b7-83de-f960339d12b0 tempest-AttachVolumeTestJSON-374454512 None] Created volume successfully.
Nov 03 18:30:56 devstack sudo[96489]: pam_unix(sudo:session): session closed for user root
Nov 03 18:30:56 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-aff73b67-11d6-49dc-8240-4ecd2460d414 tempest-CreateVolumesFromImageTest-190797813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6f6711aa-a5cb-448c-bd48-05c4a96c00b2" returned: 0 in 0.361s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:30:56 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-aff73b67-11d6-49dc-8240-4ecd2460d414 tempest-CreateVolumesFromImageTest-190797813 None] Lock "cinder-quobyte-6f6711aa-a5cb-448c-bd48-05c4a96c00b2" released by "delete_volume" :: held 0.878s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:30:56 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-aff73b67-11d6-49dc-8240-4ecd2460d414 tempest-CreateVolumesFromImageTest-190797813 None] Created reservations ['26011fae-6e3c-4dcc-9a51-bfdf37d2ab99', '38f8f93e-eaf6-49bc-885e-bd67da5970a7', '03507930-ed2a-4625-bab9-17946280ce9e', '25668d86-2bdf-4140-93da-741c0751ce94'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:30:56 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-aff73b67-11d6-49dc-8240-4ecd2460d414 tempest-CreateVolumesFromImageTest-190797813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:30:56 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-aff73b67-11d6-49dc-8240-4ecd2460d414 tempest-CreateVolumesFromImageTest-190797813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:30:56 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-aff73b67-11d6-49dc-8240-4ecd2460d414 tempest-CreateVolumesFromImageTest-190797813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:30:56 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-aff73b67-11d6-49dc-8240-4ecd2460d414 tempest-CreateVolumesFromImageTest-190797813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:30:56 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-aff73b67-11d6-49dc-8240-4ecd2460d414 tempest-CreateVolumesFromImageTest-190797813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:30:56 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-aff73b67-11d6-49dc-8240-4ecd2460d414 tempest-CreateVolumesFromImageTest-190797813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:30:56 devstack sudo[96496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:30:56 devstack sudo[96496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:30:56 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-8049ef32-c216-458b-b7b0-c80958cae983 tempest-CreateVolumesFromImageTest-190797813 None] Acquiring lock "cinder-45869f08-07b0-4297-94bd-54fadc69dbb7-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:30:57 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-8049ef32-c216-458b-b7b0-c80958cae983 tempest-CreateVolumesFromImageTest-190797813 None] Lock "cinder-45869f08-07b0-4297-94bd-54fadc69dbb7-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:30:57 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-8049ef32-c216-458b-b7b0-c80958cae983 tempest-CreateVolumesFromImageTest-190797813 None] Acquiring lock "cinder-quobyte-45869f08-07b0-4297-94bd-54fadc69dbb7" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:30:57 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-8049ef32-c216-458b-b7b0-c80958cae983 tempest-CreateVolumesFromImageTest-190797813 None] Lock "cinder-quobyte-45869f08-07b0-4297-94bd-54fadc69dbb7" acquired by "delete_volume" :: waited 0.033s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:30:57 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[60df9b3d-a4bb-4a1f-aabd-26b06d69e8c8]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:30:57 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-8049ef32-c216-458b-b7b0-c80958cae983 tempest-CreateVolumesFromImageTest-190797813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-45869f08-07b0-4297-94bd-54fadc69dbb7 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:30:57 devstack sudo[96492]: pam_unix(sudo:session): session closed for user root
Nov 03 18:30:57 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-d70d8450-c374-43f8-be6f-f79fcf34b258 tempest-VolumesGetTest-1058646393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-a681d563-38d6-4819-954d-52f4873fb935 1073741824" returned: 0 in 0.820s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:30:57 devstack sudo[96496]: pam_unix(sudo:session): session closed for user root
Nov 03 18:30:57 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-aff73b67-11d6-49dc-8240-4ecd2460d414 tempest-CreateVolumesFromImageTest-190797813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.539s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:30:57 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-aff73b67-11d6-49dc-8240-4ecd2460d414 tempest-CreateVolumesFromImageTest-190797813 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:30:57 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-aff73b67-11d6-49dc-8240-4ecd2460d414 tempest-CreateVolumesFromImageTest-190797813 None] Deleted volume successfully.
Nov 03 18:30:57 devstack sudo[96505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-45869f08-07b0-4297-94bd-54fadc69dbb7
Nov 03 18:30:57 devstack sudo[96505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:30:57 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-aff73b67-11d6-49dc-8240-4ecd2460d414 tempest-CreateVolumesFromImageTest-190797813 None] Lock "cinder-6f6711aa-a5cb-448c-bd48-05c4a96c00b2-delete_volume" released by "delete_volume" :: held 1.712s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:30:57 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-d70d8450-c374-43f8-be6f-f79fcf34b258 tempest-VolumesGetTest-1058646393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-a681d563-38d6-4819-954d-52f4873fb935 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:30:57 devstack sudo[96507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-a681d563-38d6-4819-954d-52f4873fb935
Nov 03 18:30:57 devstack sudo[96507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:30:57 devstack sudo[96507]: pam_unix(sudo:session): session closed for user root
Nov 03 18:30:57 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-d70d8450-c374-43f8-be6f-f79fcf34b258 tempest-VolumesGetTest-1058646393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-a681d563-38d6-4819-954d-52f4873fb935" returned: 0 in 0.401s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:30:57 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-d70d8450-c374-43f8-be6f-f79fcf34b258 tempest-VolumesGetTest-1058646393 None] <== create_volume: return (1332ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:30:57 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-d70d8450-c374-43f8-be6f-f79fcf34b258 tempest-VolumesGetTest-1058646393 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.337s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:30:57 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-d70d8450-c374-43f8-be6f-f79fcf34b258 tempest-VolumesGetTest-1058646393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff1d51eb-b605-40cc-a1b6-f23871520b87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a681d563-38d6-4819-954d-52f4873fb935', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:30:57 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-d70d8450-c374-43f8-be6f-f79fcf34b258 tempest-VolumesGetTest-1058646393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce58190b-ca73-4db7-96e7-2d1573768ade) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:30:57 devstack sudo[96505]: pam_unix(sudo:session): session closed for user root
Nov 03 18:30:57 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-8049ef32-c216-458b-b7b0-c80958cae983 tempest-CreateVolumesFromImageTest-190797813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-45869f08-07b0-4297-94bd-54fadc69dbb7" returned: 0 in 0.656s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:30:57 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-8049ef32-c216-458b-b7b0-c80958cae983 tempest-CreateVolumesFromImageTest-190797813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-45869f08-07b0-4297-94bd-54fadc69dbb7 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:30:57 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-d70d8450-c374-43f8-be6f-f79fcf34b258 tempest-VolumesGetTest-1058646393 None] Volume volume-a681d563-38d6-4819-954d-52f4873fb935 (a681d563-38d6-4819-954d-52f4873fb935): created successfully
Nov 03 18:30:57 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-d70d8450-c374-43f8-be6f-f79fcf34b258 tempest-VolumesGetTest-1058646393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce58190b-ca73-4db7-96e7-2d1573768ade) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:30:57 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-d70d8450-c374-43f8-be6f-f79fcf34b258 tempest-VolumesGetTest-1058646393 None] Flow 'volume_create_manager' (0c406797-4129-4b8c-8584-fd689a822b42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:30:57 devstack sudo[96517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-45869f08-07b0-4297-94bd-54fadc69dbb7
Nov 03 18:30:57 devstack sudo[96517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:30:57 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-d70d8450-c374-43f8-be6f-f79fcf34b258 tempest-VolumesGetTest-1058646393 None] Created volume successfully.
Nov 03 18:30:58 devstack sudo[96517]: pam_unix(sudo:session): session closed for user root
Nov 03 18:30:58 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-8049ef32-c216-458b-b7b0-c80958cae983 tempest-CreateVolumesFromImageTest-190797813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-45869f08-07b0-4297-94bd-54fadc69dbb7" returned: 0 in 0.374s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:30:58 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-8049ef32-c216-458b-b7b0-c80958cae983 tempest-CreateVolumesFromImageTest-190797813 None] Lock "cinder-quobyte-45869f08-07b0-4297-94bd-54fadc69dbb7" released by "delete_volume" :: held 1.115s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:30:58 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-8049ef32-c216-458b-b7b0-c80958cae983 tempest-CreateVolumesFromImageTest-190797813 None] Created reservations ['9b5050b2-4e35-458b-9e86-b86db8fe4d9c', 'd978c975-4b0c-4e40-9e50-198a33acf437', 'cf4dc4a5-00f6-412c-bffd-933425bae527', '55d2fab0-0b0e-44f0-9a86-e3934b1e027d'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:30:58 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-197a2cf8-e6bf-48a2-b39c-2d2ff9fe1d9b tempest-VolumesGetTest-1058646393 None] Acquiring lock "cinder-a681d563-38d6-4819-954d-52f4873fb935-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:30:58 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-197a2cf8-e6bf-48a2-b39c-2d2ff9fe1d9b tempest-VolumesGetTest-1058646393 None] Lock "cinder-a681d563-38d6-4819-954d-52f4873fb935-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:30:58 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-8049ef32-c216-458b-b7b0-c80958cae983 tempest-CreateVolumesFromImageTest-190797813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:30:58 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-8049ef32-c216-458b-b7b0-c80958cae983 tempest-CreateVolumesFromImageTest-190797813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:30:58 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-8049ef32-c216-458b-b7b0-c80958cae983 tempest-CreateVolumesFromImageTest-190797813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:30:58 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-8049ef32-c216-458b-b7b0-c80958cae983 tempest-CreateVolumesFromImageTest-190797813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:30:58 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-8049ef32-c216-458b-b7b0-c80958cae983 tempest-CreateVolumesFromImageTest-190797813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:30:58 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-8049ef32-c216-458b-b7b0-c80958cae983 tempest-CreateVolumesFromImageTest-190797813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:30:58 devstack sudo[96528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:30:58 devstack sudo[96528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:30:58 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-197a2cf8-e6bf-48a2-b39c-2d2ff9fe1d9b tempest-VolumesGetTest-1058646393 None] Acquiring lock "cinder-quobyte-a681d563-38d6-4819-954d-52f4873fb935" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:30:58 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-197a2cf8-e6bf-48a2-b39c-2d2ff9fe1d9b tempest-VolumesGetTest-1058646393 None] Lock "cinder-quobyte-a681d563-38d6-4819-954d-52f4873fb935" acquired by "delete_volume" :: waited 0.031s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:30:58 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[11b6c227-f148-4876-be24-5654cf1e497e]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:30:58 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-197a2cf8-e6bf-48a2-b39c-2d2ff9fe1d9b tempest-VolumesGetTest-1058646393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-a681d563-38d6-4819-954d-52f4873fb935 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:30:58 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [req-5e84bb7e-2936-418e-9757-6561df5680bb req-58eeb4ca-1190-4c2c-a33c-0dea86ddb895 tempest-AttachVolumeTestJSON-374454512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:30:58 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [req-5e84bb7e-2936-418e-9757-6561df5680bb req-58eeb4ca-1190-4c2c-a33c-0dea86ddb895 tempest-AttachVolumeTestJSON-374454512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:30:58 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [req-5e84bb7e-2936-418e-9757-6561df5680bb req-58eeb4ca-1190-4c2c-a33c-0dea86ddb895 tempest-AttachVolumeTestJSON-374454512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:30:58 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [req-5e84bb7e-2936-418e-9757-6561df5680bb req-58eeb4ca-1190-4c2c-a33c-0dea86ddb895 tempest-AttachVolumeTestJSON-374454512 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c', 'name': 'volume-93c46b04-ffc8-4e84-ada9-390c85ea3050', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '557d6759-435d-4d45-8c57-f2e0f057455e', 'enforce_multipath': True} {{(pid=86120) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 03 18:30:58 devstack sudo[96530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-a681d563-38d6-4819-954d-52f4873fb935
Nov 03 18:30:58 devstack sudo[96530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:30:58 devstack cinder-volume[86120]: INFO cinder.volume.manager [req-5e84bb7e-2936-418e-9757-6561df5680bb req-58eeb4ca-1190-4c2c-a33c-0dea86ddb895 tempest-AttachVolumeTestJSON-374454512 None] attachment_update completed successfully.
Nov 03 18:30:58 devstack sudo[96528]: pam_unix(sudo:session): session closed for user root
Nov 03 18:30:58 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-8049ef32-c216-458b-b7b0-c80958cae983 tempest-CreateVolumesFromImageTest-190797813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.332s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:30:58 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-8049ef32-c216-458b-b7b0-c80958cae983 tempest-CreateVolumesFromImageTest-190797813 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:30:58 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-8049ef32-c216-458b-b7b0-c80958cae983 tempest-CreateVolumesFromImageTest-190797813 None] Deleted volume successfully.
Nov 03 18:30:58 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-8049ef32-c216-458b-b7b0-c80958cae983 tempest-CreateVolumesFromImageTest-190797813 None] Lock "cinder-45869f08-07b0-4297-94bd-54fadc69dbb7-delete_volume" released by "delete_volume" :: held 1.900s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:30:59 devstack sudo[96530]: pam_unix(sudo:session): session closed for user root
Nov 03 18:30:59 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-197a2cf8-e6bf-48a2-b39c-2d2ff9fe1d9b tempest-VolumesGetTest-1058646393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-a681d563-38d6-4819-954d-52f4873fb935" returned: 0 in 0.503s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:30:59 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-197a2cf8-e6bf-48a2-b39c-2d2ff9fe1d9b tempest-VolumesGetTest-1058646393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-a681d563-38d6-4819-954d-52f4873fb935 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:30:59 devstack sudo[96638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-a681d563-38d6-4819-954d-52f4873fb935
Nov 03 18:30:59 devstack sudo[96638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:30:59 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-1cbba4c5-d8e1-4ca7-a2ea-c68a795c067f tempest-CreateVolumesFromImageTest-190797813 None] Acquiring lock "cinder-4a30f5bf-1081-4b27-8343-a5bda4c4fe0e-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:30:59 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-1cbba4c5-d8e1-4ca7-a2ea-c68a795c067f tempest-CreateVolumesFromImageTest-190797813 None] Lock "cinder-4a30f5bf-1081-4b27-8343-a5bda4c4fe0e-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:30:59 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-1cbba4c5-d8e1-4ca7-a2ea-c68a795c067f tempest-CreateVolumesFromImageTest-190797813 None] Acquiring lock "cinder-quobyte-4a30f5bf-1081-4b27-8343-a5bda4c4fe0e" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:30:59 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-1cbba4c5-d8e1-4ca7-a2ea-c68a795c067f tempest-CreateVolumesFromImageTest-190797813 None] Lock "cinder-quobyte-4a30f5bf-1081-4b27-8343-a5bda4c4fe0e" acquired by "delete_volume" :: waited 0.023s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:30:59 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[0faeac17-47f3-412c-87be-67504b89e895]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:30:59 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-1cbba4c5-d8e1-4ca7-a2ea-c68a795c067f tempest-CreateVolumesFromImageTest-190797813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-4a30f5bf-1081-4b27-8343-a5bda4c4fe0e {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:30:59 devstack sudo[96638]: pam_unix(sudo:session): session closed for user root
Nov 03 18:30:59 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-197a2cf8-e6bf-48a2-b39c-2d2ff9fe1d9b tempest-VolumesGetTest-1058646393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-a681d563-38d6-4819-954d-52f4873fb935" returned: 0 in 0.524s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:30:59 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-197a2cf8-e6bf-48a2-b39c-2d2ff9fe1d9b tempest-VolumesGetTest-1058646393 None] Lock "cinder-quobyte-a681d563-38d6-4819-954d-52f4873fb935" released by "delete_volume" :: held 1.092s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:30:59 devstack sudo[96955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-4a30f5bf-1081-4b27-8343-a5bda4c4fe0e
Nov 03 18:30:59 devstack sudo[96955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:30:59 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-197a2cf8-e6bf-48a2-b39c-2d2ff9fe1d9b tempest-VolumesGetTest-1058646393 None] Created reservations ['b1698429-3a34-4078-ab34-cffeaa9c7d51', 'da2ca9ce-ccbe-4b0a-a5dd-0c44f57c1b5a', 'aecfbcd1-c7fd-42c0-9dc9-e0e246bd41f8', 'bd6c8513-67f6-4f7f-a4a7-92af45b330b6'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:30:59 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-197a2cf8-e6bf-48a2-b39c-2d2ff9fe1d9b tempest-VolumesGetTest-1058646393 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:30:59 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-197a2cf8-e6bf-48a2-b39c-2d2ff9fe1d9b tempest-VolumesGetTest-1058646393 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:30:59 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-197a2cf8-e6bf-48a2-b39c-2d2ff9fe1d9b tempest-VolumesGetTest-1058646393 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:30:59 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-197a2cf8-e6bf-48a2-b39c-2d2ff9fe1d9b tempest-VolumesGetTest-1058646393 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:30:59 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-197a2cf8-e6bf-48a2-b39c-2d2ff9fe1d9b tempest-VolumesGetTest-1058646393 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:30:59 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-197a2cf8-e6bf-48a2-b39c-2d2ff9fe1d9b tempest-VolumesGetTest-1058646393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:30:59 devstack sudo[96957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:30:59 devstack sudo[96957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:31:00 devstack sudo[96955]: pam_unix(sudo:session): session closed for user root
Nov 03 18:31:00 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-1cbba4c5-d8e1-4ca7-a2ea-c68a795c067f tempest-CreateVolumesFromImageTest-190797813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-4a30f5bf-1081-4b27-8343-a5bda4c4fe0e" returned: 0 in 0.477s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:31:00 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-1cbba4c5-d8e1-4ca7-a2ea-c68a795c067f tempest-CreateVolumesFromImageTest-190797813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-4a30f5bf-1081-4b27-8343-a5bda4c4fe0e {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:31:00 devstack sudo[96962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-4a30f5bf-1081-4b27-8343-a5bda4c4fe0e
Nov 03 18:31:00 devstack sudo[96962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:31:00 devstack sudo[96957]: pam_unix(sudo:session): session closed for user root
Nov 03 18:31:00 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-197a2cf8-e6bf-48a2-b39c-2d2ff9fe1d9b tempest-VolumesGetTest-1058646393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.311s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:31:00 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-197a2cf8-e6bf-48a2-b39c-2d2ff9fe1d9b tempest-VolumesGetTest-1058646393 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:31:00 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-197a2cf8-e6bf-48a2-b39c-2d2ff9fe1d9b tempest-VolumesGetTest-1058646393 None] Deleted volume successfully.
Nov 03 18:31:00 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-197a2cf8-e6bf-48a2-b39c-2d2ff9fe1d9b tempest-VolumesGetTest-1058646393 None] Lock "cinder-a681d563-38d6-4819-954d-52f4873fb935-delete_volume" released by "delete_volume" :: held 1.772s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:31:00 devstack sudo[96962]: pam_unix(sudo:session): session closed for user root
Nov 03 18:31:00 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-1cbba4c5-d8e1-4ca7-a2ea-c68a795c067f tempest-CreateVolumesFromImageTest-190797813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-4a30f5bf-1081-4b27-8343-a5bda4c4fe0e" returned: 0 in 0.363s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:31:00 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-1cbba4c5-d8e1-4ca7-a2ea-c68a795c067f tempest-CreateVolumesFromImageTest-190797813 None] Lock "cinder-quobyte-4a30f5bf-1081-4b27-8343-a5bda4c4fe0e" released by "delete_volume" :: held 0.955s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:31:00 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-1cbba4c5-d8e1-4ca7-a2ea-c68a795c067f tempest-CreateVolumesFromImageTest-190797813 None] Created reservations ['df1afdc1-9d3f-474e-8b23-ac49075128bd', '561f67b4-8600-4e03-8a5d-2afe3edaddbf', '83e23a02-d53e-4e2a-a070-e9ff1b135827', '33c5269a-440d-42f8-8ec8-6d5bbf9ff37f'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:31:00 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-1cbba4c5-d8e1-4ca7-a2ea-c68a795c067f tempest-CreateVolumesFromImageTest-190797813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:31:00 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-1cbba4c5-d8e1-4ca7-a2ea-c68a795c067f tempest-CreateVolumesFromImageTest-190797813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:31:00 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-1cbba4c5-d8e1-4ca7-a2ea-c68a795c067f tempest-CreateVolumesFromImageTest-190797813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:31:00 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-1cbba4c5-d8e1-4ca7-a2ea-c68a795c067f tempest-CreateVolumesFromImageTest-190797813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:31:00 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-1cbba4c5-d8e1-4ca7-a2ea-c68a795c067f tempest-CreateVolumesFromImageTest-190797813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:31:00 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-1cbba4c5-d8e1-4ca7-a2ea-c68a795c067f tempest-CreateVolumesFromImageTest-190797813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:31:00 devstack sudo[96966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:31:00 devstack sudo[96966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:31:00 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-635f4205-7444-49be-a568-2dec87b4d364 tempest-VolumesGetTest-1058646393 None] Acquiring lock "cinder-00a2ede0-dbf8-42e9-8955-f3df683e2eb0-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:31:00 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-635f4205-7444-49be-a568-2dec87b4d364 tempest-VolumesGetTest-1058646393 None] Lock "cinder-00a2ede0-dbf8-42e9-8955-f3df683e2eb0-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:31:01 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-635f4205-7444-49be-a568-2dec87b4d364 tempest-VolumesGetTest-1058646393 None] Acquiring lock "cinder-quobyte-00a2ede0-dbf8-42e9-8955-f3df683e2eb0" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:31:01 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-635f4205-7444-49be-a568-2dec87b4d364 tempest-VolumesGetTest-1058646393 None] Lock "cinder-quobyte-00a2ede0-dbf8-42e9-8955-f3df683e2eb0" acquired by "delete_volume" :: waited 0.036s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:31:01 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[43c9f186-b94e-49c9-9ff9-4b4ef3fa8e76]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:31:01 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-635f4205-7444-49be-a568-2dec87b4d364 tempest-VolumesGetTest-1058646393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-00a2ede0-dbf8-42e9-8955-f3df683e2eb0 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:31:01 devstack sudo[96966]: pam_unix(sudo:session): session closed for user root
Nov 03 18:31:01 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-1cbba4c5-d8e1-4ca7-a2ea-c68a795c067f tempest-CreateVolumesFromImageTest-190797813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.448s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:31:01 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-1cbba4c5-d8e1-4ca7-a2ea-c68a795c067f tempest-CreateVolumesFromImageTest-190797813 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:31:01 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-1cbba4c5-d8e1-4ca7-a2ea-c68a795c067f tempest-CreateVolumesFromImageTest-190797813 None] Deleted volume successfully.
Nov 03 18:31:01 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-1cbba4c5-d8e1-4ca7-a2ea-c68a795c067f tempest-CreateVolumesFromImageTest-190797813 None] Lock "cinder-4a30f5bf-1081-4b27-8343-a5bda4c4fe0e-delete_volume" released by "delete_volume" :: held 1.871s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:31:01 devstack sudo[96968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-00a2ede0-dbf8-42e9-8955-f3df683e2eb0
Nov 03 18:31:01 devstack sudo[96968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:31:01 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-8fe7bba4-ba38-493c-9c13-4ae0751571f7 tempest-AttachVolumeTestJSON-374454512 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:31:01 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-8fe7bba4-ba38-493c-9c13-4ae0751571f7 tempest-AttachVolumeTestJSON-374454512 None] Flow 'volume_create_manager' (bd480a27-0b5f-46e6-b833-abe276ccde24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:31:01 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-8fe7bba4-ba38-493c-9c13-4ae0751571f7 tempest-AttachVolumeTestJSON-374454512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3636efdc-015d-4074-9573-74adf57a26ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:31:01 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-8fe7bba4-ba38-493c-9c13-4ae0751571f7 tempest-AttachVolumeTestJSON-374454512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3636efdc-015d-4074-9573-74adf57a26ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:31:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-540472494',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=709bd24e-e131-4a9c-91c7-fd2b7327dcb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44080038429342c1b6a06a1c04699704',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:31:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:31:01Z,use_quota=True,user_id='84f64ec5568f4c32a950eaaaf709123b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:31:01 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-8fe7bba4-ba38-493c-9c13-4ae0751571f7 tempest-AttachVolumeTestJSON-374454512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b18f8b11-3e60-4f3a-adf6-453047106e75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:31:01 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-8fe7bba4-ba38-493c-9c13-4ae0751571f7 tempest-AttachVolumeTestJSON-374454512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b18f8b11-3e60-4f3a-adf6-453047106e75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:31:01 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-8fe7bba4-ba38-493c-9c13-4ae0751571f7 tempest-AttachVolumeTestJSON-374454512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0bbe609-085e-43f2-bbcf-3e8c0699c136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:31:01 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-8fe7bba4-ba38-493c-9c13-4ae0751571f7 tempest-AttachVolumeTestJSON-374454512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0bbe609-085e-43f2-bbcf-3e8c0699c136) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '709bd24e-e131-4a9c-91c7-fd2b7327dcb5', 'volume_name': 'volume-709bd24e-e131-4a9c-91c7-fd2b7327dcb5', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:31:01 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-8fe7bba4-ba38-493c-9c13-4ae0751571f7 tempest-AttachVolumeTestJSON-374454512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee78d6bb-12ca-4fa1-b908-979684bb482e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:31:01 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-8fe7bba4-ba38-493c-9c13-4ae0751571f7 tempest-AttachVolumeTestJSON-374454512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee78d6bb-12ca-4fa1-b908-979684bb482e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:31:01 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-8fe7bba4-ba38-493c-9c13-4ae0751571f7 tempest-AttachVolumeTestJSON-374454512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (377551f0-9711-4925-8ad0-ac950a361c2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:31:01 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-8fe7bba4-ba38-493c-9c13-4ae0751571f7 tempest-AttachVolumeTestJSON-374454512 None] Volume 709bd24e-e131-4a9c-91c7-fd2b7327dcb5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-709bd24e-e131-4a9c-91c7-fd2b7327dcb5', 'volume_size': 1}
Nov 03 18:31:01 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-8fe7bba4-ba38-493c-9c13-4ae0751571f7 tempest-AttachVolumeTestJSON-374454512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:31:01 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-8fe7bba4-ba38-493c-9c13-4ae0751571f7 tempest-AttachVolumeTestJSON-374454512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:31:01 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-8fe7bba4-ba38-493c-9c13-4ae0751571f7 tempest-AttachVolumeTestJSON-374454512 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:31:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-540472494',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=709bd24e-e131-4a9c-91c7-fd2b7327dcb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44080038429342c1b6a06a1c04699704',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:31:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:31:01Z,use_quota=True,user_id='84f64ec5568f4c32a950eaaaf709123b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:31:01 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-8fe7bba4-ba38-493c-9c13-4ae0751571f7 tempest-AttachVolumeTestJSON-374454512 None] Creating volume 709bd24e-e131-4a9c-91c7-fd2b7327dcb5 {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:31:01 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-8fe7bba4-ba38-493c-9c13-4ae0751571f7 tempest-AttachVolumeTestJSON-374454512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:31:01 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-8fe7bba4-ba38-493c-9c13-4ae0751571f7 tempest-AttachVolumeTestJSON-374454512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:31:01 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-8fe7bba4-ba38-493c-9c13-4ae0751571f7 tempest-AttachVolumeTestJSON-374454512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:31:01 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-8fe7bba4-ba38-493c-9c13-4ae0751571f7 tempest-AttachVolumeTestJSON-374454512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:31:01 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-8fe7bba4-ba38-493c-9c13-4ae0751571f7 tempest-AttachVolumeTestJSON-374454512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:31:01 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-8fe7bba4-ba38-493c-9c13-4ae0751571f7 tempest-AttachVolumeTestJSON-374454512 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:31:01 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-8fe7bba4-ba38-493c-9c13-4ae0751571f7 tempest-AttachVolumeTestJSON-374454512 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:31:01 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-8fe7bba4-ba38-493c-9c13-4ae0751571f7 tempest-AttachVolumeTestJSON-374454512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-709bd24e-e131-4a9c-91c7-fd2b7327dcb5 1073741824 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:31:01 devstack sudo[96974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-709bd24e-e131-4a9c-91c7-fd2b7327dcb5 1073741824
Nov 03 18:31:01 devstack sudo[96974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:31:01 devstack sudo[96968]: pam_unix(sudo:session): session closed for user root
Nov 03 18:31:01 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-635f4205-7444-49be-a568-2dec87b4d364 tempest-VolumesGetTest-1058646393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-00a2ede0-dbf8-42e9-8955-f3df683e2eb0" returned: 0 in 0.519s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:31:01 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-635f4205-7444-49be-a568-2dec87b4d364 tempest-VolumesGetTest-1058646393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-00a2ede0-dbf8-42e9-8955-f3df683e2eb0 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:31:01 devstack sudo[96976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-00a2ede0-dbf8-42e9-8955-f3df683e2eb0
Nov 03 18:31:01 devstack sudo[96976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:31:01 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-35f50c44-8b4f-4736-97b5-db3c361ae2fb tempest-CreateVolumesFromImageTest-190797813 None] Acquiring lock "cinder-ae6dd2eb-5de3-44a6-b3ba-7b577553a3b3-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:31:01 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-35f50c44-8b4f-4736-97b5-db3c361ae2fb tempest-CreateVolumesFromImageTest-190797813 None] Lock "cinder-ae6dd2eb-5de3-44a6-b3ba-7b577553a3b3-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:31:01 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-35f50c44-8b4f-4736-97b5-db3c361ae2fb tempest-CreateVolumesFromImageTest-190797813 None] Acquiring lock "cinder-quobyte-ae6dd2eb-5de3-44a6-b3ba-7b577553a3b3" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:31:01 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-35f50c44-8b4f-4736-97b5-db3c361ae2fb tempest-CreateVolumesFromImageTest-190797813 None] Lock "cinder-quobyte-ae6dd2eb-5de3-44a6-b3ba-7b577553a3b3" acquired by "delete_volume" :: waited 0.018s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:31:01 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[6befdd61-da9b-4b1e-a6ad-2723e9b0f732]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:31:01 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-35f50c44-8b4f-4736-97b5-db3c361ae2fb tempest-CreateVolumesFromImageTest-190797813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ae6dd2eb-5de3-44a6-b3ba-7b577553a3b3 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:31:01 devstack sudo[96978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ae6dd2eb-5de3-44a6-b3ba-7b577553a3b3
Nov 03 18:31:01 devstack sudo[96978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:31:01 devstack sudo[96976]: pam_unix(sudo:session): session closed for user root
Nov 03 18:31:01 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-635f4205-7444-49be-a568-2dec87b4d364 tempest-VolumesGetTest-1058646393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-00a2ede0-dbf8-42e9-8955-f3df683e2eb0" returned: 0 in 0.331s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:31:01 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-635f4205-7444-49be-a568-2dec87b4d364 tempest-VolumesGetTest-1058646393 None] Lock "cinder-quobyte-00a2ede0-dbf8-42e9-8955-f3df683e2eb0" released by "delete_volume" :: held 0.917s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:31:02 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-635f4205-7444-49be-a568-2dec87b4d364 tempest-VolumesGetTest-1058646393 None] Created reservations ['9e2c0211-17a0-42f4-b1f8-8eda03ef261c', 'eb3f59a3-1350-441b-8501-779506b6fc6a', '7e158b12-85c4-4ce6-bebb-d232dc54820f', '1b36e76e-113f-4ee4-8ddf-a28694886daf'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:31:02 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-635f4205-7444-49be-a568-2dec87b4d364 tempest-VolumesGetTest-1058646393 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:31:02 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-635f4205-7444-49be-a568-2dec87b4d364 tempest-VolumesGetTest-1058646393 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:31:02 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-635f4205-7444-49be-a568-2dec87b4d364 tempest-VolumesGetTest-1058646393 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:31:02 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-635f4205-7444-49be-a568-2dec87b4d364 tempest-VolumesGetTest-1058646393 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:31:02 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-635f4205-7444-49be-a568-2dec87b4d364 tempest-VolumesGetTest-1058646393 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:31:02 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-635f4205-7444-49be-a568-2dec87b4d364 tempest-VolumesGetTest-1058646393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:31:02 devstack sudo[96974]: pam_unix(sudo:session): session closed for user root
Nov 03 18:31:02 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-8fe7bba4-ba38-493c-9c13-4ae0751571f7 tempest-AttachVolumeTestJSON-374454512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-709bd24e-e131-4a9c-91c7-fd2b7327dcb5 1073741824" returned: 0 in 0.633s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:31:02 devstack sudo[96988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:31:02 devstack sudo[96988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:31:02 devstack sudo[96978]: pam_unix(sudo:session): session closed for user root
Nov 03 18:31:02 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-35f50c44-8b4f-4736-97b5-db3c361ae2fb tempest-CreateVolumesFromImageTest-190797813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ae6dd2eb-5de3-44a6-b3ba-7b577553a3b3" returned: 0 in 0.465s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:31:02 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-35f50c44-8b4f-4736-97b5-db3c361ae2fb tempest-CreateVolumesFromImageTest-190797813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ae6dd2eb-5de3-44a6-b3ba-7b577553a3b3 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:31:02 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-8fe7bba4-ba38-493c-9c13-4ae0751571f7 tempest-AttachVolumeTestJSON-374454512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-709bd24e-e131-4a9c-91c7-fd2b7327dcb5 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:31:02 devstack sudo[96990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ae6dd2eb-5de3-44a6-b3ba-7b577553a3b3
Nov 03 18:31:02 devstack sudo[96990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:31:02 devstack sudo[96992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-709bd24e-e131-4a9c-91c7-fd2b7327dcb5
Nov 03 18:31:02 devstack sudo[96992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:31:02 devstack sudo[96990]: pam_unix(sudo:session): session closed for user root
Nov 03 18:31:02 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-35f50c44-8b4f-4736-97b5-db3c361ae2fb tempest-CreateVolumesFromImageTest-190797813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ae6dd2eb-5de3-44a6-b3ba-7b577553a3b3" returned: 0 in 0.297s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:31:02 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-35f50c44-8b4f-4736-97b5-db3c361ae2fb tempest-CreateVolumesFromImageTest-190797813 None] Lock "cinder-quobyte-ae6dd2eb-5de3-44a6-b3ba-7b577553a3b3" released by "delete_volume" :: held 0.826s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:31:02 devstack sudo[96988]: pam_unix(sudo:session): session closed for user root
Nov 03 18:31:02 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-635f4205-7444-49be-a568-2dec87b4d364 tempest-VolumesGetTest-1058646393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.407s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:31:02 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-635f4205-7444-49be-a568-2dec87b4d364 tempest-VolumesGetTest-1058646393 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:31:02 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-635f4205-7444-49be-a568-2dec87b4d364 tempest-VolumesGetTest-1058646393 None] Deleted volume successfully.
Nov 03 18:31:02 devstack sudo[96992]: pam_unix(sudo:session): session closed for user root
Nov 03 18:31:02 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-8fe7bba4-ba38-493c-9c13-4ae0751571f7 tempest-AttachVolumeTestJSON-374454512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-709bd24e-e131-4a9c-91c7-fd2b7327dcb5" returned: 0 in 0.369s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:31:02 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-8fe7bba4-ba38-493c-9c13-4ae0751571f7 tempest-AttachVolumeTestJSON-374454512 None] <== create_volume: return (1079ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:31:02 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-8fe7bba4-ba38-493c-9c13-4ae0751571f7 tempest-AttachVolumeTestJSON-374454512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.083s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:31:02 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-635f4205-7444-49be-a568-2dec87b4d364 tempest-VolumesGetTest-1058646393 None] Lock "cinder-00a2ede0-dbf8-42e9-8955-f3df683e2eb0-delete_volume" released by "delete_volume" :: held 1.684s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:31:02 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-35f50c44-8b4f-4736-97b5-db3c361ae2fb tempest-CreateVolumesFromImageTest-190797813 None] Created reservations ['3e87e359-5cbe-47a8-8eaa-ceefd6c1dd82', 'adbd3dbd-7497-4a3f-8071-52f340ccd0ec', 'ef642bf2-bf83-43cb-9aa4-d85162ec69a7', '12003898-75a2-4dc7-8090-fa85e2f0c6ab'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:31:02 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-8fe7bba4-ba38-493c-9c13-4ae0751571f7 tempest-AttachVolumeTestJSON-374454512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (377551f0-9711-4925-8ad0-ac950a361c2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-709bd24e-e131-4a9c-91c7-fd2b7327dcb5', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:31:02 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-8fe7bba4-ba38-493c-9c13-4ae0751571f7 tempest-AttachVolumeTestJSON-374454512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba914561-d5c5-4808-bdf2-4e139e05313f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:31:02 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-8fe7bba4-ba38-493c-9c13-4ae0751571f7 tempest-AttachVolumeTestJSON-374454512 None] Volume volume-709bd24e-e131-4a9c-91c7-fd2b7327dcb5 (709bd24e-e131-4a9c-91c7-fd2b7327dcb5): created successfully
Nov 03 18:31:02 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-8fe7bba4-ba38-493c-9c13-4ae0751571f7 tempest-AttachVolumeTestJSON-374454512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba914561-d5c5-4808-bdf2-4e139e05313f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:31:02 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-8fe7bba4-ba38-493c-9c13-4ae0751571f7 tempest-AttachVolumeTestJSON-374454512 None] Flow 'volume_create_manager' (bd480a27-0b5f-46e6-b833-abe276ccde24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:31:02 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-8fe7bba4-ba38-493c-9c13-4ae0751571f7 tempest-AttachVolumeTestJSON-374454512 None] Created volume successfully.
Nov 03 18:31:02 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-35f50c44-8b4f-4736-97b5-db3c361ae2fb tempest-CreateVolumesFromImageTest-190797813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:31:02 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-35f50c44-8b4f-4736-97b5-db3c361ae2fb tempest-CreateVolumesFromImageTest-190797813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:31:02 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-35f50c44-8b4f-4736-97b5-db3c361ae2fb tempest-CreateVolumesFromImageTest-190797813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:31:02 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-35f50c44-8b4f-4736-97b5-db3c361ae2fb tempest-CreateVolumesFromImageTest-190797813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:31:02 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-35f50c44-8b4f-4736-97b5-db3c361ae2fb tempest-CreateVolumesFromImageTest-190797813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:31:02 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-35f50c44-8b4f-4736-97b5-db3c361ae2fb tempest-CreateVolumesFromImageTest-190797813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:31:02 devstack sudo[96997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:31:02 devstack sudo[96997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:31:02 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-4990144d-5e76-4ce1-aa5c-27bd904827db tempest-CreateVolumesFromImageTest-190797813 None] Acquiring lock "cinder-7d8b58be-7eff-4fcd-9758-8e850cb34708-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:31:02 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-4990144d-5e76-4ce1-aa5c-27bd904827db tempest-CreateVolumesFromImageTest-190797813 None] Lock "cinder-7d8b58be-7eff-4fcd-9758-8e850cb34708-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:31:02 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-4990144d-5e76-4ce1-aa5c-27bd904827db tempest-CreateVolumesFromImageTest-190797813 None] Acquiring lock "cinder-quobyte-7d8b58be-7eff-4fcd-9758-8e850cb34708" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:31:02 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-4990144d-5e76-4ce1-aa5c-27bd904827db tempest-CreateVolumesFromImageTest-190797813 None] Lock "cinder-quobyte-7d8b58be-7eff-4fcd-9758-8e850cb34708" acquired by "delete_volume" :: waited 0.022s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:31:02 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c476655-6ecd-47f6-88ca-cac166e291be]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:31:02 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-4990144d-5e76-4ce1-aa5c-27bd904827db tempest-CreateVolumesFromImageTest-190797813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-7d8b58be-7eff-4fcd-9758-8e850cb34708 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:31:03 devstack sudo[96999]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-7d8b58be-7eff-4fcd-9758-8e850cb34708
Nov 03 18:31:03 devstack sudo[96997]: pam_unix(sudo:session): session closed for user root
Nov 03 18:31:03 devstack sudo[96999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:31:03 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-35f50c44-8b4f-4736-97b5-db3c361ae2fb tempest-CreateVolumesFromImageTest-190797813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.354s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:31:03 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-35f50c44-8b4f-4736-97b5-db3c361ae2fb tempest-CreateVolumesFromImageTest-190797813 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:31:03 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-35f50c44-8b4f-4736-97b5-db3c361ae2fb tempest-CreateVolumesFromImageTest-190797813 None] Deleted volume successfully.
Nov 03 18:31:03 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-35f50c44-8b4f-4736-97b5-db3c361ae2fb tempest-CreateVolumesFromImageTest-190797813 None] Lock "cinder-ae6dd2eb-5de3-44a6-b3ba-7b577553a3b3-delete_volume" released by "delete_volume" :: held 1.473s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:31:03 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-57502b75-8283-43fd-a40a-34ed20f2f60c tempest-VolumesGetTest-1058646393 None] Acquiring lock "cinder-98e1a1d1-0a16-432c-99dc-fea6b55236dd-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:31:03 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-57502b75-8283-43fd-a40a-34ed20f2f60c tempest-VolumesGetTest-1058646393 None] Lock "cinder-98e1a1d1-0a16-432c-99dc-fea6b55236dd-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:31:03 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-57502b75-8283-43fd-a40a-34ed20f2f60c tempest-VolumesGetTest-1058646393 None] Acquiring lock "cinder-quobyte-98e1a1d1-0a16-432c-99dc-fea6b55236dd" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:31:03 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-57502b75-8283-43fd-a40a-34ed20f2f60c tempest-VolumesGetTest-1058646393 None] Lock "cinder-quobyte-98e1a1d1-0a16-432c-99dc-fea6b55236dd" acquired by "delete_volume" :: waited 0.038s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:31:03 devstack sudo[96999]: pam_unix(sudo:session): session closed for user root
Nov 03 18:31:03 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-4990144d-5e76-4ce1-aa5c-27bd904827db tempest-CreateVolumesFromImageTest-190797813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-7d8b58be-7eff-4fcd-9758-8e850cb34708" returned: 0 in 0.529s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:31:03 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-4990144d-5e76-4ce1-aa5c-27bd904827db tempest-CreateVolumesFromImageTest-190797813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-7d8b58be-7eff-4fcd-9758-8e850cb34708 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:31:03 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[364f6bd3-d9b1-4ffa-aee8-d7f86aabe4b7]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:31:03 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-57502b75-8283-43fd-a40a-34ed20f2f60c tempest-VolumesGetTest-1058646393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-98e1a1d1-0a16-432c-99dc-fea6b55236dd {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:31:03 devstack sudo[97005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-7d8b58be-7eff-4fcd-9758-8e850cb34708
Nov 03 18:31:03 devstack sudo[97005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:31:03 devstack sudo[97006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-98e1a1d1-0a16-432c-99dc-fea6b55236dd
Nov 03 18:31:03 devstack sudo[97006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:31:03 devstack sudo[97005]: pam_unix(sudo:session): session closed for user root
Nov 03 18:31:03 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-4990144d-5e76-4ce1-aa5c-27bd904827db tempest-CreateVolumesFromImageTest-190797813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-7d8b58be-7eff-4fcd-9758-8e850cb34708" returned: 0 in 0.311s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:31:03 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-4990144d-5e76-4ce1-aa5c-27bd904827db tempest-CreateVolumesFromImageTest-190797813 None] Lock "cinder-quobyte-7d8b58be-7eff-4fcd-9758-8e850cb34708" released by "delete_volume" :: held 0.905s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:31:03 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-4990144d-5e76-4ce1-aa5c-27bd904827db tempest-CreateVolumesFromImageTest-190797813 None] Created reservations ['a8c36076-7f31-4f33-b68f-f13bc2fe23c9', '9ba07ac8-8b21-4c1c-abfe-9854e903edbe', '1305b340-eed3-4be1-906b-587c40446931', '9182443e-595e-41cf-b787-1e6cf45f4e86'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:31:04 devstack sudo[97006]: pam_unix(sudo:session): session closed for user root
Nov 03 18:31:04 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-57502b75-8283-43fd-a40a-34ed20f2f60c tempest-VolumesGetTest-1058646393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-98e1a1d1-0a16-432c-99dc-fea6b55236dd" returned: 0 in 0.499s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:31:04 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-57502b75-8283-43fd-a40a-34ed20f2f60c tempest-VolumesGetTest-1058646393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-98e1a1d1-0a16-432c-99dc-fea6b55236dd {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:31:04 devstack sudo[97016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-98e1a1d1-0a16-432c-99dc-fea6b55236dd
Nov 03 18:31:04 devstack sudo[97016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:31:04 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-4990144d-5e76-4ce1-aa5c-27bd904827db tempest-CreateVolumesFromImageTest-190797813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:31:04 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-4990144d-5e76-4ce1-aa5c-27bd904827db tempest-CreateVolumesFromImageTest-190797813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:31:04 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-4990144d-5e76-4ce1-aa5c-27bd904827db tempest-CreateVolumesFromImageTest-190797813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:31:04 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-4990144d-5e76-4ce1-aa5c-27bd904827db tempest-CreateVolumesFromImageTest-190797813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:31:04 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-4990144d-5e76-4ce1-aa5c-27bd904827db tempest-CreateVolumesFromImageTest-190797813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:31:04 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-4990144d-5e76-4ce1-aa5c-27bd904827db tempest-CreateVolumesFromImageTest-190797813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:31:04 devstack sudo[97018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:31:04 devstack sudo[97018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:31:04 devstack sudo[97016]: pam_unix(sudo:session): session closed for user root
Nov 03 18:31:04 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-57502b75-8283-43fd-a40a-34ed20f2f60c tempest-VolumesGetTest-1058646393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-98e1a1d1-0a16-432c-99dc-fea6b55236dd" returned: 0 in 0.352s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:31:04 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-57502b75-8283-43fd-a40a-34ed20f2f60c tempest-VolumesGetTest-1058646393 None] Lock "cinder-quobyte-98e1a1d1-0a16-432c-99dc-fea6b55236dd" released by "delete_volume" :: held 0.945s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:31:04 devstack sudo[97018]: pam_unix(sudo:session): session closed for user root
Nov 03 18:31:04 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-4990144d-5e76-4ce1-aa5c-27bd904827db tempest-CreateVolumesFromImageTest-190797813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.386s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:31:04 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-4990144d-5e76-4ce1-aa5c-27bd904827db tempest-CreateVolumesFromImageTest-190797813 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:31:04 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-4990144d-5e76-4ce1-aa5c-27bd904827db tempest-CreateVolumesFromImageTest-190797813 None] Deleted volume successfully.
Nov 03 18:31:04 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-57502b75-8283-43fd-a40a-34ed20f2f60c tempest-VolumesGetTest-1058646393 None] Created reservations ['4a9e9021-0cbb-4a15-8233-f0e9c757848e', '3bfece5c-e022-4b4c-b1fb-ab95174eb0de', 'dae4aa30-76af-4ffd-b1e0-c4eb7fd599ae', 'ed2019b8-655c-4bd6-831a-ca874afef941'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:31:04 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-4990144d-5e76-4ce1-aa5c-27bd904827db tempest-CreateVolumesFromImageTest-190797813 None] Lock "cinder-7d8b58be-7eff-4fcd-9758-8e850cb34708-delete_volume" released by "delete_volume" :: held 1.671s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:31:04 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-57502b75-8283-43fd-a40a-34ed20f2f60c tempest-VolumesGetTest-1058646393 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:31:04 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-57502b75-8283-43fd-a40a-34ed20f2f60c tempest-VolumesGetTest-1058646393 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:31:04 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-57502b75-8283-43fd-a40a-34ed20f2f60c tempest-VolumesGetTest-1058646393 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:31:04 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-57502b75-8283-43fd-a40a-34ed20f2f60c tempest-VolumesGetTest-1058646393 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:31:04 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-57502b75-8283-43fd-a40a-34ed20f2f60c tempest-VolumesGetTest-1058646393 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:31:04 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-57502b75-8283-43fd-a40a-34ed20f2f60c tempest-VolumesGetTest-1058646393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:31:04 devstack sudo[97030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:31:04 devstack sudo[97030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:31:04 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [req-8968b85f-4b2a-4a26-8f06-5e9d99cd6499 req-2873e1cd-d21f-40fe-a096-5fb62c28ef14 tempest-AttachVolumeTestJSON-374454512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:31:04 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [req-8968b85f-4b2a-4a26-8f06-5e9d99cd6499 req-2873e1cd-d21f-40fe-a096-5fb62c28ef14 tempest-AttachVolumeTestJSON-374454512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:31:04 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [req-8968b85f-4b2a-4a26-8f06-5e9d99cd6499 req-2873e1cd-d21f-40fe-a096-5fb62c28ef14 tempest-AttachVolumeTestJSON-374454512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:31:04 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [req-8968b85f-4b2a-4a26-8f06-5e9d99cd6499 req-2873e1cd-d21f-40fe-a096-5fb62c28ef14 tempest-AttachVolumeTestJSON-374454512 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c', 'name': 'volume-709bd24e-e131-4a9c-91c7-fd2b7327dcb5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c8638d2c-2d47-451d-9ca3-3cfc3e3520bb', 'enforce_multipath': True} {{(pid=86120) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 03 18:31:04 devstack cinder-volume[86120]: INFO cinder.volume.manager [req-8968b85f-4b2a-4a26-8f06-5e9d99cd6499 req-2873e1cd-d21f-40fe-a096-5fb62c28ef14 tempest-AttachVolumeTestJSON-374454512 None] attachment_update completed successfully.
Nov 03 18:31:04 devstack sudo[97030]: pam_unix(sudo:session): session closed for user root
Nov 03 18:31:04 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-57502b75-8283-43fd-a40a-34ed20f2f60c tempest-VolumesGetTest-1058646393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.280s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:31:04 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-57502b75-8283-43fd-a40a-34ed20f2f60c tempest-VolumesGetTest-1058646393 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:31:04 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-57502b75-8283-43fd-a40a-34ed20f2f60c tempest-VolumesGetTest-1058646393 None] Deleted volume successfully.
Nov 03 18:31:04 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-57502b75-8283-43fd-a40a-34ed20f2f60c tempest-VolumesGetTest-1058646393 None] Lock "cinder-98e1a1d1-0a16-432c-99dc-fea6b55236dd-delete_volume" released by "delete_volume" :: held 1.607s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:31:06 devstack cinder-volume[86120]: INFO cinder.volume.manager [req-932b2281-02ef-45d6-b9c3-2fcfadd14458 req-f1dd2ff8-f0b3-40c5-b3f5-b4b8f3e008f1 tempest-AttachVolumeTestJSON-374454512 None] Terminate volume connection completed successfully.
Nov 03 18:31:06 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [req-932b2281-02ef-45d6-b9c3-2fcfadd14458 req-f1dd2ff8-f0b3-40c5-b3f5-b4b8f3e008f1 tempest-AttachVolumeTestJSON-374454512 None] Deleting attachment 557d6759-435d-4d45-8c57-f2e0f057455e. {{(pid=86120) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 03 18:31:06 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-9924405e-f076-4156-a6db-32f21b1c0892 tempest-VolumesGetTest-1058646393 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:31:06 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-9924405e-f076-4156-a6db-32f21b1c0892 tempest-VolumesGetTest-1058646393 None] Flow 'volume_create_manager' (3ef4b1e7-a192-4039-958c-0cfa87974ed0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:31:06 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-9924405e-f076-4156-a6db-32f21b1c0892 tempest-VolumesGetTest-1058646393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7e47aa5-9e9c-44d1-9dd6-9b58db298b2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:31:06 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-9924405e-f076-4156-a6db-32f21b1c0892 tempest-VolumesGetTest-1058646393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7e47aa5-9e9c-44d1-9dd6-9b58db298b2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:31:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1622371668',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20bcf58d-2393-424d-a58b-9237ed286514,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='7a2e9d719ed44e7d937af97c1006955b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:31:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:31:07Z,use_quota=True,user_id='9e6bb9b9d9e14369b45e0740337deeda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:31:06 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-9924405e-f076-4156-a6db-32f21b1c0892 tempest-VolumesGetTest-1058646393 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b675588-cb85-41ed-8cda-b83e50b4fae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:31:06 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-9924405e-f076-4156-a6db-32f21b1c0892 tempest-VolumesGetTest-1058646393 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b675588-cb85-41ed-8cda-b83e50b4fae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:31:06 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-9924405e-f076-4156-a6db-32f21b1c0892 tempest-VolumesGetTest-1058646393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf399239-bbc7-4bc8-a124-c00be9f62efd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:31:06 devstack cinder-volume[86120]: DEBUG cinder.image.glance [None req-9924405e-f076-4156-a6db-32f21b1c0892 tempest-VolumesGetTest-1058646393 None] Creating Keystone auth plugin from conf {{(pid=86120) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 03 18:31:07 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-9924405e-f076-4156-a6db-32f21b1c0892 tempest-VolumesGetTest-1058646393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf399239-bbc7-4bc8-a124-c00be9f62efd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '20bcf58d-2393-424d-a58b-9237ed286514', 'volume_name': 'volume-20bcf58d-2393-424d-a58b-9237ed286514', 'volume_size': 1, 'image_id': '83b28d58-14b6-4404-8354-5cfe237c5c95', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/83b28d58-14b6-4404-8354-5cfe237c5c95', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4b0f900e807a4827ba1f8686981981d9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '83b28d58-14b6-4404-8354-5cfe237c5c95', 'created_at': datetime.datetime(2026, 11, 3, 17, 17, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 17, 17, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/83b28d58-14b6-4404-8354-5cfe237c5c95/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7a8d3c615250>}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:31:07 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-9924405e-f076-4156-a6db-32f21b1c0892 tempest-VolumesGetTest-1058646393 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00467d43-62d6-4438-b56a-eb4f026c118a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:31:07 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-9924405e-f076-4156-a6db-32f21b1c0892 tempest-VolumesGetTest-1058646393 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00467d43-62d6-4438-b56a-eb4f026c118a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:31:07 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-9924405e-f076-4156-a6db-32f21b1c0892 tempest-VolumesGetTest-1058646393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8a4aeb3-5a9e-4152-a90a-8bf794fadcbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:31:07 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-9924405e-f076-4156-a6db-32f21b1c0892 tempest-VolumesGetTest-1058646393 None] Volume 20bcf58d-2393-424d-a58b-9237ed286514: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-20bcf58d-2393-424d-a58b-9237ed286514', 'volume_size': 1, 'image_id': '83b28d58-14b6-4404-8354-5cfe237c5c95', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/83b28d58-14b6-4404-8354-5cfe237c5c95', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4b0f900e807a4827ba1f8686981981d9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '83b28d58-14b6-4404-8354-5cfe237c5c95', 'created_at': datetime.datetime(2026, 11, 3, 17, 17, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 17, 17, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/83b28d58-14b6-4404-8354-5cfe237c5c95/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7a8d3c615250>}
Nov 03 18:31:07 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-9924405e-f076-4156-a6db-32f21b1c0892 tempest-VolumesGetTest-1058646393 None] Trying to clone 20bcf58d-2393-424d-a58b-9237ed286514 from image 83b28d58-14b6-4404-8354-5cfe237c5c95 at location (None, [{'url': 'file:///opt/stack/data/glance/images/83b28d58-14b6-4404-8354-5cfe237c5c95', 'metadata': {}}]). {{(pid=86120) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 03 18:31:07 devstack cinder-volume[86120]: DEBUG cinder.image.image_utils [None req-9924405e-f076-4156-a6db-32f21b1c0892 tempest-VolumesGetTest-1058646393 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_83b28d58-14b6-4404-8354-5cfe237c5c95_2x4zmlvxdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86120) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 03 18:31:07 devstack cinder-volume[86120]: INFO cinder.image.image_utils [None req-9924405e-f076-4156-a6db-32f21b1c0892 tempest-VolumesGetTest-1058646393 None] Image download 20.69 MB at 20.69 MB/s
Nov 03 18:31:07 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[1357f01d-942e-4a0e-bed3-8c0ba2f37bae]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:31:07 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-9924405e-f076-4156-a6db-32f21b1c0892 tempest-VolumesGetTest-1058646393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_83b28d58-14b6-4404-8354-5cfe237c5c95_2x4zmlvxdevstack@QuobyteHD {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:31:07 devstack sudo[97040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_83b28d58-14b6-4404-8354-5cfe237c5c95_2x4zmlvxdevstack@QuobyteHD
Nov 03 18:31:07 devstack sudo[97040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:31:08 devstack cinder-volume[86120]: INFO cinder.volume.manager [req-7c01dca6-6ccb-4070-a3a6-fe4b62e4bc18 req-a440b0d7-4084-44dd-a570-da6a9b03e14a tempest-AttachVolumeTestJSON-374454512 None] Terminate volume connection completed successfully.
Nov 03 18:31:08 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [req-7c01dca6-6ccb-4070-a3a6-fe4b62e4bc18 req-a440b0d7-4084-44dd-a570-da6a9b03e14a tempest-AttachVolumeTestJSON-374454512 None] Deleting attachment c8638d2c-2d47-451d-9ca3-3cfc3e3520bb. {{(pid=86120) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 03 18:31:08 devstack sudo[97040]: pam_unix(sudo:session): session closed for user root
Nov 03 18:31:08 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-9924405e-f076-4156-a6db-32f21b1c0892 tempest-VolumesGetTest-1058646393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_83b28d58-14b6-4404-8354-5cfe237c5c95_2x4zmlvxdevstack@QuobyteHD" returned: 0 in 0.598s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:31:08 devstack cinder-volume[86120]: DEBUG cinder.image.image_utils [None req-9924405e-f076-4156-a6db-32f21b1c0892 tempest-VolumesGetTest-1058646393 None] Temporary image 83b28d58-14b6-4404-8354-5cfe237c5c95 is fetched for user 9e6bb9b9d9e14369b45e0740337deeda. {{(pid=86120) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 03 18:31:08 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ff1bd16-3140-486a-82bc-0c2ecd380994]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:31:08 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-9924405e-f076-4156-a6db-32f21b1c0892 tempest-VolumesGetTest-1058646393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_83b28d58-14b6-4404-8354-5cfe237c5c95_2x4zmlvxdevstack@QuobyteHD {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:31:08 devstack sudo[97072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_83b28d58-14b6-4404-8354-5cfe237c5c95_2x4zmlvxdevstack@QuobyteHD
Nov 03 18:31:08 devstack sudo[97072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:31:08 devstack sudo[97072]: pam_unix(sudo:session): session closed for user root
Nov 03 18:31:08 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-9924405e-f076-4156-a6db-32f21b1c0892 tempest-VolumesGetTest-1058646393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_83b28d58-14b6-4404-8354-5cfe237c5c95_2x4zmlvxdevstack@QuobyteHD" returned: 0 in 0.385s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:31:08 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-9924405e-f076-4156-a6db-32f21b1c0892 tempest-VolumesGetTest-1058646393 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:31:08 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-9924405e-f076-4156-a6db-32f21b1c0892 tempest-VolumesGetTest-1058646393 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:31:08 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-9924405e-f076-4156-a6db-32f21b1c0892 tempest-VolumesGetTest-1058646393 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:31:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1622371668',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20bcf58d-2393-424d-a58b-9237ed286514,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='7a2e9d719ed44e7d937af97c1006955b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:31:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:31:07Z,use_quota=True,user_id='9e6bb9b9d9e14369b45e0740337deeda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:31:08 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-9924405e-f076-4156-a6db-32f21b1c0892 tempest-VolumesGetTest-1058646393 None] Creating volume 20bcf58d-2393-424d-a58b-9237ed286514 {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:31:08 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-9924405e-f076-4156-a6db-32f21b1c0892 tempest-VolumesGetTest-1058646393 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:31:08 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-9924405e-f076-4156-a6db-32f21b1c0892 tempest-VolumesGetTest-1058646393 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:31:08 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-9924405e-f076-4156-a6db-32f21b1c0892 tempest-VolumesGetTest-1058646393 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:31:08 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-9924405e-f076-4156-a6db-32f21b1c0892 tempest-VolumesGetTest-1058646393 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:31:08 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-9924405e-f076-4156-a6db-32f21b1c0892 tempest-VolumesGetTest-1058646393 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:31:08 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-9924405e-f076-4156-a6db-32f21b1c0892 tempest-VolumesGetTest-1058646393 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:31:08 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-9924405e-f076-4156-a6db-32f21b1c0892 tempest-VolumesGetTest-1058646393 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:31:08 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-9924405e-f076-4156-a6db-32f21b1c0892 tempest-VolumesGetTest-1058646393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-20bcf58d-2393-424d-a58b-9237ed286514 1073741824 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:31:08 devstack sudo[97080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-20bcf58d-2393-424d-a58b-9237ed286514 1073741824
Nov 03 18:31:08 devstack sudo[97080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:31:09 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b02bd23-ae2b-4fd7-aaff-8f848efffb96 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:31:09 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-7b02bd23-ae2b-4fd7-aaff-8f848efffb96 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Flow 'volume_create_manager' (5388cc11-c864-4ba6-b6df-c06cbf98a570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:31:09 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-7b02bd23-ae2b-4fd7-aaff-8f848efffb96 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92da69a0-e500-4950-bcc2-36328d8e8a77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:31:09 devstack sudo[97080]: pam_unix(sudo:session): session closed for user root
Nov 03 18:31:09 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-9924405e-f076-4156-a6db-32f21b1c0892 tempest-VolumesGetTest-1058646393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-20bcf58d-2393-424d-a58b-9237ed286514 1073741824" returned: 0 in 0.727s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:31:09 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-7b02bd23-ae2b-4fd7-aaff-8f848efffb96 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92da69a0-e500-4950-bcc2-36328d8e8a77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:31:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1455261905',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0b54ce3-0a2d-416c-b50e-7d5d748f3f18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7a826a1b0e04fd99fcebc2f9fd4b7b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:31:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:31:09Z,use_quota=True,user_id='bdc725ef915c4974b0b8b68a7e4e8552',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:31:09 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-7b02bd23-ae2b-4fd7-aaff-8f848efffb96 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a24f3c5-7322-48d9-ae99-cccd5e4fe660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:31:09 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-7b02bd23-ae2b-4fd7-aaff-8f848efffb96 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a24f3c5-7322-48d9-ae99-cccd5e4fe660) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:31:09 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-7b02bd23-ae2b-4fd7-aaff-8f848efffb96 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47b006d0-4c2b-4cb1-851a-8ca81dd4028e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:31:09 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-7b02bd23-ae2b-4fd7-aaff-8f848efffb96 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47b006d0-4c2b-4cb1-851a-8ca81dd4028e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0b54ce3-0a2d-416c-b50e-7d5d748f3f18', 'volume_name': 'volume-e0b54ce3-0a2d-416c-b50e-7d5d748f3f18', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:31:09 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-7b02bd23-ae2b-4fd7-aaff-8f848efffb96 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48c5f6f2-fe78-46f6-83e4-5b3ff42c6f53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:31:09 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-7b02bd23-ae2b-4fd7-aaff-8f848efffb96 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48c5f6f2-fe78-46f6-83e4-5b3ff42c6f53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:31:09 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-7b02bd23-ae2b-4fd7-aaff-8f848efffb96 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4da0a0a8-3fe3-4a89-8f21-560f1df2259b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:31:09 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-7b02bd23-ae2b-4fd7-aaff-8f848efffb96 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Volume e0b54ce3-0a2d-416c-b50e-7d5d748f3f18: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0b54ce3-0a2d-416c-b50e-7d5d748f3f18', 'volume_size': 1}
Nov 03 18:31:09 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-7b02bd23-ae2b-4fd7-aaff-8f848efffb96 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:31:09 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-9924405e-f076-4156-a6db-32f21b1c0892 tempest-VolumesGetTest-1058646393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-20bcf58d-2393-424d-a58b-9237ed286514 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:31:09 devstack sudo[97086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-20bcf58d-2393-424d-a58b-9237ed286514
Nov 03 18:31:09 devstack sudo[97086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:31:10 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-9924405e-f076-4156-a6db-32f21b1c0892 tempest-VolumesGetTest-1058646393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-20bcf58d-2393-424d-a58b-9237ed286514" returned: 0 in 0.353s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:31:10 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-9924405e-f076-4156-a6db-32f21b1c0892 tempest-VolumesGetTest-1058646393 None] <== create_volume: return (1247ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:31:10 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-9924405e-f076-4156-a6db-32f21b1c0892 tempest-VolumesGetTest-1058646393 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.251s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:31:10 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-7b02bd23-ae2b-4fd7-aaff-8f848efffb96 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.452s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:31:10 devstack sudo[97086]: pam_unix(sudo:session): session closed for user root
Nov 03 18:31:10 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-7b02bd23-ae2b-4fd7-aaff-8f848efffb96 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:31:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1455261905',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0b54ce3-0a2d-416c-b50e-7d5d748f3f18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7a826a1b0e04fd99fcebc2f9fd4b7b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:31:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:31:09Z,use_quota=True,user_id='bdc725ef915c4974b0b8b68a7e4e8552',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:31:10 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-7b02bd23-ae2b-4fd7-aaff-8f848efffb96 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Creating volume e0b54ce3-0a2d-416c-b50e-7d5d748f3f18 {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:31:10 devstack sudo[97104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e0b54ce3-0a2d-416c-b50e-7d5d748f3f18 1073741824
Nov 03 18:31:10 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-7b02bd23-ae2b-4fd7-aaff-8f848efffb96 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:31:10 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-7b02bd23-ae2b-4fd7-aaff-8f848efffb96 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:31:10 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-7b02bd23-ae2b-4fd7-aaff-8f848efffb96 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:31:10 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-7b02bd23-ae2b-4fd7-aaff-8f848efffb96 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:31:10 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-7b02bd23-ae2b-4fd7-aaff-8f848efffb96 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:31:10 devstack sudo[97104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:31:10 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-7b02bd23-ae2b-4fd7-aaff-8f848efffb96 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:31:10 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-7b02bd23-ae2b-4fd7-aaff-8f848efffb96 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:31:10 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-7b02bd23-ae2b-4fd7-aaff-8f848efffb96 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e0b54ce3-0a2d-416c-b50e-7d5d748f3f18 1073741824 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:31:10 devstack cinder-volume[86120]: DEBUG cinder.volume.volume_utils [None req-9924405e-f076-4156-a6db-32f21b1c0892 tempest-VolumesGetTest-1058646393 None] Attempting download of 83b28d58-14b6-4404-8354-5cfe237c5c95 ((None, [{'url': 'file:///opt/stack/data/glance/images/83b28d58-14b6-4404-8354-5cfe237c5c95', 'metadata': {}}])) to volume 20bcf58d-2393-424d-a58b-9237ed286514. {{(pid=86120) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 03 18:31:10 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[93a40749-60c3-4ea4-81f1-e750baca7373]: (4, 'raw') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:31:10 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-9924405e-f076-4156-a6db-32f21b1c0892 tempest-VolumesGetTest-1058646393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_83b28d58-14b6-4404-8354-5cfe237c5c95_jm_p9mdh {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:31:10 devstack sudo[97112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_83b28d58-14b6-4404-8354-5cfe237c5c95_jm_p9mdh
Nov 03 18:31:10 devstack sudo[97112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:31:10 devstack sudo[97112]: pam_unix(sudo:session): session closed for user root
Nov 03 18:31:10 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-9924405e-f076-4156-a6db-32f21b1c0892 tempest-VolumesGetTest-1058646393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_83b28d58-14b6-4404-8354-5cfe237c5c95_jm_p9mdh" returned: 0 in 0.457s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:31:10 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-9924405e-f076-4156-a6db-32f21b1c0892 tempest-VolumesGetTest-1058646393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_83b28d58-14b6-4404-8354-5cfe237c5c95_jm_p9mdh {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:31:10 devstack sudo[97104]: pam_unix(sudo:session): session closed for user root
Nov 03 18:31:10 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-7b02bd23-ae2b-4fd7-aaff-8f848efffb96 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e0b54ce3-0a2d-416c-b50e-7d5d748f3f18 1073741824" returned: 0 in 0.719s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:31:10 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-7b02bd23-ae2b-4fd7-aaff-8f848efffb96 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e0b54ce3-0a2d-416c-b50e-7d5d748f3f18 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:31:10 devstack sudo[97123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e0b54ce3-0a2d-416c-b50e-7d5d748f3f18
Nov 03 18:31:10 devstack sudo[97123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:31:10 devstack sudo[97121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_83b28d58-14b6-4404-8354-5cfe237c5c95_jm_p9mdh
Nov 03 18:31:10 devstack sudo[97121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:31:11 devstack sudo[97123]: pam_unix(sudo:session): session closed for user root
Nov 03 18:31:11 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-7b02bd23-ae2b-4fd7-aaff-8f848efffb96 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e0b54ce3-0a2d-416c-b50e-7d5d748f3f18" returned: 0 in 0.338s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:31:11 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-7b02bd23-ae2b-4fd7-aaff-8f848efffb96 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] <== create_volume: return (1166ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:31:11 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-7b02bd23-ae2b-4fd7-aaff-8f848efffb96 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.175s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:31:11 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-7b02bd23-ae2b-4fd7-aaff-8f848efffb96 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4da0a0a8-3fe3-4a89-8f21-560f1df2259b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0b54ce3-0a2d-416c-b50e-7d5d748f3f18', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:31:11 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-7b02bd23-ae2b-4fd7-aaff-8f848efffb96 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d11c582e-83e6-4ead-a7f7-3277053d6dcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:31:11 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-7b02bd23-ae2b-4fd7-aaff-8f848efffb96 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Volume volume-e0b54ce3-0a2d-416c-b50e-7d5d748f3f18 (e0b54ce3-0a2d-416c-b50e-7d5d748f3f18): created successfully
Nov 03 18:31:11 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-7b02bd23-ae2b-4fd7-aaff-8f848efffb96 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d11c582e-83e6-4ead-a7f7-3277053d6dcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:31:11 devstack sudo[97121]: pam_unix(sudo:session): session closed for user root
Nov 03 18:31:11 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-7b02bd23-ae2b-4fd7-aaff-8f848efffb96 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Flow 'volume_create_manager' (5388cc11-c864-4ba6-b6df-c06cbf98a570) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:31:11 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-9924405e-f076-4156-a6db-32f21b1c0892 tempest-VolumesGetTest-1058646393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_83b28d58-14b6-4404-8354-5cfe237c5c95_jm_p9mdh" returned: 1 in 0.576s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:31:11 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-9924405e-f076-4156-a6db-32f21b1c0892 tempest-VolumesGetTest-1058646393 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_83b28d58-14b6-4404-8354-5cfe237c5c95_jm_p9mdh' failed. Not Retrying. {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 03 18:31:11 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[20fa593c-b7ac-4efc-87cf-312e2139469f]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:31:11 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-9924405e-f076-4156-a6db-32f21b1c0892 tempest-VolumesGetTest-1058646393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_83b28d58-14b6-4404-8354-5cfe237c5c95_2x4zmlvxdevstack@QuobyteHD {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:31:11 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-7b02bd23-ae2b-4fd7-aaff-8f848efffb96 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Created volume successfully.
Nov 03 18:31:11 devstack sudo[97130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_83b28d58-14b6-4404-8354-5cfe237c5c95_2x4zmlvxdevstack@QuobyteHD
Nov 03 18:31:11 devstack sudo[97130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:31:11 devstack sudo[97130]: pam_unix(sudo:session): session closed for user root
Nov 03 18:31:11 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-9924405e-f076-4156-a6db-32f21b1c0892 tempest-VolumesGetTest-1058646393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_83b28d58-14b6-4404-8354-5cfe237c5c95_2x4zmlvxdevstack@QuobyteHD" returned: 0 in 0.404s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:31:11 devstack cinder-volume[86120]: DEBUG cinder.image.image_utils [None req-9924405e-f076-4156-a6db-32f21b1c0892 tempest-VolumesGetTest-1058646393 None] 83b28d58-14b6-4404-8354-5cfe237c5c95 was qcow2, converting to qcow2 {{(pid=86120) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 03 18:31:11 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-9924405e-f076-4156-a6db-32f21b1c0892 tempest-VolumesGetTest-1058646393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_83b28d58-14b6-4404-8354-5cfe237c5c95_2x4zmlvxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-20bcf58d-2393-424d-a58b-9237ed286514 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:31:11 devstack sudo[97136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_83b28d58-14b6-4404-8354-5cfe237c5c95_2x4zmlvxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-20bcf58d-2393-424d-a58b-9237ed286514
Nov 03 18:31:11 devstack sudo[97136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:31:12 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-df9ed42a-8f30-4ae0-ab17-9c1f958b0bba tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:31:12 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-df9ed42a-8f30-4ae0-ab17-9c1f958b0bba tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Flow 'volume_create_manager' (b03ca29e-7d20-4b35-abd6-f8adb773ca4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:31:12 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-df9ed42a-8f30-4ae0-ab17-9c1f958b0bba tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f152952-684c-4c15-b109-cbc5372d2ba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:31:12 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-df9ed42a-8f30-4ae0-ab17-9c1f958b0bba tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f152952-684c-4c15-b109-cbc5372d2ba2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:31:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1195077676',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cef1cc73-77f9-4e59-8642-88a7e6a33144,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7a826a1b0e04fd99fcebc2f9fd4b7b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:31:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:31:12Z,use_quota=True,user_id='bdc725ef915c4974b0b8b68a7e4e8552',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:31:12 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-df9ed42a-8f30-4ae0-ab17-9c1f958b0bba tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68282b55-a544-4a3f-88aa-f191edf3ebd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:31:12 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-df9ed42a-8f30-4ae0-ab17-9c1f958b0bba tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68282b55-a544-4a3f-88aa-f191edf3ebd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:31:12 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-df9ed42a-8f30-4ae0-ab17-9c1f958b0bba tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (035e6c93-c6f8-4722-8b6f-0a3cf87779fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:31:12 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-df9ed42a-8f30-4ae0-ab17-9c1f958b0bba tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (035e6c93-c6f8-4722-8b6f-0a3cf87779fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cef1cc73-77f9-4e59-8642-88a7e6a33144', 'volume_name': 'volume-cef1cc73-77f9-4e59-8642-88a7e6a33144', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:31:12 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-df9ed42a-8f30-4ae0-ab17-9c1f958b0bba tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39dcb53c-191b-412a-a40f-047d0fe5028a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:31:12 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-df9ed42a-8f30-4ae0-ab17-9c1f958b0bba tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39dcb53c-191b-412a-a40f-047d0fe5028a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:31:12 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-df9ed42a-8f30-4ae0-ab17-9c1f958b0bba tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (516e1d44-ba4a-4e67-8b4f-d0ac18e69057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:31:12 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-df9ed42a-8f30-4ae0-ab17-9c1f958b0bba tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Volume cef1cc73-77f9-4e59-8642-88a7e6a33144: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cef1cc73-77f9-4e59-8642-88a7e6a33144', 'volume_size': 1}
Nov 03 18:31:12 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-df9ed42a-8f30-4ae0-ab17-9c1f958b0bba tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:31:12 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-df9ed42a-8f30-4ae0-ab17-9c1f958b0bba tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:31:12 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-df9ed42a-8f30-4ae0-ab17-9c1f958b0bba tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:31:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1195077676',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cef1cc73-77f9-4e59-8642-88a7e6a33144,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7a826a1b0e04fd99fcebc2f9fd4b7b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:31:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:31:12Z,use_quota=True,user_id='bdc725ef915c4974b0b8b68a7e4e8552',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:31:12 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-df9ed42a-8f30-4ae0-ab17-9c1f958b0bba tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Creating volume cef1cc73-77f9-4e59-8642-88a7e6a33144 {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:31:12 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-df9ed42a-8f30-4ae0-ab17-9c1f958b0bba tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:31:12 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-df9ed42a-8f30-4ae0-ab17-9c1f958b0bba tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:31:12 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-df9ed42a-8f30-4ae0-ab17-9c1f958b0bba tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:31:12 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-df9ed42a-8f30-4ae0-ab17-9c1f958b0bba tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:31:12 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-df9ed42a-8f30-4ae0-ab17-9c1f958b0bba tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:31:12 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-df9ed42a-8f30-4ae0-ab17-9c1f958b0bba tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:31:12 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-df9ed42a-8f30-4ae0-ab17-9c1f958b0bba tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:31:12 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-df9ed42a-8f30-4ae0-ab17-9c1f958b0bba tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-cef1cc73-77f9-4e59-8642-88a7e6a33144 1073741824 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:31:12 devstack sudo[97146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-cef1cc73-77f9-4e59-8642-88a7e6a33144 1073741824
Nov 03 18:31:12 devstack sudo[97146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:31:13 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-844b9b63-f3c6-4307-b461-5b7ed07dcffc tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:31:13 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-844b9b63-f3c6-4307-b461-5b7ed07dcffc tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Flow 'volume_create_manager' (392cc11f-5dd6-40e4-b0c0-78b5a2d14df8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:31:13 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-844b9b63-f3c6-4307-b461-5b7ed07dcffc tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc5fab95-5499-4e8a-9108-6a08c65109bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:31:13 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-844b9b63-f3c6-4307-b461-5b7ed07dcffc tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc5fab95-5499-4e8a-9108-6a08c65109bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:31:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-142481891',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3460c46-6207-488d-8ecc-9a06c3b29fab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7a826a1b0e04fd99fcebc2f9fd4b7b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:31:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:31:13Z,use_quota=True,user_id='bdc725ef915c4974b0b8b68a7e4e8552',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:31:13 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-844b9b63-f3c6-4307-b461-5b7ed07dcffc tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2aa1c416-1160-43b0-a256-4bcec9c2b14b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:31:13 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-844b9b63-f3c6-4307-b461-5b7ed07dcffc tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2aa1c416-1160-43b0-a256-4bcec9c2b14b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:31:13 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-844b9b63-f3c6-4307-b461-5b7ed07dcffc tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8a13ea9-97fd-44e6-b1cf-079a2ecacfb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:31:13 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-844b9b63-f3c6-4307-b461-5b7ed07dcffc tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8a13ea9-97fd-44e6-b1cf-079a2ecacfb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3460c46-6207-488d-8ecc-9a06c3b29fab', 'volume_name': 'volume-e3460c46-6207-488d-8ecc-9a06c3b29fab', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:31:13 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-844b9b63-f3c6-4307-b461-5b7ed07dcffc tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56e889fe-be22-49df-82a1-0b47561915ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:31:13 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-844b9b63-f3c6-4307-b461-5b7ed07dcffc tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56e889fe-be22-49df-82a1-0b47561915ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:31:13 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-844b9b63-f3c6-4307-b461-5b7ed07dcffc tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7721560a-80d7-4607-82a2-064dcaad6df8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:31:13 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-844b9b63-f3c6-4307-b461-5b7ed07dcffc tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Volume e3460c46-6207-488d-8ecc-9a06c3b29fab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3460c46-6207-488d-8ecc-9a06c3b29fab', 'volume_size': 1}
Nov 03 18:31:13 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-844b9b63-f3c6-4307-b461-5b7ed07dcffc tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:31:13 devstack sudo[97146]: pam_unix(sudo:session): session closed for user root
Nov 03 18:31:13 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-df9ed42a-8f30-4ae0-ab17-9c1f958b0bba tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-cef1cc73-77f9-4e59-8642-88a7e6a33144 1073741824" returned: 0 in 1.022s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:31:13 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-df9ed42a-8f30-4ae0-ab17-9c1f958b0bba tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-cef1cc73-77f9-4e59-8642-88a7e6a33144 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:31:13 devstack sudo[97153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-cef1cc73-77f9-4e59-8642-88a7e6a33144
Nov 03 18:31:13 devstack sudo[97153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:31:13 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d5b77d7-5faa-4677-8775-8b48f56763d3 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:31:13 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-2d5b77d7-5faa-4677-8775-8b48f56763d3 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Flow 'volume_create_manager' (4639327b-ff9f-4913-b9e9-a4a01c3b90c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:31:13 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-2d5b77d7-5faa-4677-8775-8b48f56763d3 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4678e5d7-b724-47ec-b0da-3899aa76f372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:31:13 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-2d5b77d7-5faa-4677-8775-8b48f56763d3 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4678e5d7-b724-47ec-b0da-3899aa76f372) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:31:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1024508690',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6aa38d6f-f1fa-4668-b9e7-c28fbcfc83b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7a826a1b0e04fd99fcebc2f9fd4b7b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:31:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:31:14Z,use_quota=True,user_id='bdc725ef915c4974b0b8b68a7e4e8552',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:31:13 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-2d5b77d7-5faa-4677-8775-8b48f56763d3 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (011fd0d2-2b09-46aa-a904-bed616eba210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:31:13 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-2d5b77d7-5faa-4677-8775-8b48f56763d3 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (011fd0d2-2b09-46aa-a904-bed616eba210) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:31:13 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-2d5b77d7-5faa-4677-8775-8b48f56763d3 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (598675b4-9f8b-46ed-92bf-86234727871f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:31:13 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-2d5b77d7-5faa-4677-8775-8b48f56763d3 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (598675b4-9f8b-46ed-92bf-86234727871f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6aa38d6f-f1fa-4668-b9e7-c28fbcfc83b5', 'volume_name': 'volume-6aa38d6f-f1fa-4668-b9e7-c28fbcfc83b5', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:31:13 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-2d5b77d7-5faa-4677-8775-8b48f56763d3 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87e0b03a-ac0f-4b86-bd75-2c9949fcfebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:31:13 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-2d5b77d7-5faa-4677-8775-8b48f56763d3 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87e0b03a-ac0f-4b86-bd75-2c9949fcfebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:31:13 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-2d5b77d7-5faa-4677-8775-8b48f56763d3 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5ee3636-ca5a-4b0e-80d7-ba8e39f2628d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:31:13 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-2d5b77d7-5faa-4677-8775-8b48f56763d3 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Volume 6aa38d6f-f1fa-4668-b9e7-c28fbcfc83b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6aa38d6f-f1fa-4668-b9e7-c28fbcfc83b5', 'volume_size': 1}
Nov 03 18:31:13 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-2d5b77d7-5faa-4677-8775-8b48f56763d3 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:31:14 devstack sudo[97153]: pam_unix(sudo:session): session closed for user root
Nov 03 18:31:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-df9ed42a-8f30-4ae0-ab17-9c1f958b0bba tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-cef1cc73-77f9-4e59-8642-88a7e6a33144" returned: 0 in 0.564s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:31:14 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-df9ed42a-8f30-4ae0-ab17-9c1f958b0bba tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] <== create_volume: return (1674ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:31:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-df9ed42a-8f30-4ae0-ab17-9c1f958b0bba tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.680s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:31:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-844b9b63-f3c6-4307-b461-5b7ed07dcffc tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.940s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:31:14 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-844b9b63-f3c6-4307-b461-5b7ed07dcffc tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:31:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-142481891',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3460c46-6207-488d-8ecc-9a06c3b29fab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7a826a1b0e04fd99fcebc2f9fd4b7b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:31:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:31:13Z,use_quota=True,user_id='bdc725ef915c4974b0b8b68a7e4e8552',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:31:14 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-844b9b63-f3c6-4307-b461-5b7ed07dcffc tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Creating volume e3460c46-6207-488d-8ecc-9a06c3b29fab {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:31:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-844b9b63-f3c6-4307-b461-5b7ed07dcffc tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:31:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-844b9b63-f3c6-4307-b461-5b7ed07dcffc tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:31:14 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-844b9b63-f3c6-4307-b461-5b7ed07dcffc tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:31:14 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-844b9b63-f3c6-4307-b461-5b7ed07dcffc tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:31:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-844b9b63-f3c6-4307-b461-5b7ed07dcffc tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:31:14 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-844b9b63-f3c6-4307-b461-5b7ed07dcffc tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:31:14 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-844b9b63-f3c6-4307-b461-5b7ed07dcffc tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:31:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-844b9b63-f3c6-4307-b461-5b7ed07dcffc tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e3460c46-6207-488d-8ecc-9a06c3b29fab 1073741824 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:31:14 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-df9ed42a-8f30-4ae0-ab17-9c1f958b0bba tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (516e1d44-ba4a-4e67-8b4f-d0ac18e69057) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cef1cc73-77f9-4e59-8642-88a7e6a33144', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:31:14 devstack sudo[97162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e3460c46-6207-488d-8ecc-9a06c3b29fab 1073741824
Nov 03 18:31:14 devstack sudo[97162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:31:14 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-df9ed42a-8f30-4ae0-ab17-9c1f958b0bba tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f0c28a4-0a8f-4e6f-84a2-940302e5add4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:31:14 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-df9ed42a-8f30-4ae0-ab17-9c1f958b0bba tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Volume volume-cef1cc73-77f9-4e59-8642-88a7e6a33144 (cef1cc73-77f9-4e59-8642-88a7e6a33144): created successfully
Nov 03 18:31:14 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-df9ed42a-8f30-4ae0-ab17-9c1f958b0bba tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f0c28a4-0a8f-4e6f-84a2-940302e5add4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:31:14 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-df9ed42a-8f30-4ae0-ab17-9c1f958b0bba tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Flow 'volume_create_manager' (b03ca29e-7d20-4b35-abd6-f8adb773ca4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:31:14 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-df9ed42a-8f30-4ae0-ab17-9c1f958b0bba tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Created volume successfully.
Nov 03 18:31:14 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ae254d1-6a7a-4e87-a745-5ce75a1f494f tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:31:14 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-1ae254d1-6a7a-4e87-a745-5ce75a1f494f tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Flow 'volume_create_manager' (af14baf2-1158-4916-bdb4-d11999970f99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:31:14 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-1ae254d1-6a7a-4e87-a745-5ce75a1f494f tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f3fadf6-dbea-46d3-ae97-c09dd8cdfb4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:31:14 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-1ae254d1-6a7a-4e87-a745-5ce75a1f494f tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f3fadf6-dbea-46d3-ae97-c09dd8cdfb4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:31:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-868451065',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb0e1a80-01c2-4b82-abb0-078b06ab2c40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7a826a1b0e04fd99fcebc2f9fd4b7b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:31:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:31:14Z,use_quota=True,user_id='bdc725ef915c4974b0b8b68a7e4e8552',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:31:14 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-1ae254d1-6a7a-4e87-a745-5ce75a1f494f tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d432806-cef1-4c6a-bc49-67862faee9c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:31:14 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-1ae254d1-6a7a-4e87-a745-5ce75a1f494f tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d432806-cef1-4c6a-bc49-67862faee9c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:31:14 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-1ae254d1-6a7a-4e87-a745-5ce75a1f494f tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a3ee90c-985b-4b7f-8506-7a981b8ab75f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:31:14 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-1ae254d1-6a7a-4e87-a745-5ce75a1f494f tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a3ee90c-985b-4b7f-8506-7a981b8ab75f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb0e1a80-01c2-4b82-abb0-078b06ab2c40', 'volume_name': 'volume-bb0e1a80-01c2-4b82-abb0-078b06ab2c40', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:31:14 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-1ae254d1-6a7a-4e87-a745-5ce75a1f494f tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43fdfd51-f657-4de7-8c35-7dd66bf6e297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:31:14 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-1ae254d1-6a7a-4e87-a745-5ce75a1f494f tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43fdfd51-f657-4de7-8c35-7dd66bf6e297) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:31:14 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-1ae254d1-6a7a-4e87-a745-5ce75a1f494f tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f35c475-3120-448a-9c1c-df075095ff77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:31:14 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-1ae254d1-6a7a-4e87-a745-5ce75a1f494f tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Volume bb0e1a80-01c2-4b82-abb0-078b06ab2c40: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb0e1a80-01c2-4b82-abb0-078b06ab2c40', 'volume_size': 1}
Nov 03 18:31:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-1ae254d1-6a7a-4e87-a745-5ce75a1f494f tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:31:14 devstack sudo[97136]: pam_unix(sudo:session): session closed for user root
Nov 03 18:31:14 devstack cinder-volume[86120]: DEBUG oslo_service.periodic_task [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86120) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 18:31:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:31:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:31:14 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:31:14 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:31:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:31:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:31:15 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-9924405e-f076-4156-a6db-32f21b1c0892 tempest-VolumesGetTest-1058646393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_83b28d58-14b6-4404-8354-5cfe237c5c95_2x4zmlvxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-20bcf58d-2393-424d-a58b-9237ed286514" returned: 0 in 3.203s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:31:15 devstack cinder-volume[86120]: DEBUG cinder.image.image_utils [None req-9924405e-f076-4156-a6db-32f21b1c0892 tempest-VolumesGetTest-1058646393 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_83b28d58-14b6-4404-8354-5cfe237c5c95_2x4zmlvxdevstack@QuobyteHD, size 112.00 MB, duration 3.21 sec, destination /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-20bcf58d-2393-424d-a58b-9237ed286514 {{(pid=86120) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 03 18:31:15 devstack cinder-volume[86120]: INFO cinder.image.image_utils [None req-9924405e-f076-4156-a6db-32f21b1c0892 tempest-VolumesGetTest-1058646393 None] Converted 112.00 MB image at 34.86 MB/s
Nov 03 18:31:15 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-9924405e-f076-4156-a6db-32f21b1c0892 tempest-VolumesGetTest-1058646393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-20bcf58d-2393-424d-a58b-9237ed286514 1G {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:31:15 devstack sudo[97167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:31:15 devstack sudo[97167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:31:15 devstack sudo[97169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-20bcf58d-2393-424d-a58b-9237ed286514 1G
Nov 03 18:31:15 devstack sudo[97169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:31:15 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-00dadb30-3f96-43ee-ac7d-728a26f6214a tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:31:15 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-00dadb30-3f96-43ee-ac7d-728a26f6214a tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Flow 'volume_create_manager' (0f51d1bd-b528-4960-8a2b-ca7851ef6f74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:31:15 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-00dadb30-3f96-43ee-ac7d-728a26f6214a tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (064eaba2-ae23-4698-8640-cab2d03ae0a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:31:15 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-00dadb30-3f96-43ee-ac7d-728a26f6214a tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (064eaba2-ae23-4698-8640-cab2d03ae0a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:31:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2074465771',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=009d0fd3-2b09-46a4-95b3-2e98c8984c3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7a826a1b0e04fd99fcebc2f9fd4b7b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:31:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:31:15Z,use_quota=True,user_id='bdc725ef915c4974b0b8b68a7e4e8552',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:31:15 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-00dadb30-3f96-43ee-ac7d-728a26f6214a tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be574fc7-0cdf-4185-9eed-deaae730a42b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:31:15 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-00dadb30-3f96-43ee-ac7d-728a26f6214a tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be574fc7-0cdf-4185-9eed-deaae730a42b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:31:15 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-00dadb30-3f96-43ee-ac7d-728a26f6214a tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91c7d072-af09-48bf-959d-13ff7030f60a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:31:15 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-00dadb30-3f96-43ee-ac7d-728a26f6214a tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91c7d072-af09-48bf-959d-13ff7030f60a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '009d0fd3-2b09-46a4-95b3-2e98c8984c3e', 'volume_name': 'volume-009d0fd3-2b09-46a4-95b3-2e98c8984c3e', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:31:15 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-00dadb30-3f96-43ee-ac7d-728a26f6214a tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1567ac5b-e927-4571-a418-5f606125857a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:31:15 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-00dadb30-3f96-43ee-ac7d-728a26f6214a tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1567ac5b-e927-4571-a418-5f606125857a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:31:15 devstack sudo[97162]: pam_unix(sudo:session): session closed for user root
Nov 03 18:31:15 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-00dadb30-3f96-43ee-ac7d-728a26f6214a tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d92364dd-b0e1-4428-9a3a-d90bf31a306c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:31:15 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-00dadb30-3f96-43ee-ac7d-728a26f6214a tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Volume 009d0fd3-2b09-46a4-95b3-2e98c8984c3e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-009d0fd3-2b09-46a4-95b3-2e98c8984c3e', 'volume_size': 1}
Nov 03 18:31:15 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-00dadb30-3f96-43ee-ac7d-728a26f6214a tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:31:15 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-844b9b63-f3c6-4307-b461-5b7ed07dcffc tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e3460c46-6207-488d-8ecc-9a06c3b29fab 1073741824" returned: 0 in 1.056s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:31:15 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-844b9b63-f3c6-4307-b461-5b7ed07dcffc tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e3460c46-6207-488d-8ecc-9a06c3b29fab {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:31:15 devstack sudo[97167]: pam_unix(sudo:session): session closed for user root
Nov 03 18:31:15 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.456s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:31:15 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:31:15 devstack sudo[97175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e3460c46-6207-488d-8ecc-9a06c3b29fab
Nov 03 18:31:15 devstack sudo[97175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:31:15 devstack cinder-volume[86120]: DEBUG oslo_service.periodic_task [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Running periodic task VolumeManager._thread_info {{(pid=86120) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 18:31:15 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] thread count: 28 {{(pid=86120) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 03 18:31:15 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] thread info: [<_MainThread(MainThread, started 134747145822336)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134747033686336)>, <Thread(Thread-3 (stat_writer), started daemon 134747030828736)>, <Thread(Rabbit-heartbeat, started daemon 134747035433408)>, <Thread(Thread-5 (_runner), started daemon 134747029587392)>, <Thread(Thread-7 (_runner), started daemon 134747029784256)>, <Thread(fd_logger, started daemon 134747027909120)>, <Thread(privsep_reader, started daemon 134747027006592)>, <Thread(tpool_thread_0, started daemon 134747018950336)>, <Thread(tpool_thread_1, started daemon 134747010541248)>, <Thread(tpool_thread_2, started daemon 134747002132160)>, <Thread(tpool_thread_3, started daemon 134746993723072)>, <Thread(tpool_thread_4, started daemon 134746985313984)>, <Thread(tpool_thread_5, started daemon 134746976904896)>, <Thread(tpool_thread_6, started daemon 134746968495808)>, <Thread(tpool_thread_7, started daemon 134746960086720)>, <Thread(tpool_thread_8, started daemon 134746951677632)>, <Thread(tpool_thread_9, started daemon 134746943268544)>, <Thread(tpool_thread_10, started daemon 134746934859456)>, <Thread(tpool_thread_11, started daemon 134746926450368)>, <Thread(tpool_thread_12, started daemon 134746918041280)>, <Thread(tpool_thread_13, started daemon 134746909632192)>, <Thread(tpool_thread_14, started daemon 134746901223104)>, <Thread(tpool_thread_15, started daemon 134746892814016)>, <Thread(tpool_thread_16, started daemon 134746884404928)>, <Thread(tpool_thread_17, started daemon 134746875995840)>, <Thread(tpool_thread_18, started daemon 134746867586752)>, <Thread(tpool_thread_19, started daemon 134746859177664)>] {{(pid=86120) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 03 18:31:15 devstack sudo[97169]: pam_unix(sudo:session): session closed for user root
Nov 03 18:31:15 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-9924405e-f076-4156-a6db-32f21b1c0892 tempest-VolumesGetTest-1058646393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-20bcf58d-2393-424d-a58b-9237ed286514 1G" returned: 0 in 0.488s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:31:15 devstack cinder-volume[86120]: DEBUG cinder.volume.volume_utils [None req-9924405e-f076-4156-a6db-32f21b1c0892 tempest-VolumesGetTest-1058646393 None] Downloaded image 83b28d58-14b6-4404-8354-5cfe237c5c95 ((None, [{'url': 'file:///opt/stack/data/glance/images/83b28d58-14b6-4404-8354-5cfe237c5c95', 'metadata': {}}])) to volume 20bcf58d-2393-424d-a58b-9237ed286514 successfully. {{(pid=86120) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 03 18:31:15 devstack cinder-volume[86120]: DEBUG cinder.image.image_utils [None req-9924405e-f076-4156-a6db-32f21b1c0892 tempest-VolumesGetTest-1058646393 None] Temporary image 83b28d58-14b6-4404-8354-5cfe237c5c95 for user 9e6bb9b9d9e14369b45e0740337deeda is deleted. {{(pid=86120) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 03 18:31:15 devstack cinder-volume[86120]: DEBUG cinder.volume.volume_utils [None req-9924405e-f076-4156-a6db-32f21b1c0892 tempest-VolumesGetTest-1058646393 None] Marking volume 20bcf58d-2393-424d-a58b-9237ed286514 as bootable. {{(pid=86120) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 03 18:31:15 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-9924405e-f076-4156-a6db-32f21b1c0892 tempest-VolumesGetTest-1058646393 None] Copying metadata from image 83b28d58-14b6-4404-8354-5cfe237c5c95 to 20bcf58d-2393-424d-a58b-9237ed286514. {{(pid=86120) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 03 18:31:15 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-9924405e-f076-4156-a6db-32f21b1c0892 tempest-VolumesGetTest-1058646393 None] Creating volume glance metadata for volume 20bcf58d-2393-424d-a58b-9237ed286514 backed by image 83b28d58-14b6-4404-8354-5cfe237c5c95 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '83b28d58-14b6-4404-8354-5cfe237c5c95', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86120) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 03 18:31:15 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-9924405e-f076-4156-a6db-32f21b1c0892 tempest-VolumesGetTest-1058646393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8a4aeb3-5a9e-4152-a90a-8bf794fadcbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20bcf58d-2393-424d-a58b-9237ed286514', 'volume_size': 1, 'image_id': '83b28d58-14b6-4404-8354-5cfe237c5c95', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/83b28d58-14b6-4404-8354-5cfe237c5c95', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4b0f900e807a4827ba1f8686981981d9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '83b28d58-14b6-4404-8354-5cfe237c5c95', 'created_at': datetime.datetime(2026, 11, 3, 17, 17, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 17, 17, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/83b28d58-14b6-4404-8354-5cfe237c5c95/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7a8d3c615250>}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:31:15 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-9924405e-f076-4156-a6db-32f21b1c0892 tempest-VolumesGetTest-1058646393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6528632-78ff-4951-ab13-6153e76927f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:31:15 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-9924405e-f076-4156-a6db-32f21b1c0892 tempest-VolumesGetTest-1058646393 None] Volume volume-20bcf58d-2393-424d-a58b-9237ed286514 (20bcf58d-2393-424d-a58b-9237ed286514): created successfully
Nov 03 18:31:15 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-9924405e-f076-4156-a6db-32f21b1c0892 tempest-VolumesGetTest-1058646393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6528632-78ff-4951-ab13-6153e76927f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:31:15 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-9924405e-f076-4156-a6db-32f21b1c0892 tempest-VolumesGetTest-1058646393 None] Flow 'volume_create_manager' (3ef4b1e7-a192-4039-958c-0cfa87974ed0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:31:15 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-9924405e-f076-4156-a6db-32f21b1c0892 tempest-VolumesGetTest-1058646393 None] Created volume successfully.
Nov 03 18:31:15 devstack sudo[97175]: pam_unix(sudo:session): session closed for user root
Nov 03 18:31:15 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-844b9b63-f3c6-4307-b461-5b7ed07dcffc tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e3460c46-6207-488d-8ecc-9a06c3b29fab" returned: 0 in 0.324s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:31:15 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-844b9b63-f3c6-4307-b461-5b7ed07dcffc tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] <== create_volume: return (1478ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:31:15 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-844b9b63-f3c6-4307-b461-5b7ed07dcffc tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.486s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:31:15 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-2d5b77d7-5faa-4677-8775-8b48f56763d3 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.778s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:31:15 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-2d5b77d7-5faa-4677-8775-8b48f56763d3 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:31:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1024508690',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6aa38d6f-f1fa-4668-b9e7-c28fbcfc83b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7a826a1b0e04fd99fcebc2f9fd4b7b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:31:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:31:14Z,use_quota=True,user_id='bdc725ef915c4974b0b8b68a7e4e8552',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:31:15 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-2d5b77d7-5faa-4677-8775-8b48f56763d3 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Creating volume 6aa38d6f-f1fa-4668-b9e7-c28fbcfc83b5 {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:31:15 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-2d5b77d7-5faa-4677-8775-8b48f56763d3 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:31:15 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-2d5b77d7-5faa-4677-8775-8b48f56763d3 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:31:15 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-2d5b77d7-5faa-4677-8775-8b48f56763d3 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:31:15 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-2d5b77d7-5faa-4677-8775-8b48f56763d3 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:31:15 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-2d5b77d7-5faa-4677-8775-8b48f56763d3 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:31:15 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-2d5b77d7-5faa-4677-8775-8b48f56763d3 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:31:15 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-2d5b77d7-5faa-4677-8775-8b48f56763d3 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:31:15 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-2d5b77d7-5faa-4677-8775-8b48f56763d3 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6aa38d6f-f1fa-4668-b9e7-c28fbcfc83b5 1073741824 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:31:15 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-844b9b63-f3c6-4307-b461-5b7ed07dcffc tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7721560a-80d7-4607-82a2-064dcaad6df8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3460c46-6207-488d-8ecc-9a06c3b29fab', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:31:15 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-844b9b63-f3c6-4307-b461-5b7ed07dcffc tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40b91eac-9cef-4e14-ac26-730c3c63ada6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:31:15 devstack sudo[97178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6aa38d6f-f1fa-4668-b9e7-c28fbcfc83b5 1073741824
Nov 03 18:31:15 devstack sudo[97178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:31:15 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-844b9b63-f3c6-4307-b461-5b7ed07dcffc tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Volume volume-e3460c46-6207-488d-8ecc-9a06c3b29fab (e3460c46-6207-488d-8ecc-9a06c3b29fab): created successfully
Nov 03 18:31:15 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-844b9b63-f3c6-4307-b461-5b7ed07dcffc tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40b91eac-9cef-4e14-ac26-730c3c63ada6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:31:15 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-844b9b63-f3c6-4307-b461-5b7ed07dcffc tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Flow 'volume_create_manager' (392cc11f-5dd6-40e4-b0c0-78b5a2d14df8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:31:15 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-844b9b63-f3c6-4307-b461-5b7ed07dcffc tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Created volume successfully.
Nov 03 18:31:16 devstack sudo[97178]: pam_unix(sudo:session): session closed for user root
Nov 03 18:31:16 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-2d5b77d7-5faa-4677-8775-8b48f56763d3 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6aa38d6f-f1fa-4668-b9e7-c28fbcfc83b5 1073741824" returned: 0 in 0.597s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:31:16 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-f16ba271-b68f-46e4-87a6-4c71fe12db8e tempest-AttachVolumeTestJSON-374454512 None] Acquiring lock "cinder-709bd24e-e131-4a9c-91c7-fd2b7327dcb5-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:31:16 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-f16ba271-b68f-46e4-87a6-4c71fe12db8e tempest-AttachVolumeTestJSON-374454512 None] Lock "cinder-709bd24e-e131-4a9c-91c7-fd2b7327dcb5-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:31:16 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-2d5b77d7-5faa-4677-8775-8b48f56763d3 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6aa38d6f-f1fa-4668-b9e7-c28fbcfc83b5 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:31:16 devstack sudo[97184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6aa38d6f-f1fa-4668-b9e7-c28fbcfc83b5
Nov 03 18:31:16 devstack sudo[97184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:31:16 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-f16ba271-b68f-46e4-87a6-4c71fe12db8e tempest-AttachVolumeTestJSON-374454512 None] Acquiring lock "cinder-quobyte-709bd24e-e131-4a9c-91c7-fd2b7327dcb5" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:31:16 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-f16ba271-b68f-46e4-87a6-4c71fe12db8e tempest-AttachVolumeTestJSON-374454512 None] Lock "cinder-quobyte-709bd24e-e131-4a9c-91c7-fd2b7327dcb5" acquired by "delete_volume" :: waited 0.018s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:31:16 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[faf016db-e73b-4166-bf91-d88a111c0271]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:31:16 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-f16ba271-b68f-46e4-87a6-4c71fe12db8e tempest-AttachVolumeTestJSON-374454512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-709bd24e-e131-4a9c-91c7-fd2b7327dcb5 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:31:16 devstack sudo[97186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-709bd24e-e131-4a9c-91c7-fd2b7327dcb5
Nov 03 18:31:16 devstack sudo[97186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:31:16 devstack sudo[97184]: pam_unix(sudo:session): session closed for user root
Nov 03 18:31:16 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-2d5b77d7-5faa-4677-8775-8b48f56763d3 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6aa38d6f-f1fa-4668-b9e7-c28fbcfc83b5" returned: 0 in 0.395s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:31:16 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-2d5b77d7-5faa-4677-8775-8b48f56763d3 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] <== create_volume: return (1096ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:31:16 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-2d5b77d7-5faa-4677-8775-8b48f56763d3 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.099s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:31:16 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-1ae254d1-6a7a-4e87-a745-5ce75a1f494f tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.209s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:31:16 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-1ae254d1-6a7a-4e87-a745-5ce75a1f494f tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:31:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-868451065',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb0e1a80-01c2-4b82-abb0-078b06ab2c40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7a826a1b0e04fd99fcebc2f9fd4b7b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:31:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:31:14Z,use_quota=True,user_id='bdc725ef915c4974b0b8b68a7e4e8552',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:31:16 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-1ae254d1-6a7a-4e87-a745-5ce75a1f494f tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Creating volume bb0e1a80-01c2-4b82-abb0-078b06ab2c40 {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:31:16 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-1ae254d1-6a7a-4e87-a745-5ce75a1f494f tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:31:16 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-1ae254d1-6a7a-4e87-a745-5ce75a1f494f tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:31:16 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-1ae254d1-6a7a-4e87-a745-5ce75a1f494f tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:31:16 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-1ae254d1-6a7a-4e87-a745-5ce75a1f494f tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:31:16 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-1ae254d1-6a7a-4e87-a745-5ce75a1f494f tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:31:16 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-1ae254d1-6a7a-4e87-a745-5ce75a1f494f tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:31:16 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-1ae254d1-6a7a-4e87-a745-5ce75a1f494f tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:31:16 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-1ae254d1-6a7a-4e87-a745-5ce75a1f494f tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-bb0e1a80-01c2-4b82-abb0-078b06ab2c40 1073741824 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:31:16 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-2d5b77d7-5faa-4677-8775-8b48f56763d3 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5ee3636-ca5a-4b0e-80d7-ba8e39f2628d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6aa38d6f-f1fa-4668-b9e7-c28fbcfc83b5', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:31:16 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-2d5b77d7-5faa-4677-8775-8b48f56763d3 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bf6a418-b658-456e-b7a3-d71fdcd18c97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:31:16 devstack sudo[97189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-bb0e1a80-01c2-4b82-abb0-078b06ab2c40 1073741824
Nov 03 18:31:16 devstack sudo[97189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:31:16 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-2d5b77d7-5faa-4677-8775-8b48f56763d3 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Volume volume-6aa38d6f-f1fa-4668-b9e7-c28fbcfc83b5 (6aa38d6f-f1fa-4668-b9e7-c28fbcfc83b5): created successfully
Nov 03 18:31:16 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-2d5b77d7-5faa-4677-8775-8b48f56763d3 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bf6a418-b658-456e-b7a3-d71fdcd18c97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:31:16 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-2d5b77d7-5faa-4677-8775-8b48f56763d3 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Flow 'volume_create_manager' (4639327b-ff9f-4913-b9e9-a4a01c3b90c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:31:17 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-2d5b77d7-5faa-4677-8775-8b48f56763d3 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Created volume successfully.
Nov 03 18:31:17 devstack sudo[97186]: pam_unix(sudo:session): session closed for user root
Nov 03 18:31:17 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-f16ba271-b68f-46e4-87a6-4c71fe12db8e tempest-AttachVolumeTestJSON-374454512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-709bd24e-e131-4a9c-91c7-fd2b7327dcb5" returned: 0 in 0.549s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:31:17 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-f16ba271-b68f-46e4-87a6-4c71fe12db8e tempest-AttachVolumeTestJSON-374454512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-709bd24e-e131-4a9c-91c7-fd2b7327dcb5 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:31:17 devstack sudo[97194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-709bd24e-e131-4a9c-91c7-fd2b7327dcb5
Nov 03 18:31:17 devstack sudo[97194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:31:17 devstack sudo[97194]: pam_unix(sudo:session): session closed for user root
Nov 03 18:31:17 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-f16ba271-b68f-46e4-87a6-4c71fe12db8e tempest-AttachVolumeTestJSON-374454512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-709bd24e-e131-4a9c-91c7-fd2b7327dcb5" returned: 0 in 0.450s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:31:17 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-f16ba271-b68f-46e4-87a6-4c71fe12db8e tempest-AttachVolumeTestJSON-374454512 None] Lock "cinder-quobyte-709bd24e-e131-4a9c-91c7-fd2b7327dcb5" released by "delete_volume" :: held 1.138s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:31:17 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-8394daf1-6448-40d8-ac19-130ef9dbea65 tempest-VolumesGetTest-1058646393 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:31:17 devstack sudo[97189]: pam_unix(sudo:session): session closed for user root
Nov 03 18:31:17 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-8394daf1-6448-40d8-ac19-130ef9dbea65 tempest-VolumesGetTest-1058646393 None] Flow 'volume_create_manager' (da4ce3f2-9671-4307-b4c0-69b9c0cd5993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:31:17 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-8394daf1-6448-40d8-ac19-130ef9dbea65 tempest-VolumesGetTest-1058646393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3e271f0-4ab9-4054-9fc1-29964627312b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:31:17 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-1ae254d1-6a7a-4e87-a745-5ce75a1f494f tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-bb0e1a80-01c2-4b82-abb0-078b06ab2c40 1073741824" returned: 0 in 0.868s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:31:17 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-8394daf1-6448-40d8-ac19-130ef9dbea65 tempest-VolumesGetTest-1058646393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3e271f0-4ab9-4054-9fc1-29964627312b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:31:17Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-604026982',display_name='tempest-VolumesGetTest-Volume-880621970',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af44b71f-8243-492a-9df5-ce7761e81a5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a2e9d719ed44e7d937af97c1006955b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:31:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:31:18Z,use_quota=True,user_id='9e6bb9b9d9e14369b45e0740337deeda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:31:17 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-8394daf1-6448-40d8-ac19-130ef9dbea65 tempest-VolumesGetTest-1058646393 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c00fea91-ae55-4943-a474-7e1008cd31e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:31:17 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-8394daf1-6448-40d8-ac19-130ef9dbea65 tempest-VolumesGetTest-1058646393 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c00fea91-ae55-4943-a474-7e1008cd31e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:31:17 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-8394daf1-6448-40d8-ac19-130ef9dbea65 tempest-VolumesGetTest-1058646393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed6a2cae-c901-4f76-91df-baa0d7dd02b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:31:17 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-8394daf1-6448-40d8-ac19-130ef9dbea65 tempest-VolumesGetTest-1058646393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed6a2cae-c901-4f76-91df-baa0d7dd02b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af44b71f-8243-492a-9df5-ce7761e81a5e', 'volume_name': 'volume-af44b71f-8243-492a-9df5-ce7761e81a5e', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:31:17 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-8394daf1-6448-40d8-ac19-130ef9dbea65 tempest-VolumesGetTest-1058646393 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8e96d02-9d93-46f2-9398-34ca0c653961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:31:17 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-8394daf1-6448-40d8-ac19-130ef9dbea65 tempest-VolumesGetTest-1058646393 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8e96d02-9d93-46f2-9398-34ca0c653961) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:31:17 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-8394daf1-6448-40d8-ac19-130ef9dbea65 tempest-VolumesGetTest-1058646393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e17ccf4-d825-46a9-b048-6c6aaeab3ce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:31:17 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-8394daf1-6448-40d8-ac19-130ef9dbea65 tempest-VolumesGetTest-1058646393 None] Volume af44b71f-8243-492a-9df5-ce7761e81a5e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af44b71f-8243-492a-9df5-ce7761e81a5e', 'volume_size': 1}
Nov 03 18:31:17 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-8394daf1-6448-40d8-ac19-130ef9dbea65 tempest-VolumesGetTest-1058646393 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:31:17 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-f16ba271-b68f-46e4-87a6-4c71fe12db8e tempest-AttachVolumeTestJSON-374454512 None] Created reservations ['8d1b1ff8-7bcf-4c6d-a81a-47fe76744dd5', 'b5c79a12-2639-497d-84fd-f19c430febac', '9efc6c28-792c-48fa-9fab-bb7f2ac19de5', '44de72a0-d0fb-4e09-aafa-4222e4657b3a'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:31:17 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-1ae254d1-6a7a-4e87-a745-5ce75a1f494f tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-bb0e1a80-01c2-4b82-abb0-078b06ab2c40 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:31:17 devstack sudo[97202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-bb0e1a80-01c2-4b82-abb0-078b06ab2c40
Nov 03 18:31:17 devstack sudo[97202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:31:17 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-f16ba271-b68f-46e4-87a6-4c71fe12db8e tempest-AttachVolumeTestJSON-374454512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:31:17 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-f16ba271-b68f-46e4-87a6-4c71fe12db8e tempest-AttachVolumeTestJSON-374454512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:31:17 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-f16ba271-b68f-46e4-87a6-4c71fe12db8e tempest-AttachVolumeTestJSON-374454512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:31:17 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-f16ba271-b68f-46e4-87a6-4c71fe12db8e tempest-AttachVolumeTestJSON-374454512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:31:17 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-f16ba271-b68f-46e4-87a6-4c71fe12db8e tempest-AttachVolumeTestJSON-374454512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:31:17 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-f16ba271-b68f-46e4-87a6-4c71fe12db8e tempest-AttachVolumeTestJSON-374454512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:31:17 devstack sudo[97204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:31:17 devstack sudo[97204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:31:18 devstack sudo[97202]: pam_unix(sudo:session): session closed for user root
Nov 03 18:31:18 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-1ae254d1-6a7a-4e87-a745-5ce75a1f494f tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-bb0e1a80-01c2-4b82-abb0-078b06ab2c40" returned: 0 in 0.262s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:31:18 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-1ae254d1-6a7a-4e87-a745-5ce75a1f494f tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] <== create_volume: return (1313ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:31:18 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-1ae254d1-6a7a-4e87-a745-5ce75a1f494f tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.319s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:31:18 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-00dadb30-3f96-43ee-ac7d-728a26f6214a tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.838s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:31:18 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-00dadb30-3f96-43ee-ac7d-728a26f6214a tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:31:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2074465771',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=009d0fd3-2b09-46a4-95b3-2e98c8984c3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7a826a1b0e04fd99fcebc2f9fd4b7b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:31:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:31:15Z,use_quota=True,user_id='bdc725ef915c4974b0b8b68a7e4e8552',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:31:18 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-00dadb30-3f96-43ee-ac7d-728a26f6214a tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Creating volume 009d0fd3-2b09-46a4-95b3-2e98c8984c3e {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:31:18 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-00dadb30-3f96-43ee-ac7d-728a26f6214a tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:31:18 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-00dadb30-3f96-43ee-ac7d-728a26f6214a tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:31:18 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-00dadb30-3f96-43ee-ac7d-728a26f6214a tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:31:18 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-00dadb30-3f96-43ee-ac7d-728a26f6214a tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:31:18 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-00dadb30-3f96-43ee-ac7d-728a26f6214a tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:31:18 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-00dadb30-3f96-43ee-ac7d-728a26f6214a tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:31:18 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-00dadb30-3f96-43ee-ac7d-728a26f6214a tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:31:18 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-00dadb30-3f96-43ee-ac7d-728a26f6214a tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-009d0fd3-2b09-46a4-95b3-2e98c8984c3e 1073741824 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:31:18 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-1ae254d1-6a7a-4e87-a745-5ce75a1f494f tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f35c475-3120-448a-9c1c-df075095ff77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb0e1a80-01c2-4b82-abb0-078b06ab2c40', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:31:18 devstack sudo[97208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-009d0fd3-2b09-46a4-95b3-2e98c8984c3e 1073741824
Nov 03 18:31:18 devstack sudo[97208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:31:18 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-1ae254d1-6a7a-4e87-a745-5ce75a1f494f tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cd8507d-256b-4397-8959-e5c98d3eb9c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:31:18 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-1ae254d1-6a7a-4e87-a745-5ce75a1f494f tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Volume volume-bb0e1a80-01c2-4b82-abb0-078b06ab2c40 (bb0e1a80-01c2-4b82-abb0-078b06ab2c40): created successfully
Nov 03 18:31:18 devstack sudo[97204]: pam_unix(sudo:session): session closed for user root
Nov 03 18:31:18 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-1ae254d1-6a7a-4e87-a745-5ce75a1f494f tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cd8507d-256b-4397-8959-e5c98d3eb9c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:31:18 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-1ae254d1-6a7a-4e87-a745-5ce75a1f494f tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Flow 'volume_create_manager' (af14baf2-1158-4916-bdb4-d11999970f99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:31:18 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-f16ba271-b68f-46e4-87a6-4c71fe12db8e tempest-AttachVolumeTestJSON-374454512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.275s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:31:18 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-f16ba271-b68f-46e4-87a6-4c71fe12db8e tempest-AttachVolumeTestJSON-374454512 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:31:18 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-f16ba271-b68f-46e4-87a6-4c71fe12db8e tempest-AttachVolumeTestJSON-374454512 None] Deleted volume successfully.
Nov 03 18:31:18 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-1ae254d1-6a7a-4e87-a745-5ce75a1f494f tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Created volume successfully.
Nov 03 18:31:18 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-f16ba271-b68f-46e4-87a6-4c71fe12db8e tempest-AttachVolumeTestJSON-374454512 None] Lock "cinder-709bd24e-e131-4a9c-91c7-fd2b7327dcb5-delete_volume" released by "delete_volume" :: held 1.868s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:31:18 devstack sudo[97208]: pam_unix(sudo:session): session closed for user root
Nov 03 18:31:18 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-00dadb30-3f96-43ee-ac7d-728a26f6214a tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-009d0fd3-2b09-46a4-95b3-2e98c8984c3e 1073741824" returned: 0 in 0.541s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:31:18 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-ad63eb1d-4296-4983-931a-284e0b48f4e0 tempest-AttachVolumeTestJSON-374454512 None] Acquiring lock "cinder-93c46b04-ffc8-4e84-ada9-390c85ea3050-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:31:18 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-ad63eb1d-4296-4983-931a-284e0b48f4e0 tempest-AttachVolumeTestJSON-374454512 None] Lock "cinder-93c46b04-ffc8-4e84-ada9-390c85ea3050-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:31:18 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-00dadb30-3f96-43ee-ac7d-728a26f6214a tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-009d0fd3-2b09-46a4-95b3-2e98c8984c3e {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:31:18 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-ad63eb1d-4296-4983-931a-284e0b48f4e0 tempest-AttachVolumeTestJSON-374454512 None] Acquiring lock "cinder-quobyte-93c46b04-ffc8-4e84-ada9-390c85ea3050" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:31:18 devstack sudo[97214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-009d0fd3-2b09-46a4-95b3-2e98c8984c3e
Nov 03 18:31:18 devstack sudo[97214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:31:18 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-ad63eb1d-4296-4983-931a-284e0b48f4e0 tempest-AttachVolumeTestJSON-374454512 None] Lock "cinder-quobyte-93c46b04-ffc8-4e84-ada9-390c85ea3050" acquired by "delete_volume" :: waited 0.020s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:31:18 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[18f67ef1-300a-4079-a420-53aaba22de39]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:31:18 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-ad63eb1d-4296-4983-931a-284e0b48f4e0 tempest-AttachVolumeTestJSON-374454512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-93c46b04-ffc8-4e84-ada9-390c85ea3050 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:31:19 devstack sudo[97218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-93c46b04-ffc8-4e84-ada9-390c85ea3050
Nov 03 18:31:19 devstack sudo[97218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:31:19 devstack sudo[97214]: pam_unix(sudo:session): session closed for user root
Nov 03 18:31:19 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-00dadb30-3f96-43ee-ac7d-728a26f6214a tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-009d0fd3-2b09-46a4-95b3-2e98c8984c3e" returned: 0 in 0.301s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:31:19 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-00dadb30-3f96-43ee-ac7d-728a26f6214a tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] <== create_volume: return (906ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:31:19 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-00dadb30-3f96-43ee-ac7d-728a26f6214a tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.910s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:31:19 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-8394daf1-6448-40d8-ac19-130ef9dbea65 tempest-VolumesGetTest-1058646393 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.235s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:31:19 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-8394daf1-6448-40d8-ac19-130ef9dbea65 tempest-VolumesGetTest-1058646393 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:31:17Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-604026982',display_name='tempest-VolumesGetTest-Volume-880621970',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af44b71f-8243-492a-9df5-ce7761e81a5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a2e9d719ed44e7d937af97c1006955b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:31:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:31:18Z,use_quota=True,user_id='9e6bb9b9d9e14369b45e0740337deeda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:31:19 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-8394daf1-6448-40d8-ac19-130ef9dbea65 tempest-VolumesGetTest-1058646393 None] Creating volume af44b71f-8243-492a-9df5-ce7761e81a5e {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:31:19 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-8394daf1-6448-40d8-ac19-130ef9dbea65 tempest-VolumesGetTest-1058646393 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:31:19 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-8394daf1-6448-40d8-ac19-130ef9dbea65 tempest-VolumesGetTest-1058646393 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:31:19 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-8394daf1-6448-40d8-ac19-130ef9dbea65 tempest-VolumesGetTest-1058646393 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:31:19 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-8394daf1-6448-40d8-ac19-130ef9dbea65 tempest-VolumesGetTest-1058646393 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:31:19 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-8394daf1-6448-40d8-ac19-130ef9dbea65 tempest-VolumesGetTest-1058646393 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:31:19 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-8394daf1-6448-40d8-ac19-130ef9dbea65 tempest-VolumesGetTest-1058646393 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:31:19 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-8394daf1-6448-40d8-ac19-130ef9dbea65 tempest-VolumesGetTest-1058646393 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:31:19 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-8394daf1-6448-40d8-ac19-130ef9dbea65 tempest-VolumesGetTest-1058646393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-af44b71f-8243-492a-9df5-ce7761e81a5e 1073741824 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:31:19 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-00dadb30-3f96-43ee-ac7d-728a26f6214a tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d92364dd-b0e1-4428-9a3a-d90bf31a306c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-009d0fd3-2b09-46a4-95b3-2e98c8984c3e', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:31:19 devstack sudo[97223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-af44b71f-8243-492a-9df5-ce7761e81a5e 1073741824
Nov 03 18:31:19 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-00dadb30-3f96-43ee-ac7d-728a26f6214a tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9890e124-760d-409b-bd72-a625922a6557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:31:19 devstack sudo[97223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:31:19 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-00dadb30-3f96-43ee-ac7d-728a26f6214a tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Volume volume-009d0fd3-2b09-46a4-95b3-2e98c8984c3e (009d0fd3-2b09-46a4-95b3-2e98c8984c3e): created successfully
Nov 03 18:31:19 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-00dadb30-3f96-43ee-ac7d-728a26f6214a tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9890e124-760d-409b-bd72-a625922a6557) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:31:19 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-00dadb30-3f96-43ee-ac7d-728a26f6214a tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Flow 'volume_create_manager' (0f51d1bd-b528-4960-8a2b-ca7851ef6f74) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:31:19 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-00dadb30-3f96-43ee-ac7d-728a26f6214a tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Created volume successfully.
Nov 03 18:31:19 devstack sudo[97218]: pam_unix(sudo:session): session closed for user root
Nov 03 18:31:19 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-ad63eb1d-4296-4983-931a-284e0b48f4e0 tempest-AttachVolumeTestJSON-374454512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-93c46b04-ffc8-4e84-ada9-390c85ea3050" returned: 0 in 0.440s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:31:19 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-ad63eb1d-4296-4983-931a-284e0b48f4e0 tempest-AttachVolumeTestJSON-374454512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-93c46b04-ffc8-4e84-ada9-390c85ea3050 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:31:19 devstack sudo[97228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-93c46b04-ffc8-4e84-ada9-390c85ea3050
Nov 03 18:31:19 devstack sudo[97228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:31:19 devstack sudo[97228]: pam_unix(sudo:session): session closed for user root
Nov 03 18:31:19 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-ad63eb1d-4296-4983-931a-284e0b48f4e0 tempest-AttachVolumeTestJSON-374454512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-93c46b04-ffc8-4e84-ada9-390c85ea3050" returned: 0 in 0.317s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:31:19 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-ad63eb1d-4296-4983-931a-284e0b48f4e0 tempest-AttachVolumeTestJSON-374454512 None] Lock "cinder-quobyte-93c46b04-ffc8-4e84-ada9-390c85ea3050" released by "delete_volume" :: held 0.812s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:31:19 devstack sudo[97223]: pam_unix(sudo:session): session closed for user root
Nov 03 18:31:19 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-8394daf1-6448-40d8-ac19-130ef9dbea65 tempest-VolumesGetTest-1058646393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-af44b71f-8243-492a-9df5-ce7761e81a5e 1073741824" returned: 0 in 0.557s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:31:19 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-8394daf1-6448-40d8-ac19-130ef9dbea65 tempest-VolumesGetTest-1058646393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-af44b71f-8243-492a-9df5-ce7761e81a5e {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:31:19 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-ad63eb1d-4296-4983-931a-284e0b48f4e0 tempest-AttachVolumeTestJSON-374454512 None] Created reservations ['b21b5f16-3e26-42ff-8986-3a5a76d20e98', 'e13167e6-9f8a-49a1-98fa-0445c346702e', '774757ae-5882-4ed7-80b4-d31b9df5274b', '8888f9aa-c313-4f07-8011-efe68d19843b'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:31:19 devstack sudo[97235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-af44b71f-8243-492a-9df5-ce7761e81a5e
Nov 03 18:31:19 devstack sudo[97235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:31:19 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-b236eeb1-187e-493b-a0a1-9ed7b8fae200 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Acquiring lock "cinder-009d0fd3-2b09-46a4-95b3-2e98c8984c3e-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:31:19 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-b236eeb1-187e-493b-a0a1-9ed7b8fae200 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Lock "cinder-009d0fd3-2b09-46a4-95b3-2e98c8984c3e-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:31:19 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-ad63eb1d-4296-4983-931a-284e0b48f4e0 tempest-AttachVolumeTestJSON-374454512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:31:19 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-ad63eb1d-4296-4983-931a-284e0b48f4e0 tempest-AttachVolumeTestJSON-374454512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:31:19 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-ad63eb1d-4296-4983-931a-284e0b48f4e0 tempest-AttachVolumeTestJSON-374454512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:31:19 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-ad63eb1d-4296-4983-931a-284e0b48f4e0 tempest-AttachVolumeTestJSON-374454512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:31:19 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-ad63eb1d-4296-4983-931a-284e0b48f4e0 tempest-AttachVolumeTestJSON-374454512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:31:19 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-ad63eb1d-4296-4983-931a-284e0b48f4e0 tempest-AttachVolumeTestJSON-374454512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:31:19 devstack sudo[97237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:31:19 devstack sudo[97237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:31:19 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-b236eeb1-187e-493b-a0a1-9ed7b8fae200 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Acquiring lock "cinder-quobyte-009d0fd3-2b09-46a4-95b3-2e98c8984c3e" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:31:19 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-b236eeb1-187e-493b-a0a1-9ed7b8fae200 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Lock "cinder-quobyte-009d0fd3-2b09-46a4-95b3-2e98c8984c3e" acquired by "delete_volume" :: waited 0.031s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:31:20 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[461b56f3-8b82-4f06-a065-37506a2e7113]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:31:20 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b236eeb1-187e-493b-a0a1-9ed7b8fae200 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-009d0fd3-2b09-46a4-95b3-2e98c8984c3e {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:31:20 devstack sudo[97235]: pam_unix(sudo:session): session closed for user root
Nov 03 18:31:20 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-8ddeaec5-ed65-4325-a9d5-727504d9e6d4 tempest-AttachVolumeTestJSON-374454512 None] Acquiring lock "cinder-80bb7033-5c88-4baf-9011-d7b78515ee94-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:31:20 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-8394daf1-6448-40d8-ac19-130ef9dbea65 tempest-VolumesGetTest-1058646393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-af44b71f-8243-492a-9df5-ce7761e81a5e" returned: 0 in 0.459s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:31:20 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-8394daf1-6448-40d8-ac19-130ef9dbea65 tempest-VolumesGetTest-1058646393 None] <== create_volume: return (1075ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:31:20 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-8394daf1-6448-40d8-ac19-130ef9dbea65 tempest-VolumesGetTest-1058646393 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.080s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:31:20 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-8394daf1-6448-40d8-ac19-130ef9dbea65 tempest-VolumesGetTest-1058646393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e17ccf4-d825-46a9-b048-6c6aaeab3ce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af44b71f-8243-492a-9df5-ce7761e81a5e', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:31:20 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-8394daf1-6448-40d8-ac19-130ef9dbea65 tempest-VolumesGetTest-1058646393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad148845-76a4-423b-8f48-da7e7c3500aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:31:20 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-8ddeaec5-ed65-4325-a9d5-727504d9e6d4 tempest-AttachVolumeTestJSON-374454512 None] Lock "cinder-80bb7033-5c88-4baf-9011-d7b78515ee94-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:31:20 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-8394daf1-6448-40d8-ac19-130ef9dbea65 tempest-VolumesGetTest-1058646393 None] Volume volume-af44b71f-8243-492a-9df5-ce7761e81a5e (af44b71f-8243-492a-9df5-ce7761e81a5e): created successfully
Nov 03 18:31:20 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-8394daf1-6448-40d8-ac19-130ef9dbea65 tempest-VolumesGetTest-1058646393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad148845-76a4-423b-8f48-da7e7c3500aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:31:20 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-8394daf1-6448-40d8-ac19-130ef9dbea65 tempest-VolumesGetTest-1058646393 None] Flow 'volume_create_manager' (da4ce3f2-9671-4307-b4c0-69b9c0cd5993) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:31:20 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-8394daf1-6448-40d8-ac19-130ef9dbea65 tempest-VolumesGetTest-1058646393 None] Created volume successfully.
Nov 03 18:31:20 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-8ddeaec5-ed65-4325-a9d5-727504d9e6d4 tempest-AttachVolumeTestJSON-374454512 None] Acquiring lock "cinder-quobyte-80bb7033-5c88-4baf-9011-d7b78515ee94" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:31:20 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-8ddeaec5-ed65-4325-a9d5-727504d9e6d4 tempest-AttachVolumeTestJSON-374454512 None] Lock "cinder-quobyte-80bb7033-5c88-4baf-9011-d7b78515ee94" acquired by "delete_volume" :: waited 0.020s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:31:20 devstack sudo[97240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-009d0fd3-2b09-46a4-95b3-2e98c8984c3e
Nov 03 18:31:20 devstack sudo[97240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:31:20 devstack sudo[97237]: pam_unix(sudo:session): session closed for user root
Nov 03 18:31:20 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-ad63eb1d-4296-4983-931a-284e0b48f4e0 tempest-AttachVolumeTestJSON-374454512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.449s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:31:20 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-ad63eb1d-4296-4983-931a-284e0b48f4e0 tempest-AttachVolumeTestJSON-374454512 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:31:20 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-ad63eb1d-4296-4983-931a-284e0b48f4e0 tempest-AttachVolumeTestJSON-374454512 None] Deleted volume successfully.
Nov 03 18:31:20 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6af7bbc-b411-429d-89b2-0152ba20c73d]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:31:20 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-8ddeaec5-ed65-4325-a9d5-727504d9e6d4 tempest-AttachVolumeTestJSON-374454512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-80bb7033-5c88-4baf-9011-d7b78515ee94 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:31:20 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-ad63eb1d-4296-4983-931a-284e0b48f4e0 tempest-AttachVolumeTestJSON-374454512 None] Lock "cinder-93c46b04-ffc8-4e84-ada9-390c85ea3050-delete_volume" released by "delete_volume" :: held 1.646s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:31:20 devstack sudo[97243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-80bb7033-5c88-4baf-9011-d7b78515ee94
Nov 03 18:31:20 devstack sudo[97243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:31:20 devstack sudo[97240]: pam_unix(sudo:session): session closed for user root
Nov 03 18:31:20 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b236eeb1-187e-493b-a0a1-9ed7b8fae200 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-009d0fd3-2b09-46a4-95b3-2e98c8984c3e" returned: 0 in 0.640s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:31:20 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b236eeb1-187e-493b-a0a1-9ed7b8fae200 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-009d0fd3-2b09-46a4-95b3-2e98c8984c3e {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:31:20 devstack sudo[97249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-009d0fd3-2b09-46a4-95b3-2e98c8984c3e
Nov 03 18:31:20 devstack sudo[97249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:31:20 devstack sudo[97243]: pam_unix(sudo:session): session closed for user root
Nov 03 18:31:20 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-8ddeaec5-ed65-4325-a9d5-727504d9e6d4 tempest-AttachVolumeTestJSON-374454512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-80bb7033-5c88-4baf-9011-d7b78515ee94" returned: 0 in 0.544s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:31:20 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-8ddeaec5-ed65-4325-a9d5-727504d9e6d4 tempest-AttachVolumeTestJSON-374454512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-80bb7033-5c88-4baf-9011-d7b78515ee94 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:31:20 devstack sudo[97258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-80bb7033-5c88-4baf-9011-d7b78515ee94
Nov 03 18:31:20 devstack sudo[97258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:31:21 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-8edf39f0-8b3c-4bc9-b172-e1f8f6079b98 tempest-VolumesGetTest-1058646393 None] Acquiring lock "cinder-af44b71f-8243-492a-9df5-ce7761e81a5e-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:31:21 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-8edf39f0-8b3c-4bc9-b172-e1f8f6079b98 tempest-VolumesGetTest-1058646393 None] Lock "cinder-af44b71f-8243-492a-9df5-ce7761e81a5e-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:31:21 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-8edf39f0-8b3c-4bc9-b172-e1f8f6079b98 tempest-VolumesGetTest-1058646393 None] Acquiring lock "cinder-quobyte-af44b71f-8243-492a-9df5-ce7761e81a5e" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:31:21 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-8edf39f0-8b3c-4bc9-b172-e1f8f6079b98 tempest-VolumesGetTest-1058646393 None] Lock "cinder-quobyte-af44b71f-8243-492a-9df5-ce7761e81a5e" acquired by "delete_volume" :: waited 0.019s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:31:21 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cd2fb64-4a44-41bc-86b3-358eda9004bf]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:31:21 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-8edf39f0-8b3c-4bc9-b172-e1f8f6079b98 tempest-VolumesGetTest-1058646393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-af44b71f-8243-492a-9df5-ce7761e81a5e {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:31:21 devstack sudo[97249]: pam_unix(sudo:session): session closed for user root
Nov 03 18:31:21 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b236eeb1-187e-493b-a0a1-9ed7b8fae200 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-009d0fd3-2b09-46a4-95b3-2e98c8984c3e" returned: 0 in 0.505s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:31:21 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-b236eeb1-187e-493b-a0a1-9ed7b8fae200 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Lock "cinder-quobyte-009d0fd3-2b09-46a4-95b3-2e98c8984c3e" released by "delete_volume" :: held 1.249s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:31:21 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-b236eeb1-187e-493b-a0a1-9ed7b8fae200 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Created reservations ['290b4b33-9cd8-49a0-8253-b9c3d62d96de', '791c690c-0001-4b78-95fc-1bede85e052e', 'a6287854-9c74-4c72-ab0e-cbae42d356a5', 'fb8d123e-a55b-435b-ae68-2865a37460d5'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:31:21 devstack sudo[97266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-af44b71f-8243-492a-9df5-ce7761e81a5e
Nov 03 18:31:21 devstack sudo[97258]: pam_unix(sudo:session): session closed for user root
Nov 03 18:31:21 devstack sudo[97266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:31:21 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-8ddeaec5-ed65-4325-a9d5-727504d9e6d4 tempest-AttachVolumeTestJSON-374454512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-80bb7033-5c88-4baf-9011-d7b78515ee94" returned: 0 in 0.428s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:31:21 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-8ddeaec5-ed65-4325-a9d5-727504d9e6d4 tempest-AttachVolumeTestJSON-374454512 None] Lock "cinder-quobyte-80bb7033-5c88-4baf-9011-d7b78515ee94" released by "delete_volume" :: held 1.067s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:31:21 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-b236eeb1-187e-493b-a0a1-9ed7b8fae200 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:31:21 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-b236eeb1-187e-493b-a0a1-9ed7b8fae200 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:31:21 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-b236eeb1-187e-493b-a0a1-9ed7b8fae200 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:31:21 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-b236eeb1-187e-493b-a0a1-9ed7b8fae200 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:31:21 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-b236eeb1-187e-493b-a0a1-9ed7b8fae200 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:31:21 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b236eeb1-187e-493b-a0a1-9ed7b8fae200 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:31:21 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-8ddeaec5-ed65-4325-a9d5-727504d9e6d4 tempest-AttachVolumeTestJSON-374454512 None] Created reservations ['e2486f61-22ae-4e02-a53b-bb85a2b1eb79', '034b064b-0a23-4e12-ae9d-17cf83fb09e9', '52c1eeeb-e69f-4d6d-a5f0-0ef65336360e', 'fcc51d8d-c66b-47b0-b03c-888f0728ee64'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:31:21 devstack sudo[97272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:31:21 devstack sudo[97272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:31:21 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-8ddeaec5-ed65-4325-a9d5-727504d9e6d4 tempest-AttachVolumeTestJSON-374454512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:31:21 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-8ddeaec5-ed65-4325-a9d5-727504d9e6d4 tempest-AttachVolumeTestJSON-374454512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:31:21 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-8ddeaec5-ed65-4325-a9d5-727504d9e6d4 tempest-AttachVolumeTestJSON-374454512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:31:21 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-8ddeaec5-ed65-4325-a9d5-727504d9e6d4 tempest-AttachVolumeTestJSON-374454512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:31:21 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-8ddeaec5-ed65-4325-a9d5-727504d9e6d4 tempest-AttachVolumeTestJSON-374454512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:31:21 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-8ddeaec5-ed65-4325-a9d5-727504d9e6d4 tempest-AttachVolumeTestJSON-374454512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:31:21 devstack sudo[97266]: pam_unix(sudo:session): session closed for user root
Nov 03 18:31:21 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-8edf39f0-8b3c-4bc9-b172-e1f8f6079b98 tempest-VolumesGetTest-1058646393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-af44b71f-8243-492a-9df5-ce7761e81a5e" returned: 0 in 0.597s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:31:21 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-8edf39f0-8b3c-4bc9-b172-e1f8f6079b98 tempest-VolumesGetTest-1058646393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-af44b71f-8243-492a-9df5-ce7761e81a5e {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:31:21 devstack sudo[97280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:31:21 devstack sudo[97280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:31:21 devstack sudo[97281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-af44b71f-8243-492a-9df5-ce7761e81a5e
Nov 03 18:31:21 devstack sudo[97281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:31:21 devstack sudo[97272]: pam_unix(sudo:session): session closed for user root
Nov 03 18:31:21 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b236eeb1-187e-493b-a0a1-9ed7b8fae200 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.336s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:31:21 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-b236eeb1-187e-493b-a0a1-9ed7b8fae200 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:31:21 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-b236eeb1-187e-493b-a0a1-9ed7b8fae200 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Deleted volume successfully.
Nov 03 18:31:21 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-b236eeb1-187e-493b-a0a1-9ed7b8fae200 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Lock "cinder-009d0fd3-2b09-46a4-95b3-2e98c8984c3e-delete_volume" released by "delete_volume" :: held 2.085s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:31:21 devstack sudo[97280]: pam_unix(sudo:session): session closed for user root
Nov 03 18:31:21 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-8ddeaec5-ed65-4325-a9d5-727504d9e6d4 tempest-AttachVolumeTestJSON-374454512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.299s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:31:21 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-8ddeaec5-ed65-4325-a9d5-727504d9e6d4 tempest-AttachVolumeTestJSON-374454512 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:31:22 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-8ddeaec5-ed65-4325-a9d5-727504d9e6d4 tempest-AttachVolumeTestJSON-374454512 None] Deleted volume successfully.
Nov 03 18:31:22 devstack sudo[97281]: pam_unix(sudo:session): session closed for user root
Nov 03 18:31:22 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-8edf39f0-8b3c-4bc9-b172-e1f8f6079b98 tempest-VolumesGetTest-1058646393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-af44b71f-8243-492a-9df5-ce7761e81a5e" returned: 0 in 0.297s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:31:22 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-8ddeaec5-ed65-4325-a9d5-727504d9e6d4 tempest-AttachVolumeTestJSON-374454512 None] Lock "cinder-80bb7033-5c88-4baf-9011-d7b78515ee94-delete_volume" released by "delete_volume" :: held 1.849s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:31:22 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-8edf39f0-8b3c-4bc9-b172-e1f8f6079b98 tempest-VolumesGetTest-1058646393 None] Lock "cinder-quobyte-af44b71f-8243-492a-9df5-ce7761e81a5e" released by "delete_volume" :: held 0.967s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:31:22 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-8edf39f0-8b3c-4bc9-b172-e1f8f6079b98 tempest-VolumesGetTest-1058646393 None] Created reservations ['c30e4e44-654b-42f6-bd01-437ac12e667f', '0baa9199-a171-4547-a455-de41226eb1e4', '5e3daa26-d629-4f4f-aff8-4ec9388f6977', 'c20f8f6c-9aea-4708-9e0b-1bb434a44b78'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:31:22 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-c6cd432b-1699-4cab-a50a-2dae43f68af9 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Acquiring lock "cinder-bb0e1a80-01c2-4b82-abb0-078b06ab2c40-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:31:22 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-c6cd432b-1699-4cab-a50a-2dae43f68af9 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Lock "cinder-bb0e1a80-01c2-4b82-abb0-078b06ab2c40-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:31:22 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-c6cd432b-1699-4cab-a50a-2dae43f68af9 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Acquiring lock "cinder-quobyte-bb0e1a80-01c2-4b82-abb0-078b06ab2c40" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:31:22 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-c6cd432b-1699-4cab-a50a-2dae43f68af9 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Lock "cinder-quobyte-bb0e1a80-01c2-4b82-abb0-078b06ab2c40" acquired by "delete_volume" :: waited 0.025s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:31:22 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-8edf39f0-8b3c-4bc9-b172-e1f8f6079b98 tempest-VolumesGetTest-1058646393 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:31:22 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-8edf39f0-8b3c-4bc9-b172-e1f8f6079b98 tempest-VolumesGetTest-1058646393 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:31:22 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-8edf39f0-8b3c-4bc9-b172-e1f8f6079b98 tempest-VolumesGetTest-1058646393 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:31:22 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-8edf39f0-8b3c-4bc9-b172-e1f8f6079b98 tempest-VolumesGetTest-1058646393 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:31:22 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-8edf39f0-8b3c-4bc9-b172-e1f8f6079b98 tempest-VolumesGetTest-1058646393 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:31:22 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-8edf39f0-8b3c-4bc9-b172-e1f8f6079b98 tempest-VolumesGetTest-1058646393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:31:22 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2758481-06ab-4bf3-b774-4d6e74e234bb]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:31:22 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-c6cd432b-1699-4cab-a50a-2dae43f68af9 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-bb0e1a80-01c2-4b82-abb0-078b06ab2c40 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:31:22 devstack sudo[97287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:31:22 devstack sudo[97287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:31:22 devstack sudo[97288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-bb0e1a80-01c2-4b82-abb0-078b06ab2c40
Nov 03 18:31:22 devstack sudo[97288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:31:22 devstack sudo[97287]: pam_unix(sudo:session): session closed for user root
Nov 03 18:31:22 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-8edf39f0-8b3c-4bc9-b172-e1f8f6079b98 tempest-VolumesGetTest-1058646393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.276s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:31:22 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-8edf39f0-8b3c-4bc9-b172-e1f8f6079b98 tempest-VolumesGetTest-1058646393 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:31:22 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-8edf39f0-8b3c-4bc9-b172-e1f8f6079b98 tempest-VolumesGetTest-1058646393 None] Deleted volume successfully.
Nov 03 18:31:22 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-8edf39f0-8b3c-4bc9-b172-e1f8f6079b98 tempest-VolumesGetTest-1058646393 None] Lock "cinder-af44b71f-8243-492a-9df5-ce7761e81a5e-delete_volume" released by "delete_volume" :: held 1.550s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:31:22 devstack sudo[97288]: pam_unix(sudo:session): session closed for user root
Nov 03 18:31:22 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-c6cd432b-1699-4cab-a50a-2dae43f68af9 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-bb0e1a80-01c2-4b82-abb0-078b06ab2c40" returned: 0 in 0.439s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:31:22 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-c6cd432b-1699-4cab-a50a-2dae43f68af9 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-bb0e1a80-01c2-4b82-abb0-078b06ab2c40 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:31:22 devstack sudo[97295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-bb0e1a80-01c2-4b82-abb0-078b06ab2c40
Nov 03 18:31:22 devstack sudo[97295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:31:23 devstack sudo[97295]: pam_unix(sudo:session): session closed for user root
Nov 03 18:31:23 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-c6cd432b-1699-4cab-a50a-2dae43f68af9 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-bb0e1a80-01c2-4b82-abb0-078b06ab2c40" returned: 0 in 0.301s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:31:23 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-c6cd432b-1699-4cab-a50a-2dae43f68af9 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Lock "cinder-quobyte-bb0e1a80-01c2-4b82-abb0-078b06ab2c40" released by "delete_volume" :: held 0.809s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:31:23 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-c6cd432b-1699-4cab-a50a-2dae43f68af9 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Created reservations ['2076bc8e-d857-4fb7-9e3e-dc2292245daa', '067a5347-6060-448c-bdf5-6e52239c2aad', '9ca9e57e-f4ad-480c-bbf2-cc0dbcc22d12', '6404dc01-ec50-49a5-b875-04e628ddfe05'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:31:23 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-c6cd432b-1699-4cab-a50a-2dae43f68af9 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:31:23 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-c6cd432b-1699-4cab-a50a-2dae43f68af9 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:31:23 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-c6cd432b-1699-4cab-a50a-2dae43f68af9 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:31:23 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-c6cd432b-1699-4cab-a50a-2dae43f68af9 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:31:23 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-c6cd432b-1699-4cab-a50a-2dae43f68af9 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:31:23 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-c6cd432b-1699-4cab-a50a-2dae43f68af9 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:31:23 devstack sudo[97299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:31:23 devstack sudo[97299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:31:23 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-71e8d38b-abd8-4b5e-984a-378579d11049 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Acquiring lock "cinder-6aa38d6f-f1fa-4668-b9e7-c28fbcfc83b5-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:31:23 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-71e8d38b-abd8-4b5e-984a-378579d11049 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Lock "cinder-6aa38d6f-f1fa-4668-b9e7-c28fbcfc83b5-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:31:23 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-d9f21905-be11-4fd5-a160-bfecd2d430f1 tempest-VolumesGetTest-1058646393 None] Acquiring lock "cinder-20bcf58d-2393-424d-a58b-9237ed286514-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:31:23 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-d9f21905-be11-4fd5-a160-bfecd2d430f1 tempest-VolumesGetTest-1058646393 None] Lock "cinder-20bcf58d-2393-424d-a58b-9237ed286514-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:31:23 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-71e8d38b-abd8-4b5e-984a-378579d11049 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Acquiring lock "cinder-quobyte-6aa38d6f-f1fa-4668-b9e7-c28fbcfc83b5" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:31:23 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-71e8d38b-abd8-4b5e-984a-378579d11049 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Lock "cinder-quobyte-6aa38d6f-f1fa-4668-b9e7-c28fbcfc83b5" acquired by "delete_volume" :: waited 0.045s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:31:23 devstack sudo[97299]: pam_unix(sudo:session): session closed for user root
Nov 03 18:31:23 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-d9f21905-be11-4fd5-a160-bfecd2d430f1 tempest-VolumesGetTest-1058646393 None] Acquiring lock "cinder-quobyte-20bcf58d-2393-424d-a58b-9237ed286514" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:31:23 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-c6cd432b-1699-4cab-a50a-2dae43f68af9 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.454s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:31:23 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-c6cd432b-1699-4cab-a50a-2dae43f68af9 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:31:23 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-d9f21905-be11-4fd5-a160-bfecd2d430f1 tempest-VolumesGetTest-1058646393 None] Lock "cinder-quobyte-20bcf58d-2393-424d-a58b-9237ed286514" acquired by "delete_volume" :: waited 0.024s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:31:23 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[448548c9-9781-43bb-8e70-8f20d310a528]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:31:23 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-c6cd432b-1699-4cab-a50a-2dae43f68af9 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Deleted volume successfully.
Nov 03 18:31:23 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-71e8d38b-abd8-4b5e-984a-378579d11049 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6aa38d6f-f1fa-4668-b9e7-c28fbcfc83b5 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:31:23 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef04daf0-dcd4-4739-a391-4be467fcf504]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:31:23 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-d9f21905-be11-4fd5-a160-bfecd2d430f1 tempest-VolumesGetTest-1058646393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-20bcf58d-2393-424d-a58b-9237ed286514 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:31:23 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-c6cd432b-1699-4cab-a50a-2dae43f68af9 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Lock "cinder-bb0e1a80-01c2-4b82-abb0-078b06ab2c40-delete_volume" released by "delete_volume" :: held 1.666s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:31:23 devstack sudo[97307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6aa38d6f-f1fa-4668-b9e7-c28fbcfc83b5
Nov 03 18:31:23 devstack sudo[97307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:31:23 devstack sudo[97315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-20bcf58d-2393-424d-a58b-9237ed286514
Nov 03 18:31:23 devstack sudo[97315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:31:24 devstack sudo[97307]: pam_unix(sudo:session): session closed for user root
Nov 03 18:31:24 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-71e8d38b-abd8-4b5e-984a-378579d11049 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6aa38d6f-f1fa-4668-b9e7-c28fbcfc83b5" returned: 0 in 0.578s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:31:24 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-71e8d38b-abd8-4b5e-984a-378579d11049 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6aa38d6f-f1fa-4668-b9e7-c28fbcfc83b5 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:31:24 devstack sudo[97356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6aa38d6f-f1fa-4668-b9e7-c28fbcfc83b5
Nov 03 18:31:24 devstack sudo[97356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:31:24 devstack sudo[97315]: pam_unix(sudo:session): session closed for user root
Nov 03 18:31:24 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-d9f21905-be11-4fd5-a160-bfecd2d430f1 tempest-VolumesGetTest-1058646393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-20bcf58d-2393-424d-a58b-9237ed286514" returned: 0 in 0.771s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:31:24 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-d9f21905-be11-4fd5-a160-bfecd2d430f1 tempest-VolumesGetTest-1058646393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-20bcf58d-2393-424d-a58b-9237ed286514 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:31:24 devstack sudo[97369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-20bcf58d-2393-424d-a58b-9237ed286514
Nov 03 18:31:24 devstack sudo[97369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:31:24 devstack sudo[97356]: pam_unix(sudo:session): session closed for user root
Nov 03 18:31:24 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-71e8d38b-abd8-4b5e-984a-378579d11049 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6aa38d6f-f1fa-4668-b9e7-c28fbcfc83b5" returned: 0 in 0.508s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:31:24 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-71e8d38b-abd8-4b5e-984a-378579d11049 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Lock "cinder-quobyte-6aa38d6f-f1fa-4668-b9e7-c28fbcfc83b5" released by "delete_volume" :: held 1.218s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:31:24 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-71e8d38b-abd8-4b5e-984a-378579d11049 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Created reservations ['9b53ef20-bb04-4634-b66b-aa72d603c40e', 'a54d5e70-d5de-4169-b3e0-c98a561123ee', '9fd2b042-a427-449e-a063-d91e0ed411ed', '97f6511f-01b2-4d34-9ff8-326aedfa426e'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:31:25 devstack sudo[97369]: pam_unix(sudo:session): session closed for user root
Nov 03 18:31:25 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-d9f21905-be11-4fd5-a160-bfecd2d430f1 tempest-VolumesGetTest-1058646393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-20bcf58d-2393-424d-a58b-9237ed286514" returned: 0 in 0.588s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:31:25 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-d9f21905-be11-4fd5-a160-bfecd2d430f1 tempest-VolumesGetTest-1058646393 None] Lock "cinder-quobyte-20bcf58d-2393-424d-a58b-9237ed286514" released by "delete_volume" :: held 1.520s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:31:25 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-71e8d38b-abd8-4b5e-984a-378579d11049 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:31:25 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-71e8d38b-abd8-4b5e-984a-378579d11049 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:31:25 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-71e8d38b-abd8-4b5e-984a-378579d11049 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:31:25 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-71e8d38b-abd8-4b5e-984a-378579d11049 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:31:25 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-71e8d38b-abd8-4b5e-984a-378579d11049 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:31:25 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-71e8d38b-abd8-4b5e-984a-378579d11049 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:31:25 devstack sudo[97382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:31:25 devstack sudo[97382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:31:25 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-d9f21905-be11-4fd5-a160-bfecd2d430f1 tempest-VolumesGetTest-1058646393 None] Created reservations ['d4e83c4f-3f12-4fa5-bdc3-7652e8f4abc2', '0c447a2e-e048-431f-8441-8d78e227e7af', '028f8f02-a28b-450d-855b-40d1a47eeb89', '2cbc7418-f9de-4e9d-8559-45bb4f2fd8ee'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:31:25 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-d9f21905-be11-4fd5-a160-bfecd2d430f1 tempest-VolumesGetTest-1058646393 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:31:25 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-d9f21905-be11-4fd5-a160-bfecd2d430f1 tempest-VolumesGetTest-1058646393 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:31:25 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-d9f21905-be11-4fd5-a160-bfecd2d430f1 tempest-VolumesGetTest-1058646393 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:31:25 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-d9f21905-be11-4fd5-a160-bfecd2d430f1 tempest-VolumesGetTest-1058646393 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:31:25 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-d9f21905-be11-4fd5-a160-bfecd2d430f1 tempest-VolumesGetTest-1058646393 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:31:25 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-d9f21905-be11-4fd5-a160-bfecd2d430f1 tempest-VolumesGetTest-1058646393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:31:25 devstack sudo[97386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:31:25 devstack sudo[97386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:31:25 devstack sudo[97382]: pam_unix(sudo:session): session closed for user root
Nov 03 18:31:25 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-71e8d38b-abd8-4b5e-984a-378579d11049 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.424s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:31:25 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-71e8d38b-abd8-4b5e-984a-378579d11049 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:31:25 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-71e8d38b-abd8-4b5e-984a-378579d11049 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Deleted volume successfully.
Nov 03 18:31:25 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-71e8d38b-abd8-4b5e-984a-378579d11049 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Lock "cinder-6aa38d6f-f1fa-4668-b9e7-c28fbcfc83b5-delete_volume" released by "delete_volume" :: held 2.324s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:31:25 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-a4f8048c-9e8d-4efb-b30d-6cbc5ca42dd4 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Acquiring lock "cinder-e3460c46-6207-488d-8ecc-9a06c3b29fab-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:31:25 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-a4f8048c-9e8d-4efb-b30d-6cbc5ca42dd4 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Lock "cinder-e3460c46-6207-488d-8ecc-9a06c3b29fab-delete_volume" acquired by "delete_volume" :: waited 0.078s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:31:26 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-a4f8048c-9e8d-4efb-b30d-6cbc5ca42dd4 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Acquiring lock "cinder-quobyte-e3460c46-6207-488d-8ecc-9a06c3b29fab" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:31:26 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-a4f8048c-9e8d-4efb-b30d-6cbc5ca42dd4 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Lock "cinder-quobyte-e3460c46-6207-488d-8ecc-9a06c3b29fab" acquired by "delete_volume" :: waited 0.038s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:31:26 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[e93570c3-2efe-4eb1-b8dc-af1e38b3816b]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:31:26 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-a4f8048c-9e8d-4efb-b30d-6cbc5ca42dd4 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e3460c46-6207-488d-8ecc-9a06c3b29fab {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:31:26 devstack sudo[97386]: pam_unix(sudo:session): session closed for user root
Nov 03 18:31:26 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-d9f21905-be11-4fd5-a160-bfecd2d430f1 tempest-VolumesGetTest-1058646393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.789s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:31:26 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-d9f21905-be11-4fd5-a160-bfecd2d430f1 tempest-VolumesGetTest-1058646393 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:31:26 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-d9f21905-be11-4fd5-a160-bfecd2d430f1 tempest-VolumesGetTest-1058646393 None] Deleted volume successfully.
Nov 03 18:31:26 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-d9f21905-be11-4fd5-a160-bfecd2d430f1 tempest-VolumesGetTest-1058646393 None] Lock "cinder-20bcf58d-2393-424d-a58b-9237ed286514-delete_volume" released by "delete_volume" :: held 2.873s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:31:26 devstack sudo[97393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e3460c46-6207-488d-8ecc-9a06c3b29fab
Nov 03 18:31:26 devstack sudo[97393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:31:26 devstack sudo[97393]: pam_unix(sudo:session): session closed for user root
Nov 03 18:31:26 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-a4f8048c-9e8d-4efb-b30d-6cbc5ca42dd4 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e3460c46-6207-488d-8ecc-9a06c3b29fab" returned: 0 in 0.710s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:31:26 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-a4f8048c-9e8d-4efb-b30d-6cbc5ca42dd4 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e3460c46-6207-488d-8ecc-9a06c3b29fab {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:31:26 devstack sudo[97399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e3460c46-6207-488d-8ecc-9a06c3b29fab
Nov 03 18:31:27 devstack sudo[97399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:31:27 devstack sudo[97399]: pam_unix(sudo:session): session closed for user root
Nov 03 18:31:27 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-a4f8048c-9e8d-4efb-b30d-6cbc5ca42dd4 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e3460c46-6207-488d-8ecc-9a06c3b29fab" returned: 0 in 0.378s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:31:27 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-a4f8048c-9e8d-4efb-b30d-6cbc5ca42dd4 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Lock "cinder-quobyte-e3460c46-6207-488d-8ecc-9a06c3b29fab" released by "delete_volume" :: held 1.208s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:31:27 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-a4f8048c-9e8d-4efb-b30d-6cbc5ca42dd4 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Created reservations ['62693adc-a6e0-45ec-a4d1-6116ba178737', 'b2be89cd-7b1b-4835-a911-ffadde80f7a3', 'd761d30d-e54a-4c4b-8351-b966826dcf5c', '911c9a3c-b1c2-46a0-90e3-a84afa3f2c66'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:31:27 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-a4f8048c-9e8d-4efb-b30d-6cbc5ca42dd4 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:31:27 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-a4f8048c-9e8d-4efb-b30d-6cbc5ca42dd4 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:31:27 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-a4f8048c-9e8d-4efb-b30d-6cbc5ca42dd4 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:31:27 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-a4f8048c-9e8d-4efb-b30d-6cbc5ca42dd4 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:31:27 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-a4f8048c-9e8d-4efb-b30d-6cbc5ca42dd4 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.042s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:31:27 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-a4f8048c-9e8d-4efb-b30d-6cbc5ca42dd4 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:31:27 devstack sudo[97436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:31:27 devstack sudo[97436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:31:28 devstack sudo[97436]: pam_unix(sudo:session): session closed for user root
Nov 03 18:31:28 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-a4f8048c-9e8d-4efb-b30d-6cbc5ca42dd4 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.544s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:31:28 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-a4f8048c-9e8d-4efb-b30d-6cbc5ca42dd4 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:31:28 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-a4f8048c-9e8d-4efb-b30d-6cbc5ca42dd4 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Deleted volume successfully.
Nov 03 18:31:28 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-a4f8048c-9e8d-4efb-b30d-6cbc5ca42dd4 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Lock "cinder-e3460c46-6207-488d-8ecc-9a06c3b29fab-delete_volume" released by "delete_volume" :: held 2.361s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:31:28 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-3f4129b8-9215-403f-8df1-0e9485069736 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Acquiring lock "cinder-cef1cc73-77f9-4e59-8642-88a7e6a33144-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:31:28 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-3f4129b8-9215-403f-8df1-0e9485069736 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Lock "cinder-cef1cc73-77f9-4e59-8642-88a7e6a33144-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:31:28 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-3f4129b8-9215-403f-8df1-0e9485069736 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Acquiring lock "cinder-quobyte-cef1cc73-77f9-4e59-8642-88a7e6a33144" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:31:28 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-3f4129b8-9215-403f-8df1-0e9485069736 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Lock "cinder-quobyte-cef1cc73-77f9-4e59-8642-88a7e6a33144" acquired by "delete_volume" :: waited 0.021s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:31:28 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fbdebb5-088b-4e72-906c-23348ca2492e]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:31:28 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-3f4129b8-9215-403f-8df1-0e9485069736 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-cef1cc73-77f9-4e59-8642-88a7e6a33144 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:31:28 devstack sudo[97441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-cef1cc73-77f9-4e59-8642-88a7e6a33144
Nov 03 18:31:28 devstack sudo[97441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:31:29 devstack sudo[97441]: pam_unix(sudo:session): session closed for user root
Nov 03 18:31:29 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-3f4129b8-9215-403f-8df1-0e9485069736 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-cef1cc73-77f9-4e59-8642-88a7e6a33144" returned: 0 in 0.430s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:31:29 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-3f4129b8-9215-403f-8df1-0e9485069736 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-cef1cc73-77f9-4e59-8642-88a7e6a33144 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:31:29 devstack sudo[97447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-cef1cc73-77f9-4e59-8642-88a7e6a33144
Nov 03 18:31:29 devstack sudo[97447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:31:29 devstack sudo[97447]: pam_unix(sudo:session): session closed for user root
Nov 03 18:31:29 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-3f4129b8-9215-403f-8df1-0e9485069736 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-cef1cc73-77f9-4e59-8642-88a7e6a33144" returned: 0 in 0.697s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:31:29 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-3f4129b8-9215-403f-8df1-0e9485069736 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Lock "cinder-quobyte-cef1cc73-77f9-4e59-8642-88a7e6a33144" released by "delete_volume" :: held 1.219s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:31:29 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-3f4129b8-9215-403f-8df1-0e9485069736 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Created reservations ['f07d439a-6bdc-43b1-b1cc-2dd60594bddb', '12d4e347-6415-4f16-bfb3-49aaf5830851', 'e0f5db86-a1fa-4557-b76d-9f7607b507f0', '1aed55f7-4446-40c6-8ff5-195beb999ff5'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:31:30 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-3f4129b8-9215-403f-8df1-0e9485069736 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:31:30 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-3f4129b8-9215-403f-8df1-0e9485069736 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:31:30 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-3f4129b8-9215-403f-8df1-0e9485069736 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:31:30 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-3f4129b8-9215-403f-8df1-0e9485069736 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:31:30 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-3f4129b8-9215-403f-8df1-0e9485069736 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:31:30 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-3f4129b8-9215-403f-8df1-0e9485069736 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:31:30 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb563019-2a62-45c8-a37c-ad1ea306bb9f tempest-VolumesActionsTest-1541010714 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:31:30 devstack sudo[97450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:31:30 devstack sudo[97450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:31:30 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-eb563019-2a62-45c8-a37c-ad1ea306bb9f tempest-VolumesActionsTest-1541010714 None] Flow 'volume_create_manager' (89f957e1-a9db-4d3f-b114-8af122d125d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:31:30 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-eb563019-2a62-45c8-a37c-ad1ea306bb9f tempest-VolumesActionsTest-1541010714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (752aad60-c410-48a1-b691-70a1769f508c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:31:30 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-eb563019-2a62-45c8-a37c-ad1ea306bb9f tempest-VolumesActionsTest-1541010714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (752aad60-c410-48a1-b691-70a1769f508c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:31:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1562014879',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b5491a1-f532-48ba-8a52-1b55d80e4070,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01c2db9c6ee349cc9695c54863ba09be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:31:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:31:30Z,use_quota=True,user_id='bdfe1727bc1a44fd9c4b5e708b21f03b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:31:30 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-eb563019-2a62-45c8-a37c-ad1ea306bb9f tempest-VolumesActionsTest-1541010714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5024f1ba-e0b8-4182-914e-7703cfddcaa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:31:30 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-eb563019-2a62-45c8-a37c-ad1ea306bb9f tempest-VolumesActionsTest-1541010714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5024f1ba-e0b8-4182-914e-7703cfddcaa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:31:30 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-eb563019-2a62-45c8-a37c-ad1ea306bb9f tempest-VolumesActionsTest-1541010714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4507c54c-0141-42fb-acd4-ac1561b1f9dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:31:30 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-eb563019-2a62-45c8-a37c-ad1ea306bb9f tempest-VolumesActionsTest-1541010714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4507c54c-0141-42fb-acd4-ac1561b1f9dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b5491a1-f532-48ba-8a52-1b55d80e4070', 'volume_name': 'volume-2b5491a1-f532-48ba-8a52-1b55d80e4070', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:31:30 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-eb563019-2a62-45c8-a37c-ad1ea306bb9f tempest-VolumesActionsTest-1541010714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07893c35-3a80-4b31-9bb0-ca5e690c744f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:31:30 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-eb563019-2a62-45c8-a37c-ad1ea306bb9f tempest-VolumesActionsTest-1541010714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07893c35-3a80-4b31-9bb0-ca5e690c744f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:31:30 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-eb563019-2a62-45c8-a37c-ad1ea306bb9f tempest-VolumesActionsTest-1541010714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9951ccc6-51e1-4ec7-9201-c459bd2ac534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:31:30 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-eb563019-2a62-45c8-a37c-ad1ea306bb9f tempest-VolumesActionsTest-1541010714 None] Volume 2b5491a1-f532-48ba-8a52-1b55d80e4070: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b5491a1-f532-48ba-8a52-1b55d80e4070', 'volume_size': 1}
Nov 03 18:31:30 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-eb563019-2a62-45c8-a37c-ad1ea306bb9f tempest-VolumesActionsTest-1541010714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:31:30 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-eb563019-2a62-45c8-a37c-ad1ea306bb9f tempest-VolumesActionsTest-1541010714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:31:30 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-eb563019-2a62-45c8-a37c-ad1ea306bb9f tempest-VolumesActionsTest-1541010714 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:31:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1562014879',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b5491a1-f532-48ba-8a52-1b55d80e4070,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01c2db9c6ee349cc9695c54863ba09be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:31:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:31:30Z,use_quota=True,user_id='bdfe1727bc1a44fd9c4b5e708b21f03b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:31:30 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-eb563019-2a62-45c8-a37c-ad1ea306bb9f tempest-VolumesActionsTest-1541010714 None] Creating volume 2b5491a1-f532-48ba-8a52-1b55d80e4070 {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:31:30 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-eb563019-2a62-45c8-a37c-ad1ea306bb9f tempest-VolumesActionsTest-1541010714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:31:30 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-eb563019-2a62-45c8-a37c-ad1ea306bb9f tempest-VolumesActionsTest-1541010714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:31:30 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-eb563019-2a62-45c8-a37c-ad1ea306bb9f tempest-VolumesActionsTest-1541010714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:31:30 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-eb563019-2a62-45c8-a37c-ad1ea306bb9f tempest-VolumesActionsTest-1541010714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:31:30 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-eb563019-2a62-45c8-a37c-ad1ea306bb9f tempest-VolumesActionsTest-1541010714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:31:30 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-eb563019-2a62-45c8-a37c-ad1ea306bb9f tempest-VolumesActionsTest-1541010714 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:31:30 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-eb563019-2a62-45c8-a37c-ad1ea306bb9f tempest-VolumesActionsTest-1541010714 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:31:30 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-eb563019-2a62-45c8-a37c-ad1ea306bb9f tempest-VolumesActionsTest-1541010714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2b5491a1-f532-48ba-8a52-1b55d80e4070 1073741824 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:31:30 devstack sudo[97452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2b5491a1-f532-48ba-8a52-1b55d80e4070 1073741824
Nov 03 18:31:30 devstack sudo[97452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:31:30 devstack sudo[97450]: pam_unix(sudo:session): session closed for user root
Nov 03 18:31:30 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-3f4129b8-9215-403f-8df1-0e9485069736 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.404s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:31:30 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-3f4129b8-9215-403f-8df1-0e9485069736 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:31:30 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-3f4129b8-9215-403f-8df1-0e9485069736 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Deleted volume successfully.
Nov 03 18:31:30 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-3f4129b8-9215-403f-8df1-0e9485069736 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Lock "cinder-cef1cc73-77f9-4e59-8642-88a7e6a33144-delete_volume" released by "delete_volume" :: held 2.024s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:31:31 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-d3382c7c-bb8a-48aa-9c5d-adad04b41f19 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Acquiring lock "cinder-e0b54ce3-0a2d-416c-b50e-7d5d748f3f18-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:31:31 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-d3382c7c-bb8a-48aa-9c5d-adad04b41f19 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Lock "cinder-e0b54ce3-0a2d-416c-b50e-7d5d748f3f18-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:31:31 devstack sudo[97452]: pam_unix(sudo:session): session closed for user root
Nov 03 18:31:31 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-eb563019-2a62-45c8-a37c-ad1ea306bb9f tempest-VolumesActionsTest-1541010714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2b5491a1-f532-48ba-8a52-1b55d80e4070 1073741824" returned: 0 in 0.789s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:31:31 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-d3382c7c-bb8a-48aa-9c5d-adad04b41f19 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Acquiring lock "cinder-quobyte-e0b54ce3-0a2d-416c-b50e-7d5d748f3f18" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:31:31 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-d3382c7c-bb8a-48aa-9c5d-adad04b41f19 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Lock "cinder-quobyte-e0b54ce3-0a2d-416c-b50e-7d5d748f3f18" acquired by "delete_volume" :: waited 0.035s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:31:31 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-eb563019-2a62-45c8-a37c-ad1ea306bb9f tempest-VolumesActionsTest-1541010714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2b5491a1-f532-48ba-8a52-1b55d80e4070 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:31:31 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[90d5df53-fca5-49b9-8b00-2546e5c624a2]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:31:31 devstack sudo[97460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2b5491a1-f532-48ba-8a52-1b55d80e4070
Nov 03 18:31:31 devstack sudo[97460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:31:31 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-d3382c7c-bb8a-48aa-9c5d-adad04b41f19 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e0b54ce3-0a2d-416c-b50e-7d5d748f3f18 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:31:31 devstack sudo[97462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e0b54ce3-0a2d-416c-b50e-7d5d748f3f18
Nov 03 18:31:31 devstack sudo[97462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:31:31 devstack sudo[97460]: pam_unix(sudo:session): session closed for user root
Nov 03 18:31:31 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-eb563019-2a62-45c8-a37c-ad1ea306bb9f tempest-VolumesActionsTest-1541010714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2b5491a1-f532-48ba-8a52-1b55d80e4070" returned: 0 in 0.326s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:31:31 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-eb563019-2a62-45c8-a37c-ad1ea306bb9f tempest-VolumesActionsTest-1541010714 None] <== create_volume: return (1284ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:31:31 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-eb563019-2a62-45c8-a37c-ad1ea306bb9f tempest-VolumesActionsTest-1541010714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.294s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:31:31 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-eb563019-2a62-45c8-a37c-ad1ea306bb9f tempest-VolumesActionsTest-1541010714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9951ccc6-51e1-4ec7-9201-c459bd2ac534) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b5491a1-f532-48ba-8a52-1b55d80e4070', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:31:31 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-eb563019-2a62-45c8-a37c-ad1ea306bb9f tempest-VolumesActionsTest-1541010714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fa5db64-aec3-441b-be22-034b4bf38182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:31:31 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-eb563019-2a62-45c8-a37c-ad1ea306bb9f tempest-VolumesActionsTest-1541010714 None] Volume volume-2b5491a1-f532-48ba-8a52-1b55d80e4070 (2b5491a1-f532-48ba-8a52-1b55d80e4070): created successfully
Nov 03 18:31:31 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-eb563019-2a62-45c8-a37c-ad1ea306bb9f tempest-VolumesActionsTest-1541010714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fa5db64-aec3-441b-be22-034b4bf38182) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:31:31 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-eb563019-2a62-45c8-a37c-ad1ea306bb9f tempest-VolumesActionsTest-1541010714 None] Flow 'volume_create_manager' (89f957e1-a9db-4d3f-b114-8af122d125d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:31:31 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-eb563019-2a62-45c8-a37c-ad1ea306bb9f tempest-VolumesActionsTest-1541010714 None] Created volume successfully.
Nov 03 18:31:31 devstack sudo[97462]: pam_unix(sudo:session): session closed for user root
Nov 03 18:31:31 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-d3382c7c-bb8a-48aa-9c5d-adad04b41f19 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e0b54ce3-0a2d-416c-b50e-7d5d748f3f18" returned: 0 in 0.668s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:31:31 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-d3382c7c-bb8a-48aa-9c5d-adad04b41f19 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e0b54ce3-0a2d-416c-b50e-7d5d748f3f18 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:31:32 devstack sudo[97468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e0b54ce3-0a2d-416c-b50e-7d5d748f3f18
Nov 03 18:31:32 devstack sudo[97468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:31:32 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-d6d8131b-2491-4b5e-b745-7bb37b985277 tempest-VolumesActionsTest-1541010714 None] Acquiring lock "cinder-2b5491a1-f532-48ba-8a52-1b55d80e4070" by "attach_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:31:32 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-d6d8131b-2491-4b5e-b745-7bb37b985277 tempest-VolumesActionsTest-1541010714 None] Lock "cinder-2b5491a1-f532-48ba-8a52-1b55d80e4070" acquired by "attach_volume" :: waited 0.033s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:31:32 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-d6d8131b-2491-4b5e-b745-7bb37b985277 tempest-VolumesActionsTest-1541010714 None] Attaching volume 2b5491a1-f532-48ba-8a52-1b55d80e4070 to instance ecafe391-08d3-4e41-b723-f17326c5f929 at mountpoint /dev/vdb on host None.
Nov 03 18:31:32 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-d6d8131b-2491-4b5e-b745-7bb37b985277 tempest-VolumesActionsTest-1541010714 None] Attach volume completed successfully.
Nov 03 18:31:32 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-d6d8131b-2491-4b5e-b745-7bb37b985277 tempest-VolumesActionsTest-1541010714 None] Lock "cinder-2b5491a1-f532-48ba-8a52-1b55d80e4070" released by "attach_volume" :: held 0.170s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:31:32 devstack sudo[97468]: pam_unix(sudo:session): session closed for user root
Nov 03 18:31:32 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-d3382c7c-bb8a-48aa-9c5d-adad04b41f19 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e0b54ce3-0a2d-416c-b50e-7d5d748f3f18" returned: 0 in 0.492s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:31:32 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-d3382c7c-bb8a-48aa-9c5d-adad04b41f19 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Lock "cinder-quobyte-e0b54ce3-0a2d-416c-b50e-7d5d748f3f18" released by "delete_volume" :: held 1.261s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:31:32 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-d3382c7c-bb8a-48aa-9c5d-adad04b41f19 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Created reservations ['16f748c0-f0d7-41e2-9838-6c82e178ac5a', 'a98f2884-18e1-4f8d-a19b-8f202dbae39a', 'cf540ed3-c536-417c-87a8-30213be3f7e2', 'cd5f3003-702c-4856-b15f-95cf0668661f'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:31:32 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-d3382c7c-bb8a-48aa-9c5d-adad04b41f19 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:31:32 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-d3382c7c-bb8a-48aa-9c5d-adad04b41f19 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:31:32 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-d3382c7c-bb8a-48aa-9c5d-adad04b41f19 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:31:32 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-d3382c7c-bb8a-48aa-9c5d-adad04b41f19 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:31:32 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-d3382c7c-bb8a-48aa-9c5d-adad04b41f19 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:31:32 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-d3382c7c-bb8a-48aa-9c5d-adad04b41f19 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:31:32 devstack sudo[97471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:31:32 devstack sudo[97471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:31:33 devstack sudo[97471]: pam_unix(sudo:session): session closed for user root
Nov 03 18:31:33 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-d3382c7c-bb8a-48aa-9c5d-adad04b41f19 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.539s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:31:33 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-d3382c7c-bb8a-48aa-9c5d-adad04b41f19 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:31:33 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-d3382c7c-bb8a-48aa-9c5d-adad04b41f19 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Deleted volume successfully.
Nov 03 18:31:33 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-d3382c7c-bb8a-48aa-9c5d-adad04b41f19 tempest-CreateVolumesFromSourceVolumeTest-1796899537 None] Lock "cinder-e0b54ce3-0a2d-416c-b50e-7d5d748f3f18-delete_volume" released by "delete_volume" :: held 2.239s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:31:33 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-4f2fb9ec-dd9e-4505-85c2-9478f7db8a11 tempest-VolumesActionsTest-764882347 None] Terminate volume connection completed successfully.
Nov 03 18:31:33 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-4f2fb9ec-dd9e-4505-85c2-9478f7db8a11 tempest-VolumesActionsTest-764882347 None] Acquiring lock "cinder-2b5491a1-f532-48ba-8a52-1b55d80e4070-detach_volume" by "detach_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:31:34 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-4f2fb9ec-dd9e-4505-85c2-9478f7db8a11 tempest-VolumesActionsTest-764882347 None] Lock "cinder-2b5491a1-f532-48ba-8a52-1b55d80e4070-detach_volume" acquired by "detach_volume" :: waited 0.028s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:31:34 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-4f2fb9ec-dd9e-4505-85c2-9478f7db8a11 tempest-VolumesActionsTest-764882347 None] Detaching volume 2b5491a1-f532-48ba-8a52-1b55d80e4070 from instance ecafe391-08d3-4e41-b723-f17326c5f929.
Nov 03 18:31:34 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-4f2fb9ec-dd9e-4505-85c2-9478f7db8a11 tempest-VolumesActionsTest-764882347 None] Detach volume completed successfully.
Nov 03 18:31:34 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-4f2fb9ec-dd9e-4505-85c2-9478f7db8a11 tempest-VolumesActionsTest-764882347 None] Lock "cinder-2b5491a1-f532-48ba-8a52-1b55d80e4070-detach_volume" released by "detach_volume" :: held 0.087s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:31:34 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-3acf03d0-2665-4101-93ce-06027dd01445 tempest-VolumesActionsTest-1541010714 None] Acquiring lock "cinder-2b5491a1-f532-48ba-8a52-1b55d80e4070-detach_volume" by "detach_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:31:34 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-3acf03d0-2665-4101-93ce-06027dd01445 tempest-VolumesActionsTest-1541010714 None] Lock "cinder-2b5491a1-f532-48ba-8a52-1b55d80e4070-detach_volume" acquired by "detach_volume" :: waited 0.035s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:31:34 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-3acf03d0-2665-4101-93ce-06027dd01445 tempest-VolumesActionsTest-1541010714 None] Volume detach called, but volume not attached.
Nov 03 18:31:34 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-3acf03d0-2665-4101-93ce-06027dd01445 tempest-VolumesActionsTest-1541010714 None] Lock "cinder-2b5491a1-f532-48ba-8a52-1b55d80e4070-detach_volume" released by "detach_volume" :: held 0.026s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:31:34 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-f82288f2-55d8-4783-a120-2c17e711492b tempest-VolumesActionsTest-1541010714 None] Acquiring lock "cinder-2b5491a1-f532-48ba-8a52-1b55d80e4070-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:31:34 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-f82288f2-55d8-4783-a120-2c17e711492b tempest-VolumesActionsTest-1541010714 None] Lock "cinder-2b5491a1-f532-48ba-8a52-1b55d80e4070-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:31:34 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-f82288f2-55d8-4783-a120-2c17e711492b tempest-VolumesActionsTest-1541010714 None] Acquiring lock "cinder-quobyte-2b5491a1-f532-48ba-8a52-1b55d80e4070" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:31:34 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-f82288f2-55d8-4783-a120-2c17e711492b tempest-VolumesActionsTest-1541010714 None] Lock "cinder-quobyte-2b5491a1-f532-48ba-8a52-1b55d80e4070" acquired by "delete_volume" :: waited 0.019s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:31:35 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[bca54062-ad97-46b3-876c-530d09cb3c94]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:31:35 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-f82288f2-55d8-4783-a120-2c17e711492b tempest-VolumesActionsTest-1541010714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2b5491a1-f532-48ba-8a52-1b55d80e4070 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:31:35 devstack sudo[97474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2b5491a1-f532-48ba-8a52-1b55d80e4070
Nov 03 18:31:35 devstack sudo[97474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:31:35 devstack sudo[97474]: pam_unix(sudo:session): session closed for user root
Nov 03 18:31:35 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-f82288f2-55d8-4783-a120-2c17e711492b tempest-VolumesActionsTest-1541010714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2b5491a1-f532-48ba-8a52-1b55d80e4070" returned: 0 in 0.723s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:31:35 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-f82288f2-55d8-4783-a120-2c17e711492b tempest-VolumesActionsTest-1541010714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2b5491a1-f532-48ba-8a52-1b55d80e4070 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:31:35 devstack sudo[97479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2b5491a1-f532-48ba-8a52-1b55d80e4070
Nov 03 18:31:35 devstack sudo[97479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:31:36 devstack sudo[97479]: pam_unix(sudo:session): session closed for user root
Nov 03 18:31:36 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-f82288f2-55d8-4783-a120-2c17e711492b tempest-VolumesActionsTest-1541010714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2b5491a1-f532-48ba-8a52-1b55d80e4070" returned: 0 in 0.401s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:31:36 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-f82288f2-55d8-4783-a120-2c17e711492b tempest-VolumesActionsTest-1541010714 None] Lock "cinder-quobyte-2b5491a1-f532-48ba-8a52-1b55d80e4070" released by "delete_volume" :: held 1.238s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:31:36 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-f82288f2-55d8-4783-a120-2c17e711492b tempest-VolumesActionsTest-1541010714 None] Created reservations ['a374402b-a2fe-4f18-b38f-adbdda640dd5', '7528ef44-b06e-466d-ba72-fc74e39523b2', '84e504dd-0d5a-4717-b06d-9bd89074d240', '3cd6d73c-bc74-42ef-97f7-0b6be042cfdd'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:31:36 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-f82288f2-55d8-4783-a120-2c17e711492b tempest-VolumesActionsTest-1541010714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:31:36 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-f82288f2-55d8-4783-a120-2c17e711492b tempest-VolumesActionsTest-1541010714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:31:36 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-f82288f2-55d8-4783-a120-2c17e711492b tempest-VolumesActionsTest-1541010714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:31:36 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-f82288f2-55d8-4783-a120-2c17e711492b tempest-VolumesActionsTest-1541010714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:31:36 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-f82288f2-55d8-4783-a120-2c17e711492b tempest-VolumesActionsTest-1541010714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:31:36 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-f82288f2-55d8-4783-a120-2c17e711492b tempest-VolumesActionsTest-1541010714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:31:36 devstack sudo[97482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:31:36 devstack sudo[97482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:31:36 devstack sudo[97482]: pam_unix(sudo:session): session closed for user root
Nov 03 18:31:36 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-f82288f2-55d8-4783-a120-2c17e711492b tempest-VolumesActionsTest-1541010714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.400s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:31:36 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-f82288f2-55d8-4783-a120-2c17e711492b tempest-VolumesActionsTest-1541010714 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:31:36 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-f82288f2-55d8-4783-a120-2c17e711492b tempest-VolumesActionsTest-1541010714 None] Deleted volume successfully.
Nov 03 18:31:36 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-f82288f2-55d8-4783-a120-2c17e711492b tempest-VolumesActionsTest-1541010714 None] Lock "cinder-2b5491a1-f532-48ba-8a52-1b55d80e4070-delete_volume" released by "delete_volume" :: held 1.967s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:31:39 devstack cinder-volume[86120]: DEBUG dbcounter [-] [86120] Writing DB stats cinder:SELECT=169,cinder:INSERT=54,cinder:UPDATE=214,cinder:DELETE=20 {{(pid=86120) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 18:31:39 devstack cinder-volume[86120]: DEBUG dbcounter [-] [86120] Writing DB stats cinder:UPDATE=232,cinder:SELECT=163,cinder:INSERT=60,cinder:DELETE=18 {{(pid=86120) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 18:31:39 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6861bbd-6aed-46b8-97fc-cf57dae54f4f tempest-ProjectReaderTests-2051972745 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:31:39 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-f6861bbd-6aed-46b8-97fc-cf57dae54f4f tempest-ProjectReaderTests-2051972745 None] Flow 'volume_create_manager' (ddf98128-447d-4e11-a70a-7c3aac154e64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:31:39 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-f6861bbd-6aed-46b8-97fc-cf57dae54f4f tempest-ProjectReaderTests-2051972745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b42d71e0-0ea5-4ef8-ad49-1fcdcd802243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:31:39 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-f6861bbd-6aed-46b8-97fc-cf57dae54f4f tempest-ProjectReaderTests-2051972745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b42d71e0-0ea5-4ef8-ad49-1fcdcd802243) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:31:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-859251978',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef098ac4-1157-49ee-a85e-ae09595fb4fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02709074905d461ea3c29a55a70714f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:31:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:31:40Z,use_quota=True,user_id='fdb70b09714242c1a6277076f96926cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:31:39 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-f6861bbd-6aed-46b8-97fc-cf57dae54f4f tempest-ProjectReaderTests-2051972745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08e74cb7-fa7f-4a4a-816d-842625910525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:31:39 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-f6861bbd-6aed-46b8-97fc-cf57dae54f4f tempest-ProjectReaderTests-2051972745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08e74cb7-fa7f-4a4a-816d-842625910525) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:31:39 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-f6861bbd-6aed-46b8-97fc-cf57dae54f4f tempest-ProjectReaderTests-2051972745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (976a5da9-94eb-4957-a4f5-c84f0941ad76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:31:39 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-f6861bbd-6aed-46b8-97fc-cf57dae54f4f tempest-ProjectReaderTests-2051972745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (976a5da9-94eb-4957-a4f5-c84f0941ad76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef098ac4-1157-49ee-a85e-ae09595fb4fe', 'volume_name': 'volume-ef098ac4-1157-49ee-a85e-ae09595fb4fe', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:31:39 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-f6861bbd-6aed-46b8-97fc-cf57dae54f4f tempest-ProjectReaderTests-2051972745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61323056-c989-41ef-ae07-bc365e97330f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:31:39 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-f6861bbd-6aed-46b8-97fc-cf57dae54f4f tempest-ProjectReaderTests-2051972745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61323056-c989-41ef-ae07-bc365e97330f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:31:39 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-f6861bbd-6aed-46b8-97fc-cf57dae54f4f tempest-ProjectReaderTests-2051972745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (430d1a2e-bffa-4675-b362-dc97ffb673f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:31:39 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-f6861bbd-6aed-46b8-97fc-cf57dae54f4f tempest-ProjectReaderTests-2051972745 None] Volume ef098ac4-1157-49ee-a85e-ae09595fb4fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef098ac4-1157-49ee-a85e-ae09595fb4fe', 'volume_size': 1}
Nov 03 18:31:39 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-f6861bbd-6aed-46b8-97fc-cf57dae54f4f tempest-ProjectReaderTests-2051972745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:31:39 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-f6861bbd-6aed-46b8-97fc-cf57dae54f4f tempest-ProjectReaderTests-2051972745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:31:39 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-f6861bbd-6aed-46b8-97fc-cf57dae54f4f tempest-ProjectReaderTests-2051972745 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:31:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-859251978',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef098ac4-1157-49ee-a85e-ae09595fb4fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02709074905d461ea3c29a55a70714f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:31:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:31:40Z,use_quota=True,user_id='fdb70b09714242c1a6277076f96926cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:31:39 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-f6861bbd-6aed-46b8-97fc-cf57dae54f4f tempest-ProjectReaderTests-2051972745 None] Creating volume ef098ac4-1157-49ee-a85e-ae09595fb4fe {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:31:39 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-f6861bbd-6aed-46b8-97fc-cf57dae54f4f tempest-ProjectReaderTests-2051972745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:31:39 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-f6861bbd-6aed-46b8-97fc-cf57dae54f4f tempest-ProjectReaderTests-2051972745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:31:39 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-f6861bbd-6aed-46b8-97fc-cf57dae54f4f tempest-ProjectReaderTests-2051972745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:31:39 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-f6861bbd-6aed-46b8-97fc-cf57dae54f4f tempest-ProjectReaderTests-2051972745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:31:39 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-f6861bbd-6aed-46b8-97fc-cf57dae54f4f tempest-ProjectReaderTests-2051972745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:31:39 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-f6861bbd-6aed-46b8-97fc-cf57dae54f4f tempest-ProjectReaderTests-2051972745 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:31:39 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-f6861bbd-6aed-46b8-97fc-cf57dae54f4f tempest-ProjectReaderTests-2051972745 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:31:39 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-f6861bbd-6aed-46b8-97fc-cf57dae54f4f tempest-ProjectReaderTests-2051972745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ef098ac4-1157-49ee-a85e-ae09595fb4fe 1073741824 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:31:39 devstack sudo[97512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ef098ac4-1157-49ee-a85e-ae09595fb4fe 1073741824
Nov 03 18:31:39 devstack sudo[97512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:31:40 devstack sudo[97512]: pam_unix(sudo:session): session closed for user root
Nov 03 18:31:40 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-f6861bbd-6aed-46b8-97fc-cf57dae54f4f tempest-ProjectReaderTests-2051972745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ef098ac4-1157-49ee-a85e-ae09595fb4fe 1073741824" returned: 0 in 0.580s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:31:40 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-f6861bbd-6aed-46b8-97fc-cf57dae54f4f tempest-ProjectReaderTests-2051972745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ef098ac4-1157-49ee-a85e-ae09595fb4fe {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:31:40 devstack sudo[97519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ef098ac4-1157-49ee-a85e-ae09595fb4fe
Nov 03 18:31:40 devstack sudo[97519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:31:40 devstack sudo[97519]: pam_unix(sudo:session): session closed for user root
Nov 03 18:31:40 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-f6861bbd-6aed-46b8-97fc-cf57dae54f4f tempest-ProjectReaderTests-2051972745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ef098ac4-1157-49ee-a85e-ae09595fb4fe" returned: 0 in 0.308s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:31:40 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-f6861bbd-6aed-46b8-97fc-cf57dae54f4f tempest-ProjectReaderTests-2051972745 None] <== create_volume: return (937ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:31:40 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-f6861bbd-6aed-46b8-97fc-cf57dae54f4f tempest-ProjectReaderTests-2051972745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.940s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:31:40 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-f6861bbd-6aed-46b8-97fc-cf57dae54f4f tempest-ProjectReaderTests-2051972745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (430d1a2e-bffa-4675-b362-dc97ffb673f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef098ac4-1157-49ee-a85e-ae09595fb4fe', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:31:40 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-f6861bbd-6aed-46b8-97fc-cf57dae54f4f tempest-ProjectReaderTests-2051972745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58846836-c5e2-413c-a0cc-c0e218bd6350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:31:40 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-f6861bbd-6aed-46b8-97fc-cf57dae54f4f tempest-ProjectReaderTests-2051972745 None] Volume volume-ef098ac4-1157-49ee-a85e-ae09595fb4fe (ef098ac4-1157-49ee-a85e-ae09595fb4fe): created successfully
Nov 03 18:31:40 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-f6861bbd-6aed-46b8-97fc-cf57dae54f4f tempest-ProjectReaderTests-2051972745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58846836-c5e2-413c-a0cc-c0e218bd6350) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:31:40 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-f6861bbd-6aed-46b8-97fc-cf57dae54f4f tempest-ProjectReaderTests-2051972745 None] Flow 'volume_create_manager' (ddf98128-447d-4e11-a70a-7c3aac154e64) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:31:40 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-f6861bbd-6aed-46b8-97fc-cf57dae54f4f tempest-ProjectReaderTests-2051972745 None] Created volume successfully.
Nov 03 18:31:42 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-65f16ede-2b5c-4348-8fb5-c4af1ec0f329 tempest-ProjectReaderTests-2051972745 None] Acquiring lock "cinder-ef098ac4-1157-49ee-a85e-ae09595fb4fe-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:31:42 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-65f16ede-2b5c-4348-8fb5-c4af1ec0f329 tempest-ProjectReaderTests-2051972745 None] Lock "cinder-ef098ac4-1157-49ee-a85e-ae09595fb4fe-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:31:42 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-65f16ede-2b5c-4348-8fb5-c4af1ec0f329 tempest-ProjectReaderTests-2051972745 None] Acquiring lock "cinder-quobyte-ef098ac4-1157-49ee-a85e-ae09595fb4fe" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:31:42 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-65f16ede-2b5c-4348-8fb5-c4af1ec0f329 tempest-ProjectReaderTests-2051972745 None] Lock "cinder-quobyte-ef098ac4-1157-49ee-a85e-ae09595fb4fe" acquired by "delete_volume" :: waited 0.030s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:31:42 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[a320b95d-56e3-4f45-b7b7-d7e33d9a982d]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:31:42 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-65f16ede-2b5c-4348-8fb5-c4af1ec0f329 tempest-ProjectReaderTests-2051972745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ef098ac4-1157-49ee-a85e-ae09595fb4fe {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:31:42 devstack sudo[97525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ef098ac4-1157-49ee-a85e-ae09595fb4fe
Nov 03 18:31:42 devstack sudo[97525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:31:42 devstack sudo[97525]: pam_unix(sudo:session): session closed for user root
Nov 03 18:31:42 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-65f16ede-2b5c-4348-8fb5-c4af1ec0f329 tempest-ProjectReaderTests-2051972745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ef098ac4-1157-49ee-a85e-ae09595fb4fe" returned: 0 in 0.402s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:31:42 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-65f16ede-2b5c-4348-8fb5-c4af1ec0f329 tempest-ProjectReaderTests-2051972745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ef098ac4-1157-49ee-a85e-ae09595fb4fe {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:31:42 devstack sudo[97530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ef098ac4-1157-49ee-a85e-ae09595fb4fe
Nov 03 18:31:42 devstack sudo[97530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:31:42 devstack sudo[97530]: pam_unix(sudo:session): session closed for user root
Nov 03 18:31:42 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-65f16ede-2b5c-4348-8fb5-c4af1ec0f329 tempest-ProjectReaderTests-2051972745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ef098ac4-1157-49ee-a85e-ae09595fb4fe" returned: 0 in 0.326s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:31:42 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-65f16ede-2b5c-4348-8fb5-c4af1ec0f329 tempest-ProjectReaderTests-2051972745 None] Lock "cinder-quobyte-ef098ac4-1157-49ee-a85e-ae09595fb4fe" released by "delete_volume" :: held 0.782s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:31:42 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-65f16ede-2b5c-4348-8fb5-c4af1ec0f329 tempest-ProjectReaderTests-2051972745 None] Created reservations ['217662d8-2a1f-400d-b17d-37a0f26f0bb6', 'fab13d9c-a524-4e75-9b71-8bb7f61ef655', '8aff4b74-57cb-449f-bcdc-83ae8c131cb0', '1554f7b0-630b-418f-ac1f-65674067df95'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:31:43 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-65f16ede-2b5c-4348-8fb5-c4af1ec0f329 tempest-ProjectReaderTests-2051972745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:31:43 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-65f16ede-2b5c-4348-8fb5-c4af1ec0f329 tempest-ProjectReaderTests-2051972745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:31:43 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-65f16ede-2b5c-4348-8fb5-c4af1ec0f329 tempest-ProjectReaderTests-2051972745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:31:43 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-65f16ede-2b5c-4348-8fb5-c4af1ec0f329 tempest-ProjectReaderTests-2051972745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:31:43 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-65f16ede-2b5c-4348-8fb5-c4af1ec0f329 tempest-ProjectReaderTests-2051972745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:31:43 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-65f16ede-2b5c-4348-8fb5-c4af1ec0f329 tempest-ProjectReaderTests-2051972745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:31:43 devstack sudo[97533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:31:43 devstack sudo[97533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:31:43 devstack sudo[97533]: pam_unix(sudo:session): session closed for user root
Nov 03 18:31:43 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-65f16ede-2b5c-4348-8fb5-c4af1ec0f329 tempest-ProjectReaderTests-2051972745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.361s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:31:43 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-65f16ede-2b5c-4348-8fb5-c4af1ec0f329 tempest-ProjectReaderTests-2051972745 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:31:43 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-65f16ede-2b5c-4348-8fb5-c4af1ec0f329 tempest-ProjectReaderTests-2051972745 None] Deleted volume successfully.
Nov 03 18:31:43 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-65f16ede-2b5c-4348-8fb5-c4af1ec0f329 tempest-ProjectReaderTests-2051972745 None] Lock "cinder-ef098ac4-1157-49ee-a85e-ae09595fb4fe-delete_volume" released by "delete_volume" :: held 1.404s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:31:43 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-93be39e0-d017-43d5-85b9-4bdfad9f0fdd tempest-ProjectReaderTests-2051972745 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:31:43 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-93be39e0-d017-43d5-85b9-4bdfad9f0fdd tempest-ProjectReaderTests-2051972745 None] Flow 'volume_create_manager' (2ee4716c-8b7e-4bd9-b13c-4853cba49666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:31:43 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-93be39e0-d017-43d5-85b9-4bdfad9f0fdd tempest-ProjectReaderTests-2051972745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1e9ed22-83b8-49e8-8b1e-35ffd3dd84d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:31:44 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-93be39e0-d017-43d5-85b9-4bdfad9f0fdd tempest-ProjectReaderTests-2051972745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1e9ed22-83b8-49e8-8b1e-35ffd3dd84d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:31:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-465452483',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e461d62-167e-45a1-b532-7c196b2246d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02709074905d461ea3c29a55a70714f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:31:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:31:44Z,use_quota=True,user_id='fdb70b09714242c1a6277076f96926cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:31:44 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-93be39e0-d017-43d5-85b9-4bdfad9f0fdd tempest-ProjectReaderTests-2051972745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45fe28db-f5e9-4601-b513-a2bdf3071310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:31:44 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-93be39e0-d017-43d5-85b9-4bdfad9f0fdd tempest-ProjectReaderTests-2051972745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45fe28db-f5e9-4601-b513-a2bdf3071310) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:31:44 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-93be39e0-d017-43d5-85b9-4bdfad9f0fdd tempest-ProjectReaderTests-2051972745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3240d42-42b9-4819-8dde-db53a5aed2a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:31:44 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-93be39e0-d017-43d5-85b9-4bdfad9f0fdd tempest-ProjectReaderTests-2051972745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3240d42-42b9-4819-8dde-db53a5aed2a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e461d62-167e-45a1-b532-7c196b2246d5', 'volume_name': 'volume-9e461d62-167e-45a1-b532-7c196b2246d5', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:31:44 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-93be39e0-d017-43d5-85b9-4bdfad9f0fdd tempest-ProjectReaderTests-2051972745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bdf3896-f1f3-4df7-b80a-9489b47f3dc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:31:44 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-93be39e0-d017-43d5-85b9-4bdfad9f0fdd tempest-ProjectReaderTests-2051972745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bdf3896-f1f3-4df7-b80a-9489b47f3dc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:31:44 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-93be39e0-d017-43d5-85b9-4bdfad9f0fdd tempest-ProjectReaderTests-2051972745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c8f1cbb-4890-4c61-9d42-098883e80634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:31:44 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-93be39e0-d017-43d5-85b9-4bdfad9f0fdd tempest-ProjectReaderTests-2051972745 None] Volume 9e461d62-167e-45a1-b532-7c196b2246d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e461d62-167e-45a1-b532-7c196b2246d5', 'volume_size': 1}
Nov 03 18:31:44 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-93be39e0-d017-43d5-85b9-4bdfad9f0fdd tempest-ProjectReaderTests-2051972745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:31:44 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-93be39e0-d017-43d5-85b9-4bdfad9f0fdd tempest-ProjectReaderTests-2051972745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:31:44 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-93be39e0-d017-43d5-85b9-4bdfad9f0fdd tempest-ProjectReaderTests-2051972745 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:31:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-465452483',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e461d62-167e-45a1-b532-7c196b2246d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02709074905d461ea3c29a55a70714f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:31:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:31:44Z,use_quota=True,user_id='fdb70b09714242c1a6277076f96926cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:31:44 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-93be39e0-d017-43d5-85b9-4bdfad9f0fdd tempest-ProjectReaderTests-2051972745 None] Creating volume 9e461d62-167e-45a1-b532-7c196b2246d5 {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:31:44 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-93be39e0-d017-43d5-85b9-4bdfad9f0fdd tempest-ProjectReaderTests-2051972745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:31:44 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-93be39e0-d017-43d5-85b9-4bdfad9f0fdd tempest-ProjectReaderTests-2051972745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:31:44 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-93be39e0-d017-43d5-85b9-4bdfad9f0fdd tempest-ProjectReaderTests-2051972745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:31:44 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-93be39e0-d017-43d5-85b9-4bdfad9f0fdd tempest-ProjectReaderTests-2051972745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:31:44 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-93be39e0-d017-43d5-85b9-4bdfad9f0fdd tempest-ProjectReaderTests-2051972745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:31:44 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-93be39e0-d017-43d5-85b9-4bdfad9f0fdd tempest-ProjectReaderTests-2051972745 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:31:44 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-93be39e0-d017-43d5-85b9-4bdfad9f0fdd tempest-ProjectReaderTests-2051972745 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:31:44 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-93be39e0-d017-43d5-85b9-4bdfad9f0fdd tempest-ProjectReaderTests-2051972745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-9e461d62-167e-45a1-b532-7c196b2246d5 1073741824 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:31:44 devstack sudo[97536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-9e461d62-167e-45a1-b532-7c196b2246d5 1073741824
Nov 03 18:31:44 devstack sudo[97536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:31:44 devstack sudo[97536]: pam_unix(sudo:session): session closed for user root
Nov 03 18:31:44 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-93be39e0-d017-43d5-85b9-4bdfad9f0fdd tempest-ProjectReaderTests-2051972745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-9e461d62-167e-45a1-b532-7c196b2246d5 1073741824" returned: 0 in 0.561s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:31:44 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-93be39e0-d017-43d5-85b9-4bdfad9f0fdd tempest-ProjectReaderTests-2051972745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-9e461d62-167e-45a1-b532-7c196b2246d5 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:31:44 devstack sudo[97542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-9e461d62-167e-45a1-b532-7c196b2246d5
Nov 03 18:31:44 devstack sudo[97542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:31:44 devstack sudo[97542]: pam_unix(sudo:session): session closed for user root
Nov 03 18:31:44 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-93be39e0-d017-43d5-85b9-4bdfad9f0fdd tempest-ProjectReaderTests-2051972745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-9e461d62-167e-45a1-b532-7c196b2246d5" returned: 0 in 0.265s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:31:44 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-93be39e0-d017-43d5-85b9-4bdfad9f0fdd tempest-ProjectReaderTests-2051972745 None] <== create_volume: return (896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:31:44 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-93be39e0-d017-43d5-85b9-4bdfad9f0fdd tempest-ProjectReaderTests-2051972745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.898s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:31:44 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-93be39e0-d017-43d5-85b9-4bdfad9f0fdd tempest-ProjectReaderTests-2051972745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c8f1cbb-4890-4c61-9d42-098883e80634) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e461d62-167e-45a1-b532-7c196b2246d5', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:31:44 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-93be39e0-d017-43d5-85b9-4bdfad9f0fdd tempest-ProjectReaderTests-2051972745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e20abe57-2609-422f-9000-1613827cedfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:31:44 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-93be39e0-d017-43d5-85b9-4bdfad9f0fdd tempest-ProjectReaderTests-2051972745 None] Volume volume-9e461d62-167e-45a1-b532-7c196b2246d5 (9e461d62-167e-45a1-b532-7c196b2246d5): created successfully
Nov 03 18:31:44 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-93be39e0-d017-43d5-85b9-4bdfad9f0fdd tempest-ProjectReaderTests-2051972745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e20abe57-2609-422f-9000-1613827cedfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:31:44 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-93be39e0-d017-43d5-85b9-4bdfad9f0fdd tempest-ProjectReaderTests-2051972745 None] Flow 'volume_create_manager' (2ee4716c-8b7e-4bd9-b13c-4853cba49666) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:31:45 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-93be39e0-d017-43d5-85b9-4bdfad9f0fdd tempest-ProjectReaderTests-2051972745 None] Created volume successfully.
Nov 03 18:31:45 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-89a2251a-7589-421a-873b-54f12586f6a1 tempest-VolumesActionsTest-1541010714 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:31:45 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-89a2251a-7589-421a-873b-54f12586f6a1 tempest-VolumesActionsTest-1541010714 None] Flow 'volume_create_manager' (521bd0cc-e5d9-46bb-b9e7-4c057bd5426a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:31:45 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-89a2251a-7589-421a-873b-54f12586f6a1 tempest-VolumesActionsTest-1541010714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71200180-62cb-4e7d-8982-1854bff4230a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:31:45 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-89a2251a-7589-421a-873b-54f12586f6a1 tempest-VolumesActionsTest-1541010714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71200180-62cb-4e7d-8982-1854bff4230a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:31:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-160154284',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8aa7f61e-e919-43a9-aeff-a5f0d37bf288,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01c2db9c6ee349cc9695c54863ba09be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:31:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:31:46Z,use_quota=True,user_id='bdfe1727bc1a44fd9c4b5e708b21f03b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:31:45 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-89a2251a-7589-421a-873b-54f12586f6a1 tempest-VolumesActionsTest-1541010714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96b2a454-2b05-45fd-84bf-174bcb4956e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:31:45 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-89a2251a-7589-421a-873b-54f12586f6a1 tempest-VolumesActionsTest-1541010714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96b2a454-2b05-45fd-84bf-174bcb4956e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:31:45 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-89a2251a-7589-421a-873b-54f12586f6a1 tempest-VolumesActionsTest-1541010714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (365b7a6e-72e0-4fe0-a69c-3ec86e1ae10a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:31:45 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-89a2251a-7589-421a-873b-54f12586f6a1 tempest-VolumesActionsTest-1541010714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (365b7a6e-72e0-4fe0-a69c-3ec86e1ae10a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8aa7f61e-e919-43a9-aeff-a5f0d37bf288', 'volume_name': 'volume-8aa7f61e-e919-43a9-aeff-a5f0d37bf288', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:31:45 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-89a2251a-7589-421a-873b-54f12586f6a1 tempest-VolumesActionsTest-1541010714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b494a7db-ab4b-4aca-b22b-556c335ac662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:31:45 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-89a2251a-7589-421a-873b-54f12586f6a1 tempest-VolumesActionsTest-1541010714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b494a7db-ab4b-4aca-b22b-556c335ac662) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:31:45 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-89a2251a-7589-421a-873b-54f12586f6a1 tempest-VolumesActionsTest-1541010714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37850a28-f922-4c7a-aace-317934cf94c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:31:45 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-89a2251a-7589-421a-873b-54f12586f6a1 tempest-VolumesActionsTest-1541010714 None] Volume 8aa7f61e-e919-43a9-aeff-a5f0d37bf288: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8aa7f61e-e919-43a9-aeff-a5f0d37bf288', 'volume_size': 1}
Nov 03 18:31:45 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-89a2251a-7589-421a-873b-54f12586f6a1 tempest-VolumesActionsTest-1541010714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:31:45 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-89a2251a-7589-421a-873b-54f12586f6a1 tempest-VolumesActionsTest-1541010714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:31:45 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-89a2251a-7589-421a-873b-54f12586f6a1 tempest-VolumesActionsTest-1541010714 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:31:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-160154284',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8aa7f61e-e919-43a9-aeff-a5f0d37bf288,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01c2db9c6ee349cc9695c54863ba09be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:31:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:31:46Z,use_quota=True,user_id='bdfe1727bc1a44fd9c4b5e708b21f03b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:31:45 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-89a2251a-7589-421a-873b-54f12586f6a1 tempest-VolumesActionsTest-1541010714 None] Creating volume 8aa7f61e-e919-43a9-aeff-a5f0d37bf288 {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:31:45 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-89a2251a-7589-421a-873b-54f12586f6a1 tempest-VolumesActionsTest-1541010714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:31:45 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-89a2251a-7589-421a-873b-54f12586f6a1 tempest-VolumesActionsTest-1541010714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:31:45 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-89a2251a-7589-421a-873b-54f12586f6a1 tempest-VolumesActionsTest-1541010714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:31:45 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-89a2251a-7589-421a-873b-54f12586f6a1 tempest-VolumesActionsTest-1541010714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:31:45 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-89a2251a-7589-421a-873b-54f12586f6a1 tempest-VolumesActionsTest-1541010714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:31:45 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-89a2251a-7589-421a-873b-54f12586f6a1 tempest-VolumesActionsTest-1541010714 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:31:45 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-89a2251a-7589-421a-873b-54f12586f6a1 tempest-VolumesActionsTest-1541010714 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:31:45 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-89a2251a-7589-421a-873b-54f12586f6a1 tempest-VolumesActionsTest-1541010714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8aa7f61e-e919-43a9-aeff-a5f0d37bf288 1073741824 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:31:45 devstack sudo[97545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8aa7f61e-e919-43a9-aeff-a5f0d37bf288 1073741824
Nov 03 18:31:45 devstack sudo[97545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:31:46 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-31bf5cf4-c9fe-4073-b686-66f74ba98743 tempest-ProjectReaderTests-2051972745 None] Acquiring lock "cinder-9e461d62-167e-45a1-b532-7c196b2246d5-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:31:46 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-31bf5cf4-c9fe-4073-b686-66f74ba98743 tempest-ProjectReaderTests-2051972745 None] Lock "cinder-9e461d62-167e-45a1-b532-7c196b2246d5-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:31:46 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-31bf5cf4-c9fe-4073-b686-66f74ba98743 tempest-ProjectReaderTests-2051972745 None] Acquiring lock "cinder-quobyte-9e461d62-167e-45a1-b532-7c196b2246d5" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:31:46 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-31bf5cf4-c9fe-4073-b686-66f74ba98743 tempest-ProjectReaderTests-2051972745 None] Lock "cinder-quobyte-9e461d62-167e-45a1-b532-7c196b2246d5" acquired by "delete_volume" :: waited 0.021s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:31:46 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[7adce127-8c21-4a4e-89dc-197eab9a5dff]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:31:46 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-31bf5cf4-c9fe-4073-b686-66f74ba98743 tempest-ProjectReaderTests-2051972745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-9e461d62-167e-45a1-b532-7c196b2246d5 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:31:46 devstack sudo[97550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-9e461d62-167e-45a1-b532-7c196b2246d5
Nov 03 18:31:46 devstack sudo[97550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:31:46 devstack sudo[97545]: pam_unix(sudo:session): session closed for user root
Nov 03 18:31:46 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-89a2251a-7589-421a-873b-54f12586f6a1 tempest-VolumesActionsTest-1541010714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8aa7f61e-e919-43a9-aeff-a5f0d37bf288 1073741824" returned: 0 in 0.729s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:31:46 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-89a2251a-7589-421a-873b-54f12586f6a1 tempest-VolumesActionsTest-1541010714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8aa7f61e-e919-43a9-aeff-a5f0d37bf288 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:31:46 devstack sudo[97553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8aa7f61e-e919-43a9-aeff-a5f0d37bf288
Nov 03 18:31:46 devstack sudo[97553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:31:46 devstack sudo[97550]: pam_unix(sudo:session): session closed for user root
Nov 03 18:31:46 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-31bf5cf4-c9fe-4073-b686-66f74ba98743 tempest-ProjectReaderTests-2051972745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-9e461d62-167e-45a1-b532-7c196b2246d5" returned: 0 in 0.486s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:31:46 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-31bf5cf4-c9fe-4073-b686-66f74ba98743 tempest-ProjectReaderTests-2051972745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-9e461d62-167e-45a1-b532-7c196b2246d5 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:31:46 devstack sudo[97558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-9e461d62-167e-45a1-b532-7c196b2246d5
Nov 03 18:31:46 devstack sudo[97558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:31:46 devstack sudo[97553]: pam_unix(sudo:session): session closed for user root
Nov 03 18:31:46 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-89a2251a-7589-421a-873b-54f12586f6a1 tempest-VolumesActionsTest-1541010714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8aa7f61e-e919-43a9-aeff-a5f0d37bf288" returned: 0 in 0.318s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:31:46 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-89a2251a-7589-421a-873b-54f12586f6a1 tempest-VolumesActionsTest-1541010714 None] <== create_volume: return (1113ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:31:46 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-89a2251a-7589-421a-873b-54f12586f6a1 tempest-VolumesActionsTest-1541010714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.117s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:31:46 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-89a2251a-7589-421a-873b-54f12586f6a1 tempest-VolumesActionsTest-1541010714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37850a28-f922-4c7a-aace-317934cf94c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8aa7f61e-e919-43a9-aeff-a5f0d37bf288', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:31:46 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-89a2251a-7589-421a-873b-54f12586f6a1 tempest-VolumesActionsTest-1541010714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ede298bb-98c1-4560-b21e-9b14e38e7d0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:31:46 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-89a2251a-7589-421a-873b-54f12586f6a1 tempest-VolumesActionsTest-1541010714 None] Volume volume-8aa7f61e-e919-43a9-aeff-a5f0d37bf288 (8aa7f61e-e919-43a9-aeff-a5f0d37bf288): created successfully
Nov 03 18:31:46 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-89a2251a-7589-421a-873b-54f12586f6a1 tempest-VolumesActionsTest-1541010714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ede298bb-98c1-4560-b21e-9b14e38e7d0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:31:46 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-89a2251a-7589-421a-873b-54f12586f6a1 tempest-VolumesActionsTest-1541010714 None] Flow 'volume_create_manager' (521bd0cc-e5d9-46bb-b9e7-4c057bd5426a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:31:46 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-89a2251a-7589-421a-873b-54f12586f6a1 tempest-VolumesActionsTest-1541010714 None] Created volume successfully.
Nov 03 18:31:47 devstack sudo[97558]: pam_unix(sudo:session): session closed for user root
Nov 03 18:31:47 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-31bf5cf4-c9fe-4073-b686-66f74ba98743 tempest-ProjectReaderTests-2051972745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-9e461d62-167e-45a1-b532-7c196b2246d5" returned: 0 in 0.325s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:31:47 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-31bf5cf4-c9fe-4073-b686-66f74ba98743 tempest-ProjectReaderTests-2051972745 None] Lock "cinder-quobyte-9e461d62-167e-45a1-b532-7c196b2246d5" released by "delete_volume" :: held 0.877s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:31:47 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-31bf5cf4-c9fe-4073-b686-66f74ba98743 tempest-ProjectReaderTests-2051972745 None] Created reservations ['47979d4d-e25a-4d43-87a2-f2a90052d214', '6a847a9d-8121-4c5c-ad09-4b7e4c820507', '3d6e60eb-9c9e-4591-97cc-6ccbf9efe1bc', '77816fe3-950a-47fb-8ead-cab425c1338e'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:31:47 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-31bf5cf4-c9fe-4073-b686-66f74ba98743 tempest-ProjectReaderTests-2051972745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:31:47 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-31bf5cf4-c9fe-4073-b686-66f74ba98743 tempest-ProjectReaderTests-2051972745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:31:47 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-31bf5cf4-c9fe-4073-b686-66f74ba98743 tempest-ProjectReaderTests-2051972745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:31:47 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-31bf5cf4-c9fe-4073-b686-66f74ba98743 tempest-ProjectReaderTests-2051972745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:31:47 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-31bf5cf4-c9fe-4073-b686-66f74ba98743 tempest-ProjectReaderTests-2051972745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:31:47 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-31bf5cf4-c9fe-4073-b686-66f74ba98743 tempest-ProjectReaderTests-2051972745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:31:47 devstack sudo[97562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:31:47 devstack sudo[97562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:31:47 devstack sudo[97562]: pam_unix(sudo:session): session closed for user root
Nov 03 18:31:47 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-31bf5cf4-c9fe-4073-b686-66f74ba98743 tempest-ProjectReaderTests-2051972745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.367s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:31:47 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-31bf5cf4-c9fe-4073-b686-66f74ba98743 tempest-ProjectReaderTests-2051972745 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:31:47 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-31bf5cf4-c9fe-4073-b686-66f74ba98743 tempest-ProjectReaderTests-2051972745 None] Deleted volume successfully.
Nov 03 18:31:47 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-31bf5cf4-c9fe-4073-b686-66f74ba98743 tempest-ProjectReaderTests-2051972745 None] Lock "cinder-9e461d62-167e-45a1-b532-7c196b2246d5-delete_volume" released by "delete_volume" :: held 1.580s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:31:48 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-70b4c0a3-14f5-4740-840a-c029051be232 tempest-VolumesActionsTest-764882347 None] Acquiring lock "cinder-8aa7f61e-e919-43a9-aeff-a5f0d37bf288-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:31:48 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-70b4c0a3-14f5-4740-840a-c029051be232 tempest-VolumesActionsTest-764882347 None] Lock "cinder-8aa7f61e-e919-43a9-aeff-a5f0d37bf288-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:31:48 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-70b4c0a3-14f5-4740-840a-c029051be232 tempest-VolumesActionsTest-764882347 None] Acquiring lock "cinder-quobyte-8aa7f61e-e919-43a9-aeff-a5f0d37bf288" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:31:48 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-70b4c0a3-14f5-4740-840a-c029051be232 tempest-VolumesActionsTest-764882347 None] Lock "cinder-quobyte-8aa7f61e-e919-43a9-aeff-a5f0d37bf288" acquired by "delete_volume" :: waited 0.019s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:31:48 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fbdbb5a-5cc5-471f-8240-50101f66aa9c]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:31:48 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-70b4c0a3-14f5-4740-840a-c029051be232 tempest-VolumesActionsTest-764882347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8aa7f61e-e919-43a9-aeff-a5f0d37bf288 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:31:48 devstack sudo[97565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8aa7f61e-e919-43a9-aeff-a5f0d37bf288
Nov 03 18:31:48 devstack sudo[97565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:31:48 devstack sudo[97565]: pam_unix(sudo:session): session closed for user root
Nov 03 18:31:48 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-70b4c0a3-14f5-4740-840a-c029051be232 tempest-VolumesActionsTest-764882347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8aa7f61e-e919-43a9-aeff-a5f0d37bf288" returned: 0 in 0.557s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:31:48 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-70b4c0a3-14f5-4740-840a-c029051be232 tempest-VolumesActionsTest-764882347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8aa7f61e-e919-43a9-aeff-a5f0d37bf288 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:31:48 devstack sudo[97570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8aa7f61e-e919-43a9-aeff-a5f0d37bf288
Nov 03 18:31:48 devstack sudo[97570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:31:49 devstack sudo[97570]: pam_unix(sudo:session): session closed for user root
Nov 03 18:31:49 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-70b4c0a3-14f5-4740-840a-c029051be232 tempest-VolumesActionsTest-764882347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8aa7f61e-e919-43a9-aeff-a5f0d37bf288" returned: 0 in 0.321s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:31:49 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-70b4c0a3-14f5-4740-840a-c029051be232 tempest-VolumesActionsTest-764882347 None] Lock "cinder-quobyte-8aa7f61e-e919-43a9-aeff-a5f0d37bf288" released by "delete_volume" :: held 0.939s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:31:49 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-70b4c0a3-14f5-4740-840a-c029051be232 tempest-VolumesActionsTest-764882347 None] Created reservations ['e0119f9c-dc0f-4869-9dac-06ddd4452fb1', 'ba45dff9-09ff-4d99-82a7-210e8a5a4543', '57985ae0-1e8b-488a-a725-34e107b976c4', 'acc4dd67-691b-4d5c-b934-51bde8b2f2fa'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:31:49 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-70b4c0a3-14f5-4740-840a-c029051be232 tempest-VolumesActionsTest-764882347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:31:49 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-70b4c0a3-14f5-4740-840a-c029051be232 tempest-VolumesActionsTest-764882347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:31:49 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-70b4c0a3-14f5-4740-840a-c029051be232 tempest-VolumesActionsTest-764882347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:31:49 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-70b4c0a3-14f5-4740-840a-c029051be232 tempest-VolumesActionsTest-764882347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:31:49 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-70b4c0a3-14f5-4740-840a-c029051be232 tempest-VolumesActionsTest-764882347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:31:49 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-70b4c0a3-14f5-4740-840a-c029051be232 tempest-VolumesActionsTest-764882347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:31:49 devstack sudo[97574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:31:49 devstack sudo[97574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:31:49 devstack sudo[97574]: pam_unix(sudo:session): session closed for user root
Nov 03 18:31:49 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-70b4c0a3-14f5-4740-840a-c029051be232 tempest-VolumesActionsTest-764882347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.471s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:31:49 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-70b4c0a3-14f5-4740-840a-c029051be232 tempest-VolumesActionsTest-764882347 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:31:49 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-70b4c0a3-14f5-4740-840a-c029051be232 tempest-VolumesActionsTest-764882347 None] Deleted volume successfully.
Nov 03 18:31:49 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-70b4c0a3-14f5-4740-840a-c029051be232 tempest-VolumesActionsTest-764882347 None] Lock "cinder-8aa7f61e-e919-43a9-aeff-a5f0d37bf288-delete_volume" released by "delete_volume" :: held 1.767s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:31:50 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e4aa54d-464d-44bd-930f-28493a4cebeb tempest-VolumesSnapshotTestJSON-1802230238 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:31:50 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-0e4aa54d-464d-44bd-930f-28493a4cebeb tempest-VolumesSnapshotTestJSON-1802230238 None] Flow 'volume_create_manager' (f5d2d4d7-5b54-4c11-84fb-b41b2a68a43f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:31:50 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-0e4aa54d-464d-44bd-930f-28493a4cebeb tempest-VolumesSnapshotTestJSON-1802230238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e393feb-c022-4569-a8d4-5d0d3816f2a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:31:50 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-0e4aa54d-464d-44bd-930f-28493a4cebeb tempest-VolumesSnapshotTestJSON-1802230238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e393feb-c022-4569-a8d4-5d0d3816f2a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:31:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2145599201',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=376626e4-96de-4582-83fb-6fb52291bcb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab0c92f90881489890fc637dcadeb490',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:31:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:31:50Z,use_quota=True,user_id='b63532e97ecb442abb935c8ea13836cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:31:50 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-0e4aa54d-464d-44bd-930f-28493a4cebeb tempest-VolumesSnapshotTestJSON-1802230238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c7fbb40-4f3d-4056-8bca-5d80dada846f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:31:50 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-0e4aa54d-464d-44bd-930f-28493a4cebeb tempest-VolumesSnapshotTestJSON-1802230238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c7fbb40-4f3d-4056-8bca-5d80dada846f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:31:50 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-0e4aa54d-464d-44bd-930f-28493a4cebeb tempest-VolumesSnapshotTestJSON-1802230238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26547bbf-3765-4130-9437-c24c7c145d45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:31:50 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-0e4aa54d-464d-44bd-930f-28493a4cebeb tempest-VolumesSnapshotTestJSON-1802230238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26547bbf-3765-4130-9437-c24c7c145d45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '376626e4-96de-4582-83fb-6fb52291bcb5', 'volume_name': 'volume-376626e4-96de-4582-83fb-6fb52291bcb5', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:31:50 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-0e4aa54d-464d-44bd-930f-28493a4cebeb tempest-VolumesSnapshotTestJSON-1802230238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d18b01c3-7e07-4471-b628-0fc5fd7f55e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:31:50 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-0e4aa54d-464d-44bd-930f-28493a4cebeb tempest-VolumesSnapshotTestJSON-1802230238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d18b01c3-7e07-4471-b628-0fc5fd7f55e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:31:50 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-0e4aa54d-464d-44bd-930f-28493a4cebeb tempest-VolumesSnapshotTestJSON-1802230238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d0439bb-8199-467c-b501-4d74050b9960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:31:50 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-0e4aa54d-464d-44bd-930f-28493a4cebeb tempest-VolumesSnapshotTestJSON-1802230238 None] Volume 376626e4-96de-4582-83fb-6fb52291bcb5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-376626e4-96de-4582-83fb-6fb52291bcb5', 'volume_size': 1}
Nov 03 18:31:50 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-0e4aa54d-464d-44bd-930f-28493a4cebeb tempest-VolumesSnapshotTestJSON-1802230238 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:31:50 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-0e4aa54d-464d-44bd-930f-28493a4cebeb tempest-VolumesSnapshotTestJSON-1802230238 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:31:50 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-0e4aa54d-464d-44bd-930f-28493a4cebeb tempest-VolumesSnapshotTestJSON-1802230238 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:31:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2145599201',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=376626e4-96de-4582-83fb-6fb52291bcb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab0c92f90881489890fc637dcadeb490',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:31:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:31:50Z,use_quota=True,user_id='b63532e97ecb442abb935c8ea13836cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:31:50 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-0e4aa54d-464d-44bd-930f-28493a4cebeb tempest-VolumesSnapshotTestJSON-1802230238 None] Creating volume 376626e4-96de-4582-83fb-6fb52291bcb5 {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:31:50 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-0e4aa54d-464d-44bd-930f-28493a4cebeb tempest-VolumesSnapshotTestJSON-1802230238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:31:50 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-0e4aa54d-464d-44bd-930f-28493a4cebeb tempest-VolumesSnapshotTestJSON-1802230238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:31:50 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-0e4aa54d-464d-44bd-930f-28493a4cebeb tempest-VolumesSnapshotTestJSON-1802230238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:31:50 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-0e4aa54d-464d-44bd-930f-28493a4cebeb tempest-VolumesSnapshotTestJSON-1802230238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:31:50 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-0e4aa54d-464d-44bd-930f-28493a4cebeb tempest-VolumesSnapshotTestJSON-1802230238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:31:50 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-0e4aa54d-464d-44bd-930f-28493a4cebeb tempest-VolumesSnapshotTestJSON-1802230238 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:31:50 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-0e4aa54d-464d-44bd-930f-28493a4cebeb tempest-VolumesSnapshotTestJSON-1802230238 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:31:50 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-0e4aa54d-464d-44bd-930f-28493a4cebeb tempest-VolumesSnapshotTestJSON-1802230238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-376626e4-96de-4582-83fb-6fb52291bcb5 1073741824 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:31:50 devstack sudo[97578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-376626e4-96de-4582-83fb-6fb52291bcb5 1073741824
Nov 03 18:31:50 devstack sudo[97578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:31:50 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-baf6ad60-6b5e-4670-bd6b-37851619904b tempest-VolumesActionsTest-1541010714 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:31:50 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-baf6ad60-6b5e-4670-bd6b-37851619904b tempest-VolumesActionsTest-1541010714 None] Flow 'volume_create_manager' (e727e19a-b36b-4611-90dc-0de6c024e370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:31:50 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-baf6ad60-6b5e-4670-bd6b-37851619904b tempest-VolumesActionsTest-1541010714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b486730f-e5de-4877-9661-80940af489da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:31:50 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-baf6ad60-6b5e-4670-bd6b-37851619904b tempest-VolumesActionsTest-1541010714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b486730f-e5de-4877-9661-80940af489da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:31:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-544483128',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53bec304-1b9a-44c2-8f41-18ad643baad7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01c2db9c6ee349cc9695c54863ba09be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:31:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:31:51Z,use_quota=True,user_id='bdfe1727bc1a44fd9c4b5e708b21f03b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:31:50 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-baf6ad60-6b5e-4670-bd6b-37851619904b tempest-VolumesActionsTest-1541010714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (402de030-7c66-4243-a461-334154dbb54c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:31:50 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-baf6ad60-6b5e-4670-bd6b-37851619904b tempest-VolumesActionsTest-1541010714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (402de030-7c66-4243-a461-334154dbb54c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:31:50 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-baf6ad60-6b5e-4670-bd6b-37851619904b tempest-VolumesActionsTest-1541010714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b5f56a1-bc7d-4038-beb1-ec154c3ebb97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:31:50 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-baf6ad60-6b5e-4670-bd6b-37851619904b tempest-VolumesActionsTest-1541010714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b5f56a1-bc7d-4038-beb1-ec154c3ebb97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53bec304-1b9a-44c2-8f41-18ad643baad7', 'volume_name': 'volume-53bec304-1b9a-44c2-8f41-18ad643baad7', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:31:50 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-baf6ad60-6b5e-4670-bd6b-37851619904b tempest-VolumesActionsTest-1541010714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34c21e77-7147-427b-aaa7-3827a06604d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:31:50 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-baf6ad60-6b5e-4670-bd6b-37851619904b tempest-VolumesActionsTest-1541010714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34c21e77-7147-427b-aaa7-3827a06604d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:31:50 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-baf6ad60-6b5e-4670-bd6b-37851619904b tempest-VolumesActionsTest-1541010714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (102e151e-55bc-43c4-bee1-46c0976fb359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:31:50 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-baf6ad60-6b5e-4670-bd6b-37851619904b tempest-VolumesActionsTest-1541010714 None] Volume 53bec304-1b9a-44c2-8f41-18ad643baad7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53bec304-1b9a-44c2-8f41-18ad643baad7', 'volume_size': 1}
Nov 03 18:31:50 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-baf6ad60-6b5e-4670-bd6b-37851619904b tempest-VolumesActionsTest-1541010714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:31:51 devstack sudo[97578]: pam_unix(sudo:session): session closed for user root
Nov 03 18:31:51 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-0e4aa54d-464d-44bd-930f-28493a4cebeb tempest-VolumesSnapshotTestJSON-1802230238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-376626e4-96de-4582-83fb-6fb52291bcb5 1073741824" returned: 0 in 0.632s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:31:51 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-0e4aa54d-464d-44bd-930f-28493a4cebeb tempest-VolumesSnapshotTestJSON-1802230238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-376626e4-96de-4582-83fb-6fb52291bcb5 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:31:51 devstack sudo[97584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-376626e4-96de-4582-83fb-6fb52291bcb5
Nov 03 18:31:51 devstack sudo[97584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:31:51 devstack sudo[97584]: pam_unix(sudo:session): session closed for user root
Nov 03 18:31:51 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-0e4aa54d-464d-44bd-930f-28493a4cebeb tempest-VolumesSnapshotTestJSON-1802230238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-376626e4-96de-4582-83fb-6fb52291bcb5" returned: 0 in 0.413s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:31:51 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-0e4aa54d-464d-44bd-930f-28493a4cebeb tempest-VolumesSnapshotTestJSON-1802230238 None] <== create_volume: return (1115ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:31:51 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-0e4aa54d-464d-44bd-930f-28493a4cebeb tempest-VolumesSnapshotTestJSON-1802230238 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.118s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:31:51 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-baf6ad60-6b5e-4670-bd6b-37851619904b tempest-VolumesActionsTest-1541010714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.776s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:31:51 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-baf6ad60-6b5e-4670-bd6b-37851619904b tempest-VolumesActionsTest-1541010714 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:31:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-544483128',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53bec304-1b9a-44c2-8f41-18ad643baad7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01c2db9c6ee349cc9695c54863ba09be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:31:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:31:51Z,use_quota=True,user_id='bdfe1727bc1a44fd9c4b5e708b21f03b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:31:51 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-baf6ad60-6b5e-4670-bd6b-37851619904b tempest-VolumesActionsTest-1541010714 None] Creating volume 53bec304-1b9a-44c2-8f41-18ad643baad7 {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:31:51 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-baf6ad60-6b5e-4670-bd6b-37851619904b tempest-VolumesActionsTest-1541010714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:31:51 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-baf6ad60-6b5e-4670-bd6b-37851619904b tempest-VolumesActionsTest-1541010714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:31:51 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-baf6ad60-6b5e-4670-bd6b-37851619904b tempest-VolumesActionsTest-1541010714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:31:51 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-baf6ad60-6b5e-4670-bd6b-37851619904b tempest-VolumesActionsTest-1541010714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:31:51 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-baf6ad60-6b5e-4670-bd6b-37851619904b tempest-VolumesActionsTest-1541010714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:31:51 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-baf6ad60-6b5e-4670-bd6b-37851619904b tempest-VolumesActionsTest-1541010714 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:31:51 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-baf6ad60-6b5e-4670-bd6b-37851619904b tempest-VolumesActionsTest-1541010714 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:31:51 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-baf6ad60-6b5e-4670-bd6b-37851619904b tempest-VolumesActionsTest-1541010714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-53bec304-1b9a-44c2-8f41-18ad643baad7 1073741824 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:31:51 devstack sudo[97587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-53bec304-1b9a-44c2-8f41-18ad643baad7 1073741824
Nov 03 18:31:51 devstack sudo[97587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:31:51 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-0e4aa54d-464d-44bd-930f-28493a4cebeb tempest-VolumesSnapshotTestJSON-1802230238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d0439bb-8199-467c-b501-4d74050b9960) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-376626e4-96de-4582-83fb-6fb52291bcb5', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:31:51 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-0e4aa54d-464d-44bd-930f-28493a4cebeb tempest-VolumesSnapshotTestJSON-1802230238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de5d7e1d-9284-4f67-b223-0bad84ccfb8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:31:51 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-0e4aa54d-464d-44bd-930f-28493a4cebeb tempest-VolumesSnapshotTestJSON-1802230238 None] Volume volume-376626e4-96de-4582-83fb-6fb52291bcb5 (376626e4-96de-4582-83fb-6fb52291bcb5): created successfully
Nov 03 18:31:51 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-0e4aa54d-464d-44bd-930f-28493a4cebeb tempest-VolumesSnapshotTestJSON-1802230238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de5d7e1d-9284-4f67-b223-0bad84ccfb8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:31:51 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-0e4aa54d-464d-44bd-930f-28493a4cebeb tempest-VolumesSnapshotTestJSON-1802230238 None] Flow 'volume_create_manager' (f5d2d4d7-5b54-4c11-84fb-b41b2a68a43f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:31:51 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-0e4aa54d-464d-44bd-930f-28493a4cebeb tempest-VolumesSnapshotTestJSON-1802230238 None] Created volume successfully.
Nov 03 18:31:52 devstack sudo[97587]: pam_unix(sudo:session): session closed for user root
Nov 03 18:31:52 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-baf6ad60-6b5e-4670-bd6b-37851619904b tempest-VolumesActionsTest-1541010714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-53bec304-1b9a-44c2-8f41-18ad643baad7 1073741824" returned: 0 in 0.614s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:31:52 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-baf6ad60-6b5e-4670-bd6b-37851619904b tempest-VolumesActionsTest-1541010714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-53bec304-1b9a-44c2-8f41-18ad643baad7 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:31:52 devstack sudo[97593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-53bec304-1b9a-44c2-8f41-18ad643baad7
Nov 03 18:31:52 devstack sudo[97593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:31:52 devstack sudo[97593]: pam_unix(sudo:session): session closed for user root
Nov 03 18:31:52 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-baf6ad60-6b5e-4670-bd6b-37851619904b tempest-VolumesActionsTest-1541010714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-53bec304-1b9a-44c2-8f41-18ad643baad7" returned: 0 in 0.366s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:31:52 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-baf6ad60-6b5e-4670-bd6b-37851619904b tempest-VolumesActionsTest-1541010714 None] <== create_volume: return (1043ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:31:52 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-baf6ad60-6b5e-4670-bd6b-37851619904b tempest-VolumesActionsTest-1541010714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.048s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:31:52 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-baf6ad60-6b5e-4670-bd6b-37851619904b tempest-VolumesActionsTest-1541010714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (102e151e-55bc-43c4-bee1-46c0976fb359) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53bec304-1b9a-44c2-8f41-18ad643baad7', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:31:52 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-baf6ad60-6b5e-4670-bd6b-37851619904b tempest-VolumesActionsTest-1541010714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df0c4f49-cd5d-4e02-89d3-0879dbf9831d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:31:52 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-baf6ad60-6b5e-4670-bd6b-37851619904b tempest-VolumesActionsTest-1541010714 None] Volume volume-53bec304-1b9a-44c2-8f41-18ad643baad7 (53bec304-1b9a-44c2-8f41-18ad643baad7): created successfully
Nov 03 18:31:52 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-baf6ad60-6b5e-4670-bd6b-37851619904b tempest-VolumesActionsTest-1541010714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df0c4f49-cd5d-4e02-89d3-0879dbf9831d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:31:52 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-baf6ad60-6b5e-4670-bd6b-37851619904b tempest-VolumesActionsTest-1541010714 None] Flow 'volume_create_manager' (e727e19a-b36b-4611-90dc-0de6c024e370) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:31:52 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-baf6ad60-6b5e-4670-bd6b-37851619904b tempest-VolumesActionsTest-1541010714 None] Created volume successfully.
Nov 03 18:31:52 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-24c64892-7c5d-4c3c-a17f-fec3e467cbfd tempest-VolumesSnapshotTestJSON-1802230238 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:31:52 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-24c64892-7c5d-4c3c-a17f-fec3e467cbfd tempest-VolumesSnapshotTestJSON-1802230238 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:31:52 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-24c64892-7c5d-4c3c-a17f-fec3e467cbfd tempest-VolumesSnapshotTestJSON-1802230238 None] Creating offline snapshot 4e43dfa6-7a9e-46b5-8ad1-fdc1e7093f46 of volume 376626e4-96de-4582-83fb-6fb52291bcb5 {{(pid=86120) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 18:31:52 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ab68ca4-dcdd-49b6-b3ac-04a7f637d14e]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:31:52 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-24c64892-7c5d-4c3c-a17f-fec3e467cbfd tempest-VolumesSnapshotTestJSON-1802230238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-376626e4-96de-4582-83fb-6fb52291bcb5 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:31:53 devstack sudo[97596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-376626e4-96de-4582-83fb-6fb52291bcb5
Nov 03 18:31:53 devstack sudo[97596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:31:53 devstack sudo[97596]: pam_unix(sudo:session): session closed for user root
Nov 03 18:31:53 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-24c64892-7c5d-4c3c-a17f-fec3e467cbfd tempest-VolumesSnapshotTestJSON-1802230238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-376626e4-96de-4582-83fb-6fb52291bcb5" returned: 0 in 0.450s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:31:53 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-24c64892-7c5d-4c3c-a17f-fec3e467cbfd tempest-VolumesSnapshotTestJSON-1802230238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-376626e4-96de-4582-83fb-6fb52291bcb5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-376626e4-96de-4582-83fb-6fb52291bcb5.4e43dfa6-7a9e-46b5-8ad1-fdc1e7093f46 1G {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:31:53 devstack sudo[97601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-376626e4-96de-4582-83fb-6fb52291bcb5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-376626e4-96de-4582-83fb-6fb52291bcb5.4e43dfa6-7a9e-46b5-8ad1-fdc1e7093f46 1G
Nov 03 18:31:53 devstack sudo[97601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:31:53 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-17bef1cc-1371-4043-9f31-219ad55fe8aa tempest-VolumesActionsTest-764882347 None] Acquiring lock "cinder-53bec304-1b9a-44c2-8f41-18ad643baad7-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:31:53 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-17bef1cc-1371-4043-9f31-219ad55fe8aa tempest-VolumesActionsTest-764882347 None] Lock "cinder-53bec304-1b9a-44c2-8f41-18ad643baad7-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:31:54 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-17bef1cc-1371-4043-9f31-219ad55fe8aa tempest-VolumesActionsTest-764882347 None] Acquiring lock "cinder-quobyte-53bec304-1b9a-44c2-8f41-18ad643baad7" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:31:54 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-17bef1cc-1371-4043-9f31-219ad55fe8aa tempest-VolumesActionsTest-764882347 None] Lock "cinder-quobyte-53bec304-1b9a-44c2-8f41-18ad643baad7" acquired by "delete_volume" :: waited 0.041s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:31:54 devstack sudo[97601]: pam_unix(sudo:session): session closed for user root
Nov 03 18:31:54 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-24c64892-7c5d-4c3c-a17f-fec3e467cbfd tempest-VolumesSnapshotTestJSON-1802230238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-376626e4-96de-4582-83fb-6fb52291bcb5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-376626e4-96de-4582-83fb-6fb52291bcb5.4e43dfa6-7a9e-46b5-8ad1-fdc1e7093f46 1G" returned: 0 in 0.672s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:31:54 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-24c64892-7c5d-4c3c-a17f-fec3e467cbfd tempest-VolumesSnapshotTestJSON-1802230238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-376626e4-96de-4582-83fb-6fb52291bcb5 -F qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-376626e4-96de-4582-83fb-6fb52291bcb5.4e43dfa6-7a9e-46b5-8ad1-fdc1e7093f46 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:31:54 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfec8ae5-7a5b-442b-ac87-10b89b139a99]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:31:54 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-17bef1cc-1371-4043-9f31-219ad55fe8aa tempest-VolumesActionsTest-764882347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-53bec304-1b9a-44c2-8f41-18ad643baad7 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:31:54 devstack sudo[97609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-376626e4-96de-4582-83fb-6fb52291bcb5 -F qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-376626e4-96de-4582-83fb-6fb52291bcb5.4e43dfa6-7a9e-46b5-8ad1-fdc1e7093f46
Nov 03 18:31:54 devstack sudo[97609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:31:54 devstack sudo[97610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-53bec304-1b9a-44c2-8f41-18ad643baad7
Nov 03 18:31:54 devstack sudo[97610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:31:54 devstack sudo[97609]: pam_unix(sudo:session): session closed for user root
Nov 03 18:31:54 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-24c64892-7c5d-4c3c-a17f-fec3e467cbfd tempest-VolumesSnapshotTestJSON-1802230238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-376626e4-96de-4582-83fb-6fb52291bcb5 -F qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-376626e4-96de-4582-83fb-6fb52291bcb5.4e43dfa6-7a9e-46b5-8ad1-fdc1e7093f46" returned: 0 in 0.485s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:31:54 devstack cinder-volume[86120]: WARNING cinder.volume.drivers.remotefs [None req-24c64892-7c5d-4c3c-a17f-fec3e467cbfd tempest-VolumesSnapshotTestJSON-1802230238 None] /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-376626e4-96de-4582-83fb-6fb52291bcb5.4e43dfa6-7a9e-46b5-8ad1-fdc1e7093f46 is being set with open permissions: ugo+rw
Nov 03 18:31:54 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-24c64892-7c5d-4c3c-a17f-fec3e467cbfd tempest-VolumesSnapshotTestJSON-1802230238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-376626e4-96de-4582-83fb-6fb52291bcb5.4e43dfa6-7a9e-46b5-8ad1-fdc1e7093f46 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:31:54 devstack sudo[97618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-376626e4-96de-4582-83fb-6fb52291bcb5.4e43dfa6-7a9e-46b5-8ad1-fdc1e7093f46
Nov 03 18:31:54 devstack sudo[97618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:31:54 devstack sudo[97610]: pam_unix(sudo:session): session closed for user root
Nov 03 18:31:54 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-17bef1cc-1371-4043-9f31-219ad55fe8aa tempest-VolumesActionsTest-764882347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-53bec304-1b9a-44c2-8f41-18ad643baad7" returned: 0 in 0.545s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:31:54 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-17bef1cc-1371-4043-9f31-219ad55fe8aa tempest-VolumesActionsTest-764882347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-53bec304-1b9a-44c2-8f41-18ad643baad7 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:31:54 devstack sudo[97621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-53bec304-1b9a-44c2-8f41-18ad643baad7
Nov 03 18:31:54 devstack sudo[97621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:31:54 devstack sudo[97618]: pam_unix(sudo:session): session closed for user root
Nov 03 18:31:54 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-24c64892-7c5d-4c3c-a17f-fec3e467cbfd tempest-VolumesSnapshotTestJSON-1802230238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-376626e4-96de-4582-83fb-6fb52291bcb5.4e43dfa6-7a9e-46b5-8ad1-fdc1e7093f46" returned: 0 in 0.328s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:31:54 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-24c64892-7c5d-4c3c-a17f-fec3e467cbfd tempest-VolumesSnapshotTestJSON-1802230238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-376626e4-96de-4582-83fb-6fb52291bcb5.info {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:31:55 devstack sudo[97625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-376626e4-96de-4582-83fb-6fb52291bcb5.info
Nov 03 18:31:55 devstack sudo[97625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:31:55 devstack sudo[97621]: pam_unix(sudo:session): session closed for user root
Nov 03 18:31:55 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-17bef1cc-1371-4043-9f31-219ad55fe8aa tempest-VolumesActionsTest-764882347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-53bec304-1b9a-44c2-8f41-18ad643baad7" returned: 0 in 0.358s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:31:55 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-17bef1cc-1371-4043-9f31-219ad55fe8aa tempest-VolumesActionsTest-764882347 None] Lock "cinder-quobyte-53bec304-1b9a-44c2-8f41-18ad643baad7" released by "delete_volume" :: held 1.001s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:31:55 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-17bef1cc-1371-4043-9f31-219ad55fe8aa tempest-VolumesActionsTest-764882347 None] Created reservations ['6bd72e1c-fec3-41f5-ac98-1fbc55d204d4', '285f691b-9b4a-4087-9ecf-e889a562b2a3', '496f3333-233e-4467-a90f-d38a1e5456d4', 'e9745834-2dac-4f30-91b8-d63af8e9c382'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:31:55 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-17bef1cc-1371-4043-9f31-219ad55fe8aa tempest-VolumesActionsTest-764882347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:31:55 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-17bef1cc-1371-4043-9f31-219ad55fe8aa tempest-VolumesActionsTest-764882347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:31:55 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-17bef1cc-1371-4043-9f31-219ad55fe8aa tempest-VolumesActionsTest-764882347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:31:55 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-17bef1cc-1371-4043-9f31-219ad55fe8aa tempest-VolumesActionsTest-764882347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:31:55 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-17bef1cc-1371-4043-9f31-219ad55fe8aa tempest-VolumesActionsTest-764882347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:31:55 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-17bef1cc-1371-4043-9f31-219ad55fe8aa tempest-VolumesActionsTest-764882347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:31:55 devstack sudo[97627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:31:55 devstack sudo[97627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:31:55 devstack sudo[97625]: pam_unix(sudo:session): session closed for user root
Nov 03 18:31:55 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-24c64892-7c5d-4c3c-a17f-fec3e467cbfd tempest-VolumesSnapshotTestJSON-1802230238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-376626e4-96de-4582-83fb-6fb52291bcb5.info" returned: 0 in 0.467s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:31:55 devstack cinder-volume[86120]: WARNING cinder.volume.drivers.remotefs [None req-24c64892-7c5d-4c3c-a17f-fec3e467cbfd tempest-VolumesSnapshotTestJSON-1802230238 None] /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-376626e4-96de-4582-83fb-6fb52291bcb5.info is being set with open permissions: ugo+rw
Nov 03 18:31:55 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-24c64892-7c5d-4c3c-a17f-fec3e467cbfd tempest-VolumesSnapshotTestJSON-1802230238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-376626e4-96de-4582-83fb-6fb52291bcb5.info {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:31:55 devstack sudo[97630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-376626e4-96de-4582-83fb-6fb52291bcb5.info
Nov 03 18:31:55 devstack sudo[97630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:31:55 devstack sudo[97627]: pam_unix(sudo:session): session closed for user root
Nov 03 18:31:55 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-17bef1cc-1371-4043-9f31-219ad55fe8aa tempest-VolumesActionsTest-764882347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.318s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:31:55 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-17bef1cc-1371-4043-9f31-219ad55fe8aa tempest-VolumesActionsTest-764882347 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:31:55 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-17bef1cc-1371-4043-9f31-219ad55fe8aa tempest-VolumesActionsTest-764882347 None] Deleted volume successfully.
Nov 03 18:31:55 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-17bef1cc-1371-4043-9f31-219ad55fe8aa tempest-VolumesActionsTest-764882347 None] Lock "cinder-53bec304-1b9a-44c2-8f41-18ad643baad7-delete_volume" released by "delete_volume" :: held 1.630s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:31:55 devstack sudo[97630]: pam_unix(sudo:session): session closed for user root
Nov 03 18:31:55 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-24c64892-7c5d-4c3c-a17f-fec3e467cbfd tempest-VolumesSnapshotTestJSON-1802230238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-376626e4-96de-4582-83fb-6fb52291bcb5.info" returned: 0 in 0.311s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:31:55 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-24c64892-7c5d-4c3c-a17f-fec3e467cbfd tempest-VolumesSnapshotTestJSON-1802230238 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.836s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:31:55 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-24c64892-7c5d-4c3c-a17f-fec3e467cbfd tempest-VolumesSnapshotTestJSON-1802230238 None] Create snapshot completed successfully
Nov 03 18:31:56 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-eb2b755b-c65c-4812-853c-7f48c7387017 tempest-VolumesSnapshotTestJSON-1802230238 None] Acquiring lock "cinder-4e43dfa6-7a9e-46b5-8ad1-fdc1e7093f46-delete_snapshot" by "delete_snapshot" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:31:56 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-eb2b755b-c65c-4812-853c-7f48c7387017 tempest-VolumesSnapshotTestJSON-1802230238 None] Lock "cinder-4e43dfa6-7a9e-46b5-8ad1-fdc1e7093f46-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:31:56 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-eb2b755b-c65c-4812-853c-7f48c7387017 tempest-VolumesSnapshotTestJSON-1802230238 None] Acquiring lock "cinder-quobyte-376626e4-96de-4582-83fb-6fb52291bcb5" by "delete_snapshot" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:31:56 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-eb2b755b-c65c-4812-853c-7f48c7387017 tempest-VolumesSnapshotTestJSON-1802230238 None] Lock "cinder-quobyte-376626e4-96de-4582-83fb-6fb52291bcb5" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:31:56 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-eb2b755b-c65c-4812-853c-7f48c7387017 tempest-VolumesSnapshotTestJSON-1802230238 None] Acquiring lock "cinder-quobyte-4e43dfa6-7a9e-46b5-8ad1-fdc1e7093f46" by "_delete_snapshot" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:31:56 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-eb2b755b-c65c-4812-853c-7f48c7387017 tempest-VolumesSnapshotTestJSON-1802230238 None] Lock "cinder-quobyte-4e43dfa6-7a9e-46b5-8ad1-fdc1e7093f46" acquired by "_delete_snapshot" :: waited 0.041s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:31:56 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-eb2b755b-c65c-4812-853c-7f48c7387017 tempest-VolumesSnapshotTestJSON-1802230238 None] Deleting offline snapshot 4e43dfa6-7a9e-46b5-8ad1-fdc1e7093f46 of volume 376626e4-96de-4582-83fb-6fb52291bcb5 {{(pid=86120) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 18:31:56 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-eb2b755b-c65c-4812-853c-7f48c7387017 tempest-VolumesSnapshotTestJSON-1802230238 None] snapshot_file for this snap is: volume-376626e4-96de-4582-83fb-6fb52291bcb5.4e43dfa6-7a9e-46b5-8ad1-fdc1e7093f46 {{(pid=86120) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 18:31:56 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d8db5ed-97ad-48fc-8aec-dd3ff3ffc268]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:31:56 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-eb2b755b-c65c-4812-853c-7f48c7387017 tempest-VolumesSnapshotTestJSON-1802230238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-376626e4-96de-4582-83fb-6fb52291bcb5.4e43dfa6-7a9e-46b5-8ad1-fdc1e7093f46 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:31:56 devstack sudo[97634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-376626e4-96de-4582-83fb-6fb52291bcb5.4e43dfa6-7a9e-46b5-8ad1-fdc1e7093f46
Nov 03 18:31:56 devstack sudo[97634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:31:57 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-62f3d5b1-2004-4d27-a1b9-5456835930f8 tempest-VolumesActionsTest-1541010714 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:31:57 devstack sudo[97634]: pam_unix(sudo:session): session closed for user root
Nov 03 18:31:57 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-62f3d5b1-2004-4d27-a1b9-5456835930f8 tempest-VolumesActionsTest-1541010714 None] Flow 'volume_create_manager' (e5f2c734-cdc5-4d64-a333-bf103997252f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:31:57 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-62f3d5b1-2004-4d27-a1b9-5456835930f8 tempest-VolumesActionsTest-1541010714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (faf1d650-a5ab-42ea-b0fc-c7c6716f0962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:31:57 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-eb2b755b-c65c-4812-853c-7f48c7387017 tempest-VolumesSnapshotTestJSON-1802230238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-376626e4-96de-4582-83fb-6fb52291bcb5.4e43dfa6-7a9e-46b5-8ad1-fdc1e7093f46" returned: 0 in 0.524s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:31:57 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-eb2b755b-c65c-4812-853c-7f48c7387017 tempest-VolumesSnapshotTestJSON-1802230238 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-376626e4-96de-4582-83fb-6fb52291bcb5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86120) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 18:31:57 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-62f3d5b1-2004-4d27-a1b9-5456835930f8 tempest-VolumesActionsTest-1541010714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (faf1d650-a5ab-42ea-b0fc-c7c6716f0962) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:31:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1338830972',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abe32820-373b-4ee9-be1e-36c47d040443,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01c2db9c6ee349cc9695c54863ba09be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:31:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:31:57Z,use_quota=True,user_id='bdfe1727bc1a44fd9c4b5e708b21f03b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:31:57 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-62f3d5b1-2004-4d27-a1b9-5456835930f8 tempest-VolumesActionsTest-1541010714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27621274-090d-4f1a-b06e-17c1433b03bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:31:57 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-62f3d5b1-2004-4d27-a1b9-5456835930f8 tempest-VolumesActionsTest-1541010714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27621274-090d-4f1a-b06e-17c1433b03bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:31:57 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-62f3d5b1-2004-4d27-a1b9-5456835930f8 tempest-VolumesActionsTest-1541010714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11544c4f-29e0-445b-8bc1-93d27eb6cff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:31:57 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-62f3d5b1-2004-4d27-a1b9-5456835930f8 tempest-VolumesActionsTest-1541010714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11544c4f-29e0-445b-8bc1-93d27eb6cff9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'abe32820-373b-4ee9-be1e-36c47d040443', 'volume_name': 'volume-abe32820-373b-4ee9-be1e-36c47d040443', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:31:57 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-62f3d5b1-2004-4d27-a1b9-5456835930f8 tempest-VolumesActionsTest-1541010714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74be8405-db00-45c8-a8f7-ae32c82836a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:31:57 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-62f3d5b1-2004-4d27-a1b9-5456835930f8 tempest-VolumesActionsTest-1541010714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74be8405-db00-45c8-a8f7-ae32c82836a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:31:57 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-62f3d5b1-2004-4d27-a1b9-5456835930f8 tempest-VolumesActionsTest-1541010714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7e08611-a057-4b3f-b80b-dfd71214d90f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:31:57 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-62f3d5b1-2004-4d27-a1b9-5456835930f8 tempest-VolumesActionsTest-1541010714 None] Volume abe32820-373b-4ee9-be1e-36c47d040443: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-abe32820-373b-4ee9-be1e-36c47d040443', 'volume_size': 1}
Nov 03 18:31:57 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-62f3d5b1-2004-4d27-a1b9-5456835930f8 tempest-VolumesActionsTest-1541010714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:31:57 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-62f3d5b1-2004-4d27-a1b9-5456835930f8 tempest-VolumesActionsTest-1541010714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:31:57 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-62f3d5b1-2004-4d27-a1b9-5456835930f8 tempest-VolumesActionsTest-1541010714 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:31:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1338830972',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abe32820-373b-4ee9-be1e-36c47d040443,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01c2db9c6ee349cc9695c54863ba09be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:31:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:31:57Z,use_quota=True,user_id='bdfe1727bc1a44fd9c4b5e708b21f03b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:31:57 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-62f3d5b1-2004-4d27-a1b9-5456835930f8 tempest-VolumesActionsTest-1541010714 None] Creating volume abe32820-373b-4ee9-be1e-36c47d040443 {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:31:57 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-62f3d5b1-2004-4d27-a1b9-5456835930f8 tempest-VolumesActionsTest-1541010714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:31:57 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-62f3d5b1-2004-4d27-a1b9-5456835930f8 tempest-VolumesActionsTest-1541010714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:31:57 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-62f3d5b1-2004-4d27-a1b9-5456835930f8 tempest-VolumesActionsTest-1541010714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:31:57 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-62f3d5b1-2004-4d27-a1b9-5456835930f8 tempest-VolumesActionsTest-1541010714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:31:57 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-62f3d5b1-2004-4d27-a1b9-5456835930f8 tempest-VolumesActionsTest-1541010714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:31:57 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-62f3d5b1-2004-4d27-a1b9-5456835930f8 tempest-VolumesActionsTest-1541010714 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:31:57 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-62f3d5b1-2004-4d27-a1b9-5456835930f8 tempest-VolumesActionsTest-1541010714 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:31:57 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-62f3d5b1-2004-4d27-a1b9-5456835930f8 tempest-VolumesActionsTest-1541010714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-abe32820-373b-4ee9-be1e-36c47d040443 1073741824 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:31:57 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[45597b8e-b123-4eb5-a40c-75241c738564]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:31:57 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-eb2b755b-c65c-4812-853c-7f48c7387017 tempest-VolumesSnapshotTestJSON-1802230238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-376626e4-96de-4582-83fb-6fb52291bcb5 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:31:57 devstack sudo[97640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-abe32820-373b-4ee9-be1e-36c47d040443 1073741824
Nov 03 18:31:57 devstack sudo[97640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:31:57 devstack sudo[97641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-376626e4-96de-4582-83fb-6fb52291bcb5
Nov 03 18:31:57 devstack sudo[97641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:31:57 devstack sudo[97641]: pam_unix(sudo:session): session closed for user root
Nov 03 18:31:57 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-eb2b755b-c65c-4812-853c-7f48c7387017 tempest-VolumesSnapshotTestJSON-1802230238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-376626e4-96de-4582-83fb-6fb52291bcb5" returned: 0 in 0.567s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:31:57 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-eb2b755b-c65c-4812-853c-7f48c7387017 tempest-VolumesSnapshotTestJSON-1802230238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-376626e4-96de-4582-83fb-6fb52291bcb5.4e43dfa6-7a9e-46b5-8ad1-fdc1e7093f46 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:31:57 devstack sudo[97654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-376626e4-96de-4582-83fb-6fb52291bcb5.4e43dfa6-7a9e-46b5-8ad1-fdc1e7093f46
Nov 03 18:31:57 devstack sudo[97654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:31:57 devstack sudo[97640]: pam_unix(sudo:session): session closed for user root
Nov 03 18:31:57 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-62f3d5b1-2004-4d27-a1b9-5456835930f8 tempest-VolumesActionsTest-1541010714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-abe32820-373b-4ee9-be1e-36c47d040443 1073741824" returned: 0 in 0.681s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:31:57 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-62f3d5b1-2004-4d27-a1b9-5456835930f8 tempest-VolumesActionsTest-1541010714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-abe32820-373b-4ee9-be1e-36c47d040443 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:31:57 devstack sudo[97656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-abe32820-373b-4ee9-be1e-36c47d040443
Nov 03 18:31:57 devstack sudo[97656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:31:58 devstack sudo[97654]: pam_unix(sudo:session): session closed for user root
Nov 03 18:31:58 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-eb2b755b-c65c-4812-853c-7f48c7387017 tempest-VolumesSnapshotTestJSON-1802230238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-376626e4-96de-4582-83fb-6fb52291bcb5.4e43dfa6-7a9e-46b5-8ad1-fdc1e7093f46" returned: 0 in 0.475s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:31:58 devstack sudo[97656]: pam_unix(sudo:session): session closed for user root
Nov 03 18:31:58 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-eb2b755b-c65c-4812-853c-7f48c7387017 tempest-VolumesSnapshotTestJSON-1802230238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-376626e4-96de-4582-83fb-6fb52291bcb5.4e43dfa6-7a9e-46b5-8ad1-fdc1e7093f46 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:31:58 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-62f3d5b1-2004-4d27-a1b9-5456835930f8 tempest-VolumesActionsTest-1541010714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-abe32820-373b-4ee9-be1e-36c47d040443" returned: 0 in 0.344s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:31:58 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-62f3d5b1-2004-4d27-a1b9-5456835930f8 tempest-VolumesActionsTest-1541010714 None] <== create_volume: return (1085ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:31:58 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-62f3d5b1-2004-4d27-a1b9-5456835930f8 tempest-VolumesActionsTest-1541010714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.089s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:31:58 devstack sudo[97662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-376626e4-96de-4582-83fb-6fb52291bcb5.4e43dfa6-7a9e-46b5-8ad1-fdc1e7093f46
Nov 03 18:31:58 devstack sudo[97662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:31:58 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-62f3d5b1-2004-4d27-a1b9-5456835930f8 tempest-VolumesActionsTest-1541010714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7e08611-a057-4b3f-b80b-dfd71214d90f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-abe32820-373b-4ee9-be1e-36c47d040443', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:31:58 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-62f3d5b1-2004-4d27-a1b9-5456835930f8 tempest-VolumesActionsTest-1541010714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f669fd5a-4e1c-4b94-998b-f25a22702ad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:31:58 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-62f3d5b1-2004-4d27-a1b9-5456835930f8 tempest-VolumesActionsTest-1541010714 None] Volume volume-abe32820-373b-4ee9-be1e-36c47d040443 (abe32820-373b-4ee9-be1e-36c47d040443): created successfully
Nov 03 18:31:58 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-62f3d5b1-2004-4d27-a1b9-5456835930f8 tempest-VolumesActionsTest-1541010714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f669fd5a-4e1c-4b94-998b-f25a22702ad6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:31:58 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-62f3d5b1-2004-4d27-a1b9-5456835930f8 tempest-VolumesActionsTest-1541010714 None] Flow 'volume_create_manager' (e5f2c734-cdc5-4d64-a333-bf103997252f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:31:58 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-62f3d5b1-2004-4d27-a1b9-5456835930f8 tempest-VolumesActionsTest-1541010714 None] Created volume successfully.
Nov 03 18:31:58 devstack sudo[97662]: pam_unix(sudo:session): session closed for user root
Nov 03 18:31:58 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-eb2b755b-c65c-4812-853c-7f48c7387017 tempest-VolumesSnapshotTestJSON-1802230238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-376626e4-96de-4582-83fb-6fb52291bcb5.4e43dfa6-7a9e-46b5-8ad1-fdc1e7093f46" returned: 0 in 0.356s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:31:58 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-eb2b755b-c65c-4812-853c-7f48c7387017 tempest-VolumesSnapshotTestJSON-1802230238 None] Lock "cinder-quobyte-4e43dfa6-7a9e-46b5-8ad1-fdc1e7093f46" released by "_delete_snapshot" :: held 2.169s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:31:58 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-eb2b755b-c65c-4812-853c-7f48c7387017 tempest-VolumesSnapshotTestJSON-1802230238 None] Lock "cinder-quobyte-376626e4-96de-4582-83fb-6fb52291bcb5" released by "delete_snapshot" :: held 2.220s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:31:58 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-eb2b755b-c65c-4812-853c-7f48c7387017 tempest-VolumesSnapshotTestJSON-1802230238 None] Created reservations ['f786c3a9-3cbf-446e-be8d-824164de4c90', 'ddc1e964-4063-4486-a3b4-dfe375d22f72', 'f2567e4c-5a5a-450c-a01e-d6c65555f891', '69594f8a-b0a8-4cd4-b416-bdfd7ec8e1f0'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:31:58 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-eb2b755b-c65c-4812-853c-7f48c7387017 tempest-VolumesSnapshotTestJSON-1802230238 None] Delete snapshot completed successfully.
Nov 03 18:31:58 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-eb2b755b-c65c-4812-853c-7f48c7387017 tempest-VolumesSnapshotTestJSON-1802230238 None] Lock "cinder-4e43dfa6-7a9e-46b5-8ad1-fdc1e7093f46-delete_snapshot" released by "delete_snapshot" :: held 2.499s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:31:59 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-d60e8291-fa54-4534-9f0a-3bce3651f493 tempest-VolumesActionsTest-764882347 None] Acquiring lock "cinder-abe32820-373b-4ee9-be1e-36c47d040443-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:31:59 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-d60e8291-fa54-4534-9f0a-3bce3651f493 tempest-VolumesActionsTest-764882347 None] Lock "cinder-abe32820-373b-4ee9-be1e-36c47d040443-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:31:59 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-d60e8291-fa54-4534-9f0a-3bce3651f493 tempest-VolumesActionsTest-764882347 None] Acquiring lock "cinder-quobyte-abe32820-373b-4ee9-be1e-36c47d040443" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:31:59 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-d60e8291-fa54-4534-9f0a-3bce3651f493 tempest-VolumesActionsTest-764882347 None] Lock "cinder-quobyte-abe32820-373b-4ee9-be1e-36c47d040443" acquired by "delete_volume" :: waited 0.025s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:31:59 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1c12003-7a0e-4a61-96c2-d6c9e5c3681a]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:31:59 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-d60e8291-fa54-4534-9f0a-3bce3651f493 tempest-VolumesActionsTest-764882347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-abe32820-373b-4ee9-be1e-36c47d040443 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:31:59 devstack sudo[97676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-abe32820-373b-4ee9-be1e-36c47d040443
Nov 03 18:31:59 devstack sudo[97676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:31:59 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa9b4ab4-8e4e-4f11-8cdb-f0fc1867ee7c tempest-ProjectReaderTests-1272689156 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:31:59 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-aa9b4ab4-8e4e-4f11-8cdb-f0fc1867ee7c tempest-ProjectReaderTests-1272689156 None] Flow 'volume_create_manager' (10a3f277-2a3d-4b36-a483-f649a15e4d79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:31:59 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-aa9b4ab4-8e4e-4f11-8cdb-f0fc1867ee7c tempest-ProjectReaderTests-1272689156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac7ee32d-31b9-4f0f-841a-3fa11fb37214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:32:00 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-aa9b4ab4-8e4e-4f11-8cdb-f0fc1867ee7c tempest-ProjectReaderTests-1272689156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac7ee32d-31b9-4f0f-841a-3fa11fb37214) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:31:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2068303489',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6df1f532-3435-4c42-8a2e-f35d5f1dd3b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a9d2cf922c447649a36df9707fab65e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:32:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:32:00Z,use_quota=True,user_id='9d80735c04024af0abff0a3c0c54c250',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:32:00 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-aa9b4ab4-8e4e-4f11-8cdb-f0fc1867ee7c tempest-ProjectReaderTests-1272689156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b84bab4-3d17-40b8-bff7-1cc92945cbc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:32:00 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-aa9b4ab4-8e4e-4f11-8cdb-f0fc1867ee7c tempest-ProjectReaderTests-1272689156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b84bab4-3d17-40b8-bff7-1cc92945cbc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:32:00 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-aa9b4ab4-8e4e-4f11-8cdb-f0fc1867ee7c tempest-ProjectReaderTests-1272689156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fbbdbfd-0a48-46ab-a916-7a8b1faf92e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:32:00 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-aa9b4ab4-8e4e-4f11-8cdb-f0fc1867ee7c tempest-ProjectReaderTests-1272689156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fbbdbfd-0a48-46ab-a916-7a8b1faf92e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6df1f532-3435-4c42-8a2e-f35d5f1dd3b2', 'volume_name': 'volume-6df1f532-3435-4c42-8a2e-f35d5f1dd3b2', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:32:00 devstack sudo[97676]: pam_unix(sudo:session): session closed for user root
Nov 03 18:32:00 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-aa9b4ab4-8e4e-4f11-8cdb-f0fc1867ee7c tempest-ProjectReaderTests-1272689156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (688d215a-d189-49c9-88c5-42db7a521484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:32:00 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-aa9b4ab4-8e4e-4f11-8cdb-f0fc1867ee7c tempest-ProjectReaderTests-1272689156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (688d215a-d189-49c9-88c5-42db7a521484) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:32:00 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-aa9b4ab4-8e4e-4f11-8cdb-f0fc1867ee7c tempest-ProjectReaderTests-1272689156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (039dd00d-1cb2-4f1c-9830-5f32cf592e04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:32:00 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-aa9b4ab4-8e4e-4f11-8cdb-f0fc1867ee7c tempest-ProjectReaderTests-1272689156 None] Volume 6df1f532-3435-4c42-8a2e-f35d5f1dd3b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6df1f532-3435-4c42-8a2e-f35d5f1dd3b2', 'volume_size': 1}
Nov 03 18:32:00 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-aa9b4ab4-8e4e-4f11-8cdb-f0fc1867ee7c tempest-ProjectReaderTests-1272689156 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:32:00 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-aa9b4ab4-8e4e-4f11-8cdb-f0fc1867ee7c tempest-ProjectReaderTests-1272689156 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:32:00 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-aa9b4ab4-8e4e-4f11-8cdb-f0fc1867ee7c tempest-ProjectReaderTests-1272689156 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:31:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2068303489',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6df1f532-3435-4c42-8a2e-f35d5f1dd3b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a9d2cf922c447649a36df9707fab65e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:32:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:32:00Z,use_quota=True,user_id='9d80735c04024af0abff0a3c0c54c250',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:32:00 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-aa9b4ab4-8e4e-4f11-8cdb-f0fc1867ee7c tempest-ProjectReaderTests-1272689156 None] Creating volume 6df1f532-3435-4c42-8a2e-f35d5f1dd3b2 {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:32:00 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-aa9b4ab4-8e4e-4f11-8cdb-f0fc1867ee7c tempest-ProjectReaderTests-1272689156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:32:00 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-aa9b4ab4-8e4e-4f11-8cdb-f0fc1867ee7c tempest-ProjectReaderTests-1272689156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:32:00 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-aa9b4ab4-8e4e-4f11-8cdb-f0fc1867ee7c tempest-ProjectReaderTests-1272689156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:32:00 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-aa9b4ab4-8e4e-4f11-8cdb-f0fc1867ee7c tempest-ProjectReaderTests-1272689156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:32:00 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-aa9b4ab4-8e4e-4f11-8cdb-f0fc1867ee7c tempest-ProjectReaderTests-1272689156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:32:00 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-aa9b4ab4-8e4e-4f11-8cdb-f0fc1867ee7c tempest-ProjectReaderTests-1272689156 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:32:00 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-aa9b4ab4-8e4e-4f11-8cdb-f0fc1867ee7c tempest-ProjectReaderTests-1272689156 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:32:00 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-aa9b4ab4-8e4e-4f11-8cdb-f0fc1867ee7c tempest-ProjectReaderTests-1272689156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6df1f532-3435-4c42-8a2e-f35d5f1dd3b2 1073741824 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:32:00 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-d60e8291-fa54-4534-9f0a-3bce3651f493 tempest-VolumesActionsTest-764882347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-abe32820-373b-4ee9-be1e-36c47d040443" returned: 0 in 0.521s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:32:00 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-d60e8291-fa54-4534-9f0a-3bce3651f493 tempest-VolumesActionsTest-764882347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-abe32820-373b-4ee9-be1e-36c47d040443 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:32:00 devstack sudo[97686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6df1f532-3435-4c42-8a2e-f35d5f1dd3b2 1073741824
Nov 03 18:32:00 devstack sudo[97686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:32:00 devstack sudo[97687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-abe32820-373b-4ee9-be1e-36c47d040443
Nov 03 18:32:00 devstack sudo[97687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:32:00 devstack sudo[97687]: pam_unix(sudo:session): session closed for user root
Nov 03 18:32:00 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-d60e8291-fa54-4534-9f0a-3bce3651f493 tempest-VolumesActionsTest-764882347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-abe32820-373b-4ee9-be1e-36c47d040443" returned: 0 in 0.340s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:32:00 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-d60e8291-fa54-4534-9f0a-3bce3651f493 tempest-VolumesActionsTest-764882347 None] Lock "cinder-quobyte-abe32820-373b-4ee9-be1e-36c47d040443" released by "delete_volume" :: held 0.974s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:32:00 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba3d081c-b6b9-45ff-869b-10515dc1a528 tempest-VolumesSnapshotTestJSON-1802230238 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:32:00 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-ba3d081c-b6b9-45ff-869b-10515dc1a528 tempest-VolumesSnapshotTestJSON-1802230238 None] Flow 'volume_create_manager' (4a5808df-9354-40d7-922b-d294634730da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:32:00 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-ba3d081c-b6b9-45ff-869b-10515dc1a528 tempest-VolumesSnapshotTestJSON-1802230238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e37c697-531f-4168-b775-b0156279e40b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:32:00 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-d60e8291-fa54-4534-9f0a-3bce3651f493 tempest-VolumesActionsTest-764882347 None] Created reservations ['57340190-b633-4818-80d4-a13666971028', '5f2b84c7-9ff8-4e5e-bd4f-0003868f5f6e', '681cd40a-c2d9-46a8-add2-6832f582f574', 'a3d741ce-656b-4af9-a7f9-c33b604e32de'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:32:00 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-ba3d081c-b6b9-45ff-869b-10515dc1a528 tempest-VolumesSnapshotTestJSON-1802230238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e37c697-531f-4168-b775-b0156279e40b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:32:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-554168183',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3a16914-4aab-4f30-a54b-569287ecc7e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab0c92f90881489890fc637dcadeb490',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:32:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:32:00Z,use_quota=True,user_id='b63532e97ecb442abb935c8ea13836cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:32:00 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-ba3d081c-b6b9-45ff-869b-10515dc1a528 tempest-VolumesSnapshotTestJSON-1802230238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46165d13-f0ea-471f-b32b-a88bc564eb55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:32:00 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-ba3d081c-b6b9-45ff-869b-10515dc1a528 tempest-VolumesSnapshotTestJSON-1802230238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46165d13-f0ea-471f-b32b-a88bc564eb55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:32:00 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-ba3d081c-b6b9-45ff-869b-10515dc1a528 tempest-VolumesSnapshotTestJSON-1802230238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa00e835-e3ca-47f1-b17c-27b0c135e187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:32:00 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-ba3d081c-b6b9-45ff-869b-10515dc1a528 tempest-VolumesSnapshotTestJSON-1802230238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa00e835-e3ca-47f1-b17c-27b0c135e187) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3a16914-4aab-4f30-a54b-569287ecc7e6', 'volume_name': 'volume-e3a16914-4aab-4f30-a54b-569287ecc7e6', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:32:00 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-ba3d081c-b6b9-45ff-869b-10515dc1a528 tempest-VolumesSnapshotTestJSON-1802230238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc9fe724-befc-48b5-95ec-5ddeac136549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:32:00 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-ba3d081c-b6b9-45ff-869b-10515dc1a528 tempest-VolumesSnapshotTestJSON-1802230238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc9fe724-befc-48b5-95ec-5ddeac136549) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:32:00 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-ba3d081c-b6b9-45ff-869b-10515dc1a528 tempest-VolumesSnapshotTestJSON-1802230238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96a8b12c-6541-46db-9b21-4e26563bc0e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:32:00 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-ba3d081c-b6b9-45ff-869b-10515dc1a528 tempest-VolumesSnapshotTestJSON-1802230238 None] Volume e3a16914-4aab-4f30-a54b-569287ecc7e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3a16914-4aab-4f30-a54b-569287ecc7e6', 'volume_size': 1}
Nov 03 18:32:00 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-ba3d081c-b6b9-45ff-869b-10515dc1a528 tempest-VolumesSnapshotTestJSON-1802230238 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:32:00 devstack sudo[97686]: pam_unix(sudo:session): session closed for user root
Nov 03 18:32:00 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-aa9b4ab4-8e4e-4f11-8cdb-f0fc1867ee7c tempest-ProjectReaderTests-1272689156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6df1f532-3435-4c42-8a2e-f35d5f1dd3b2 1073741824" returned: 0 in 0.626s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:32:00 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-aa9b4ab4-8e4e-4f11-8cdb-f0fc1867ee7c tempest-ProjectReaderTests-1272689156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6df1f532-3435-4c42-8a2e-f35d5f1dd3b2 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:32:00 devstack sudo[97697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6df1f532-3435-4c42-8a2e-f35d5f1dd3b2
Nov 03 18:32:00 devstack sudo[97697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:32:00 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-d60e8291-fa54-4534-9f0a-3bce3651f493 tempest-VolumesActionsTest-764882347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:32:00 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-d60e8291-fa54-4534-9f0a-3bce3651f493 tempest-VolumesActionsTest-764882347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:32:00 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-d60e8291-fa54-4534-9f0a-3bce3651f493 tempest-VolumesActionsTest-764882347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:32:00 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-d60e8291-fa54-4534-9f0a-3bce3651f493 tempest-VolumesActionsTest-764882347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:32:00 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-d60e8291-fa54-4534-9f0a-3bce3651f493 tempest-VolumesActionsTest-764882347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:32:00 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-d60e8291-fa54-4534-9f0a-3bce3651f493 tempest-VolumesActionsTest-764882347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:32:00 devstack sudo[97699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:32:00 devstack sudo[97699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:32:01 devstack sudo[97697]: pam_unix(sudo:session): session closed for user root
Nov 03 18:32:01 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-aa9b4ab4-8e4e-4f11-8cdb-f0fc1867ee7c tempest-ProjectReaderTests-1272689156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6df1f532-3435-4c42-8a2e-f35d5f1dd3b2" returned: 0 in 0.307s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:32:01 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-aa9b4ab4-8e4e-4f11-8cdb-f0fc1867ee7c tempest-ProjectReaderTests-1272689156 None] <== create_volume: return (1004ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:32:01 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-aa9b4ab4-8e4e-4f11-8cdb-f0fc1867ee7c tempest-ProjectReaderTests-1272689156 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.010s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:32:01 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-ba3d081c-b6b9-45ff-869b-10515dc1a528 tempest-VolumesSnapshotTestJSON-1802230238 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.407s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:32:01 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-ba3d081c-b6b9-45ff-869b-10515dc1a528 tempest-VolumesSnapshotTestJSON-1802230238 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:32:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-554168183',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3a16914-4aab-4f30-a54b-569287ecc7e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab0c92f90881489890fc637dcadeb490',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:32:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:32:00Z,use_quota=True,user_id='b63532e97ecb442abb935c8ea13836cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:32:01 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-ba3d081c-b6b9-45ff-869b-10515dc1a528 tempest-VolumesSnapshotTestJSON-1802230238 None] Creating volume e3a16914-4aab-4f30-a54b-569287ecc7e6 {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:32:01 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-ba3d081c-b6b9-45ff-869b-10515dc1a528 tempest-VolumesSnapshotTestJSON-1802230238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:32:01 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-ba3d081c-b6b9-45ff-869b-10515dc1a528 tempest-VolumesSnapshotTestJSON-1802230238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:32:01 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-ba3d081c-b6b9-45ff-869b-10515dc1a528 tempest-VolumesSnapshotTestJSON-1802230238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:32:01 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-ba3d081c-b6b9-45ff-869b-10515dc1a528 tempest-VolumesSnapshotTestJSON-1802230238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:32:01 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-ba3d081c-b6b9-45ff-869b-10515dc1a528 tempest-VolumesSnapshotTestJSON-1802230238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:32:01 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-ba3d081c-b6b9-45ff-869b-10515dc1a528 tempest-VolumesSnapshotTestJSON-1802230238 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:32:01 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-ba3d081c-b6b9-45ff-869b-10515dc1a528 tempest-VolumesSnapshotTestJSON-1802230238 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:32:01 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-ba3d081c-b6b9-45ff-869b-10515dc1a528 tempest-VolumesSnapshotTestJSON-1802230238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e3a16914-4aab-4f30-a54b-569287ecc7e6 1073741824 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:32:01 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-aa9b4ab4-8e4e-4f11-8cdb-f0fc1867ee7c tempest-ProjectReaderTests-1272689156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (039dd00d-1cb2-4f1c-9830-5f32cf592e04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6df1f532-3435-4c42-8a2e-f35d5f1dd3b2', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:32:01 devstack sudo[97703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e3a16914-4aab-4f30-a54b-569287ecc7e6 1073741824
Nov 03 18:32:01 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-aa9b4ab4-8e4e-4f11-8cdb-f0fc1867ee7c tempest-ProjectReaderTests-1272689156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0102b8f-fb44-4ee0-a05b-179c255cb2e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:32:01 devstack sudo[97703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:32:01 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-aa9b4ab4-8e4e-4f11-8cdb-f0fc1867ee7c tempest-ProjectReaderTests-1272689156 None] Volume volume-6df1f532-3435-4c42-8a2e-f35d5f1dd3b2 (6df1f532-3435-4c42-8a2e-f35d5f1dd3b2): created successfully
Nov 03 18:32:01 devstack sudo[97699]: pam_unix(sudo:session): session closed for user root
Nov 03 18:32:01 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-aa9b4ab4-8e4e-4f11-8cdb-f0fc1867ee7c tempest-ProjectReaderTests-1272689156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0102b8f-fb44-4ee0-a05b-179c255cb2e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:32:01 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-aa9b4ab4-8e4e-4f11-8cdb-f0fc1867ee7c tempest-ProjectReaderTests-1272689156 None] Flow 'volume_create_manager' (10a3f277-2a3d-4b36-a483-f649a15e4d79) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:32:01 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-d60e8291-fa54-4534-9f0a-3bce3651f493 tempest-VolumesActionsTest-764882347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.354s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:32:01 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-d60e8291-fa54-4534-9f0a-3bce3651f493 tempest-VolumesActionsTest-764882347 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:32:01 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-d60e8291-fa54-4534-9f0a-3bce3651f493 tempest-VolumesActionsTest-764882347 None] Deleted volume successfully.
Nov 03 18:32:01 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-aa9b4ab4-8e4e-4f11-8cdb-f0fc1867ee7c tempest-ProjectReaderTests-1272689156 None] Created volume successfully.
Nov 03 18:32:01 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-d60e8291-fa54-4534-9f0a-3bce3651f493 tempest-VolumesActionsTest-764882347 None] Lock "cinder-abe32820-373b-4ee9-be1e-36c47d040443-delete_volume" released by "delete_volume" :: held 1.839s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:32:01 devstack sudo[97703]: pam_unix(sudo:session): session closed for user root
Nov 03 18:32:01 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-ba3d081c-b6b9-45ff-869b-10515dc1a528 tempest-VolumesSnapshotTestJSON-1802230238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e3a16914-4aab-4f30-a54b-569287ecc7e6 1073741824" returned: 0 in 0.477s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:32:01 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-ba3d081c-b6b9-45ff-869b-10515dc1a528 tempest-VolumesSnapshotTestJSON-1802230238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e3a16914-4aab-4f30-a54b-569287ecc7e6 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:32:01 devstack sudo[97709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e3a16914-4aab-4f30-a54b-569287ecc7e6
Nov 03 18:32:01 devstack sudo[97709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:32:01 devstack sudo[97709]: pam_unix(sudo:session): session closed for user root
Nov 03 18:32:01 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-ba3d081c-b6b9-45ff-869b-10515dc1a528 tempest-VolumesSnapshotTestJSON-1802230238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e3a16914-4aab-4f30-a54b-569287ecc7e6" returned: 0 in 0.369s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:32:01 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-ba3d081c-b6b9-45ff-869b-10515dc1a528 tempest-VolumesSnapshotTestJSON-1802230238 None] <== create_volume: return (900ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:32:01 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-ba3d081c-b6b9-45ff-869b-10515dc1a528 tempest-VolumesSnapshotTestJSON-1802230238 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.903s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:32:02 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-ba3d081c-b6b9-45ff-869b-10515dc1a528 tempest-VolumesSnapshotTestJSON-1802230238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96a8b12c-6541-46db-9b21-4e26563bc0e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3a16914-4aab-4f30-a54b-569287ecc7e6', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:32:02 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-ba3d081c-b6b9-45ff-869b-10515dc1a528 tempest-VolumesSnapshotTestJSON-1802230238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0b5a145-dd4a-44bc-80fa-45f2f129c1ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:32:02 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-ba3d081c-b6b9-45ff-869b-10515dc1a528 tempest-VolumesSnapshotTestJSON-1802230238 None] Volume volume-e3a16914-4aab-4f30-a54b-569287ecc7e6 (e3a16914-4aab-4f30-a54b-569287ecc7e6): created successfully
Nov 03 18:32:02 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-ba3d081c-b6b9-45ff-869b-10515dc1a528 tempest-VolumesSnapshotTestJSON-1802230238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0b5a145-dd4a-44bc-80fa-45f2f129c1ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:32:02 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-ba3d081c-b6b9-45ff-869b-10515dc1a528 tempest-VolumesSnapshotTestJSON-1802230238 None] Flow 'volume_create_manager' (4a5808df-9354-40d7-922b-d294634730da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:32:02 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-ba3d081c-b6b9-45ff-869b-10515dc1a528 tempest-VolumesSnapshotTestJSON-1802230238 None] Created volume successfully.
Nov 03 18:32:02 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-6f941ad7-134a-4b8a-9e67-30ee6d10f9d3 tempest-ProjectReaderTests-1272689156 None] Acquiring lock "cinder-6df1f532-3435-4c42-8a2e-f35d5f1dd3b2-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:32:02 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-6f941ad7-134a-4b8a-9e67-30ee6d10f9d3 tempest-ProjectReaderTests-1272689156 None] Lock "cinder-6df1f532-3435-4c42-8a2e-f35d5f1dd3b2-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:32:02 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-6f941ad7-134a-4b8a-9e67-30ee6d10f9d3 tempest-ProjectReaderTests-1272689156 None] Acquiring lock "cinder-quobyte-6df1f532-3435-4c42-8a2e-f35d5f1dd3b2" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:32:02 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-6f941ad7-134a-4b8a-9e67-30ee6d10f9d3 tempest-ProjectReaderTests-1272689156 None] Lock "cinder-quobyte-6df1f532-3435-4c42-8a2e-f35d5f1dd3b2" acquired by "delete_volume" :: waited 0.017s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:32:02 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[86e7a864-39fb-49be-99fd-6bd17e9f3cf6]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:32:02 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-6f941ad7-134a-4b8a-9e67-30ee6d10f9d3 tempest-ProjectReaderTests-1272689156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6df1f532-3435-4c42-8a2e-f35d5f1dd3b2 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:32:02 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7636e9a-ec5a-403e-8013-e9872c9bb9cd tempest-VolumesActionsTest-1541010714 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:32:02 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-d7636e9a-ec5a-403e-8013-e9872c9bb9cd tempest-VolumesActionsTest-1541010714 None] Flow 'volume_create_manager' (34026fb0-55d1-4bec-938f-b43a9f843adb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:32:02 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-d7636e9a-ec5a-403e-8013-e9872c9bb9cd tempest-VolumesActionsTest-1541010714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b78bc8b1-afed-416b-b653-3a47da887d21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:32:02 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-d7636e9a-ec5a-403e-8013-e9872c9bb9cd tempest-VolumesActionsTest-1541010714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b78bc8b1-afed-416b-b653-3a47da887d21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:32:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-725253831',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac866150-25ad-4c4f-9538-be1d0e8e777c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01c2db9c6ee349cc9695c54863ba09be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:32:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:32:02Z,use_quota=True,user_id='bdfe1727bc1a44fd9c4b5e708b21f03b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:32:02 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-d7636e9a-ec5a-403e-8013-e9872c9bb9cd tempest-VolumesActionsTest-1541010714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (940b75b9-86f5-40af-ad92-7c572e0b3a1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:32:02 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-d7636e9a-ec5a-403e-8013-e9872c9bb9cd tempest-VolumesActionsTest-1541010714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (940b75b9-86f5-40af-ad92-7c572e0b3a1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:32:02 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-d7636e9a-ec5a-403e-8013-e9872c9bb9cd tempest-VolumesActionsTest-1541010714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbdc9d2a-bffe-45d8-9574-85c13f74a40b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:32:02 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-d7636e9a-ec5a-403e-8013-e9872c9bb9cd tempest-VolumesActionsTest-1541010714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbdc9d2a-bffe-45d8-9574-85c13f74a40b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac866150-25ad-4c4f-9538-be1d0e8e777c', 'volume_name': 'volume-ac866150-25ad-4c4f-9538-be1d0e8e777c', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:32:02 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-d7636e9a-ec5a-403e-8013-e9872c9bb9cd tempest-VolumesActionsTest-1541010714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e298ffd6-4f4a-4ed5-add3-8032b17b5f53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:32:02 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-d7636e9a-ec5a-403e-8013-e9872c9bb9cd tempest-VolumesActionsTest-1541010714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e298ffd6-4f4a-4ed5-add3-8032b17b5f53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:32:02 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-d7636e9a-ec5a-403e-8013-e9872c9bb9cd tempest-VolumesActionsTest-1541010714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (999013e3-2363-47d2-b2fe-8ca91b748a5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:32:02 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-d7636e9a-ec5a-403e-8013-e9872c9bb9cd tempest-VolumesActionsTest-1541010714 None] Volume ac866150-25ad-4c4f-9538-be1d0e8e777c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac866150-25ad-4c4f-9538-be1d0e8e777c', 'volume_size': 1}
Nov 03 18:32:02 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-d7636e9a-ec5a-403e-8013-e9872c9bb9cd tempest-VolumesActionsTest-1541010714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:32:02 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-d7636e9a-ec5a-403e-8013-e9872c9bb9cd tempest-VolumesActionsTest-1541010714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:32:02 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-d7636e9a-ec5a-403e-8013-e9872c9bb9cd tempest-VolumesActionsTest-1541010714 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:32:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-725253831',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac866150-25ad-4c4f-9538-be1d0e8e777c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01c2db9c6ee349cc9695c54863ba09be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:32:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:32:02Z,use_quota=True,user_id='bdfe1727bc1a44fd9c4b5e708b21f03b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:32:02 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-d7636e9a-ec5a-403e-8013-e9872c9bb9cd tempest-VolumesActionsTest-1541010714 None] Creating volume ac866150-25ad-4c4f-9538-be1d0e8e777c {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:32:02 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-d7636e9a-ec5a-403e-8013-e9872c9bb9cd tempest-VolumesActionsTest-1541010714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:32:02 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-d7636e9a-ec5a-403e-8013-e9872c9bb9cd tempest-VolumesActionsTest-1541010714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:32:02 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-d7636e9a-ec5a-403e-8013-e9872c9bb9cd tempest-VolumesActionsTest-1541010714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:32:02 devstack sudo[97713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6df1f532-3435-4c42-8a2e-f35d5f1dd3b2
Nov 03 18:32:02 devstack sudo[97713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:32:02 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-d7636e9a-ec5a-403e-8013-e9872c9bb9cd tempest-VolumesActionsTest-1541010714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:32:02 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-d7636e9a-ec5a-403e-8013-e9872c9bb9cd tempest-VolumesActionsTest-1541010714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:32:02 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-d7636e9a-ec5a-403e-8013-e9872c9bb9cd tempest-VolumesActionsTest-1541010714 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:32:02 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-d7636e9a-ec5a-403e-8013-e9872c9bb9cd tempest-VolumesActionsTest-1541010714 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:32:02 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-d7636e9a-ec5a-403e-8013-e9872c9bb9cd tempest-VolumesActionsTest-1541010714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ac866150-25ad-4c4f-9538-be1d0e8e777c 1073741824 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:32:02 devstack sudo[97715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ac866150-25ad-4c4f-9538-be1d0e8e777c 1073741824
Nov 03 18:32:02 devstack sudo[97715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:32:02 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-f6f0f1f5-c24e-465e-a337-d998ddd850f3 tempest-VolumesSnapshotTestJSON-1802230238 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:32:02 devstack sudo[97713]: pam_unix(sudo:session): session closed for user root
Nov 03 18:32:02 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-6f941ad7-134a-4b8a-9e67-30ee6d10f9d3 tempest-ProjectReaderTests-1272689156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6df1f532-3435-4c42-8a2e-f35d5f1dd3b2" returned: 0 in 0.540s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:32:02 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-6f941ad7-134a-4b8a-9e67-30ee6d10f9d3 tempest-ProjectReaderTests-1272689156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6df1f532-3435-4c42-8a2e-f35d5f1dd3b2 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:32:02 devstack sudo[97723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6df1f532-3435-4c42-8a2e-f35d5f1dd3b2
Nov 03 18:32:02 devstack sudo[97723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:32:03 devstack sudo[97715]: pam_unix(sudo:session): session closed for user root
Nov 03 18:32:03 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-d7636e9a-ec5a-403e-8013-e9872c9bb9cd tempest-VolumesActionsTest-1541010714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ac866150-25ad-4c4f-9538-be1d0e8e777c 1073741824" returned: 0 in 0.811s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:32:03 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-d7636e9a-ec5a-403e-8013-e9872c9bb9cd tempest-VolumesActionsTest-1541010714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ac866150-25ad-4c4f-9538-be1d0e8e777c {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:32:03 devstack sudo[97723]: pam_unix(sudo:session): session closed for user root
Nov 03 18:32:03 devstack sudo[97768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ac866150-25ad-4c4f-9538-be1d0e8e777c
Nov 03 18:32:03 devstack sudo[97768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:32:03 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-6f941ad7-134a-4b8a-9e67-30ee6d10f9d3 tempest-ProjectReaderTests-1272689156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6df1f532-3435-4c42-8a2e-f35d5f1dd3b2" returned: 0 in 0.566s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:32:03 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-6f941ad7-134a-4b8a-9e67-30ee6d10f9d3 tempest-ProjectReaderTests-1272689156 None] Lock "cinder-quobyte-6df1f532-3435-4c42-8a2e-f35d5f1dd3b2" released by "delete_volume" :: held 1.230s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:32:03 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-6f941ad7-134a-4b8a-9e67-30ee6d10f9d3 tempest-ProjectReaderTests-1272689156 None] Created reservations ['c90cdc38-1b4b-44f1-89d3-88420f00dc59', '93543597-753d-4085-bf9b-b5a9d2f95780', 'f679c2f8-f80e-4613-9a7f-defdd08f474e', 'cfddd930-2634-4191-a291-ec749b9f307b'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:32:03 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-6f941ad7-134a-4b8a-9e67-30ee6d10f9d3 tempest-ProjectReaderTests-1272689156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:32:03 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-6f941ad7-134a-4b8a-9e67-30ee6d10f9d3 tempest-ProjectReaderTests-1272689156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:32:03 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-6f941ad7-134a-4b8a-9e67-30ee6d10f9d3 tempest-ProjectReaderTests-1272689156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:32:03 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-6f941ad7-134a-4b8a-9e67-30ee6d10f9d3 tempest-ProjectReaderTests-1272689156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:32:03 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-6f941ad7-134a-4b8a-9e67-30ee6d10f9d3 tempest-ProjectReaderTests-1272689156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:32:03 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-6f941ad7-134a-4b8a-9e67-30ee6d10f9d3 tempest-ProjectReaderTests-1272689156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:32:03 devstack sudo[97787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:32:03 devstack sudo[97787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:32:03 devstack sudo[97768]: pam_unix(sudo:session): session closed for user root
Nov 03 18:32:03 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-d7636e9a-ec5a-403e-8013-e9872c9bb9cd tempest-VolumesActionsTest-1541010714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ac866150-25ad-4c4f-9538-be1d0e8e777c" returned: 0 in 0.445s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:32:03 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-d7636e9a-ec5a-403e-8013-e9872c9bb9cd tempest-VolumesActionsTest-1541010714 None] <== create_volume: return (1362ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:32:03 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-d7636e9a-ec5a-403e-8013-e9872c9bb9cd tempest-VolumesActionsTest-1541010714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.366s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:32:03 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-f6f0f1f5-c24e-465e-a337-d998ddd850f3 tempest-VolumesSnapshotTestJSON-1802230238 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.011s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:32:03 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-d7636e9a-ec5a-403e-8013-e9872c9bb9cd tempest-VolumesActionsTest-1541010714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (999013e3-2363-47d2-b2fe-8ca91b748a5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac866150-25ad-4c4f-9538-be1d0e8e777c', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:32:03 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-d7636e9a-ec5a-403e-8013-e9872c9bb9cd tempest-VolumesActionsTest-1541010714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (860fa1b7-54b1-4910-b415-16f9ce776a88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:32:03 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-f6f0f1f5-c24e-465e-a337-d998ddd850f3 tempest-VolumesSnapshotTestJSON-1802230238 None] Creating offline snapshot 26892c54-59a3-4a29-a483-47bd1104a884 of volume e3a16914-4aab-4f30-a54b-569287ecc7e6 {{(pid=86120) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 18:32:03 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-d7636e9a-ec5a-403e-8013-e9872c9bb9cd tempest-VolumesActionsTest-1541010714 None] Volume volume-ac866150-25ad-4c4f-9538-be1d0e8e777c (ac866150-25ad-4c4f-9538-be1d0e8e777c): created successfully
Nov 03 18:32:03 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-d7636e9a-ec5a-403e-8013-e9872c9bb9cd tempest-VolumesActionsTest-1541010714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (860fa1b7-54b1-4910-b415-16f9ce776a88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:32:03 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-d7636e9a-ec5a-403e-8013-e9872c9bb9cd tempest-VolumesActionsTest-1541010714 None] Flow 'volume_create_manager' (34026fb0-55d1-4bec-938f-b43a9f843adb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:32:04 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[08e1f536-9555-43ff-b9cc-10713376bbf8]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:32:04 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-f6f0f1f5-c24e-465e-a337-d998ddd850f3 tempest-VolumesSnapshotTestJSON-1802230238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e3a16914-4aab-4f30-a54b-569287ecc7e6 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:32:04 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-d7636e9a-ec5a-403e-8013-e9872c9bb9cd tempest-VolumesActionsTest-1541010714 None] Created volume successfully.
Nov 03 18:32:04 devstack sudo[97792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e3a16914-4aab-4f30-a54b-569287ecc7e6
Nov 03 18:32:04 devstack sudo[97792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:32:04 devstack sudo[97787]: pam_unix(sudo:session): session closed for user root
Nov 03 18:32:04 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-6f941ad7-134a-4b8a-9e67-30ee6d10f9d3 tempest-ProjectReaderTests-1272689156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.635s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:32:04 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-6f941ad7-134a-4b8a-9e67-30ee6d10f9d3 tempest-ProjectReaderTests-1272689156 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:32:04 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-6f941ad7-134a-4b8a-9e67-30ee6d10f9d3 tempest-ProjectReaderTests-1272689156 None] Deleted volume successfully.
Nov 03 18:32:04 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-6f941ad7-134a-4b8a-9e67-30ee6d10f9d3 tempest-ProjectReaderTests-1272689156 None] Lock "cinder-6df1f532-3435-4c42-8a2e-f35d5f1dd3b2-delete_volume" released by "delete_volume" :: held 2.234s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:32:04 devstack sudo[97792]: pam_unix(sudo:session): session closed for user root
Nov 03 18:32:04 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-f6f0f1f5-c24e-465e-a337-d998ddd850f3 tempest-VolumesSnapshotTestJSON-1802230238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e3a16914-4aab-4f30-a54b-569287ecc7e6" returned: 0 in 0.745s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:32:04 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-f6f0f1f5-c24e-465e-a337-d998ddd850f3 tempest-VolumesSnapshotTestJSON-1802230238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e3a16914-4aab-4f30-a54b-569287ecc7e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e3a16914-4aab-4f30-a54b-569287ecc7e6.26892c54-59a3-4a29-a483-47bd1104a884 1G {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:32:04 devstack sudo[97806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e3a16914-4aab-4f30-a54b-569287ecc7e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e3a16914-4aab-4f30-a54b-569287ecc7e6.26892c54-59a3-4a29-a483-47bd1104a884 1G
Nov 03 18:32:04 devstack sudo[97806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:32:04 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-af30686e-af35-4744-ab11-2b98a9a32a82 tempest-VolumesActionsTest-764882347 None] Acquiring lock "cinder-ac866150-25ad-4c4f-9538-be1d0e8e777c-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:32:04 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-af30686e-af35-4744-ab11-2b98a9a32a82 tempest-VolumesActionsTest-764882347 None] Lock "cinder-ac866150-25ad-4c4f-9538-be1d0e8e777c-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:32:04 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-af30686e-af35-4744-ab11-2b98a9a32a82 tempest-VolumesActionsTest-764882347 None] Acquiring lock "cinder-quobyte-ac866150-25ad-4c4f-9538-be1d0e8e777c" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:32:04 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-af30686e-af35-4744-ab11-2b98a9a32a82 tempest-VolumesActionsTest-764882347 None] Lock "cinder-quobyte-ac866150-25ad-4c4f-9538-be1d0e8e777c" acquired by "delete_volume" :: waited 0.029s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:32:05 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[067a2e63-3fcd-48a0-a459-0a0af50f2b0c]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:32:05 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-af30686e-af35-4744-ab11-2b98a9a32a82 tempest-VolumesActionsTest-764882347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ac866150-25ad-4c4f-9538-be1d0e8e777c {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:32:05 devstack sudo[97808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ac866150-25ad-4c4f-9538-be1d0e8e777c
Nov 03 18:32:05 devstack sudo[97808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:32:05 devstack sudo[97806]: pam_unix(sudo:session): session closed for user root
Nov 03 18:32:05 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-f6f0f1f5-c24e-465e-a337-d998ddd850f3 tempest-VolumesSnapshotTestJSON-1802230238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e3a16914-4aab-4f30-a54b-569287ecc7e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e3a16914-4aab-4f30-a54b-569287ecc7e6.26892c54-59a3-4a29-a483-47bd1104a884 1G" returned: 0 in 0.958s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:32:05 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-f6f0f1f5-c24e-465e-a337-d998ddd850f3 tempest-VolumesSnapshotTestJSON-1802230238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e3a16914-4aab-4f30-a54b-569287ecc7e6 -F qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e3a16914-4aab-4f30-a54b-569287ecc7e6.26892c54-59a3-4a29-a483-47bd1104a884 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:32:05 devstack sudo[97808]: pam_unix(sudo:session): session closed for user root
Nov 03 18:32:05 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-af30686e-af35-4744-ab11-2b98a9a32a82 tempest-VolumesActionsTest-764882347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ac866150-25ad-4c4f-9538-be1d0e8e777c" returned: 0 in 0.683s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:32:05 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-af30686e-af35-4744-ab11-2b98a9a32a82 tempest-VolumesActionsTest-764882347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ac866150-25ad-4c4f-9538-be1d0e8e777c {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:32:05 devstack sudo[97816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e3a16914-4aab-4f30-a54b-569287ecc7e6 -F qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e3a16914-4aab-4f30-a54b-569287ecc7e6.26892c54-59a3-4a29-a483-47bd1104a884
Nov 03 18:32:05 devstack sudo[97816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:32:05 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-513571c6-fbd3-409a-bfc4-46212d4f5421 tempest-ProjectReaderTests-1272689156 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:32:05 devstack sudo[97818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ac866150-25ad-4c4f-9538-be1d0e8e777c
Nov 03 18:32:05 devstack sudo[97818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:32:05 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-513571c6-fbd3-409a-bfc4-46212d4f5421 tempest-ProjectReaderTests-1272689156 None] Flow 'volume_create_manager' (79c13f32-a63a-482f-9c8f-59a67f6f5ad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:32:05 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-513571c6-fbd3-409a-bfc4-46212d4f5421 tempest-ProjectReaderTests-1272689156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (292fe3e1-9705-418a-a3a1-88ed7b432d76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:32:05 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-513571c6-fbd3-409a-bfc4-46212d4f5421 tempest-ProjectReaderTests-1272689156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (292fe3e1-9705-418a-a3a1-88ed7b432d76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:32:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-495588504',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5163e67a-d409-4a25-b799-473b1078ab01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a9d2cf922c447649a36df9707fab65e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:32:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:32:06Z,use_quota=True,user_id='9d80735c04024af0abff0a3c0c54c250',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:32:05 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-513571c6-fbd3-409a-bfc4-46212d4f5421 tempest-ProjectReaderTests-1272689156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (774df903-9ddd-4a49-b1ad-7b88efea0764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:32:05 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-513571c6-fbd3-409a-bfc4-46212d4f5421 tempest-ProjectReaderTests-1272689156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (774df903-9ddd-4a49-b1ad-7b88efea0764) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:32:05 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-513571c6-fbd3-409a-bfc4-46212d4f5421 tempest-ProjectReaderTests-1272689156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1475089-5570-4de5-9580-3611d6513d11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:32:05 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-513571c6-fbd3-409a-bfc4-46212d4f5421 tempest-ProjectReaderTests-1272689156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1475089-5570-4de5-9580-3611d6513d11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5163e67a-d409-4a25-b799-473b1078ab01', 'volume_name': 'volume-5163e67a-d409-4a25-b799-473b1078ab01', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:32:05 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-513571c6-fbd3-409a-bfc4-46212d4f5421 tempest-ProjectReaderTests-1272689156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb253b1d-ccf8-4a1a-8f1f-1020a5a4b1a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:32:05 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-513571c6-fbd3-409a-bfc4-46212d4f5421 tempest-ProjectReaderTests-1272689156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb253b1d-ccf8-4a1a-8f1f-1020a5a4b1a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:32:05 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-513571c6-fbd3-409a-bfc4-46212d4f5421 tempest-ProjectReaderTests-1272689156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd08ce00-fbdd-4920-9edc-ff17e725849c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:32:05 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-513571c6-fbd3-409a-bfc4-46212d4f5421 tempest-ProjectReaderTests-1272689156 None] Volume 5163e67a-d409-4a25-b799-473b1078ab01: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5163e67a-d409-4a25-b799-473b1078ab01', 'volume_size': 1}
Nov 03 18:32:05 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-513571c6-fbd3-409a-bfc4-46212d4f5421 tempest-ProjectReaderTests-1272689156 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:32:06 devstack sudo[97818]: pam_unix(sudo:session): session closed for user root
Nov 03 18:32:06 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-af30686e-af35-4744-ab11-2b98a9a32a82 tempest-VolumesActionsTest-764882347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ac866150-25ad-4c4f-9538-be1d0e8e777c" returned: 0 in 0.443s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:32:06 devstack sudo[97816]: pam_unix(sudo:session): session closed for user root
Nov 03 18:32:06 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-f6f0f1f5-c24e-465e-a337-d998ddd850f3 tempest-VolumesSnapshotTestJSON-1802230238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e3a16914-4aab-4f30-a54b-569287ecc7e6 -F qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e3a16914-4aab-4f30-a54b-569287ecc7e6.26892c54-59a3-4a29-a483-47bd1104a884" returned: 0 in 0.492s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:32:06 devstack cinder-volume[86120]: WARNING cinder.volume.drivers.remotefs [None req-f6f0f1f5-c24e-465e-a337-d998ddd850f3 tempest-VolumesSnapshotTestJSON-1802230238 None] /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e3a16914-4aab-4f30-a54b-569287ecc7e6.26892c54-59a3-4a29-a483-47bd1104a884 is being set with open permissions: ugo+rw
Nov 03 18:32:06 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-f6f0f1f5-c24e-465e-a337-d998ddd850f3 tempest-VolumesSnapshotTestJSON-1802230238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e3a16914-4aab-4f30-a54b-569287ecc7e6.26892c54-59a3-4a29-a483-47bd1104a884 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:32:06 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-af30686e-af35-4744-ab11-2b98a9a32a82 tempest-VolumesActionsTest-764882347 None] Lock "cinder-quobyte-ac866150-25ad-4c4f-9538-be1d0e8e777c" released by "delete_volume" :: held 1.250s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:32:06 devstack sudo[97825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e3a16914-4aab-4f30-a54b-569287ecc7e6.26892c54-59a3-4a29-a483-47bd1104a884
Nov 03 18:32:06 devstack sudo[97825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:32:06 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-af30686e-af35-4744-ab11-2b98a9a32a82 tempest-VolumesActionsTest-764882347 None] Created reservations ['75ea782a-6afc-4bbb-a7a6-2629420c375c', '7fbbec59-aa96-4d2e-b4e6-9c3ff52bf540', 'b66750bf-8ca7-47e5-96d4-5fc0348ae2cc', '65c2932a-3cda-45fb-9594-122dcb45f5c0'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:32:06 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-af30686e-af35-4744-ab11-2b98a9a32a82 tempest-VolumesActionsTest-764882347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:32:06 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-af30686e-af35-4744-ab11-2b98a9a32a82 tempest-VolumesActionsTest-764882347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:32:06 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-af30686e-af35-4744-ab11-2b98a9a32a82 tempest-VolumesActionsTest-764882347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:32:06 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-af30686e-af35-4744-ab11-2b98a9a32a82 tempest-VolumesActionsTest-764882347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:32:06 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-af30686e-af35-4744-ab11-2b98a9a32a82 tempest-VolumesActionsTest-764882347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:32:06 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-af30686e-af35-4744-ab11-2b98a9a32a82 tempest-VolumesActionsTest-764882347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:32:06 devstack sudo[97827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:32:06 devstack sudo[97827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:32:06 devstack sudo[97825]: pam_unix(sudo:session): session closed for user root
Nov 03 18:32:06 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-f6f0f1f5-c24e-465e-a337-d998ddd850f3 tempest-VolumesSnapshotTestJSON-1802230238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e3a16914-4aab-4f30-a54b-569287ecc7e6.26892c54-59a3-4a29-a483-47bd1104a884" returned: 0 in 0.303s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:32:06 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-f6f0f1f5-c24e-465e-a337-d998ddd850f3 tempest-VolumesSnapshotTestJSON-1802230238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e3a16914-4aab-4f30-a54b-569287ecc7e6.info {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:32:06 devstack sudo[97830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e3a16914-4aab-4f30-a54b-569287ecc7e6.info
Nov 03 18:32:06 devstack sudo[97830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:32:06 devstack sudo[97827]: pam_unix(sudo:session): session closed for user root
Nov 03 18:32:06 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-af30686e-af35-4744-ab11-2b98a9a32a82 tempest-VolumesActionsTest-764882347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.348s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:32:06 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-af30686e-af35-4744-ab11-2b98a9a32a82 tempest-VolumesActionsTest-764882347 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:32:06 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-af30686e-af35-4744-ab11-2b98a9a32a82 tempest-VolumesActionsTest-764882347 None] Deleted volume successfully.
Nov 03 18:32:06 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-af30686e-af35-4744-ab11-2b98a9a32a82 tempest-VolumesActionsTest-764882347 None] Lock "cinder-ac866150-25ad-4c4f-9538-be1d0e8e777c-delete_volume" released by "delete_volume" :: held 1.939s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:32:06 devstack sudo[97830]: pam_unix(sudo:session): session closed for user root
Nov 03 18:32:06 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-f6f0f1f5-c24e-465e-a337-d998ddd850f3 tempest-VolumesSnapshotTestJSON-1802230238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e3a16914-4aab-4f30-a54b-569287ecc7e6.info" returned: 0 in 0.310s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:32:06 devstack cinder-volume[86120]: WARNING cinder.volume.drivers.remotefs [None req-f6f0f1f5-c24e-465e-a337-d998ddd850f3 tempest-VolumesSnapshotTestJSON-1802230238 None] /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e3a16914-4aab-4f30-a54b-569287ecc7e6.info is being set with open permissions: ugo+rw
Nov 03 18:32:06 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-f6f0f1f5-c24e-465e-a337-d998ddd850f3 tempest-VolumesSnapshotTestJSON-1802230238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e3a16914-4aab-4f30-a54b-569287ecc7e6.info {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:32:06 devstack sudo[97834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e3a16914-4aab-4f30-a54b-569287ecc7e6.info
Nov 03 18:32:06 devstack sudo[97834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:32:07 devstack sudo[97834]: pam_unix(sudo:session): session closed for user root
Nov 03 18:32:07 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-f6f0f1f5-c24e-465e-a337-d998ddd850f3 tempest-VolumesSnapshotTestJSON-1802230238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e3a16914-4aab-4f30-a54b-569287ecc7e6.info" returned: 0 in 0.346s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:32:07 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-f6f0f1f5-c24e-465e-a337-d998ddd850f3 tempest-VolumesSnapshotTestJSON-1802230238 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.359s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:32:07 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-513571c6-fbd3-409a-bfc4-46212d4f5421 tempest-ProjectReaderTests-1272689156 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.331s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:32:07 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-513571c6-fbd3-409a-bfc4-46212d4f5421 tempest-ProjectReaderTests-1272689156 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:32:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-495588504',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5163e67a-d409-4a25-b799-473b1078ab01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a9d2cf922c447649a36df9707fab65e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:32:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:32:06Z,use_quota=True,user_id='9d80735c04024af0abff0a3c0c54c250',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:32:07 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-513571c6-fbd3-409a-bfc4-46212d4f5421 tempest-ProjectReaderTests-1272689156 None] Creating volume 5163e67a-d409-4a25-b799-473b1078ab01 {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:32:07 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-513571c6-fbd3-409a-bfc4-46212d4f5421 tempest-ProjectReaderTests-1272689156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:32:07 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-513571c6-fbd3-409a-bfc4-46212d4f5421 tempest-ProjectReaderTests-1272689156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:32:07 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-513571c6-fbd3-409a-bfc4-46212d4f5421 tempest-ProjectReaderTests-1272689156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:32:07 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-513571c6-fbd3-409a-bfc4-46212d4f5421 tempest-ProjectReaderTests-1272689156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:32:07 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-513571c6-fbd3-409a-bfc4-46212d4f5421 tempest-ProjectReaderTests-1272689156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:32:07 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-513571c6-fbd3-409a-bfc4-46212d4f5421 tempest-ProjectReaderTests-1272689156 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:32:07 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-513571c6-fbd3-409a-bfc4-46212d4f5421 tempest-ProjectReaderTests-1272689156 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:32:07 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-513571c6-fbd3-409a-bfc4-46212d4f5421 tempest-ProjectReaderTests-1272689156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-5163e67a-d409-4a25-b799-473b1078ab01 1073741824 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:32:07 devstack sudo[97838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-5163e67a-d409-4a25-b799-473b1078ab01 1073741824
Nov 03 18:32:07 devstack sudo[97838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:32:07 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-f6f0f1f5-c24e-465e-a337-d998ddd850f3 tempest-VolumesSnapshotTestJSON-1802230238 None] Create snapshot completed successfully
Nov 03 18:32:07 devstack sudo[97838]: pam_unix(sudo:session): session closed for user root
Nov 03 18:32:07 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-513571c6-fbd3-409a-bfc4-46212d4f5421 tempest-ProjectReaderTests-1272689156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-5163e67a-d409-4a25-b799-473b1078ab01 1073741824" returned: 0 in 0.697s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:32:08 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-513571c6-fbd3-409a-bfc4-46212d4f5421 tempest-ProjectReaderTests-1272689156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-5163e67a-d409-4a25-b799-473b1078ab01 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:32:08 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-c627b1e0-e9d7-4b21-b268-6715c735df4c tempest-VolumesActionsTest-1541010714 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:32:08 devstack sudo[97844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-5163e67a-d409-4a25-b799-473b1078ab01
Nov 03 18:32:08 devstack sudo[97844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:32:08 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-c627b1e0-e9d7-4b21-b268-6715c735df4c tempest-VolumesActionsTest-1541010714 None] Flow 'volume_create_manager' (cd1df16c-2ae7-4586-8536-d08f9e560778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:32:08 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-c627b1e0-e9d7-4b21-b268-6715c735df4c tempest-VolumesActionsTest-1541010714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4630c4d6-01b6-4499-9755-5dc6deb583ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:32:08 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-c627b1e0-e9d7-4b21-b268-6715c735df4c tempest-VolumesActionsTest-1541010714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4630c4d6-01b6-4499-9755-5dc6deb583ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:32:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1562201993',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30fef675-a409-4052-8026-2ed4db73f6cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01c2db9c6ee349cc9695c54863ba09be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:32:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:32:08Z,use_quota=True,user_id='bdfe1727bc1a44fd9c4b5e708b21f03b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:32:08 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-c627b1e0-e9d7-4b21-b268-6715c735df4c tempest-VolumesActionsTest-1541010714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (490f74f2-c5d1-4656-9e59-387a62bd7f2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:32:08 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-c627b1e0-e9d7-4b21-b268-6715c735df4c tempest-VolumesActionsTest-1541010714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (490f74f2-c5d1-4656-9e59-387a62bd7f2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:32:08 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-c627b1e0-e9d7-4b21-b268-6715c735df4c tempest-VolumesActionsTest-1541010714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64721e42-5d23-4f97-abb4-8b98b6dc7b23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:32:08 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-c627b1e0-e9d7-4b21-b268-6715c735df4c tempest-VolumesActionsTest-1541010714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64721e42-5d23-4f97-abb4-8b98b6dc7b23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30fef675-a409-4052-8026-2ed4db73f6cf', 'volume_name': 'volume-30fef675-a409-4052-8026-2ed4db73f6cf', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:32:08 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-c627b1e0-e9d7-4b21-b268-6715c735df4c tempest-VolumesActionsTest-1541010714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67b0a53b-8b7a-4eda-888f-80ec54790ab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:32:08 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-c627b1e0-e9d7-4b21-b268-6715c735df4c tempest-VolumesActionsTest-1541010714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67b0a53b-8b7a-4eda-888f-80ec54790ab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:32:08 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-c627b1e0-e9d7-4b21-b268-6715c735df4c tempest-VolumesActionsTest-1541010714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b9a3630-d6e0-433c-b544-853177914943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:32:08 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-c627b1e0-e9d7-4b21-b268-6715c735df4c tempest-VolumesActionsTest-1541010714 None] Volume 30fef675-a409-4052-8026-2ed4db73f6cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30fef675-a409-4052-8026-2ed4db73f6cf', 'volume_size': 1}
Nov 03 18:32:08 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-c627b1e0-e9d7-4b21-b268-6715c735df4c tempest-VolumesActionsTest-1541010714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:32:08 devstack sudo[97844]: pam_unix(sudo:session): session closed for user root
Nov 03 18:32:08 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-513571c6-fbd3-409a-bfc4-46212d4f5421 tempest-ProjectReaderTests-1272689156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-5163e67a-d409-4a25-b799-473b1078ab01" returned: 0 in 0.300s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:32:08 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-513571c6-fbd3-409a-bfc4-46212d4f5421 tempest-ProjectReaderTests-1272689156 None] <== create_volume: return (1081ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:32:08 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-513571c6-fbd3-409a-bfc4-46212d4f5421 tempest-ProjectReaderTests-1272689156 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.084s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:32:08 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-c627b1e0-e9d7-4b21-b268-6715c735df4c tempest-VolumesActionsTest-1541010714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.201s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:32:08 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-c627b1e0-e9d7-4b21-b268-6715c735df4c tempest-VolumesActionsTest-1541010714 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:32:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1562201993',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30fef675-a409-4052-8026-2ed4db73f6cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01c2db9c6ee349cc9695c54863ba09be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:32:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:32:08Z,use_quota=True,user_id='bdfe1727bc1a44fd9c4b5e708b21f03b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:32:08 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-c627b1e0-e9d7-4b21-b268-6715c735df4c tempest-VolumesActionsTest-1541010714 None] Creating volume 30fef675-a409-4052-8026-2ed4db73f6cf {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:32:08 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-c627b1e0-e9d7-4b21-b268-6715c735df4c tempest-VolumesActionsTest-1541010714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:32:08 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-c627b1e0-e9d7-4b21-b268-6715c735df4c tempest-VolumesActionsTest-1541010714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:32:08 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-c627b1e0-e9d7-4b21-b268-6715c735df4c tempest-VolumesActionsTest-1541010714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:32:08 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-c627b1e0-e9d7-4b21-b268-6715c735df4c tempest-VolumesActionsTest-1541010714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:32:08 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-c627b1e0-e9d7-4b21-b268-6715c735df4c tempest-VolumesActionsTest-1541010714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:32:08 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-c627b1e0-e9d7-4b21-b268-6715c735df4c tempest-VolumesActionsTest-1541010714 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:32:08 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-c627b1e0-e9d7-4b21-b268-6715c735df4c tempest-VolumesActionsTest-1541010714 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:32:08 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-c627b1e0-e9d7-4b21-b268-6715c735df4c tempest-VolumesActionsTest-1541010714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-30fef675-a409-4052-8026-2ed4db73f6cf 1073741824 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:32:08 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-513571c6-fbd3-409a-bfc4-46212d4f5421 tempest-ProjectReaderTests-1272689156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd08ce00-fbdd-4920-9edc-ff17e725849c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5163e67a-d409-4a25-b799-473b1078ab01', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:32:08 devstack sudo[97847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-30fef675-a409-4052-8026-2ed4db73f6cf 1073741824
Nov 03 18:32:08 devstack sudo[97847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:32:08 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-513571c6-fbd3-409a-bfc4-46212d4f5421 tempest-ProjectReaderTests-1272689156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d2a027c-b18a-4a14-bedd-b059a9447f23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:32:08 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-513571c6-fbd3-409a-bfc4-46212d4f5421 tempest-ProjectReaderTests-1272689156 None] Volume volume-5163e67a-d409-4a25-b799-473b1078ab01 (5163e67a-d409-4a25-b799-473b1078ab01): created successfully
Nov 03 18:32:08 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-513571c6-fbd3-409a-bfc4-46212d4f5421 tempest-ProjectReaderTests-1272689156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d2a027c-b18a-4a14-bedd-b059a9447f23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:32:08 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-513571c6-fbd3-409a-bfc4-46212d4f5421 tempest-ProjectReaderTests-1272689156 None] Flow 'volume_create_manager' (79c13f32-a63a-482f-9c8f-59a67f6f5ad3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:32:08 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-513571c6-fbd3-409a-bfc4-46212d4f5421 tempest-ProjectReaderTests-1272689156 None] Created volume successfully.
Nov 03 18:32:08 devstack sudo[97847]: pam_unix(sudo:session): session closed for user root
Nov 03 18:32:08 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-c627b1e0-e9d7-4b21-b268-6715c735df4c tempest-VolumesActionsTest-1541010714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-30fef675-a409-4052-8026-2ed4db73f6cf 1073741824" returned: 0 in 0.508s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:32:08 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2410af9-a847-44d2-80a6-bfb662215ee8 tempest-VolumesSnapshotTestJSON-1802230238 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:32:08 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-e2410af9-a847-44d2-80a6-bfb662215ee8 tempest-VolumesSnapshotTestJSON-1802230238 None] Flow 'volume_create_manager' (69eaac43-db7b-4e37-a174-9667b5919d69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:32:08 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-e2410af9-a847-44d2-80a6-bfb662215ee8 tempest-VolumesSnapshotTestJSON-1802230238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59ab6a81-cdcd-4679-8c42-d5e7b540c9eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:32:08 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-c627b1e0-e9d7-4b21-b268-6715c735df4c tempest-VolumesActionsTest-1541010714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-30fef675-a409-4052-8026-2ed4db73f6cf {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:32:08 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-e2410af9-a847-44d2-80a6-bfb662215ee8 tempest-VolumesSnapshotTestJSON-1802230238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59ab6a81-cdcd-4679-8c42-d5e7b540c9eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:32:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2075955380',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e615f110-0eab-4d29-a76b-cae96b186b2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab0c92f90881489890fc637dcadeb490',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:32:09Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=26892c54-59a3-4a29-a483-47bd1104a884,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:32:09Z,use_quota=True,user_id='b63532e97ecb442abb935c8ea13836cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:32:09 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-e2410af9-a847-44d2-80a6-bfb662215ee8 tempest-VolumesSnapshotTestJSON-1802230238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b296e826-c58d-4633-849e-fd22d1f962b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:32:09 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-e2410af9-a847-44d2-80a6-bfb662215ee8 tempest-VolumesSnapshotTestJSON-1802230238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b296e826-c58d-4633-849e-fd22d1f962b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:32:09 devstack sudo[97855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-30fef675-a409-4052-8026-2ed4db73f6cf
Nov 03 18:32:09 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-e2410af9-a847-44d2-80a6-bfb662215ee8 tempest-VolumesSnapshotTestJSON-1802230238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4df72c8-1c3e-4f19-9cbd-d4c4f6b19322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:32:09 devstack sudo[97855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:32:09 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-e2410af9-a847-44d2-80a6-bfb662215ee8 tempest-VolumesSnapshotTestJSON-1802230238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4df72c8-1c3e-4f19-9cbd-d4c4f6b19322) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e615f110-0eab-4d29-a76b-cae96b186b2c', 'volume_name': 'volume-e615f110-0eab-4d29-a76b-cae96b186b2c', 'volume_size': 2, 'snapshot_id': '26892c54-59a3-4a29-a483-47bd1104a884'}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:32:09 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-e2410af9-a847-44d2-80a6-bfb662215ee8 tempest-VolumesSnapshotTestJSON-1802230238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2584b627-ff5a-487b-a8c1-859a953b60ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:32:09 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-e2410af9-a847-44d2-80a6-bfb662215ee8 tempest-VolumesSnapshotTestJSON-1802230238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2584b627-ff5a-487b-a8c1-859a953b60ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:32:09 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-e2410af9-a847-44d2-80a6-bfb662215ee8 tempest-VolumesSnapshotTestJSON-1802230238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0ef35fc-e0c1-4256-b124-f8bb85551a35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:32:09 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-e2410af9-a847-44d2-80a6-bfb662215ee8 tempest-VolumesSnapshotTestJSON-1802230238 None] Volume e615f110-0eab-4d29-a76b-cae96b186b2c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e615f110-0eab-4d29-a76b-cae96b186b2c', 'volume_size': 2, 'snapshot_id': '26892c54-59a3-4a29-a483-47bd1104a884'}
Nov 03 18:32:09 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-d795793f-4476-4ce2-be45-28cde7d3d907 tempest-ProjectReaderTests-1272689156 None] Acquiring lock "cinder-5163e67a-d409-4a25-b799-473b1078ab01-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:32:09 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-e2410af9-a847-44d2-80a6-bfb662215ee8 tempest-VolumesSnapshotTestJSON-1802230238 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:32:09 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-d795793f-4476-4ce2-be45-28cde7d3d907 tempest-ProjectReaderTests-1272689156 None] Lock "cinder-5163e67a-d409-4a25-b799-473b1078ab01-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:32:09 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-d795793f-4476-4ce2-be45-28cde7d3d907 tempest-ProjectReaderTests-1272689156 None] Acquiring lock "cinder-quobyte-5163e67a-d409-4a25-b799-473b1078ab01" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:32:09 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-d795793f-4476-4ce2-be45-28cde7d3d907 tempest-ProjectReaderTests-1272689156 None] Lock "cinder-quobyte-5163e67a-d409-4a25-b799-473b1078ab01" acquired by "delete_volume" :: waited 0.022s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:32:09 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[e694a200-5682-4c9c-ba6d-10b642050e28]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:32:09 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-d795793f-4476-4ce2-be45-28cde7d3d907 tempest-ProjectReaderTests-1272689156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-5163e67a-d409-4a25-b799-473b1078ab01 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:32:09 devstack sudo[97855]: pam_unix(sudo:session): session closed for user root
Nov 03 18:32:09 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-c627b1e0-e9d7-4b21-b268-6715c735df4c tempest-VolumesActionsTest-1541010714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-30fef675-a409-4052-8026-2ed4db73f6cf" returned: 0 in 0.307s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:32:09 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-c627b1e0-e9d7-4b21-b268-6715c735df4c tempest-VolumesActionsTest-1541010714 None] <== create_volume: return (922ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:32:09 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-c627b1e0-e9d7-4b21-b268-6715c735df4c tempest-VolumesActionsTest-1541010714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.925s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:32:09 devstack sudo[97857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-5163e67a-d409-4a25-b799-473b1078ab01
Nov 03 18:32:09 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-e2410af9-a847-44d2-80a6-bfb662215ee8 tempest-VolumesSnapshotTestJSON-1802230238 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.209s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:32:09 devstack sudo[97857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:32:09 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-e2410af9-a847-44d2-80a6-bfb662215ee8 tempest-VolumesSnapshotTestJSON-1802230238 None] Acquiring lock "cinder-quobyte-26892c54-59a3-4a29-a483-47bd1104a884-e615f110-0eab-4d29-a76b-cae96b186b2c" by "_create_volume_from_snapshot" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:32:09 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-c627b1e0-e9d7-4b21-b268-6715c735df4c tempest-VolumesActionsTest-1541010714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b9a3630-d6e0-433c-b544-853177914943) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30fef675-a409-4052-8026-2ed4db73f6cf', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:32:09 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-c627b1e0-e9d7-4b21-b268-6715c735df4c tempest-VolumesActionsTest-1541010714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c28dff65-ae8e-4fde-ae9c-bdf4fd55e96a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:32:09 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-e2410af9-a847-44d2-80a6-bfb662215ee8 tempest-VolumesSnapshotTestJSON-1802230238 None] Lock "cinder-quobyte-26892c54-59a3-4a29-a483-47bd1104a884-e615f110-0eab-4d29-a76b-cae96b186b2c" acquired by "_create_volume_from_snapshot" :: waited 0.037s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:32:09 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-e2410af9-a847-44d2-80a6-bfb662215ee8 tempest-VolumesSnapshotTestJSON-1802230238 None] Creating volume e615f110-0eab-4d29-a76b-cae96b186b2c from snapshot 26892c54-59a3-4a29-a483-47bd1104a884 {{(pid=86120) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 03 18:32:09 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-e2410af9-a847-44d2-80a6-bfb662215ee8 tempest-VolumesSnapshotTestJSON-1802230238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:32:09 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-e2410af9-a847-44d2-80a6-bfb662215ee8 tempest-VolumesSnapshotTestJSON-1802230238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:32:09 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-e2410af9-a847-44d2-80a6-bfb662215ee8 tempest-VolumesSnapshotTestJSON-1802230238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:32:09 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-e2410af9-a847-44d2-80a6-bfb662215ee8 tempest-VolumesSnapshotTestJSON-1802230238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:32:09 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-e2410af9-a847-44d2-80a6-bfb662215ee8 tempest-VolumesSnapshotTestJSON-1802230238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:32:09 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-e2410af9-a847-44d2-80a6-bfb662215ee8 tempest-VolumesSnapshotTestJSON-1802230238 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:32:09 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-e2410af9-a847-44d2-80a6-bfb662215ee8 tempest-VolumesSnapshotTestJSON-1802230238 None] Acquiring lock "cinder-quobyte-e615f110-0eab-4d29-a76b-cae96b186b2c" by "_copy_volume_from_snapshot" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:32:09 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-c627b1e0-e9d7-4b21-b268-6715c735df4c tempest-VolumesActionsTest-1541010714 None] Volume volume-30fef675-a409-4052-8026-2ed4db73f6cf (30fef675-a409-4052-8026-2ed4db73f6cf): created successfully
Nov 03 18:32:09 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-c627b1e0-e9d7-4b21-b268-6715c735df4c tempest-VolumesActionsTest-1541010714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c28dff65-ae8e-4fde-ae9c-bdf4fd55e96a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:32:09 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-c627b1e0-e9d7-4b21-b268-6715c735df4c tempest-VolumesActionsTest-1541010714 None] Flow 'volume_create_manager' (cd1df16c-2ae7-4586-8536-d08f9e560778) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:32:09 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-e2410af9-a847-44d2-80a6-bfb662215ee8 tempest-VolumesSnapshotTestJSON-1802230238 None] Lock "cinder-quobyte-e615f110-0eab-4d29-a76b-cae96b186b2c" acquired by "_copy_volume_from_snapshot" :: waited 0.033s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:32:09 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-e2410af9-a847-44d2-80a6-bfb662215ee8 tempest-VolumesSnapshotTestJSON-1802230238 None] snapshot: 26892c54-59a3-4a29-a483-47bd1104a884, volume: e615f110-0eab-4d29-a76b-cae96b186b2c,  {{(pid=86120) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 03 18:32:09 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-c627b1e0-e9d7-4b21-b268-6715c735df4c tempest-VolumesActionsTest-1541010714 None] Created volume successfully.
Nov 03 18:32:09 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-e2410af9-a847-44d2-80a6-bfb662215ee8 tempest-VolumesSnapshotTestJSON-1802230238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:32:09 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-e2410af9-a847-44d2-80a6-bfb662215ee8 tempest-VolumesSnapshotTestJSON-1802230238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:32:09 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-e2410af9-a847-44d2-80a6-bfb662215ee8 tempest-VolumesSnapshotTestJSON-1802230238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:32:09 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-e2410af9-a847-44d2-80a6-bfb662215ee8 tempest-VolumesSnapshotTestJSON-1802230238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:32:09 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-e2410af9-a847-44d2-80a6-bfb662215ee8 tempest-VolumesSnapshotTestJSON-1802230238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:32:09 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[00ef4db6-9c66-4968-9f13-3e3fe28120a5]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:32:09 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-e2410af9-a847-44d2-80a6-bfb662215ee8 tempest-VolumesSnapshotTestJSON-1802230238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e3a16914-4aab-4f30-a54b-569287ecc7e6.26892c54-59a3-4a29-a483-47bd1104a884 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:32:09 devstack sudo[97860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e3a16914-4aab-4f30-a54b-569287ecc7e6.26892c54-59a3-4a29-a483-47bd1104a884
Nov 03 18:32:09 devstack sudo[97860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:32:09 devstack sudo[97857]: pam_unix(sudo:session): session closed for user root
Nov 03 18:32:09 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-d795793f-4476-4ce2-be45-28cde7d3d907 tempest-ProjectReaderTests-1272689156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-5163e67a-d409-4a25-b799-473b1078ab01" returned: 0 in 0.395s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:32:09 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-d795793f-4476-4ce2-be45-28cde7d3d907 tempest-ProjectReaderTests-1272689156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-5163e67a-d409-4a25-b799-473b1078ab01 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:32:09 devstack sudo[97865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-5163e67a-d409-4a25-b799-473b1078ab01
Nov 03 18:32:09 devstack sudo[97865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:32:09 devstack sudo[97865]: pam_unix(sudo:session): session closed for user root
Nov 03 18:32:09 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-d795793f-4476-4ce2-be45-28cde7d3d907 tempest-ProjectReaderTests-1272689156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-5163e67a-d409-4a25-b799-473b1078ab01" returned: 0 in 0.253s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:32:09 devstack sudo[97860]: pam_unix(sudo:session): session closed for user root
Nov 03 18:32:09 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-e2410af9-a847-44d2-80a6-bfb662215ee8 tempest-VolumesSnapshotTestJSON-1802230238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e3a16914-4aab-4f30-a54b-569287ecc7e6.26892c54-59a3-4a29-a483-47bd1104a884" returned: 0 in 0.412s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:32:09 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-e2410af9-a847-44d2-80a6-bfb662215ee8 tempest-VolumesSnapshotTestJSON-1802230238 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e3a16914-4aab-4f30-a54b-569287ecc7e6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86120) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 18:32:09 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-d795793f-4476-4ce2-be45-28cde7d3d907 tempest-ProjectReaderTests-1272689156 None] Lock "cinder-quobyte-5163e67a-d409-4a25-b799-473b1078ab01" released by "delete_volume" :: held 0.690s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:32:09 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d7824b3-07b1-4993-82cd-b669a72637ca]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:32:09 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-e2410af9-a847-44d2-80a6-bfb662215ee8 tempest-VolumesSnapshotTestJSON-1802230238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e3a16914-4aab-4f30-a54b-569287ecc7e6 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:32:09 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-d795793f-4476-4ce2-be45-28cde7d3d907 tempest-ProjectReaderTests-1272689156 None] Created reservations ['2bf7fffb-936b-4ca9-ac1e-f59813dc13c6', '5ab58668-a1f1-4c19-85a7-9795322f65fd', 'f1b0e156-22ee-4f8b-834a-23c3f76f9679', 'f3d58e37-7ad0-47e7-ba30-0ca2b7f60d78'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:32:09 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-d795793f-4476-4ce2-be45-28cde7d3d907 tempest-ProjectReaderTests-1272689156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:32:09 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-d795793f-4476-4ce2-be45-28cde7d3d907 tempest-ProjectReaderTests-1272689156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:32:09 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-d795793f-4476-4ce2-be45-28cde7d3d907 tempest-ProjectReaderTests-1272689156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:32:09 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-d795793f-4476-4ce2-be45-28cde7d3d907 tempest-ProjectReaderTests-1272689156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:32:09 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-d795793f-4476-4ce2-be45-28cde7d3d907 tempest-ProjectReaderTests-1272689156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:32:09 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-d795793f-4476-4ce2-be45-28cde7d3d907 tempest-ProjectReaderTests-1272689156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:32:09 devstack sudo[97872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e3a16914-4aab-4f30-a54b-569287ecc7e6
Nov 03 18:32:09 devstack sudo[97872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:32:10 devstack sudo[97874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:32:10 devstack sudo[97874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:32:10 devstack sudo[97874]: pam_unix(sudo:session): session closed for user root
Nov 03 18:32:10 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-d795793f-4476-4ce2-be45-28cde7d3d907 tempest-ProjectReaderTests-1272689156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.320s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:32:10 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-d795793f-4476-4ce2-be45-28cde7d3d907 tempest-ProjectReaderTests-1272689156 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:32:10 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-d795793f-4476-4ce2-be45-28cde7d3d907 tempest-ProjectReaderTests-1272689156 None] Deleted volume successfully.
Nov 03 18:32:10 devstack sudo[97872]: pam_unix(sudo:session): session closed for user root
Nov 03 18:32:10 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-d795793f-4476-4ce2-be45-28cde7d3d907 tempest-ProjectReaderTests-1272689156 None] Lock "cinder-5163e67a-d409-4a25-b799-473b1078ab01-delete_volume" released by "delete_volume" :: held 1.283s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:32:10 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-e2410af9-a847-44d2-80a6-bfb662215ee8 tempest-VolumesSnapshotTestJSON-1802230238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e3a16914-4aab-4f30-a54b-569287ecc7e6" returned: 0 in 0.527s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:32:10 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-e2410af9-a847-44d2-80a6-bfb662215ee8 tempest-VolumesSnapshotTestJSON-1802230238 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e3a16914-4aab-4f30-a54b-569287ecc7e6 {{(pid=86120) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 03 18:32:10 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-e2410af9-a847-44d2-80a6-bfb662215ee8 tempest-VolumesSnapshotTestJSON-1802230238 None] Creating direct copy from snapshot {{(pid=86120) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 03 18:32:10 devstack cinder-volume[86120]: DEBUG cinder.utils [None req-e2410af9-a847-44d2-80a6-bfb662215ee8 tempest-VolumesSnapshotTestJSON-1802230238 None] Path /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e615f110-0eab-4d29-a76b-cae96b186b2c not found in is_blk_device check {{(pid=86120) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 03 18:32:10 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-e2410af9-a847-44d2-80a6-bfb662215ee8 tempest-VolumesSnapshotTestJSON-1802230238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e3a16914-4aab-4f30-a54b-569287ecc7e6 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e615f110-0eab-4d29-a76b-cae96b186b2c {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:32:10 devstack sudo[97881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e3a16914-4aab-4f30-a54b-569287ecc7e6 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e615f110-0eab-4d29-a76b-cae96b186b2c
Nov 03 18:32:10 devstack sudo[97881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:32:10 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-d327d10b-a6a0-4876-8a36-7010b119265b tempest-ProjectReaderTests-1272689156 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:32:10 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-d327d10b-a6a0-4876-8a36-7010b119265b tempest-ProjectReaderTests-1272689156 None] Flow 'volume_create_manager' (1b1c6048-bfc5-4e30-8324-7f987710312d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:32:10 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-d327d10b-a6a0-4876-8a36-7010b119265b tempest-ProjectReaderTests-1272689156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3a7ad06-a6dd-4f94-b76b-af690bd5436e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:32:10 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-d327d10b-a6a0-4876-8a36-7010b119265b tempest-ProjectReaderTests-1272689156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3a7ad06-a6dd-4f94-b76b-af690bd5436e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:32:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1970671529',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0722eb10-0f7b-45cd-ac0b-0c8f8537829c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a9d2cf922c447649a36df9707fab65e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:32:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:32:11Z,use_quota=True,user_id='9d80735c04024af0abff0a3c0c54c250',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:32:11 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-d327d10b-a6a0-4876-8a36-7010b119265b tempest-ProjectReaderTests-1272689156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1411a116-aa8a-4c9c-a90f-0d1fea50a74d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:32:11 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-d327d10b-a6a0-4876-8a36-7010b119265b tempest-ProjectReaderTests-1272689156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1411a116-aa8a-4c9c-a90f-0d1fea50a74d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:32:11 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-d327d10b-a6a0-4876-8a36-7010b119265b tempest-ProjectReaderTests-1272689156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d094bd3-7134-49d9-bd0d-669011ce91ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:32:11 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-d327d10b-a6a0-4876-8a36-7010b119265b tempest-ProjectReaderTests-1272689156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d094bd3-7134-49d9-bd0d-669011ce91ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0722eb10-0f7b-45cd-ac0b-0c8f8537829c', 'volume_name': 'volume-0722eb10-0f7b-45cd-ac0b-0c8f8537829c', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:32:11 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-d327d10b-a6a0-4876-8a36-7010b119265b tempest-ProjectReaderTests-1272689156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69e41af1-030e-48bc-bd30-f370ac8bfb92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:32:11 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-d327d10b-a6a0-4876-8a36-7010b119265b tempest-ProjectReaderTests-1272689156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69e41af1-030e-48bc-bd30-f370ac8bfb92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:32:11 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-d327d10b-a6a0-4876-8a36-7010b119265b tempest-ProjectReaderTests-1272689156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (345e8fbf-3ee3-40de-9852-a3732c2aae85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:32:11 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-d327d10b-a6a0-4876-8a36-7010b119265b tempest-ProjectReaderTests-1272689156 None] Volume 0722eb10-0f7b-45cd-ac0b-0c8f8537829c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0722eb10-0f7b-45cd-ac0b-0c8f8537829c', 'volume_size': 1}
Nov 03 18:32:11 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-d327d10b-a6a0-4876-8a36-7010b119265b tempest-ProjectReaderTests-1272689156 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:32:11 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-7d58c2cb-1d8c-4d58-8506-84cf5f8014e7 tempest-VolumesActionsTest-1541010714 None] Acquiring lock "cinder-30fef675-a409-4052-8026-2ed4db73f6cf-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:32:11 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-7d58c2cb-1d8c-4d58-8506-84cf5f8014e7 tempest-VolumesActionsTest-1541010714 None] Lock "cinder-30fef675-a409-4052-8026-2ed4db73f6cf-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:32:11 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-7d58c2cb-1d8c-4d58-8506-84cf5f8014e7 tempest-VolumesActionsTest-1541010714 None] Acquiring lock "cinder-quobyte-30fef675-a409-4052-8026-2ed4db73f6cf" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:32:11 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-7d58c2cb-1d8c-4d58-8506-84cf5f8014e7 tempest-VolumesActionsTest-1541010714 None] Lock "cinder-quobyte-30fef675-a409-4052-8026-2ed4db73f6cf" acquired by "delete_volume" :: waited 0.040s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:32:11 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[097a8e78-37a9-48d7-9ef0-46745323e19e]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:32:11 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-7d58c2cb-1d8c-4d58-8506-84cf5f8014e7 tempest-VolumesActionsTest-1541010714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-30fef675-a409-4052-8026-2ed4db73f6cf {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:32:11 devstack sudo[97894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-30fef675-a409-4052-8026-2ed4db73f6cf
Nov 03 18:32:11 devstack sudo[97894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:32:12 devstack sudo[97894]: pam_unix(sudo:session): session closed for user root
Nov 03 18:32:12 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-7d58c2cb-1d8c-4d58-8506-84cf5f8014e7 tempest-VolumesActionsTest-1541010714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-30fef675-a409-4052-8026-2ed4db73f6cf" returned: 0 in 0.888s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:32:12 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-7d58c2cb-1d8c-4d58-8506-84cf5f8014e7 tempest-VolumesActionsTest-1541010714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-30fef675-a409-4052-8026-2ed4db73f6cf {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:32:12 devstack sudo[97899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-30fef675-a409-4052-8026-2ed4db73f6cf
Nov 03 18:32:12 devstack sudo[97899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:32:13 devstack sudo[97899]: pam_unix(sudo:session): session closed for user root
Nov 03 18:32:13 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-7d58c2cb-1d8c-4d58-8506-84cf5f8014e7 tempest-VolumesActionsTest-1541010714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-30fef675-a409-4052-8026-2ed4db73f6cf" returned: 0 in 0.474s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:32:13 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-7d58c2cb-1d8c-4d58-8506-84cf5f8014e7 tempest-VolumesActionsTest-1541010714 None] Lock "cinder-quobyte-30fef675-a409-4052-8026-2ed4db73f6cf" released by "delete_volume" :: held 1.492s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:32:13 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-7d58c2cb-1d8c-4d58-8506-84cf5f8014e7 tempest-VolumesActionsTest-1541010714 None] Created reservations ['e67d1cac-c0e4-4c7b-8015-001778bdb2cd', '3c42b647-6614-45eb-b126-9dcb0983340e', 'ce162e19-2c02-4619-8abd-8dafc56b1dd2', '99862730-4fa6-45d9-9435-fd37a9376cde'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:32:13 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-7d58c2cb-1d8c-4d58-8506-84cf5f8014e7 tempest-VolumesActionsTest-1541010714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:32:13 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-7d58c2cb-1d8c-4d58-8506-84cf5f8014e7 tempest-VolumesActionsTest-1541010714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:32:13 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-7d58c2cb-1d8c-4d58-8506-84cf5f8014e7 tempest-VolumesActionsTest-1541010714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:32:13 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-7d58c2cb-1d8c-4d58-8506-84cf5f8014e7 tempest-VolumesActionsTest-1541010714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:32:13 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-7d58c2cb-1d8c-4d58-8506-84cf5f8014e7 tempest-VolumesActionsTest-1541010714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:32:13 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-7d58c2cb-1d8c-4d58-8506-84cf5f8014e7 tempest-VolumesActionsTest-1541010714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:32:13 devstack sudo[97902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:32:13 devstack sudo[97902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:32:13 devstack sudo[97902]: pam_unix(sudo:session): session closed for user root
Nov 03 18:32:13 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-7d58c2cb-1d8c-4d58-8506-84cf5f8014e7 tempest-VolumesActionsTest-1541010714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.530s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:32:13 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-7d58c2cb-1d8c-4d58-8506-84cf5f8014e7 tempest-VolumesActionsTest-1541010714 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:32:13 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-7d58c2cb-1d8c-4d58-8506-84cf5f8014e7 tempest-VolumesActionsTest-1541010714 None] Deleted volume successfully.
Nov 03 18:32:14 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-7d58c2cb-1d8c-4d58-8506-84cf5f8014e7 tempest-VolumesActionsTest-1541010714 None] Lock "cinder-30fef675-a409-4052-8026-2ed4db73f6cf-delete_volume" released by "delete_volume" :: held 2.614s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:32:14 devstack cinder-volume[86120]: DEBUG oslo_service.periodic_task [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86120) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 18:32:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:32:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:32:14 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:32:14 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:32:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:32:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:32:15 devstack sudo[97912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:32:15 devstack sudo[97912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:32:15 devstack sudo[97912]: pam_unix(sudo:session): session closed for user root
Nov 03 18:32:15 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.738s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:32:15 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:32:15 devstack cinder-volume[86120]: DEBUG oslo_service.periodic_task [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Running periodic task VolumeManager._thread_info {{(pid=86120) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 18:32:15 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] thread count: 28 {{(pid=86120) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 03 18:32:15 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] thread info: [<_MainThread(MainThread, started 134747145822336)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134747033686336)>, <Thread(Thread-3 (stat_writer), started daemon 134747030828736)>, <Thread(Rabbit-heartbeat, started daemon 134747035433408)>, <Thread(Thread-5 (_runner), started daemon 134747029587392)>, <Thread(Thread-7 (_runner), started daemon 134747029784256)>, <Thread(fd_logger, started daemon 134747027909120)>, <Thread(privsep_reader, started daemon 134747027006592)>, <Thread(tpool_thread_0, started daemon 134747018950336)>, <Thread(tpool_thread_1, started daemon 134747010541248)>, <Thread(tpool_thread_2, started daemon 134747002132160)>, <Thread(tpool_thread_3, started daemon 134746993723072)>, <Thread(tpool_thread_4, started daemon 134746985313984)>, <Thread(tpool_thread_5, started daemon 134746976904896)>, <Thread(tpool_thread_6, started daemon 134746968495808)>, <Thread(tpool_thread_7, started daemon 134746960086720)>, <Thread(tpool_thread_8, started daemon 134746951677632)>, <Thread(tpool_thread_9, started daemon 134746943268544)>, <Thread(tpool_thread_10, started daemon 134746934859456)>, <Thread(tpool_thread_11, started daemon 134746926450368)>, <Thread(tpool_thread_12, started daemon 134746918041280)>, <Thread(tpool_thread_13, started daemon 134746909632192)>, <Thread(tpool_thread_14, started daemon 134746901223104)>, <Thread(tpool_thread_15, started daemon 134746892814016)>, <Thread(tpool_thread_16, started daemon 134746884404928)>, <Thread(tpool_thread_17, started daemon 134746875995840)>, <Thread(tpool_thread_18, started daemon 134746867586752)>, <Thread(tpool_thread_19, started daemon 134746859177664)>] {{(pid=86120) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 03 18:32:18 devstack sudo[97881]: pam_unix(sudo:session): session closed for user root
Nov 03 18:32:18 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-e2410af9-a847-44d2-80a6-bfb662215ee8 tempest-VolumesSnapshotTestJSON-1802230238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e3a16914-4aab-4f30-a54b-569287ecc7e6 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e615f110-0eab-4d29-a76b-cae96b186b2c" returned: 0 in 8.342s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:32:18 devstack cinder-volume[86120]: DEBUG cinder.image.image_utils [None req-e2410af9-a847-44d2-80a6-bfb662215ee8 tempest-VolumesSnapshotTestJSON-1802230238 None] Image conversion details: src /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e3a16914-4aab-4f30-a54b-569287ecc7e6, size 1024.00 MB, duration 8.34 sec, destination /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e615f110-0eab-4d29-a76b-cae96b186b2c {{(pid=86120) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 03 18:32:18 devstack cinder-volume[86120]: INFO cinder.image.image_utils [None req-e2410af9-a847-44d2-80a6-bfb662215ee8 tempest-VolumesSnapshotTestJSON-1802230238 None] Converted 1024.00 MB image at 122.73 MB/s
Nov 03 18:32:18 devstack cinder-volume[86120]: WARNING cinder.volume.drivers.remotefs [None req-e2410af9-a847-44d2-80a6-bfb662215ee8 tempest-VolumesSnapshotTestJSON-1802230238 None] /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e615f110-0eab-4d29-a76b-cae96b186b2c is being set with open permissions: ugo+rw
Nov 03 18:32:18 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-e2410af9-a847-44d2-80a6-bfb662215ee8 tempest-VolumesSnapshotTestJSON-1802230238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e615f110-0eab-4d29-a76b-cae96b186b2c {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:32:18 devstack sudo[97918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e615f110-0eab-4d29-a76b-cae96b186b2c
Nov 03 18:32:18 devstack sudo[97918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:32:18 devstack sudo[97918]: pam_unix(sudo:session): session closed for user root
Nov 03 18:32:18 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-e2410af9-a847-44d2-80a6-bfb662215ee8 tempest-VolumesSnapshotTestJSON-1802230238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e615f110-0eab-4d29-a76b-cae96b186b2c" returned: 0 in 0.265s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:32:19 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-e2410af9-a847-44d2-80a6-bfb662215ee8 tempest-VolumesSnapshotTestJSON-1802230238 None] Lock "cinder-quobyte-e615f110-0eab-4d29-a76b-cae96b186b2c" released by "_copy_volume_from_snapshot" :: held 9.641s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:32:19 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-e2410af9-a847-44d2-80a6-bfb662215ee8 tempest-VolumesSnapshotTestJSON-1802230238 None] Lock "cinder-quobyte-26892c54-59a3-4a29-a483-47bd1104a884-e615f110-0eab-4d29-a76b-cae96b186b2c" released by "_create_volume_from_snapshot" :: held 9.746s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:32:19 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-e2410af9-a847-44d2-80a6-bfb662215ee8 tempest-VolumesSnapshotTestJSON-1802230238 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.786s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:32:19 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-d327d10b-a6a0-4876-8a36-7010b119265b tempest-ProjectReaderTests-1272689156 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.015s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:32:19 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-d327d10b-a6a0-4876-8a36-7010b119265b tempest-ProjectReaderTests-1272689156 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:32:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1970671529',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0722eb10-0f7b-45cd-ac0b-0c8f8537829c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a9d2cf922c447649a36df9707fab65e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:32:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:32:11Z,use_quota=True,user_id='9d80735c04024af0abff0a3c0c54c250',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:32:19 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-d327d10b-a6a0-4876-8a36-7010b119265b tempest-ProjectReaderTests-1272689156 None] Creating volume 0722eb10-0f7b-45cd-ac0b-0c8f8537829c {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:32:19 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-d327d10b-a6a0-4876-8a36-7010b119265b tempest-ProjectReaderTests-1272689156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:32:19 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-d327d10b-a6a0-4876-8a36-7010b119265b tempest-ProjectReaderTests-1272689156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:32:19 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-d327d10b-a6a0-4876-8a36-7010b119265b tempest-ProjectReaderTests-1272689156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:32:19 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-d327d10b-a6a0-4876-8a36-7010b119265b tempest-ProjectReaderTests-1272689156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:32:19 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-d327d10b-a6a0-4876-8a36-7010b119265b tempest-ProjectReaderTests-1272689156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:32:19 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-d327d10b-a6a0-4876-8a36-7010b119265b tempest-ProjectReaderTests-1272689156 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:32:19 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-d327d10b-a6a0-4876-8a36-7010b119265b tempest-ProjectReaderTests-1272689156 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:32:19 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-d327d10b-a6a0-4876-8a36-7010b119265b tempest-ProjectReaderTests-1272689156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-0722eb10-0f7b-45cd-ac0b-0c8f8537829c 1073741824 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:32:19 devstack sudo[97954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-0722eb10-0f7b-45cd-ac0b-0c8f8537829c 1073741824
Nov 03 18:32:19 devstack sudo[97954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:32:19 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-e2410af9-a847-44d2-80a6-bfb662215ee8 tempest-VolumesSnapshotTestJSON-1802230238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0ef35fc-e0c1-4256-b124-f8bb85551a35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e615f110-0eab-4d29-a76b-cae96b186b2c', 'volume_size': 2, 'snapshot_id': '26892c54-59a3-4a29-a483-47bd1104a884'}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:32:19 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-e2410af9-a847-44d2-80a6-bfb662215ee8 tempest-VolumesSnapshotTestJSON-1802230238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58a404ec-17d4-4912-8335-aea3429ecdcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:32:19 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-e2410af9-a847-44d2-80a6-bfb662215ee8 tempest-VolumesSnapshotTestJSON-1802230238 None] Volume volume-e615f110-0eab-4d29-a76b-cae96b186b2c (e615f110-0eab-4d29-a76b-cae96b186b2c): created successfully
Nov 03 18:32:19 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-e2410af9-a847-44d2-80a6-bfb662215ee8 tempest-VolumesSnapshotTestJSON-1802230238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58a404ec-17d4-4912-8335-aea3429ecdcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:32:19 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-e2410af9-a847-44d2-80a6-bfb662215ee8 tempest-VolumesSnapshotTestJSON-1802230238 None] Flow 'volume_create_manager' (69eaac43-db7b-4e37-a174-9667b5919d69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:32:19 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-e2410af9-a847-44d2-80a6-bfb662215ee8 tempest-VolumesSnapshotTestJSON-1802230238 None] Created volume successfully.
Nov 03 18:32:19 devstack sudo[97954]: pam_unix(sudo:session): session closed for user root
Nov 03 18:32:19 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-d327d10b-a6a0-4876-8a36-7010b119265b tempest-ProjectReaderTests-1272689156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-0722eb10-0f7b-45cd-ac0b-0c8f8537829c 1073741824" returned: 0 in 0.401s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:32:19 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-d327d10b-a6a0-4876-8a36-7010b119265b tempest-ProjectReaderTests-1272689156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-0722eb10-0f7b-45cd-ac0b-0c8f8537829c {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:32:19 devstack sudo[97960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-0722eb10-0f7b-45cd-ac0b-0c8f8537829c
Nov 03 18:32:19 devstack sudo[97960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:32:19 devstack sudo[97960]: pam_unix(sudo:session): session closed for user root
Nov 03 18:32:19 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-d327d10b-a6a0-4876-8a36-7010b119265b tempest-ProjectReaderTests-1272689156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-0722eb10-0f7b-45cd-ac0b-0c8f8537829c" returned: 0 in 0.257s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:32:19 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-d327d10b-a6a0-4876-8a36-7010b119265b tempest-ProjectReaderTests-1272689156 None] <== create_volume: return (700ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:32:19 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-d327d10b-a6a0-4876-8a36-7010b119265b tempest-ProjectReaderTests-1272689156 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.702s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:32:19 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-d327d10b-a6a0-4876-8a36-7010b119265b tempest-ProjectReaderTests-1272689156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (345e8fbf-3ee3-40de-9852-a3732c2aae85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0722eb10-0f7b-45cd-ac0b-0c8f8537829c', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:32:19 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-d327d10b-a6a0-4876-8a36-7010b119265b tempest-ProjectReaderTests-1272689156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c225e674-1aa4-48e4-ac79-fe06d432b08c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:32:19 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-d327d10b-a6a0-4876-8a36-7010b119265b tempest-ProjectReaderTests-1272689156 None] Volume volume-0722eb10-0f7b-45cd-ac0b-0c8f8537829c (0722eb10-0f7b-45cd-ac0b-0c8f8537829c): created successfully
Nov 03 18:32:19 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-d327d10b-a6a0-4876-8a36-7010b119265b tempest-ProjectReaderTests-1272689156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c225e674-1aa4-48e4-ac79-fe06d432b08c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:32:19 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-d327d10b-a6a0-4876-8a36-7010b119265b tempest-ProjectReaderTests-1272689156 None] Flow 'volume_create_manager' (1b1c6048-bfc5-4e30-8324-7f987710312d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:32:19 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-d327d10b-a6a0-4876-8a36-7010b119265b tempest-ProjectReaderTests-1272689156 None] Created volume successfully.
Nov 03 18:32:20 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-54655bc4-2eec-48ca-a1a1-8b06bf10ddbb tempest-VolumesSnapshotTestJSON-1802230238 None] Acquiring lock "cinder-e615f110-0eab-4d29-a76b-cae96b186b2c-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:32:20 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-54655bc4-2eec-48ca-a1a1-8b06bf10ddbb tempest-VolumesSnapshotTestJSON-1802230238 None] Lock "cinder-e615f110-0eab-4d29-a76b-cae96b186b2c-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:32:20 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-54655bc4-2eec-48ca-a1a1-8b06bf10ddbb tempest-VolumesSnapshotTestJSON-1802230238 None] Acquiring lock "cinder-quobyte-e615f110-0eab-4d29-a76b-cae96b186b2c" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:32:20 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-54655bc4-2eec-48ca-a1a1-8b06bf10ddbb tempest-VolumesSnapshotTestJSON-1802230238 None] Lock "cinder-quobyte-e615f110-0eab-4d29-a76b-cae96b186b2c" acquired by "delete_volume" :: waited 0.015s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:32:20 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aa25e91-4e3c-441c-b347-5515034ba871]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:32:20 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-54655bc4-2eec-48ca-a1a1-8b06bf10ddbb tempest-VolumesSnapshotTestJSON-1802230238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e615f110-0eab-4d29-a76b-cae96b186b2c {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:32:20 devstack sudo[97963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e615f110-0eab-4d29-a76b-cae96b186b2c
Nov 03 18:32:20 devstack sudo[97963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:32:20 devstack sudo[97963]: pam_unix(sudo:session): session closed for user root
Nov 03 18:32:20 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-54655bc4-2eec-48ca-a1a1-8b06bf10ddbb tempest-VolumesSnapshotTestJSON-1802230238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e615f110-0eab-4d29-a76b-cae96b186b2c" returned: 0 in 0.395s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:32:20 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-54655bc4-2eec-48ca-a1a1-8b06bf10ddbb tempest-VolumesSnapshotTestJSON-1802230238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e615f110-0eab-4d29-a76b-cae96b186b2c {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:32:20 devstack sudo[97969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e615f110-0eab-4d29-a76b-cae96b186b2c
Nov 03 18:32:20 devstack sudo[97969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:32:20 devstack sudo[97969]: pam_unix(sudo:session): session closed for user root
Nov 03 18:32:20 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-54655bc4-2eec-48ca-a1a1-8b06bf10ddbb tempest-VolumesSnapshotTestJSON-1802230238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e615f110-0eab-4d29-a76b-cae96b186b2c" returned: 0 in 0.294s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:32:20 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-54655bc4-2eec-48ca-a1a1-8b06bf10ddbb tempest-VolumesSnapshotTestJSON-1802230238 None] Lock "cinder-quobyte-e615f110-0eab-4d29-a76b-cae96b186b2c" released by "delete_volume" :: held 0.737s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:32:20 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-9efe0626-7646-4fcf-85f1-014becd29c05 tempest-ProjectReaderTests-1272689156 None] Acquiring lock "cinder-0722eb10-0f7b-45cd-ac0b-0c8f8537829c-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:32:21 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-54655bc4-2eec-48ca-a1a1-8b06bf10ddbb tempest-VolumesSnapshotTestJSON-1802230238 None] Created reservations ['6a44f699-7c22-41ef-a84b-c5093522dcbf', '815c3c0d-0476-468f-95f4-1dc68273876f', '9792683f-bb9a-4d8d-a4ac-33f42c549894', '20eac8ce-ec1b-453a-a42d-73ec36b01953'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:32:21 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-9efe0626-7646-4fcf-85f1-014becd29c05 tempest-ProjectReaderTests-1272689156 None] Lock "cinder-0722eb10-0f7b-45cd-ac0b-0c8f8537829c-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:32:21 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-9efe0626-7646-4fcf-85f1-014becd29c05 tempest-ProjectReaderTests-1272689156 None] Acquiring lock "cinder-quobyte-0722eb10-0f7b-45cd-ac0b-0c8f8537829c" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:32:21 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-9efe0626-7646-4fcf-85f1-014becd29c05 tempest-ProjectReaderTests-1272689156 None] Lock "cinder-quobyte-0722eb10-0f7b-45cd-ac0b-0c8f8537829c" acquired by "delete_volume" :: waited 0.023s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:32:21 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[9287081e-4d24-4e66-a646-7ed9c940c1a2]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:32:21 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-9efe0626-7646-4fcf-85f1-014becd29c05 tempest-ProjectReaderTests-1272689156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-0722eb10-0f7b-45cd-ac0b-0c8f8537829c {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:32:21 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-54655bc4-2eec-48ca-a1a1-8b06bf10ddbb tempest-VolumesSnapshotTestJSON-1802230238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:32:21 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-54655bc4-2eec-48ca-a1a1-8b06bf10ddbb tempest-VolumesSnapshotTestJSON-1802230238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:32:21 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-54655bc4-2eec-48ca-a1a1-8b06bf10ddbb tempest-VolumesSnapshotTestJSON-1802230238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:32:21 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-54655bc4-2eec-48ca-a1a1-8b06bf10ddbb tempest-VolumesSnapshotTestJSON-1802230238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:32:21 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-54655bc4-2eec-48ca-a1a1-8b06bf10ddbb tempest-VolumesSnapshotTestJSON-1802230238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:32:21 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-54655bc4-2eec-48ca-a1a1-8b06bf10ddbb tempest-VolumesSnapshotTestJSON-1802230238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:32:21 devstack sudo[97973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:32:21 devstack sudo[97973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:32:21 devstack sudo[97972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-0722eb10-0f7b-45cd-ac0b-0c8f8537829c
Nov 03 18:32:21 devstack sudo[97972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:32:21 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-f5fda4bb-f5da-4ba8-af1d-28c2432fe5c3 tempest-VolumesSnapshotTestJSON-1802230238 None] Acquiring lock "cinder-26892c54-59a3-4a29-a483-47bd1104a884-delete_snapshot" by "delete_snapshot" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:32:21 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-f5fda4bb-f5da-4ba8-af1d-28c2432fe5c3 tempest-VolumesSnapshotTestJSON-1802230238 None] Lock "cinder-26892c54-59a3-4a29-a483-47bd1104a884-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:32:21 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-f5fda4bb-f5da-4ba8-af1d-28c2432fe5c3 tempest-VolumesSnapshotTestJSON-1802230238 None] Acquiring lock "cinder-quobyte-e3a16914-4aab-4f30-a54b-569287ecc7e6" by "delete_snapshot" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:32:21 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-f5fda4bb-f5da-4ba8-af1d-28c2432fe5c3 tempest-VolumesSnapshotTestJSON-1802230238 None] Lock "cinder-quobyte-e3a16914-4aab-4f30-a54b-569287ecc7e6" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:32:21 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-f5fda4bb-f5da-4ba8-af1d-28c2432fe5c3 tempest-VolumesSnapshotTestJSON-1802230238 None] Acquiring lock "cinder-quobyte-26892c54-59a3-4a29-a483-47bd1104a884" by "_delete_snapshot" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:32:21 devstack sudo[97973]: pam_unix(sudo:session): session closed for user root
Nov 03 18:32:21 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-54655bc4-2eec-48ca-a1a1-8b06bf10ddbb tempest-VolumesSnapshotTestJSON-1802230238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.317s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:32:21 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-54655bc4-2eec-48ca-a1a1-8b06bf10ddbb tempest-VolumesSnapshotTestJSON-1802230238 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:32:21 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-f5fda4bb-f5da-4ba8-af1d-28c2432fe5c3 tempest-VolumesSnapshotTestJSON-1802230238 None] Lock "cinder-quobyte-26892c54-59a3-4a29-a483-47bd1104a884" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:32:21 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-f5fda4bb-f5da-4ba8-af1d-28c2432fe5c3 tempest-VolumesSnapshotTestJSON-1802230238 None] Deleting offline snapshot 26892c54-59a3-4a29-a483-47bd1104a884 of volume e3a16914-4aab-4f30-a54b-569287ecc7e6 {{(pid=86120) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 18:32:21 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-f5fda4bb-f5da-4ba8-af1d-28c2432fe5c3 tempest-VolumesSnapshotTestJSON-1802230238 None] snapshot_file for this snap is: volume-e3a16914-4aab-4f30-a54b-569287ecc7e6.26892c54-59a3-4a29-a483-47bd1104a884 {{(pid=86120) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 18:32:21 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-54655bc4-2eec-48ca-a1a1-8b06bf10ddbb tempest-VolumesSnapshotTestJSON-1802230238 None] Deleted volume successfully.
Nov 03 18:32:21 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fc9d44d-c9b2-4f38-bfc9-b18d2d5c19c2]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:32:21 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-f5fda4bb-f5da-4ba8-af1d-28c2432fe5c3 tempest-VolumesSnapshotTestJSON-1802230238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e3a16914-4aab-4f30-a54b-569287ecc7e6.26892c54-59a3-4a29-a483-47bd1104a884 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:32:21 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-54655bc4-2eec-48ca-a1a1-8b06bf10ddbb tempest-VolumesSnapshotTestJSON-1802230238 None] Lock "cinder-e615f110-0eab-4d29-a76b-cae96b186b2c-delete_volume" released by "delete_volume" :: held 1.408s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:32:21 devstack sudo[97972]: pam_unix(sudo:session): session closed for user root
Nov 03 18:32:21 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-9efe0626-7646-4fcf-85f1-014becd29c05 tempest-ProjectReaderTests-1272689156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-0722eb10-0f7b-45cd-ac0b-0c8f8537829c" returned: 0 in 0.521s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:32:21 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-9efe0626-7646-4fcf-85f1-014becd29c05 tempest-ProjectReaderTests-1272689156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-0722eb10-0f7b-45cd-ac0b-0c8f8537829c {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:32:21 devstack sudo[97977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e3a16914-4aab-4f30-a54b-569287ecc7e6.26892c54-59a3-4a29-a483-47bd1104a884
Nov 03 18:32:21 devstack sudo[97977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:32:21 devstack sudo[97981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-0722eb10-0f7b-45cd-ac0b-0c8f8537829c
Nov 03 18:32:21 devstack sudo[97981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:32:21 devstack sudo[97981]: pam_unix(sudo:session): session closed for user root
Nov 03 18:32:21 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-9efe0626-7646-4fcf-85f1-014becd29c05 tempest-ProjectReaderTests-1272689156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-0722eb10-0f7b-45cd-ac0b-0c8f8537829c" returned: 0 in 0.270s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:32:21 devstack sudo[97977]: pam_unix(sudo:session): session closed for user root
Nov 03 18:32:21 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-f5fda4bb-f5da-4ba8-af1d-28c2432fe5c3 tempest-VolumesSnapshotTestJSON-1802230238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e3a16914-4aab-4f30-a54b-569287ecc7e6.26892c54-59a3-4a29-a483-47bd1104a884" returned: 0 in 0.406s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:32:21 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-f5fda4bb-f5da-4ba8-af1d-28c2432fe5c3 tempest-VolumesSnapshotTestJSON-1802230238 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e3a16914-4aab-4f30-a54b-569287ecc7e6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86120) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 18:32:21 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-9efe0626-7646-4fcf-85f1-014becd29c05 tempest-ProjectReaderTests-1272689156 None] Lock "cinder-quobyte-0722eb10-0f7b-45cd-ac0b-0c8f8537829c" released by "delete_volume" :: held 0.868s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:32:21 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0d9508c-8fea-424b-8279-ffc344a63aa3]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:32:21 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-f5fda4bb-f5da-4ba8-af1d-28c2432fe5c3 tempest-VolumesSnapshotTestJSON-1802230238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e3a16914-4aab-4f30-a54b-569287ecc7e6 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:32:22 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-9efe0626-7646-4fcf-85f1-014becd29c05 tempest-ProjectReaderTests-1272689156 None] Created reservations ['e0670a60-f926-4e68-bd42-4cfc4c7a6d56', '372b5f53-ab89-437f-911e-fb8ed5367c79', '66b8b968-33f1-41d5-a848-cc05788e1906', '54384c1c-daf6-48f3-90b7-e711e209fdb5'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:32:22 devstack sudo[97988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e3a16914-4aab-4f30-a54b-569287ecc7e6
Nov 03 18:32:22 devstack sudo[97988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:32:22 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-9efe0626-7646-4fcf-85f1-014becd29c05 tempest-ProjectReaderTests-1272689156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:32:22 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-9efe0626-7646-4fcf-85f1-014becd29c05 tempest-ProjectReaderTests-1272689156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:32:22 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-9efe0626-7646-4fcf-85f1-014becd29c05 tempest-ProjectReaderTests-1272689156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:32:22 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-9efe0626-7646-4fcf-85f1-014becd29c05 tempest-ProjectReaderTests-1272689156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:32:22 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-9efe0626-7646-4fcf-85f1-014becd29c05 tempest-ProjectReaderTests-1272689156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:32:22 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-9efe0626-7646-4fcf-85f1-014becd29c05 tempest-ProjectReaderTests-1272689156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:32:22 devstack sudo[97990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:32:22 devstack sudo[97990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:32:22 devstack sudo[97990]: pam_unix(sudo:session): session closed for user root
Nov 03 18:32:22 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-9efe0626-7646-4fcf-85f1-014becd29c05 tempest-ProjectReaderTests-1272689156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.370s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:32:22 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-9efe0626-7646-4fcf-85f1-014becd29c05 tempest-ProjectReaderTests-1272689156 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:32:22 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-9efe0626-7646-4fcf-85f1-014becd29c05 tempest-ProjectReaderTests-1272689156 None] Deleted volume successfully.
Nov 03 18:32:22 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-9efe0626-7646-4fcf-85f1-014becd29c05 tempest-ProjectReaderTests-1272689156 None] Lock "cinder-0722eb10-0f7b-45cd-ac0b-0c8f8537829c-delete_volume" released by "delete_volume" :: held 1.541s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:32:22 devstack sudo[97988]: pam_unix(sudo:session): session closed for user root
Nov 03 18:32:22 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-f5fda4bb-f5da-4ba8-af1d-28c2432fe5c3 tempest-VolumesSnapshotTestJSON-1802230238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e3a16914-4aab-4f30-a54b-569287ecc7e6" returned: 0 in 0.735s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:32:22 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-f5fda4bb-f5da-4ba8-af1d-28c2432fe5c3 tempest-VolumesSnapshotTestJSON-1802230238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e3a16914-4aab-4f30-a54b-569287ecc7e6.26892c54-59a3-4a29-a483-47bd1104a884 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:32:22 devstack sudo[97997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e3a16914-4aab-4f30-a54b-569287ecc7e6.26892c54-59a3-4a29-a483-47bd1104a884
Nov 03 18:32:22 devstack sudo[97997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:32:22 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-6916b413-220a-4cf6-a1f3-098bdedb96bd tempest-ProjectReaderTests-1272689156 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:32:22 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-6916b413-220a-4cf6-a1f3-098bdedb96bd tempest-ProjectReaderTests-1272689156 None] Flow 'volume_create_manager' (10f3751a-a734-44fa-963b-d24b94ca1f20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:32:22 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-6916b413-220a-4cf6-a1f3-098bdedb96bd tempest-ProjectReaderTests-1272689156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71debd44-f0ce-4786-a714-05157b6dd944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:32:22 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-6916b413-220a-4cf6-a1f3-098bdedb96bd tempest-ProjectReaderTests-1272689156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71debd44-f0ce-4786-a714-05157b6dd944) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:32:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1465618522',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c869ae3-c3dd-45b8-8c14-a3673f687e2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a9d2cf922c447649a36df9707fab65e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:32:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:32:23Z,use_quota=True,user_id='9d80735c04024af0abff0a3c0c54c250',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:32:22 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-6916b413-220a-4cf6-a1f3-098bdedb96bd tempest-ProjectReaderTests-1272689156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0266176a-8c01-401d-9f7d-e0876db446cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:32:22 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-6916b413-220a-4cf6-a1f3-098bdedb96bd tempest-ProjectReaderTests-1272689156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0266176a-8c01-401d-9f7d-e0876db446cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:32:22 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-6916b413-220a-4cf6-a1f3-098bdedb96bd tempest-ProjectReaderTests-1272689156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acd78a0f-b456-4100-a6f9-20e701e9a88d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:32:22 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-6916b413-220a-4cf6-a1f3-098bdedb96bd tempest-ProjectReaderTests-1272689156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acd78a0f-b456-4100-a6f9-20e701e9a88d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c869ae3-c3dd-45b8-8c14-a3673f687e2f', 'volume_name': 'volume-3c869ae3-c3dd-45b8-8c14-a3673f687e2f', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:32:22 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-6916b413-220a-4cf6-a1f3-098bdedb96bd tempest-ProjectReaderTests-1272689156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30a97776-3308-48d8-bec6-506a8e667d6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:32:22 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-6916b413-220a-4cf6-a1f3-098bdedb96bd tempest-ProjectReaderTests-1272689156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30a97776-3308-48d8-bec6-506a8e667d6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:32:22 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-6916b413-220a-4cf6-a1f3-098bdedb96bd tempest-ProjectReaderTests-1272689156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7bc8e1c-3afd-4ba7-a7e5-99a46f7ebd89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:32:22 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-6916b413-220a-4cf6-a1f3-098bdedb96bd tempest-ProjectReaderTests-1272689156 None] Volume 3c869ae3-c3dd-45b8-8c14-a3673f687e2f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c869ae3-c3dd-45b8-8c14-a3673f687e2f', 'volume_size': 1}
Nov 03 18:32:22 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-6916b413-220a-4cf6-a1f3-098bdedb96bd tempest-ProjectReaderTests-1272689156 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:32:22 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-6916b413-220a-4cf6-a1f3-098bdedb96bd tempest-ProjectReaderTests-1272689156 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:32:22 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-6916b413-220a-4cf6-a1f3-098bdedb96bd tempest-ProjectReaderTests-1272689156 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:32:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1465618522',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c869ae3-c3dd-45b8-8c14-a3673f687e2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a9d2cf922c447649a36df9707fab65e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:32:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:32:23Z,use_quota=True,user_id='9d80735c04024af0abff0a3c0c54c250',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:32:22 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-6916b413-220a-4cf6-a1f3-098bdedb96bd tempest-ProjectReaderTests-1272689156 None] Creating volume 3c869ae3-c3dd-45b8-8c14-a3673f687e2f {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:32:22 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-6916b413-220a-4cf6-a1f3-098bdedb96bd tempest-ProjectReaderTests-1272689156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:32:22 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-6916b413-220a-4cf6-a1f3-098bdedb96bd tempest-ProjectReaderTests-1272689156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:32:22 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-6916b413-220a-4cf6-a1f3-098bdedb96bd tempest-ProjectReaderTests-1272689156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:32:22 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-6916b413-220a-4cf6-a1f3-098bdedb96bd tempest-ProjectReaderTests-1272689156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:32:22 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-6916b413-220a-4cf6-a1f3-098bdedb96bd tempest-ProjectReaderTests-1272689156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:32:22 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-6916b413-220a-4cf6-a1f3-098bdedb96bd tempest-ProjectReaderTests-1272689156 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:32:22 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-6916b413-220a-4cf6-a1f3-098bdedb96bd tempest-ProjectReaderTests-1272689156 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:32:22 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-6916b413-220a-4cf6-a1f3-098bdedb96bd tempest-ProjectReaderTests-1272689156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3c869ae3-c3dd-45b8-8c14-a3673f687e2f 1073741824 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:32:22 devstack sudo[98001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3c869ae3-c3dd-45b8-8c14-a3673f687e2f 1073741824
Nov 03 18:32:22 devstack sudo[98001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:32:23 devstack sudo[97997]: pam_unix(sudo:session): session closed for user root
Nov 03 18:32:23 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-f5fda4bb-f5da-4ba8-af1d-28c2432fe5c3 tempest-VolumesSnapshotTestJSON-1802230238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e3a16914-4aab-4f30-a54b-569287ecc7e6.26892c54-59a3-4a29-a483-47bd1104a884" returned: 0 in 0.388s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:32:23 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-f5fda4bb-f5da-4ba8-af1d-28c2432fe5c3 tempest-VolumesSnapshotTestJSON-1802230238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e3a16914-4aab-4f30-a54b-569287ecc7e6.26892c54-59a3-4a29-a483-47bd1104a884 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:32:23 devstack sudo[98004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e3a16914-4aab-4f30-a54b-569287ecc7e6.26892c54-59a3-4a29-a483-47bd1104a884
Nov 03 18:32:23 devstack sudo[98004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:32:23 devstack sudo[98004]: pam_unix(sudo:session): session closed for user root
Nov 03 18:32:23 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-f5fda4bb-f5da-4ba8-af1d-28c2432fe5c3 tempest-VolumesSnapshotTestJSON-1802230238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e3a16914-4aab-4f30-a54b-569287ecc7e6.26892c54-59a3-4a29-a483-47bd1104a884" returned: 0 in 0.277s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:32:23 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-f5fda4bb-f5da-4ba8-af1d-28c2432fe5c3 tempest-VolumesSnapshotTestJSON-1802230238 None] Lock "cinder-quobyte-26892c54-59a3-4a29-a483-47bd1104a884" released by "_delete_snapshot" :: held 1.965s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:32:23 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-f5fda4bb-f5da-4ba8-af1d-28c2432fe5c3 tempest-VolumesSnapshotTestJSON-1802230238 None] Lock "cinder-quobyte-e3a16914-4aab-4f30-a54b-569287ecc7e6" released by "delete_snapshot" :: held 2.005s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:32:23 devstack sudo[98001]: pam_unix(sudo:session): session closed for user root
Nov 03 18:32:23 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-6916b413-220a-4cf6-a1f3-098bdedb96bd tempest-ProjectReaderTests-1272689156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3c869ae3-c3dd-45b8-8c14-a3673f687e2f 1073741824" returned: 0 in 0.523s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:32:23 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-6916b413-220a-4cf6-a1f3-098bdedb96bd tempest-ProjectReaderTests-1272689156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3c869ae3-c3dd-45b8-8c14-a3673f687e2f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:32:23 devstack sudo[98010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3c869ae3-c3dd-45b8-8c14-a3673f687e2f
Nov 03 18:32:23 devstack sudo[98010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:32:23 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-f5fda4bb-f5da-4ba8-af1d-28c2432fe5c3 tempest-VolumesSnapshotTestJSON-1802230238 None] Created reservations ['525030c1-91e5-4c72-aefb-144ff2e0c1ef', 'e5a23bfd-fa38-46ee-a3b2-c57b0bfa625c', '20e966a0-f305-43c4-8899-5846c95bdb3f', '6a66fd64-06fb-4d78-983a-721e5a2a099c'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:32:23 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-f5fda4bb-f5da-4ba8-af1d-28c2432fe5c3 tempest-VolumesSnapshotTestJSON-1802230238 None] Delete snapshot completed successfully.
Nov 03 18:32:23 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-f5fda4bb-f5da-4ba8-af1d-28c2432fe5c3 tempest-VolumesSnapshotTestJSON-1802230238 None] Lock "cinder-26892c54-59a3-4a29-a483-47bd1104a884-delete_snapshot" released by "delete_snapshot" :: held 2.236s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:32:23 devstack sudo[98010]: pam_unix(sudo:session): session closed for user root
Nov 03 18:32:23 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-6916b413-220a-4cf6-a1f3-098bdedb96bd tempest-ProjectReaderTests-1272689156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3c869ae3-c3dd-45b8-8c14-a3673f687e2f" returned: 0 in 0.271s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:32:23 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-6916b413-220a-4cf6-a1f3-098bdedb96bd tempest-ProjectReaderTests-1272689156 None] <== create_volume: return (843ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:32:23 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-6916b413-220a-4cf6-a1f3-098bdedb96bd tempest-ProjectReaderTests-1272689156 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.846s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:32:23 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-6916b413-220a-4cf6-a1f3-098bdedb96bd tempest-ProjectReaderTests-1272689156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7bc8e1c-3afd-4ba7-a7e5-99a46f7ebd89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c869ae3-c3dd-45b8-8c14-a3673f687e2f', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:32:23 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-6916b413-220a-4cf6-a1f3-098bdedb96bd tempest-ProjectReaderTests-1272689156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64c9955d-dbf5-401f-a270-0b1465eb08f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:32:23 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-6916b413-220a-4cf6-a1f3-098bdedb96bd tempest-ProjectReaderTests-1272689156 None] Volume volume-3c869ae3-c3dd-45b8-8c14-a3673f687e2f (3c869ae3-c3dd-45b8-8c14-a3673f687e2f): created successfully
Nov 03 18:32:23 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-6916b413-220a-4cf6-a1f3-098bdedb96bd tempest-ProjectReaderTests-1272689156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64c9955d-dbf5-401f-a270-0b1465eb08f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:32:23 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-6916b413-220a-4cf6-a1f3-098bdedb96bd tempest-ProjectReaderTests-1272689156 None] Flow 'volume_create_manager' (10f3751a-a734-44fa-963b-d24b94ca1f20) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:32:23 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-6916b413-220a-4cf6-a1f3-098bdedb96bd tempest-ProjectReaderTests-1272689156 None] Created volume successfully.
Nov 03 18:32:24 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-46bebff0-cb76-47b2-b8cd-bfb2ab3787b3 tempest-VolumesSnapshotTestJSON-1802230238 None] Acquiring lock "cinder-e3a16914-4aab-4f30-a54b-569287ecc7e6-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:32:24 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-46bebff0-cb76-47b2-b8cd-bfb2ab3787b3 tempest-VolumesSnapshotTestJSON-1802230238 None] Lock "cinder-e3a16914-4aab-4f30-a54b-569287ecc7e6-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:32:24 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-46bebff0-cb76-47b2-b8cd-bfb2ab3787b3 tempest-VolumesSnapshotTestJSON-1802230238 None] Acquiring lock "cinder-quobyte-e3a16914-4aab-4f30-a54b-569287ecc7e6" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:32:24 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-46bebff0-cb76-47b2-b8cd-bfb2ab3787b3 tempest-VolumesSnapshotTestJSON-1802230238 None] Lock "cinder-quobyte-e3a16914-4aab-4f30-a54b-569287ecc7e6" acquired by "delete_volume" :: waited 0.018s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:32:24 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc32f5fe-eacc-465b-91ba-ce635489ed9a]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:32:24 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-46bebff0-cb76-47b2-b8cd-bfb2ab3787b3 tempest-VolumesSnapshotTestJSON-1802230238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e3a16914-4aab-4f30-a54b-569287ecc7e6 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:32:24 devstack sudo[98013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e3a16914-4aab-4f30-a54b-569287ecc7e6
Nov 03 18:32:24 devstack sudo[98013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:32:24 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-6ca03d0e-a9c9-4e9b-9ad7-80ec89e90c8d tempest-ProjectReaderTests-1272689156 None] Acquiring lock "cinder-3c869ae3-c3dd-45b8-8c14-a3673f687e2f-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:32:25 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-6ca03d0e-a9c9-4e9b-9ad7-80ec89e90c8d tempest-ProjectReaderTests-1272689156 None] Lock "cinder-3c869ae3-c3dd-45b8-8c14-a3673f687e2f-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:32:25 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-6ca03d0e-a9c9-4e9b-9ad7-80ec89e90c8d tempest-ProjectReaderTests-1272689156 None] Acquiring lock "cinder-quobyte-3c869ae3-c3dd-45b8-8c14-a3673f687e2f" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:32:25 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-6ca03d0e-a9c9-4e9b-9ad7-80ec89e90c8d tempest-ProjectReaderTests-1272689156 None] Lock "cinder-quobyte-3c869ae3-c3dd-45b8-8c14-a3673f687e2f" acquired by "delete_volume" :: waited 0.016s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:32:25 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[f91f3948-1c07-4d1a-a311-56f6ba1ae7e7]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:32:25 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-6ca03d0e-a9c9-4e9b-9ad7-80ec89e90c8d tempest-ProjectReaderTests-1272689156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3c869ae3-c3dd-45b8-8c14-a3673f687e2f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:32:25 devstack sudo[98015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3c869ae3-c3dd-45b8-8c14-a3673f687e2f
Nov 03 18:32:25 devstack sudo[98015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:32:25 devstack sudo[98013]: pam_unix(sudo:session): session closed for user root
Nov 03 18:32:25 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-46bebff0-cb76-47b2-b8cd-bfb2ab3787b3 tempest-VolumesSnapshotTestJSON-1802230238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e3a16914-4aab-4f30-a54b-569287ecc7e6" returned: 0 in 0.503s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:32:25 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-46bebff0-cb76-47b2-b8cd-bfb2ab3787b3 tempest-VolumesSnapshotTestJSON-1802230238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e3a16914-4aab-4f30-a54b-569287ecc7e6 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:32:25 devstack sudo[98020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e3a16914-4aab-4f30-a54b-569287ecc7e6
Nov 03 18:32:25 devstack sudo[98020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:32:25 devstack sudo[98020]: pam_unix(sudo:session): session closed for user root
Nov 03 18:32:25 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-46bebff0-cb76-47b2-b8cd-bfb2ab3787b3 tempest-VolumesSnapshotTestJSON-1802230238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e3a16914-4aab-4f30-a54b-569287ecc7e6" returned: 0 in 0.324s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:32:25 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-46bebff0-cb76-47b2-b8cd-bfb2ab3787b3 tempest-VolumesSnapshotTestJSON-1802230238 None] Lock "cinder-quobyte-e3a16914-4aab-4f30-a54b-569287ecc7e6" released by "delete_volume" :: held 0.927s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:32:25 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-46bebff0-cb76-47b2-b8cd-bfb2ab3787b3 tempest-VolumesSnapshotTestJSON-1802230238 None] Created reservations ['94ea1c53-adac-4282-89b9-1ae774db8ae5', '70c50d13-d4f6-4872-b496-99d89a350ecb', '53fe60ec-fb24-4cc9-8bf4-dedb388721ff', '6ae00a5d-fe9f-44bb-8f3b-128ef39dd085'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:32:25 devstack sudo[98015]: pam_unix(sudo:session): session closed for user root
Nov 03 18:32:25 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-6ca03d0e-a9c9-4e9b-9ad7-80ec89e90c8d tempest-ProjectReaderTests-1272689156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3c869ae3-c3dd-45b8-8c14-a3673f687e2f" returned: 0 in 0.648s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:32:25 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-6ca03d0e-a9c9-4e9b-9ad7-80ec89e90c8d tempest-ProjectReaderTests-1272689156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3c869ae3-c3dd-45b8-8c14-a3673f687e2f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:32:25 devstack sudo[98027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3c869ae3-c3dd-45b8-8c14-a3673f687e2f
Nov 03 18:32:25 devstack sudo[98027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:32:25 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-46bebff0-cb76-47b2-b8cd-bfb2ab3787b3 tempest-VolumesSnapshotTestJSON-1802230238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:32:25 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-46bebff0-cb76-47b2-b8cd-bfb2ab3787b3 tempest-VolumesSnapshotTestJSON-1802230238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:32:25 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-46bebff0-cb76-47b2-b8cd-bfb2ab3787b3 tempest-VolumesSnapshotTestJSON-1802230238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:32:25 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-46bebff0-cb76-47b2-b8cd-bfb2ab3787b3 tempest-VolumesSnapshotTestJSON-1802230238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:32:25 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-46bebff0-cb76-47b2-b8cd-bfb2ab3787b3 tempest-VolumesSnapshotTestJSON-1802230238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:32:25 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-46bebff0-cb76-47b2-b8cd-bfb2ab3787b3 tempest-VolumesSnapshotTestJSON-1802230238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:32:25 devstack sudo[98029]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:32:25 devstack sudo[98029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:32:26 devstack sudo[98027]: pam_unix(sudo:session): session closed for user root
Nov 03 18:32:26 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-6ca03d0e-a9c9-4e9b-9ad7-80ec89e90c8d tempest-ProjectReaderTests-1272689156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3c869ae3-c3dd-45b8-8c14-a3673f687e2f" returned: 0 in 0.360s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:32:26 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-6ca03d0e-a9c9-4e9b-9ad7-80ec89e90c8d tempest-ProjectReaderTests-1272689156 None] Lock "cinder-quobyte-3c869ae3-c3dd-45b8-8c14-a3673f687e2f" released by "delete_volume" :: held 1.070s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:32:26 devstack sudo[98029]: pam_unix(sudo:session): session closed for user root
Nov 03 18:32:26 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-46bebff0-cb76-47b2-b8cd-bfb2ab3787b3 tempest-VolumesSnapshotTestJSON-1802230238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.323s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:32:26 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-46bebff0-cb76-47b2-b8cd-bfb2ab3787b3 tempest-VolumesSnapshotTestJSON-1802230238 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:32:26 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-46bebff0-cb76-47b2-b8cd-bfb2ab3787b3 tempest-VolumesSnapshotTestJSON-1802230238 None] Deleted volume successfully.
Nov 03 18:32:26 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-6ca03d0e-a9c9-4e9b-9ad7-80ec89e90c8d tempest-ProjectReaderTests-1272689156 None] Created reservations ['16e1b8a1-6f2a-46a8-8378-1c4af1b4acd0', '91472a42-0562-4ce7-9bd0-e7c8c4534d01', 'ad398791-25cf-4f67-b723-81f8f453a870', '4ee83c00-27ed-433d-baec-f2fa91cb2ab8'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:32:26 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-46bebff0-cb76-47b2-b8cd-bfb2ab3787b3 tempest-VolumesSnapshotTestJSON-1802230238 None] Lock "cinder-e3a16914-4aab-4f30-a54b-569287ecc7e6-delete_volume" released by "delete_volume" :: held 1.545s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:32:26 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-6ca03d0e-a9c9-4e9b-9ad7-80ec89e90c8d tempest-ProjectReaderTests-1272689156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:32:26 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-6ca03d0e-a9c9-4e9b-9ad7-80ec89e90c8d tempest-ProjectReaderTests-1272689156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:32:26 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-6ca03d0e-a9c9-4e9b-9ad7-80ec89e90c8d tempest-ProjectReaderTests-1272689156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:32:26 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-6ca03d0e-a9c9-4e9b-9ad7-80ec89e90c8d tempest-ProjectReaderTests-1272689156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:32:26 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-6ca03d0e-a9c9-4e9b-9ad7-80ec89e90c8d tempest-ProjectReaderTests-1272689156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:32:26 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-6ca03d0e-a9c9-4e9b-9ad7-80ec89e90c8d tempest-ProjectReaderTests-1272689156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:32:26 devstack sudo[98033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:32:26 devstack sudo[98033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:32:26 devstack sudo[98033]: pam_unix(sudo:session): session closed for user root
Nov 03 18:32:26 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-6ca03d0e-a9c9-4e9b-9ad7-80ec89e90c8d tempest-ProjectReaderTests-1272689156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.306s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:32:26 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-6ca03d0e-a9c9-4e9b-9ad7-80ec89e90c8d tempest-ProjectReaderTests-1272689156 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:32:26 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-6ca03d0e-a9c9-4e9b-9ad7-80ec89e90c8d tempest-ProjectReaderTests-1272689156 None] Deleted volume successfully.
Nov 03 18:32:26 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-6ca03d0e-a9c9-4e9b-9ad7-80ec89e90c8d tempest-ProjectReaderTests-1272689156 None] Lock "cinder-3c869ae3-c3dd-45b8-8c14-a3673f687e2f-delete_volume" released by "delete_volume" :: held 1.622s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:32:27 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-8957223f-a178-4b96-b776-274aaf6400a6 tempest-VolumesSnapshotTestJSON-1802230238 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:32:27 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-8957223f-a178-4b96-b776-274aaf6400a6 tempest-VolumesSnapshotTestJSON-1802230238 None] Flow 'volume_create_manager' (ac963990-04fe-4a61-b30b-9d415368d952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:32:27 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-8957223f-a178-4b96-b776-274aaf6400a6 tempest-VolumesSnapshotTestJSON-1802230238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (799acd22-86f7-4651-ac05-b3772b6c4045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:32:27 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-8957223f-a178-4b96-b776-274aaf6400a6 tempest-VolumesSnapshotTestJSON-1802230238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (799acd22-86f7-4651-ac05-b3772b6c4045) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:32:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-200706043',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74f595d0-131a-4ab4-880c-584a910b9957,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab0c92f90881489890fc637dcadeb490',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:32:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:32:28Z,use_quota=True,user_id='b63532e97ecb442abb935c8ea13836cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:32:27 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-8957223f-a178-4b96-b776-274aaf6400a6 tempest-VolumesSnapshotTestJSON-1802230238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61906276-c512-4893-ad82-99764d1dcaf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:32:27 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-8957223f-a178-4b96-b776-274aaf6400a6 tempest-VolumesSnapshotTestJSON-1802230238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61906276-c512-4893-ad82-99764d1dcaf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:32:28 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-8957223f-a178-4b96-b776-274aaf6400a6 tempest-VolumesSnapshotTestJSON-1802230238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68cdfaab-355c-4c03-9b9c-f7b01b34bb9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:32:28 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-8957223f-a178-4b96-b776-274aaf6400a6 tempest-VolumesSnapshotTestJSON-1802230238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68cdfaab-355c-4c03-9b9c-f7b01b34bb9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74f595d0-131a-4ab4-880c-584a910b9957', 'volume_name': 'volume-74f595d0-131a-4ab4-880c-584a910b9957', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:32:28 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-8957223f-a178-4b96-b776-274aaf6400a6 tempest-VolumesSnapshotTestJSON-1802230238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e38fdea-83fe-475d-9f46-492f8d5e4da0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:32:28 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-8957223f-a178-4b96-b776-274aaf6400a6 tempest-VolumesSnapshotTestJSON-1802230238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e38fdea-83fe-475d-9f46-492f8d5e4da0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:32:28 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-8957223f-a178-4b96-b776-274aaf6400a6 tempest-VolumesSnapshotTestJSON-1802230238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b5e54e4-cb65-416e-904d-fbb0afb2a0c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:32:28 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-8957223f-a178-4b96-b776-274aaf6400a6 tempest-VolumesSnapshotTestJSON-1802230238 None] Volume 74f595d0-131a-4ab4-880c-584a910b9957: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74f595d0-131a-4ab4-880c-584a910b9957', 'volume_size': 1}
Nov 03 18:32:28 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-8957223f-a178-4b96-b776-274aaf6400a6 tempest-VolumesSnapshotTestJSON-1802230238 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:32:28 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-8957223f-a178-4b96-b776-274aaf6400a6 tempest-VolumesSnapshotTestJSON-1802230238 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:32:28 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-8957223f-a178-4b96-b776-274aaf6400a6 tempest-VolumesSnapshotTestJSON-1802230238 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:32:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-200706043',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74f595d0-131a-4ab4-880c-584a910b9957,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab0c92f90881489890fc637dcadeb490',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:32:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:32:28Z,use_quota=True,user_id='b63532e97ecb442abb935c8ea13836cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:32:28 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-8957223f-a178-4b96-b776-274aaf6400a6 tempest-VolumesSnapshotTestJSON-1802230238 None] Creating volume 74f595d0-131a-4ab4-880c-584a910b9957 {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:32:28 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-8957223f-a178-4b96-b776-274aaf6400a6 tempest-VolumesSnapshotTestJSON-1802230238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:32:28 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-8957223f-a178-4b96-b776-274aaf6400a6 tempest-VolumesSnapshotTestJSON-1802230238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:32:28 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-8957223f-a178-4b96-b776-274aaf6400a6 tempest-VolumesSnapshotTestJSON-1802230238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:32:28 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-8957223f-a178-4b96-b776-274aaf6400a6 tempest-VolumesSnapshotTestJSON-1802230238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:32:28 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-8957223f-a178-4b96-b776-274aaf6400a6 tempest-VolumesSnapshotTestJSON-1802230238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:32:28 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-8957223f-a178-4b96-b776-274aaf6400a6 tempest-VolumesSnapshotTestJSON-1802230238 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:32:28 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-8957223f-a178-4b96-b776-274aaf6400a6 tempest-VolumesSnapshotTestJSON-1802230238 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:32:28 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-8957223f-a178-4b96-b776-274aaf6400a6 tempest-VolumesSnapshotTestJSON-1802230238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-74f595d0-131a-4ab4-880c-584a910b9957 1073741824 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:32:28 devstack sudo[98039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-74f595d0-131a-4ab4-880c-584a910b9957 1073741824
Nov 03 18:32:28 devstack sudo[98039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:32:28 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-734677cb-5409-4c89-9b48-b26ded9b1457 tempest-AttachVolumeNegativeTest-621877883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:32:28 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-734677cb-5409-4c89-9b48-b26ded9b1457 tempest-AttachVolumeNegativeTest-621877883 None] Flow 'volume_create_manager' (4d4324d2-3760-4d37-9bec-a73007f99671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:32:28 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-734677cb-5409-4c89-9b48-b26ded9b1457 tempest-AttachVolumeNegativeTest-621877883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23eb6f58-b666-471d-bc96-f4a9c1f980d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:32:28 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-734677cb-5409-4c89-9b48-b26ded9b1457 tempest-AttachVolumeNegativeTest-621877883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23eb6f58-b666-471d-bc96-f4a9c1f980d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:32:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1035678127',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fa467b2-7d0b-4623-894e-084590495828,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='947da25973cf48a4afa1ef1957395d16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:32:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:32:28Z,use_quota=True,user_id='f08080986d0446f99591e76938d047cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:32:28 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-734677cb-5409-4c89-9b48-b26ded9b1457 tempest-AttachVolumeNegativeTest-621877883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fce7339-1194-4a33-9913-8185bc1a1105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:32:28 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-734677cb-5409-4c89-9b48-b26ded9b1457 tempest-AttachVolumeNegativeTest-621877883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fce7339-1194-4a33-9913-8185bc1a1105) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:32:28 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-734677cb-5409-4c89-9b48-b26ded9b1457 tempest-AttachVolumeNegativeTest-621877883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8fecebc-76e2-46d8-ae50-956390e21cf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:32:28 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-734677cb-5409-4c89-9b48-b26ded9b1457 tempest-AttachVolumeNegativeTest-621877883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8fecebc-76e2-46d8-ae50-956390e21cf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8fa467b2-7d0b-4623-894e-084590495828', 'volume_name': 'volume-8fa467b2-7d0b-4623-894e-084590495828', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:32:28 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-734677cb-5409-4c89-9b48-b26ded9b1457 tempest-AttachVolumeNegativeTest-621877883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e96bb464-5237-4069-9829-fb1b392dd0f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:32:28 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-734677cb-5409-4c89-9b48-b26ded9b1457 tempest-AttachVolumeNegativeTest-621877883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e96bb464-5237-4069-9829-fb1b392dd0f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:32:28 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-734677cb-5409-4c89-9b48-b26ded9b1457 tempest-AttachVolumeNegativeTest-621877883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6eab297-15f7-49f6-9ebe-08e3edcfe3ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:32:28 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-734677cb-5409-4c89-9b48-b26ded9b1457 tempest-AttachVolumeNegativeTest-621877883 None] Volume 8fa467b2-7d0b-4623-894e-084590495828: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8fa467b2-7d0b-4623-894e-084590495828', 'volume_size': 1}
Nov 03 18:32:28 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-734677cb-5409-4c89-9b48-b26ded9b1457 tempest-AttachVolumeNegativeTest-621877883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:32:28 devstack sudo[98039]: pam_unix(sudo:session): session closed for user root
Nov 03 18:32:28 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-8957223f-a178-4b96-b776-274aaf6400a6 tempest-VolumesSnapshotTestJSON-1802230238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-74f595d0-131a-4ab4-880c-584a910b9957 1073741824" returned: 0 in 0.514s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:32:28 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-8957223f-a178-4b96-b776-274aaf6400a6 tempest-VolumesSnapshotTestJSON-1802230238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-74f595d0-131a-4ab4-880c-584a910b9957 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:32:28 devstack sudo[98045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-74f595d0-131a-4ab4-880c-584a910b9957
Nov 03 18:32:28 devstack sudo[98045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:32:29 devstack sudo[98045]: pam_unix(sudo:session): session closed for user root
Nov 03 18:32:29 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-8957223f-a178-4b96-b776-274aaf6400a6 tempest-VolumesSnapshotTestJSON-1802230238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-74f595d0-131a-4ab4-880c-584a910b9957" returned: 0 in 0.394s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:32:29 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-8957223f-a178-4b96-b776-274aaf6400a6 tempest-VolumesSnapshotTestJSON-1802230238 None] <== create_volume: return (964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:32:29 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-8957223f-a178-4b96-b776-274aaf6400a6 tempest-VolumesSnapshotTestJSON-1802230238 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.971s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:32:29 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-734677cb-5409-4c89-9b48-b26ded9b1457 tempest-AttachVolumeNegativeTest-621877883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.822s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:32:29 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-734677cb-5409-4c89-9b48-b26ded9b1457 tempest-AttachVolumeNegativeTest-621877883 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:32:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1035678127',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fa467b2-7d0b-4623-894e-084590495828,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='947da25973cf48a4afa1ef1957395d16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:32:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:32:28Z,use_quota=True,user_id='f08080986d0446f99591e76938d047cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:32:29 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-734677cb-5409-4c89-9b48-b26ded9b1457 tempest-AttachVolumeNegativeTest-621877883 None] Creating volume 8fa467b2-7d0b-4623-894e-084590495828 {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:32:29 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-734677cb-5409-4c89-9b48-b26ded9b1457 tempest-AttachVolumeNegativeTest-621877883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:32:29 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-734677cb-5409-4c89-9b48-b26ded9b1457 tempest-AttachVolumeNegativeTest-621877883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:32:29 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-734677cb-5409-4c89-9b48-b26ded9b1457 tempest-AttachVolumeNegativeTest-621877883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:32:29 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-734677cb-5409-4c89-9b48-b26ded9b1457 tempest-AttachVolumeNegativeTest-621877883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:32:29 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-734677cb-5409-4c89-9b48-b26ded9b1457 tempest-AttachVolumeNegativeTest-621877883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:32:29 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-734677cb-5409-4c89-9b48-b26ded9b1457 tempest-AttachVolumeNegativeTest-621877883 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:32:29 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-734677cb-5409-4c89-9b48-b26ded9b1457 tempest-AttachVolumeNegativeTest-621877883 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:32:29 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-734677cb-5409-4c89-9b48-b26ded9b1457 tempest-AttachVolumeNegativeTest-621877883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8fa467b2-7d0b-4623-894e-084590495828 1073741824 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:32:29 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-8957223f-a178-4b96-b776-274aaf6400a6 tempest-VolumesSnapshotTestJSON-1802230238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b5e54e4-cb65-416e-904d-fbb0afb2a0c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74f595d0-131a-4ab4-880c-584a910b9957', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:32:29 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-8957223f-a178-4b96-b776-274aaf6400a6 tempest-VolumesSnapshotTestJSON-1802230238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6576db3e-5621-4163-a4f2-720b2b12ed59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:32:29 devstack sudo[98083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8fa467b2-7d0b-4623-894e-084590495828 1073741824
Nov 03 18:32:29 devstack sudo[98083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:32:29 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-8957223f-a178-4b96-b776-274aaf6400a6 tempest-VolumesSnapshotTestJSON-1802230238 None] Volume volume-74f595d0-131a-4ab4-880c-584a910b9957 (74f595d0-131a-4ab4-880c-584a910b9957): created successfully
Nov 03 18:32:29 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-8957223f-a178-4b96-b776-274aaf6400a6 tempest-VolumesSnapshotTestJSON-1802230238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6576db3e-5621-4163-a4f2-720b2b12ed59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:32:29 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-8957223f-a178-4b96-b776-274aaf6400a6 tempest-VolumesSnapshotTestJSON-1802230238 None] Flow 'volume_create_manager' (ac963990-04fe-4a61-b30b-9d415368d952) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:32:29 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-8957223f-a178-4b96-b776-274aaf6400a6 tempest-VolumesSnapshotTestJSON-1802230238 None] Created volume successfully.
Nov 03 18:32:29 devstack sudo[98083]: pam_unix(sudo:session): session closed for user root
Nov 03 18:32:29 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-734677cb-5409-4c89-9b48-b26ded9b1457 tempest-AttachVolumeNegativeTest-621877883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8fa467b2-7d0b-4623-894e-084590495828 1073741824" returned: 0 in 0.586s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:32:29 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-734677cb-5409-4c89-9b48-b26ded9b1457 tempest-AttachVolumeNegativeTest-621877883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8fa467b2-7d0b-4623-894e-084590495828 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:32:29 devstack sudo[98091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8fa467b2-7d0b-4623-894e-084590495828
Nov 03 18:32:29 devstack sudo[98091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:32:30 devstack sudo[98091]: pam_unix(sudo:session): session closed for user root
Nov 03 18:32:30 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-734677cb-5409-4c89-9b48-b26ded9b1457 tempest-AttachVolumeNegativeTest-621877883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8fa467b2-7d0b-4623-894e-084590495828" returned: 0 in 0.341s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:32:30 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-734677cb-5409-4c89-9b48-b26ded9b1457 tempest-AttachVolumeNegativeTest-621877883 None] <== create_volume: return (990ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:32:30 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-734677cb-5409-4c89-9b48-b26ded9b1457 tempest-AttachVolumeNegativeTest-621877883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.998s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:32:30 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-734677cb-5409-4c89-9b48-b26ded9b1457 tempest-AttachVolumeNegativeTest-621877883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6eab297-15f7-49f6-9ebe-08e3edcfe3ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8fa467b2-7d0b-4623-894e-084590495828', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:32:30 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-734677cb-5409-4c89-9b48-b26ded9b1457 tempest-AttachVolumeNegativeTest-621877883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (944fa2e5-c6fa-4cc2-b74b-f6042de52d33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:32:30 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-734677cb-5409-4c89-9b48-b26ded9b1457 tempest-AttachVolumeNegativeTest-621877883 None] Volume volume-8fa467b2-7d0b-4623-894e-084590495828 (8fa467b2-7d0b-4623-894e-084590495828): created successfully
Nov 03 18:32:30 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-734677cb-5409-4c89-9b48-b26ded9b1457 tempest-AttachVolumeNegativeTest-621877883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (944fa2e5-c6fa-4cc2-b74b-f6042de52d33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:32:30 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-734677cb-5409-4c89-9b48-b26ded9b1457 tempest-AttachVolumeNegativeTest-621877883 None] Flow 'volume_create_manager' (4d4324d2-3760-4d37-9bec-a73007f99671) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:32:30 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-734677cb-5409-4c89-9b48-b26ded9b1457 tempest-AttachVolumeNegativeTest-621877883 None] Created volume successfully.
Nov 03 18:32:30 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-5f89dccf-9b3b-42bf-aa6f-57d0f06d964e tempest-VolumesSnapshotTestJSON-1802230238 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:32:30 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-5f89dccf-9b3b-42bf-aa6f-57d0f06d964e tempest-VolumesSnapshotTestJSON-1802230238 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:32:30 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-5f89dccf-9b3b-42bf-aa6f-57d0f06d964e tempest-VolumesSnapshotTestJSON-1802230238 None] Creating offline snapshot d07e98e9-2ee3-4c64-969d-1411bc32340e of volume 74f595d0-131a-4ab4-880c-584a910b9957 {{(pid=86120) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 18:32:30 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[36167ee5-34a8-44e7-9ee0-f520f6aa44a2]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:32:30 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-5f89dccf-9b3b-42bf-aa6f-57d0f06d964e tempest-VolumesSnapshotTestJSON-1802230238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-74f595d0-131a-4ab4-880c-584a910b9957 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:32:30 devstack sudo[98094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-74f595d0-131a-4ab4-880c-584a910b9957
Nov 03 18:32:30 devstack sudo[98094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:32:30 devstack sudo[98094]: pam_unix(sudo:session): session closed for user root
Nov 03 18:32:30 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-5f89dccf-9b3b-42bf-aa6f-57d0f06d964e tempest-VolumesSnapshotTestJSON-1802230238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-74f595d0-131a-4ab4-880c-584a910b9957" returned: 0 in 0.380s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:32:30 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-5f89dccf-9b3b-42bf-aa6f-57d0f06d964e tempest-VolumesSnapshotTestJSON-1802230238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-74f595d0-131a-4ab4-880c-584a910b9957,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-74f595d0-131a-4ab4-880c-584a910b9957.d07e98e9-2ee3-4c64-969d-1411bc32340e 1G {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:32:30 devstack sudo[98099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-74f595d0-131a-4ab4-880c-584a910b9957,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-74f595d0-131a-4ab4-880c-584a910b9957.d07e98e9-2ee3-4c64-969d-1411bc32340e 1G
Nov 03 18:32:30 devstack sudo[98099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:32:31 devstack sudo[98099]: pam_unix(sudo:session): session closed for user root
Nov 03 18:32:31 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-5f89dccf-9b3b-42bf-aa6f-57d0f06d964e tempest-VolumesSnapshotTestJSON-1802230238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-74f595d0-131a-4ab4-880c-584a910b9957,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-74f595d0-131a-4ab4-880c-584a910b9957.d07e98e9-2ee3-4c64-969d-1411bc32340e 1G" returned: 0 in 0.463s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:32:31 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-5f89dccf-9b3b-42bf-aa6f-57d0f06d964e tempest-VolumesSnapshotTestJSON-1802230238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74f595d0-131a-4ab4-880c-584a910b9957 -F qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-74f595d0-131a-4ab4-880c-584a910b9957.d07e98e9-2ee3-4c64-969d-1411bc32340e {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:32:31 devstack sudo[98105]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74f595d0-131a-4ab4-880c-584a910b9957 -F qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-74f595d0-131a-4ab4-880c-584a910b9957.d07e98e9-2ee3-4c64-969d-1411bc32340e
Nov 03 18:32:31 devstack sudo[98105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:32:31 devstack sudo[98105]: pam_unix(sudo:session): session closed for user root
Nov 03 18:32:31 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-5f89dccf-9b3b-42bf-aa6f-57d0f06d964e tempest-VolumesSnapshotTestJSON-1802230238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74f595d0-131a-4ab4-880c-584a910b9957 -F qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-74f595d0-131a-4ab4-880c-584a910b9957.d07e98e9-2ee3-4c64-969d-1411bc32340e" returned: 0 in 0.332s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:32:31 devstack cinder-volume[86120]: WARNING cinder.volume.drivers.remotefs [None req-5f89dccf-9b3b-42bf-aa6f-57d0f06d964e tempest-VolumesSnapshotTestJSON-1802230238 None] /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-74f595d0-131a-4ab4-880c-584a910b9957.d07e98e9-2ee3-4c64-969d-1411bc32340e is being set with open permissions: ugo+rw
Nov 03 18:32:31 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-5f89dccf-9b3b-42bf-aa6f-57d0f06d964e tempest-VolumesSnapshotTestJSON-1802230238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-74f595d0-131a-4ab4-880c-584a910b9957.d07e98e9-2ee3-4c64-969d-1411bc32340e {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:32:31 devstack sudo[98113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-74f595d0-131a-4ab4-880c-584a910b9957.d07e98e9-2ee3-4c64-969d-1411bc32340e
Nov 03 18:32:31 devstack sudo[98113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:32:31 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-404d34f2-790f-46b8-bbce-c0db3c6280e3 tempest-VolumesListAdminTestJSON-527344037 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:32:31 devstack sudo[98113]: pam_unix(sudo:session): session closed for user root
Nov 03 18:32:31 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-404d34f2-790f-46b8-bbce-c0db3c6280e3 tempest-VolumesListAdminTestJSON-527344037 None] Flow 'volume_create_manager' (f48853a9-6607-4b96-8e10-f72878e641fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:32:31 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-404d34f2-790f-46b8-bbce-c0db3c6280e3 tempest-VolumesListAdminTestJSON-527344037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f571e971-ca82-4700-a561-ec3b1e0b270f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:32:31 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-5f89dccf-9b3b-42bf-aa6f-57d0f06d964e tempest-VolumesSnapshotTestJSON-1802230238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-74f595d0-131a-4ab4-880c-584a910b9957.d07e98e9-2ee3-4c64-969d-1411bc32340e" returned: 0 in 0.306s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:32:31 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-404d34f2-790f-46b8-bbce-c0db3c6280e3 tempest-VolumesListAdminTestJSON-527344037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f571e971-ca82-4700-a561-ec3b1e0b270f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:32:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1135783030',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2eda2f0-7a2a-469f-8e90-c6ff9a044d5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2559a25b76a64b15ae61594394c09dd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:32:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:32:32Z,use_quota=True,user_id='a517ae1bcc7e4384ae3986a73a907940',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:32:31 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-404d34f2-790f-46b8-bbce-c0db3c6280e3 tempest-VolumesListAdminTestJSON-527344037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb3befbe-2043-4104-9bc5-bd50cf413220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:32:31 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-404d34f2-790f-46b8-bbce-c0db3c6280e3 tempest-VolumesListAdminTestJSON-527344037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb3befbe-2043-4104-9bc5-bd50cf413220) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:32:31 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-404d34f2-790f-46b8-bbce-c0db3c6280e3 tempest-VolumesListAdminTestJSON-527344037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (132e1535-2aa4-4b9f-98f8-aac3c01d3757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:32:31 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-404d34f2-790f-46b8-bbce-c0db3c6280e3 tempest-VolumesListAdminTestJSON-527344037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (132e1535-2aa4-4b9f-98f8-aac3c01d3757) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2eda2f0-7a2a-469f-8e90-c6ff9a044d5a', 'volume_name': 'volume-d2eda2f0-7a2a-469f-8e90-c6ff9a044d5a', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:32:31 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-404d34f2-790f-46b8-bbce-c0db3c6280e3 tempest-VolumesListAdminTestJSON-527344037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aef80080-9e83-4089-aa55-b775256972d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:32:31 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-404d34f2-790f-46b8-bbce-c0db3c6280e3 tempest-VolumesListAdminTestJSON-527344037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aef80080-9e83-4089-aa55-b775256972d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:32:31 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-404d34f2-790f-46b8-bbce-c0db3c6280e3 tempest-VolumesListAdminTestJSON-527344037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba5dfef3-34fc-4aa5-8a3f-bca9d9a9e46f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:32:31 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-404d34f2-790f-46b8-bbce-c0db3c6280e3 tempest-VolumesListAdminTestJSON-527344037 None] Volume d2eda2f0-7a2a-469f-8e90-c6ff9a044d5a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2eda2f0-7a2a-469f-8e90-c6ff9a044d5a', 'volume_size': 1}
Nov 03 18:32:31 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-404d34f2-790f-46b8-bbce-c0db3c6280e3 tempest-VolumesListAdminTestJSON-527344037 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:32:31 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-5f89dccf-9b3b-42bf-aa6f-57d0f06d964e tempest-VolumesSnapshotTestJSON-1802230238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-74f595d0-131a-4ab4-880c-584a910b9957.info {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:32:31 devstack sudo[98116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-74f595d0-131a-4ab4-880c-584a910b9957.info
Nov 03 18:32:31 devstack sudo[98116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:32:32 devstack sudo[98116]: pam_unix(sudo:session): session closed for user root
Nov 03 18:32:32 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-5f89dccf-9b3b-42bf-aa6f-57d0f06d964e tempest-VolumesSnapshotTestJSON-1802230238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-74f595d0-131a-4ab4-880c-584a910b9957.info" returned: 0 in 0.275s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:32:32 devstack cinder-volume[86120]: WARNING cinder.volume.drivers.remotefs [None req-5f89dccf-9b3b-42bf-aa6f-57d0f06d964e tempest-VolumesSnapshotTestJSON-1802230238 None] /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-74f595d0-131a-4ab4-880c-584a910b9957.info is being set with open permissions: ugo+rw
Nov 03 18:32:32 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-5f89dccf-9b3b-42bf-aa6f-57d0f06d964e tempest-VolumesSnapshotTestJSON-1802230238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-74f595d0-131a-4ab4-880c-584a910b9957.info {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:32:32 devstack sudo[98127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-74f595d0-131a-4ab4-880c-584a910b9957.info
Nov 03 18:32:32 devstack sudo[98127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:32:32 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [req-12d175e3-9d58-47ee-ba99-6f323472eb29 req-f1069f77-cd7c-484c-a32c-e6791c858813 tempest-AttachVolumeNegativeTest-621877883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:32:32 devstack sudo[98127]: pam_unix(sudo:session): session closed for user root
Nov 03 18:32:32 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-5f89dccf-9b3b-42bf-aa6f-57d0f06d964e tempest-VolumesSnapshotTestJSON-1802230238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-74f595d0-131a-4ab4-880c-584a910b9957.info" returned: 0 in 0.239s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:32:32 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-5f89dccf-9b3b-42bf-aa6f-57d0f06d964e tempest-VolumesSnapshotTestJSON-1802230238 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.138s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:32:32 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-404d34f2-790f-46b8-bbce-c0db3c6280e3 tempest-VolumesListAdminTestJSON-527344037 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.561s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:32:32 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-404d34f2-790f-46b8-bbce-c0db3c6280e3 tempest-VolumesListAdminTestJSON-527344037 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:32:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1135783030',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2eda2f0-7a2a-469f-8e90-c6ff9a044d5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2559a25b76a64b15ae61594394c09dd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:32:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:32:32Z,use_quota=True,user_id='a517ae1bcc7e4384ae3986a73a907940',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:32:32 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-404d34f2-790f-46b8-bbce-c0db3c6280e3 tempest-VolumesListAdminTestJSON-527344037 None] Creating volume d2eda2f0-7a2a-469f-8e90-c6ff9a044d5a {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:32:32 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-404d34f2-790f-46b8-bbce-c0db3c6280e3 tempest-VolumesListAdminTestJSON-527344037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:32:32 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-404d34f2-790f-46b8-bbce-c0db3c6280e3 tempest-VolumesListAdminTestJSON-527344037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:32:32 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-404d34f2-790f-46b8-bbce-c0db3c6280e3 tempest-VolumesListAdminTestJSON-527344037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:32:32 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-404d34f2-790f-46b8-bbce-c0db3c6280e3 tempest-VolumesListAdminTestJSON-527344037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:32:32 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-404d34f2-790f-46b8-bbce-c0db3c6280e3 tempest-VolumesListAdminTestJSON-527344037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:32:32 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-404d34f2-790f-46b8-bbce-c0db3c6280e3 tempest-VolumesListAdminTestJSON-527344037 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:32:32 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-404d34f2-790f-46b8-bbce-c0db3c6280e3 tempest-VolumesListAdminTestJSON-527344037 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:32:32 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-404d34f2-790f-46b8-bbce-c0db3c6280e3 tempest-VolumesListAdminTestJSON-527344037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d2eda2f0-7a2a-469f-8e90-c6ff9a044d5a 1073741824 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:32:32 devstack sudo[98130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d2eda2f0-7a2a-469f-8e90-c6ff9a044d5a 1073741824
Nov 03 18:32:32 devstack sudo[98130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:32:32 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-5f89dccf-9b3b-42bf-aa6f-57d0f06d964e tempest-VolumesSnapshotTestJSON-1802230238 None] Create snapshot completed successfully
Nov 03 18:32:32 devstack sudo[98130]: pam_unix(sudo:session): session closed for user root
Nov 03 18:32:32 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-404d34f2-790f-46b8-bbce-c0db3c6280e3 tempest-VolumesListAdminTestJSON-527344037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d2eda2f0-7a2a-469f-8e90-c6ff9a044d5a 1073741824" returned: 0 in 0.446s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:32:32 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-404d34f2-790f-46b8-bbce-c0db3c6280e3 tempest-VolumesListAdminTestJSON-527344037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d2eda2f0-7a2a-469f-8e90-c6ff9a044d5a {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:32:32 devstack sudo[98135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d2eda2f0-7a2a-469f-8e90-c6ff9a044d5a
Nov 03 18:32:32 devstack sudo[98135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:32:33 devstack sudo[98135]: pam_unix(sudo:session): session closed for user root
Nov 03 18:32:33 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-404d34f2-790f-46b8-bbce-c0db3c6280e3 tempest-VolumesListAdminTestJSON-527344037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d2eda2f0-7a2a-469f-8e90-c6ff9a044d5a" returned: 0 in 0.255s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:32:33 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-404d34f2-790f-46b8-bbce-c0db3c6280e3 tempest-VolumesListAdminTestJSON-527344037 None] <== create_volume: return (736ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:32:33 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-404d34f2-790f-46b8-bbce-c0db3c6280e3 tempest-VolumesListAdminTestJSON-527344037 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.739s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:32:33 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [req-12d175e3-9d58-47ee-ba99-6f323472eb29 req-f1069f77-cd7c-484c-a32c-e6791c858813 tempest-AttachVolumeNegativeTest-621877883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.961s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:32:33 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-404d34f2-790f-46b8-bbce-c0db3c6280e3 tempest-VolumesListAdminTestJSON-527344037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba5dfef3-34fc-4aa5-8a3f-bca9d9a9e46f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2eda2f0-7a2a-469f-8e90-c6ff9a044d5a', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:32:33 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-404d34f2-790f-46b8-bbce-c0db3c6280e3 tempest-VolumesListAdminTestJSON-527344037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c5237ad-b74e-4c76-9594-5ac15893620e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:32:33 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [req-12d175e3-9d58-47ee-ba99-6f323472eb29 req-f1069f77-cd7c-484c-a32c-e6791c858813 tempest-AttachVolumeNegativeTest-621877883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:32:33 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-404d34f2-790f-46b8-bbce-c0db3c6280e3 tempest-VolumesListAdminTestJSON-527344037 None] Volume volume-d2eda2f0-7a2a-469f-8e90-c6ff9a044d5a (d2eda2f0-7a2a-469f-8e90-c6ff9a044d5a): created successfully
Nov 03 18:32:33 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-404d34f2-790f-46b8-bbce-c0db3c6280e3 tempest-VolumesListAdminTestJSON-527344037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c5237ad-b74e-4c76-9594-5ac15893620e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:32:33 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-404d34f2-790f-46b8-bbce-c0db3c6280e3 tempest-VolumesListAdminTestJSON-527344037 None] Flow 'volume_create_manager' (f48853a9-6607-4b96-8e10-f72878e641fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:32:33 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-404d34f2-790f-46b8-bbce-c0db3c6280e3 tempest-VolumesListAdminTestJSON-527344037 None] Created volume successfully.
Nov 03 18:32:33 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [req-12d175e3-9d58-47ee-ba99-6f323472eb29 req-f1069f77-cd7c-484c-a32c-e6791c858813 tempest-AttachVolumeNegativeTest-621877883 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c', 'name': 'volume-8fa467b2-7d0b-4623-894e-084590495828', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9505ca91-3a76-4afa-8d94-3224bfdc9b82', 'enforce_multipath': True} {{(pid=86120) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 03 18:32:33 devstack cinder-volume[86120]: INFO cinder.volume.manager [req-12d175e3-9d58-47ee-ba99-6f323472eb29 req-f1069f77-cd7c-484c-a32c-e6791c858813 tempest-AttachVolumeNegativeTest-621877883 None] attachment_update completed successfully.
Nov 03 18:32:34 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-16557180-8746-404a-81a6-8eaa2019204a tempest-VolumesSnapshotTestJSON-1802230238 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:32:34 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-16557180-8746-404a-81a6-8eaa2019204a tempest-VolumesSnapshotTestJSON-1802230238 None] Flow 'volume_create_manager' (12957f0f-f0b4-43e9-8b82-4a20e3d02daa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:32:34 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-16557180-8746-404a-81a6-8eaa2019204a tempest-VolumesSnapshotTestJSON-1802230238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ef9912e-f41d-4490-bb4d-4e61fcea1d61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:32:34 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-16557180-8746-404a-81a6-8eaa2019204a tempest-VolumesSnapshotTestJSON-1802230238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ef9912e-f41d-4490-bb4d-4e61fcea1d61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:32:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1326520539',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0a2d5f7-0050-499c-ab50-4ff252479b2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab0c92f90881489890fc637dcadeb490',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:32:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d07e98e9-2ee3-4c64-969d-1411bc32340e,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:32:34Z,use_quota=True,user_id='b63532e97ecb442abb935c8ea13836cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:32:34 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-16557180-8746-404a-81a6-8eaa2019204a tempest-VolumesSnapshotTestJSON-1802230238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99d6f96a-535d-486b-9801-4648ac18c424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:32:34 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-16557180-8746-404a-81a6-8eaa2019204a tempest-VolumesSnapshotTestJSON-1802230238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99d6f96a-535d-486b-9801-4648ac18c424) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:32:34 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-16557180-8746-404a-81a6-8eaa2019204a tempest-VolumesSnapshotTestJSON-1802230238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b86ccec1-944a-4db1-96a4-4cad6b0443da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:32:34 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-16557180-8746-404a-81a6-8eaa2019204a tempest-VolumesSnapshotTestJSON-1802230238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b86ccec1-944a-4db1-96a4-4cad6b0443da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e0a2d5f7-0050-499c-ab50-4ff252479b2a', 'volume_name': 'volume-e0a2d5f7-0050-499c-ab50-4ff252479b2a', 'volume_size': 1, 'snapshot_id': 'd07e98e9-2ee3-4c64-969d-1411bc32340e'}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:32:34 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-16557180-8746-404a-81a6-8eaa2019204a tempest-VolumesSnapshotTestJSON-1802230238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16fe6de4-9650-47c5-8370-e1b0686f8acc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:32:34 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-16557180-8746-404a-81a6-8eaa2019204a tempest-VolumesSnapshotTestJSON-1802230238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16fe6de4-9650-47c5-8370-e1b0686f8acc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:32:34 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-16557180-8746-404a-81a6-8eaa2019204a tempest-VolumesSnapshotTestJSON-1802230238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ce77a71-1935-44b9-b3d3-66a5b8cac1c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:32:34 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-16557180-8746-404a-81a6-8eaa2019204a tempest-VolumesSnapshotTestJSON-1802230238 None] Volume e0a2d5f7-0050-499c-ab50-4ff252479b2a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e0a2d5f7-0050-499c-ab50-4ff252479b2a', 'volume_size': 1, 'snapshot_id': 'd07e98e9-2ee3-4c64-969d-1411bc32340e'}
Nov 03 18:32:34 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-16557180-8746-404a-81a6-8eaa2019204a tempest-VolumesSnapshotTestJSON-1802230238 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:32:34 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-16557180-8746-404a-81a6-8eaa2019204a tempest-VolumesSnapshotTestJSON-1802230238 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:32:34 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-16557180-8746-404a-81a6-8eaa2019204a tempest-VolumesSnapshotTestJSON-1802230238 None] Acquiring lock "cinder-quobyte-d07e98e9-2ee3-4c64-969d-1411bc32340e-e0a2d5f7-0050-499c-ab50-4ff252479b2a" by "_create_volume_from_snapshot" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:32:34 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-16557180-8746-404a-81a6-8eaa2019204a tempest-VolumesSnapshotTestJSON-1802230238 None] Lock "cinder-quobyte-d07e98e9-2ee3-4c64-969d-1411bc32340e-e0a2d5f7-0050-499c-ab50-4ff252479b2a" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:32:34 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-16557180-8746-404a-81a6-8eaa2019204a tempest-VolumesSnapshotTestJSON-1802230238 None] Creating volume e0a2d5f7-0050-499c-ab50-4ff252479b2a from snapshot d07e98e9-2ee3-4c64-969d-1411bc32340e {{(pid=86120) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 03 18:32:34 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-16557180-8746-404a-81a6-8eaa2019204a tempest-VolumesSnapshotTestJSON-1802230238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:32:34 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-16557180-8746-404a-81a6-8eaa2019204a tempest-VolumesSnapshotTestJSON-1802230238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:32:34 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-16557180-8746-404a-81a6-8eaa2019204a tempest-VolumesSnapshotTestJSON-1802230238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:32:34 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-16557180-8746-404a-81a6-8eaa2019204a tempest-VolumesSnapshotTestJSON-1802230238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:32:34 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-16557180-8746-404a-81a6-8eaa2019204a tempest-VolumesSnapshotTestJSON-1802230238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:32:34 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-16557180-8746-404a-81a6-8eaa2019204a tempest-VolumesSnapshotTestJSON-1802230238 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:32:34 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-16557180-8746-404a-81a6-8eaa2019204a tempest-VolumesSnapshotTestJSON-1802230238 None] Acquiring lock "cinder-quobyte-e0a2d5f7-0050-499c-ab50-4ff252479b2a" by "_copy_volume_from_snapshot" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:32:34 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-16557180-8746-404a-81a6-8eaa2019204a tempest-VolumesSnapshotTestJSON-1802230238 None] Lock "cinder-quobyte-e0a2d5f7-0050-499c-ab50-4ff252479b2a" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:32:34 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-16557180-8746-404a-81a6-8eaa2019204a tempest-VolumesSnapshotTestJSON-1802230238 None] snapshot: d07e98e9-2ee3-4c64-969d-1411bc32340e, volume: e0a2d5f7-0050-499c-ab50-4ff252479b2a,  {{(pid=86120) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 03 18:32:34 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-16557180-8746-404a-81a6-8eaa2019204a tempest-VolumesSnapshotTestJSON-1802230238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:32:34 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-16557180-8746-404a-81a6-8eaa2019204a tempest-VolumesSnapshotTestJSON-1802230238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:32:34 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-16557180-8746-404a-81a6-8eaa2019204a tempest-VolumesSnapshotTestJSON-1802230238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:32:34 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-16557180-8746-404a-81a6-8eaa2019204a tempest-VolumesSnapshotTestJSON-1802230238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:32:34 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-16557180-8746-404a-81a6-8eaa2019204a tempest-VolumesSnapshotTestJSON-1802230238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:32:34 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9165d5a-0808-4d05-8775-c219c4a0fc29]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:32:34 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-16557180-8746-404a-81a6-8eaa2019204a tempest-VolumesSnapshotTestJSON-1802230238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-74f595d0-131a-4ab4-880c-584a910b9957.d07e98e9-2ee3-4c64-969d-1411bc32340e {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:32:34 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-75542b85-151a-4048-b824-ed38cae14fc5 tempest-VolumesListAdminTestJSON-527344037 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:32:34 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-75542b85-151a-4048-b824-ed38cae14fc5 tempest-VolumesListAdminTestJSON-527344037 None] Flow 'volume_create_manager' (c4ab62b4-1b42-4254-9eba-e20422b81d35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:32:34 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-75542b85-151a-4048-b824-ed38cae14fc5 tempest-VolumesListAdminTestJSON-527344037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06f569f6-f5cd-44ef-8613-b439932e1b8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:32:34 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-75542b85-151a-4048-b824-ed38cae14fc5 tempest-VolumesListAdminTestJSON-527344037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06f569f6-f5cd-44ef-8613-b439932e1b8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:32:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-238475465',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36451a7a-9f0f-4802-acdc-8cf23415b960,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2559a25b76a64b15ae61594394c09dd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:32:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:32:34Z,use_quota=True,user_id='a517ae1bcc7e4384ae3986a73a907940',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:32:34 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-75542b85-151a-4048-b824-ed38cae14fc5 tempest-VolumesListAdminTestJSON-527344037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f49666cb-83cb-451f-95e8-85f95a4760a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:32:34 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-75542b85-151a-4048-b824-ed38cae14fc5 tempest-VolumesListAdminTestJSON-527344037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f49666cb-83cb-451f-95e8-85f95a4760a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:32:34 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-75542b85-151a-4048-b824-ed38cae14fc5 tempest-VolumesListAdminTestJSON-527344037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8571f6f-3879-4781-a5d1-8d814246c075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:32:34 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-75542b85-151a-4048-b824-ed38cae14fc5 tempest-VolumesListAdminTestJSON-527344037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8571f6f-3879-4781-a5d1-8d814246c075) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36451a7a-9f0f-4802-acdc-8cf23415b960', 'volume_name': 'volume-36451a7a-9f0f-4802-acdc-8cf23415b960', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:32:34 devstack sudo[98553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-74f595d0-131a-4ab4-880c-584a910b9957.d07e98e9-2ee3-4c64-969d-1411bc32340e
Nov 03 18:32:34 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-75542b85-151a-4048-b824-ed38cae14fc5 tempest-VolumesListAdminTestJSON-527344037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88e16f93-8223-44c1-8541-7aad8eb1a680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:32:34 devstack sudo[98553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:32:34 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-75542b85-151a-4048-b824-ed38cae14fc5 tempest-VolumesListAdminTestJSON-527344037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88e16f93-8223-44c1-8541-7aad8eb1a680) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:32:34 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-75542b85-151a-4048-b824-ed38cae14fc5 tempest-VolumesListAdminTestJSON-527344037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf73526b-15dc-490c-9027-1b0f099e5b64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:32:34 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-75542b85-151a-4048-b824-ed38cae14fc5 tempest-VolumesListAdminTestJSON-527344037 None] Volume 36451a7a-9f0f-4802-acdc-8cf23415b960: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36451a7a-9f0f-4802-acdc-8cf23415b960', 'volume_size': 1}
Nov 03 18:32:34 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-75542b85-151a-4048-b824-ed38cae14fc5 tempest-VolumesListAdminTestJSON-527344037 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:32:34 devstack sudo[98553]: pam_unix(sudo:session): session closed for user root
Nov 03 18:32:34 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-16557180-8746-404a-81a6-8eaa2019204a tempest-VolumesSnapshotTestJSON-1802230238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-74f595d0-131a-4ab4-880c-584a910b9957.d07e98e9-2ee3-4c64-969d-1411bc32340e" returned: 0 in 0.375s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:32:34 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-16557180-8746-404a-81a6-8eaa2019204a tempest-VolumesSnapshotTestJSON-1802230238 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-74f595d0-131a-4ab4-880c-584a910b9957(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86120) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 18:32:34 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[010d0019-c0c0-4b0c-a771-6b5212c0edac]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:32:34 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-16557180-8746-404a-81a6-8eaa2019204a tempest-VolumesSnapshotTestJSON-1802230238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-74f595d0-131a-4ab4-880c-584a910b9957 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:32:34 devstack sudo[98558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-74f595d0-131a-4ab4-880c-584a910b9957
Nov 03 18:32:34 devstack sudo[98558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:32:35 devstack sudo[98558]: pam_unix(sudo:session): session closed for user root
Nov 03 18:32:35 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-16557180-8746-404a-81a6-8eaa2019204a tempest-VolumesSnapshotTestJSON-1802230238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-74f595d0-131a-4ab4-880c-584a910b9957" returned: 0 in 0.392s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:32:35 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-16557180-8746-404a-81a6-8eaa2019204a tempest-VolumesSnapshotTestJSON-1802230238 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-74f595d0-131a-4ab4-880c-584a910b9957 {{(pid=86120) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 03 18:32:35 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-16557180-8746-404a-81a6-8eaa2019204a tempest-VolumesSnapshotTestJSON-1802230238 None] Creating direct copy from snapshot {{(pid=86120) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 03 18:32:35 devstack cinder-volume[86120]: DEBUG cinder.utils [None req-16557180-8746-404a-81a6-8eaa2019204a tempest-VolumesSnapshotTestJSON-1802230238 None] Path /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e0a2d5f7-0050-499c-ab50-4ff252479b2a not found in is_blk_device check {{(pid=86120) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 03 18:32:35 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-16557180-8746-404a-81a6-8eaa2019204a tempest-VolumesSnapshotTestJSON-1802230238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-74f595d0-131a-4ab4-880c-584a910b9957 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e0a2d5f7-0050-499c-ab50-4ff252479b2a {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:32:35 devstack sudo[98563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-74f595d0-131a-4ab4-880c-584a910b9957 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e0a2d5f7-0050-499c-ab50-4ff252479b2a
Nov 03 18:32:35 devstack sudo[98563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:32:42 devstack sudo[98563]: pam_unix(sudo:session): session closed for user root
Nov 03 18:32:42 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-16557180-8746-404a-81a6-8eaa2019204a tempest-VolumesSnapshotTestJSON-1802230238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-74f595d0-131a-4ab4-880c-584a910b9957 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e0a2d5f7-0050-499c-ab50-4ff252479b2a" returned: 0 in 7.202s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:32:42 devstack cinder-volume[86120]: DEBUG cinder.image.image_utils [None req-16557180-8746-404a-81a6-8eaa2019204a tempest-VolumesSnapshotTestJSON-1802230238 None] Image conversion details: src /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-74f595d0-131a-4ab4-880c-584a910b9957, size 1024.00 MB, duration 7.20 sec, destination /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e0a2d5f7-0050-499c-ab50-4ff252479b2a {{(pid=86120) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 03 18:32:42 devstack cinder-volume[86120]: INFO cinder.image.image_utils [None req-16557180-8746-404a-81a6-8eaa2019204a tempest-VolumesSnapshotTestJSON-1802230238 None] Converted 1024.00 MB image at 142.13 MB/s
Nov 03 18:32:42 devstack cinder-volume[86120]: WARNING cinder.volume.drivers.remotefs [None req-16557180-8746-404a-81a6-8eaa2019204a tempest-VolumesSnapshotTestJSON-1802230238 None] /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e0a2d5f7-0050-499c-ab50-4ff252479b2a is being set with open permissions: ugo+rw
Nov 03 18:32:42 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-16557180-8746-404a-81a6-8eaa2019204a tempest-VolumesSnapshotTestJSON-1802230238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e0a2d5f7-0050-499c-ab50-4ff252479b2a {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:32:42 devstack sudo[98583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e0a2d5f7-0050-499c-ab50-4ff252479b2a
Nov 03 18:32:42 devstack sudo[98583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:32:42 devstack sudo[98583]: pam_unix(sudo:session): session closed for user root
Nov 03 18:32:42 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-16557180-8746-404a-81a6-8eaa2019204a tempest-VolumesSnapshotTestJSON-1802230238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e0a2d5f7-0050-499c-ab50-4ff252479b2a" returned: 0 in 0.250s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:32:42 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-16557180-8746-404a-81a6-8eaa2019204a tempest-VolumesSnapshotTestJSON-1802230238 None] Lock "cinder-quobyte-e0a2d5f7-0050-499c-ab50-4ff252479b2a" released by "_copy_volume_from_snapshot" :: held 8.312s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:32:42 devstack cinder-volume[86120]: DEBUG dbcounter [-] [86120] Writing DB stats cinder:SELECT=147,cinder:INSERT=38,cinder:UPDATE=173,cinder:DELETE=20 {{(pid=86120) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 18:32:42 devstack cinder-volume[86120]: DEBUG dbcounter [-] [86120] Writing DB stats cinder:SELECT=129,cinder:UPDATE=175,cinder:INSERT=42,cinder:DELETE=13 {{(pid=86120) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 18:32:42 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-16557180-8746-404a-81a6-8eaa2019204a tempest-VolumesSnapshotTestJSON-1802230238 None] Lock "cinder-quobyte-d07e98e9-2ee3-4c64-969d-1411bc32340e-e0a2d5f7-0050-499c-ab50-4ff252479b2a" released by "_create_volume_from_snapshot" :: held 8.398s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:32:42 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-16557180-8746-404a-81a6-8eaa2019204a tempest-VolumesSnapshotTestJSON-1802230238 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.417s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:32:42 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-75542b85-151a-4048-b824-ed38cae14fc5 tempest-VolumesListAdminTestJSON-527344037 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.187s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:32:42 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-75542b85-151a-4048-b824-ed38cae14fc5 tempest-VolumesListAdminTestJSON-527344037 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:32:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-238475465',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36451a7a-9f0f-4802-acdc-8cf23415b960,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2559a25b76a64b15ae61594394c09dd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:32:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:32:34Z,use_quota=True,user_id='a517ae1bcc7e4384ae3986a73a907940',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:32:42 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-75542b85-151a-4048-b824-ed38cae14fc5 tempest-VolumesListAdminTestJSON-527344037 None] Creating volume 36451a7a-9f0f-4802-acdc-8cf23415b960 {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:32:42 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-75542b85-151a-4048-b824-ed38cae14fc5 tempest-VolumesListAdminTestJSON-527344037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:32:42 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-75542b85-151a-4048-b824-ed38cae14fc5 tempest-VolumesListAdminTestJSON-527344037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:32:42 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-75542b85-151a-4048-b824-ed38cae14fc5 tempest-VolumesListAdminTestJSON-527344037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:32:42 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-75542b85-151a-4048-b824-ed38cae14fc5 tempest-VolumesListAdminTestJSON-527344037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:32:42 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-75542b85-151a-4048-b824-ed38cae14fc5 tempest-VolumesListAdminTestJSON-527344037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:32:42 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-75542b85-151a-4048-b824-ed38cae14fc5 tempest-VolumesListAdminTestJSON-527344037 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:32:42 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-75542b85-151a-4048-b824-ed38cae14fc5 tempest-VolumesListAdminTestJSON-527344037 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:32:42 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-75542b85-151a-4048-b824-ed38cae14fc5 tempest-VolumesListAdminTestJSON-527344037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-36451a7a-9f0f-4802-acdc-8cf23415b960 1073741824 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:32:42 devstack sudo[98590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-36451a7a-9f0f-4802-acdc-8cf23415b960 1073741824
Nov 03 18:32:42 devstack sudo[98590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:32:42 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-16557180-8746-404a-81a6-8eaa2019204a tempest-VolumesSnapshotTestJSON-1802230238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ce77a71-1935-44b9-b3d3-66a5b8cac1c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0a2d5f7-0050-499c-ab50-4ff252479b2a', 'volume_size': 1, 'snapshot_id': 'd07e98e9-2ee3-4c64-969d-1411bc32340e'}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:32:42 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-16557180-8746-404a-81a6-8eaa2019204a tempest-VolumesSnapshotTestJSON-1802230238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51b87bf2-39fd-4f4c-aa57-bd03ec8784fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:32:42 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-16557180-8746-404a-81a6-8eaa2019204a tempest-VolumesSnapshotTestJSON-1802230238 None] Volume volume-e0a2d5f7-0050-499c-ab50-4ff252479b2a (e0a2d5f7-0050-499c-ab50-4ff252479b2a): created successfully
Nov 03 18:32:42 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-16557180-8746-404a-81a6-8eaa2019204a tempest-VolumesSnapshotTestJSON-1802230238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51b87bf2-39fd-4f4c-aa57-bd03ec8784fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:32:42 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-16557180-8746-404a-81a6-8eaa2019204a tempest-VolumesSnapshotTestJSON-1802230238 None] Flow 'volume_create_manager' (12957f0f-f0b4-43e9-8b82-4a20e3d02daa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:32:42 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-16557180-8746-404a-81a6-8eaa2019204a tempest-VolumesSnapshotTestJSON-1802230238 None] Created volume successfully.
Nov 03 18:32:43 devstack sudo[98590]: pam_unix(sudo:session): session closed for user root
Nov 03 18:32:43 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-75542b85-151a-4048-b824-ed38cae14fc5 tempest-VolumesListAdminTestJSON-527344037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-36451a7a-9f0f-4802-acdc-8cf23415b960 1073741824" returned: 0 in 0.574s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:32:43 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-75542b85-151a-4048-b824-ed38cae14fc5 tempest-VolumesListAdminTestJSON-527344037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-36451a7a-9f0f-4802-acdc-8cf23415b960 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:32:43 devstack sudo[98608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-36451a7a-9f0f-4802-acdc-8cf23415b960
Nov 03 18:32:43 devstack sudo[98608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:32:43 devstack sudo[98608]: pam_unix(sudo:session): session closed for user root
Nov 03 18:32:43 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-75542b85-151a-4048-b824-ed38cae14fc5 tempest-VolumesListAdminTestJSON-527344037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-36451a7a-9f0f-4802-acdc-8cf23415b960" returned: 0 in 0.251s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:32:43 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-75542b85-151a-4048-b824-ed38cae14fc5 tempest-VolumesListAdminTestJSON-527344037 None] <== create_volume: return (879ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:32:43 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-75542b85-151a-4048-b824-ed38cae14fc5 tempest-VolumesListAdminTestJSON-527344037 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.882s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:32:43 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-75542b85-151a-4048-b824-ed38cae14fc5 tempest-VolumesListAdminTestJSON-527344037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf73526b-15dc-490c-9027-1b0f099e5b64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36451a7a-9f0f-4802-acdc-8cf23415b960', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:32:43 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-75542b85-151a-4048-b824-ed38cae14fc5 tempest-VolumesListAdminTestJSON-527344037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33ef60f9-0f67-497c-a4df-070988f71efe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:32:43 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-75542b85-151a-4048-b824-ed38cae14fc5 tempest-VolumesListAdminTestJSON-527344037 None] Volume volume-36451a7a-9f0f-4802-acdc-8cf23415b960 (36451a7a-9f0f-4802-acdc-8cf23415b960): created successfully
Nov 03 18:32:43 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-75542b85-151a-4048-b824-ed38cae14fc5 tempest-VolumesListAdminTestJSON-527344037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33ef60f9-0f67-497c-a4df-070988f71efe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:32:43 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-75542b85-151a-4048-b824-ed38cae14fc5 tempest-VolumesListAdminTestJSON-527344037 None] Flow 'volume_create_manager' (c4ab62b4-1b42-4254-9eba-e20422b81d35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:32:43 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-75542b85-151a-4048-b824-ed38cae14fc5 tempest-VolumesListAdminTestJSON-527344037 None] Created volume successfully.
Nov 03 18:32:43 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-8f052190-1bfb-46db-90b3-595ab5d63b17 tempest-VolumesSnapshotTestJSON-1802230238 None] Acquiring lock "cinder-e0a2d5f7-0050-499c-ab50-4ff252479b2a-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:32:43 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-8f052190-1bfb-46db-90b3-595ab5d63b17 tempest-VolumesSnapshotTestJSON-1802230238 None] Lock "cinder-e0a2d5f7-0050-499c-ab50-4ff252479b2a-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:32:44 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-8f052190-1bfb-46db-90b3-595ab5d63b17 tempest-VolumesSnapshotTestJSON-1802230238 None] Acquiring lock "cinder-quobyte-e0a2d5f7-0050-499c-ab50-4ff252479b2a" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:32:44 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-8f052190-1bfb-46db-90b3-595ab5d63b17 tempest-VolumesSnapshotTestJSON-1802230238 None] Lock "cinder-quobyte-e0a2d5f7-0050-499c-ab50-4ff252479b2a" acquired by "delete_volume" :: waited 0.016s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:32:44 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[83543991-de3c-449c-96da-920b4cc05248]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:32:44 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-8f052190-1bfb-46db-90b3-595ab5d63b17 tempest-VolumesSnapshotTestJSON-1802230238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e0a2d5f7-0050-499c-ab50-4ff252479b2a {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:32:44 devstack sudo[98611]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e0a2d5f7-0050-499c-ab50-4ff252479b2a
Nov 03 18:32:44 devstack sudo[98611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:32:44 devstack sudo[98611]: pam_unix(sudo:session): session closed for user root
Nov 03 18:32:44 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-8f052190-1bfb-46db-90b3-595ab5d63b17 tempest-VolumesSnapshotTestJSON-1802230238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e0a2d5f7-0050-499c-ab50-4ff252479b2a" returned: 0 in 0.410s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:32:44 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-8f052190-1bfb-46db-90b3-595ab5d63b17 tempest-VolumesSnapshotTestJSON-1802230238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e0a2d5f7-0050-499c-ab50-4ff252479b2a {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:32:44 devstack sudo[98617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e0a2d5f7-0050-499c-ab50-4ff252479b2a
Nov 03 18:32:44 devstack sudo[98617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:32:44 devstack sudo[98617]: pam_unix(sudo:session): session closed for user root
Nov 03 18:32:44 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-8f052190-1bfb-46db-90b3-595ab5d63b17 tempest-VolumesSnapshotTestJSON-1802230238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e0a2d5f7-0050-499c-ab50-4ff252479b2a" returned: 0 in 0.294s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:32:44 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-8f052190-1bfb-46db-90b3-595ab5d63b17 tempest-VolumesSnapshotTestJSON-1802230238 None] Lock "cinder-quobyte-e0a2d5f7-0050-499c-ab50-4ff252479b2a" released by "delete_volume" :: held 0.767s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:32:44 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-8f052190-1bfb-46db-90b3-595ab5d63b17 tempest-VolumesSnapshotTestJSON-1802230238 None] Created reservations ['49d48a43-ee1f-4c42-95c4-ed6f448c2d81', '81096327-ed45-4712-8c0c-b522c436631f', '7963b7a4-051a-446e-9064-9e7af5fdef2c', '9efcdde0-0e02-4829-bbcf-5b5dac1e3685'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:32:44 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-8f052190-1bfb-46db-90b3-595ab5d63b17 tempest-VolumesSnapshotTestJSON-1802230238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:32:44 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-8f052190-1bfb-46db-90b3-595ab5d63b17 tempest-VolumesSnapshotTestJSON-1802230238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:32:44 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-8f052190-1bfb-46db-90b3-595ab5d63b17 tempest-VolumesSnapshotTestJSON-1802230238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:32:44 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-8f052190-1bfb-46db-90b3-595ab5d63b17 tempest-VolumesSnapshotTestJSON-1802230238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:32:44 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-8f052190-1bfb-46db-90b3-595ab5d63b17 tempest-VolumesSnapshotTestJSON-1802230238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:32:44 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-8f052190-1bfb-46db-90b3-595ab5d63b17 tempest-VolumesSnapshotTestJSON-1802230238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:32:44 devstack sudo[98620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:32:44 devstack sudo[98620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:32:44 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfee220e-8566-4108-8de7-c50186f69205 tempest-VolumesListAdminTestJSON-527344037 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:32:44 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-bfee220e-8566-4108-8de7-c50186f69205 tempest-VolumesListAdminTestJSON-527344037 None] Flow 'volume_create_manager' (64bc5d33-0400-42ae-acf1-e7071210a871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:32:44 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-bfee220e-8566-4108-8de7-c50186f69205 tempest-VolumesListAdminTestJSON-527344037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16f61ecf-e48f-43d0-8605-713eaa13c213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:32:45 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-bfee220e-8566-4108-8de7-c50186f69205 tempest-VolumesListAdminTestJSON-527344037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16f61ecf-e48f-43d0-8605-713eaa13c213) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:32:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-381016980',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb31ff6e-9212-49b0-a718-a3c789bbfdd3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2559a25b76a64b15ae61594394c09dd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:32:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:32:45Z,use_quota=True,user_id='a517ae1bcc7e4384ae3986a73a907940',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:32:45 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-bfee220e-8566-4108-8de7-c50186f69205 tempest-VolumesListAdminTestJSON-527344037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (639f093b-5aff-4713-a724-d61c09710ad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:32:45 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-bfee220e-8566-4108-8de7-c50186f69205 tempest-VolumesListAdminTestJSON-527344037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (639f093b-5aff-4713-a724-d61c09710ad5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:32:45 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-bfee220e-8566-4108-8de7-c50186f69205 tempest-VolumesListAdminTestJSON-527344037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41a2c8e1-75b5-468d-ac3a-38052cfe5124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:32:45 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-bfee220e-8566-4108-8de7-c50186f69205 tempest-VolumesListAdminTestJSON-527344037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41a2c8e1-75b5-468d-ac3a-38052cfe5124) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb31ff6e-9212-49b0-a718-a3c789bbfdd3', 'volume_name': 'volume-cb31ff6e-9212-49b0-a718-a3c789bbfdd3', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:32:45 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-bfee220e-8566-4108-8de7-c50186f69205 tempest-VolumesListAdminTestJSON-527344037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c214e445-78cf-4df5-be4e-e3cb44fa0309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:32:45 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-bfee220e-8566-4108-8de7-c50186f69205 tempest-VolumesListAdminTestJSON-527344037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c214e445-78cf-4df5-be4e-e3cb44fa0309) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:32:45 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-bfee220e-8566-4108-8de7-c50186f69205 tempest-VolumesListAdminTestJSON-527344037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ade51d6d-fe9b-498b-830e-a1aa8fcb2770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:32:45 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-bfee220e-8566-4108-8de7-c50186f69205 tempest-VolumesListAdminTestJSON-527344037 None] Volume cb31ff6e-9212-49b0-a718-a3c789bbfdd3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb31ff6e-9212-49b0-a718-a3c789bbfdd3', 'volume_size': 1}
Nov 03 18:32:45 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-bfee220e-8566-4108-8de7-c50186f69205 tempest-VolumesListAdminTestJSON-527344037 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:32:45 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-bfee220e-8566-4108-8de7-c50186f69205 tempest-VolumesListAdminTestJSON-527344037 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:32:45 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-bfee220e-8566-4108-8de7-c50186f69205 tempest-VolumesListAdminTestJSON-527344037 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:32:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-381016980',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb31ff6e-9212-49b0-a718-a3c789bbfdd3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2559a25b76a64b15ae61594394c09dd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:32:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:32:45Z,use_quota=True,user_id='a517ae1bcc7e4384ae3986a73a907940',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:32:45 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-bfee220e-8566-4108-8de7-c50186f69205 tempest-VolumesListAdminTestJSON-527344037 None] Creating volume cb31ff6e-9212-49b0-a718-a3c789bbfdd3 {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:32:45 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-bfee220e-8566-4108-8de7-c50186f69205 tempest-VolumesListAdminTestJSON-527344037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:32:45 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-bfee220e-8566-4108-8de7-c50186f69205 tempest-VolumesListAdminTestJSON-527344037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:32:45 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-bfee220e-8566-4108-8de7-c50186f69205 tempest-VolumesListAdminTestJSON-527344037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:32:45 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-bfee220e-8566-4108-8de7-c50186f69205 tempest-VolumesListAdminTestJSON-527344037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:32:45 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-bfee220e-8566-4108-8de7-c50186f69205 tempest-VolumesListAdminTestJSON-527344037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:32:45 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-bfee220e-8566-4108-8de7-c50186f69205 tempest-VolumesListAdminTestJSON-527344037 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:32:45 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-bfee220e-8566-4108-8de7-c50186f69205 tempest-VolumesListAdminTestJSON-527344037 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:32:45 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-bfee220e-8566-4108-8de7-c50186f69205 tempest-VolumesListAdminTestJSON-527344037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-cb31ff6e-9212-49b0-a718-a3c789bbfdd3 1073741824 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:32:45 devstack sudo[98622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-cb31ff6e-9212-49b0-a718-a3c789bbfdd3 1073741824
Nov 03 18:32:45 devstack sudo[98622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:32:45 devstack sudo[98620]: pam_unix(sudo:session): session closed for user root
Nov 03 18:32:45 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-a34bb5e8-cfd7-4052-8678-ccf702ac92bc tempest-VolumesSnapshotTestJSON-1802230238 None] Acquiring lock "cinder-d07e98e9-2ee3-4c64-969d-1411bc32340e-delete_snapshot" by "delete_snapshot" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:32:45 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-8f052190-1bfb-46db-90b3-595ab5d63b17 tempest-VolumesSnapshotTestJSON-1802230238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.537s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:32:45 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-8f052190-1bfb-46db-90b3-595ab5d63b17 tempest-VolumesSnapshotTestJSON-1802230238 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:32:45 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-8f052190-1bfb-46db-90b3-595ab5d63b17 tempest-VolumesSnapshotTestJSON-1802230238 None] Deleted volume successfully.
Nov 03 18:32:45 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-a34bb5e8-cfd7-4052-8678-ccf702ac92bc tempest-VolumesSnapshotTestJSON-1802230238 None] Lock "cinder-d07e98e9-2ee3-4c64-969d-1411bc32340e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:32:45 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-a34bb5e8-cfd7-4052-8678-ccf702ac92bc tempest-VolumesSnapshotTestJSON-1802230238 None] Acquiring lock "cinder-quobyte-74f595d0-131a-4ab4-880c-584a910b9957" by "delete_snapshot" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:32:45 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-a34bb5e8-cfd7-4052-8678-ccf702ac92bc tempest-VolumesSnapshotTestJSON-1802230238 None] Lock "cinder-quobyte-74f595d0-131a-4ab4-880c-584a910b9957" acquired by "delete_snapshot" :: waited 0.049s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:32:45 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-a34bb5e8-cfd7-4052-8678-ccf702ac92bc tempest-VolumesSnapshotTestJSON-1802230238 None] Acquiring lock "cinder-quobyte-d07e98e9-2ee3-4c64-969d-1411bc32340e" by "_delete_snapshot" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:32:45 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-8f052190-1bfb-46db-90b3-595ab5d63b17 tempest-VolumesSnapshotTestJSON-1802230238 None] Lock "cinder-e0a2d5f7-0050-499c-ab50-4ff252479b2a-delete_volume" released by "delete_volume" :: held 1.571s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:32:45 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-a34bb5e8-cfd7-4052-8678-ccf702ac92bc tempest-VolumesSnapshotTestJSON-1802230238 None] Lock "cinder-quobyte-d07e98e9-2ee3-4c64-969d-1411bc32340e" acquired by "_delete_snapshot" :: waited 0.042s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:32:45 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-a34bb5e8-cfd7-4052-8678-ccf702ac92bc tempest-VolumesSnapshotTestJSON-1802230238 None] Deleting offline snapshot d07e98e9-2ee3-4c64-969d-1411bc32340e of volume 74f595d0-131a-4ab4-880c-584a910b9957 {{(pid=86120) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 18:32:45 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-a34bb5e8-cfd7-4052-8678-ccf702ac92bc tempest-VolumesSnapshotTestJSON-1802230238 None] snapshot_file for this snap is: volume-74f595d0-131a-4ab4-880c-584a910b9957.d07e98e9-2ee3-4c64-969d-1411bc32340e {{(pid=86120) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 18:32:45 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[6296fc78-b5f9-4a40-9fe0-7746f3252b54]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:32:45 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-a34bb5e8-cfd7-4052-8678-ccf702ac92bc tempest-VolumesSnapshotTestJSON-1802230238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-74f595d0-131a-4ab4-880c-584a910b9957.d07e98e9-2ee3-4c64-969d-1411bc32340e {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:32:45 devstack sudo[98655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-74f595d0-131a-4ab4-880c-584a910b9957.d07e98e9-2ee3-4c64-969d-1411bc32340e
Nov 03 18:32:45 devstack sudo[98655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:32:46 devstack sudo[98622]: pam_unix(sudo:session): session closed for user root
Nov 03 18:32:46 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-bfee220e-8566-4108-8de7-c50186f69205 tempest-VolumesListAdminTestJSON-527344037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-cb31ff6e-9212-49b0-a718-a3c789bbfdd3 1073741824" returned: 0 in 1.009s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:32:46 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-bfee220e-8566-4108-8de7-c50186f69205 tempest-VolumesListAdminTestJSON-527344037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-cb31ff6e-9212-49b0-a718-a3c789bbfdd3 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:32:46 devstack sudo[98672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-cb31ff6e-9212-49b0-a718-a3c789bbfdd3
Nov 03 18:32:46 devstack sudo[98672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:32:46 devstack sudo[98655]: pam_unix(sudo:session): session closed for user root
Nov 03 18:32:46 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-a34bb5e8-cfd7-4052-8678-ccf702ac92bc tempest-VolumesSnapshotTestJSON-1802230238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-74f595d0-131a-4ab4-880c-584a910b9957.d07e98e9-2ee3-4c64-969d-1411bc32340e" returned: 0 in 0.610s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:32:46 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-a34bb5e8-cfd7-4052-8678-ccf702ac92bc tempest-VolumesSnapshotTestJSON-1802230238 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-74f595d0-131a-4ab4-880c-584a910b9957(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86120) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 18:32:46 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[be461859-7174-421f-8e70-d7aeca625fe9]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:32:46 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-a34bb5e8-cfd7-4052-8678-ccf702ac92bc tempest-VolumesSnapshotTestJSON-1802230238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-74f595d0-131a-4ab4-880c-584a910b9957 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:32:46 devstack sudo[98675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-74f595d0-131a-4ab4-880c-584a910b9957
Nov 03 18:32:46 devstack sudo[98675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:32:46 devstack sudo[98672]: pam_unix(sudo:session): session closed for user root
Nov 03 18:32:46 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-bfee220e-8566-4108-8de7-c50186f69205 tempest-VolumesListAdminTestJSON-527344037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-cb31ff6e-9212-49b0-a718-a3c789bbfdd3" returned: 0 in 0.338s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:32:46 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-bfee220e-8566-4108-8de7-c50186f69205 tempest-VolumesListAdminTestJSON-527344037 None] <== create_volume: return (1427ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:32:46 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-bfee220e-8566-4108-8de7-c50186f69205 tempest-VolumesListAdminTestJSON-527344037 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.431s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:32:46 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-bfee220e-8566-4108-8de7-c50186f69205 tempest-VolumesListAdminTestJSON-527344037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ade51d6d-fe9b-498b-830e-a1aa8fcb2770) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb31ff6e-9212-49b0-a718-a3c789bbfdd3', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:32:46 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-bfee220e-8566-4108-8de7-c50186f69205 tempest-VolumesListAdminTestJSON-527344037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf155680-5a80-4fc3-90a4-1e5893da06f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:32:46 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-bfee220e-8566-4108-8de7-c50186f69205 tempest-VolumesListAdminTestJSON-527344037 None] Volume volume-cb31ff6e-9212-49b0-a718-a3c789bbfdd3 (cb31ff6e-9212-49b0-a718-a3c789bbfdd3): created successfully
Nov 03 18:32:46 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-bfee220e-8566-4108-8de7-c50186f69205 tempest-VolumesListAdminTestJSON-527344037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf155680-5a80-4fc3-90a4-1e5893da06f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:32:46 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-bfee220e-8566-4108-8de7-c50186f69205 tempest-VolumesListAdminTestJSON-527344037 None] Flow 'volume_create_manager' (64bc5d33-0400-42ae-acf1-e7071210a871) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:32:46 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-bfee220e-8566-4108-8de7-c50186f69205 tempest-VolumesListAdminTestJSON-527344037 None] Created volume successfully.
Nov 03 18:32:46 devstack sudo[98675]: pam_unix(sudo:session): session closed for user root
Nov 03 18:32:46 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-a34bb5e8-cfd7-4052-8678-ccf702ac92bc tempest-VolumesSnapshotTestJSON-1802230238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-74f595d0-131a-4ab4-880c-584a910b9957" returned: 0 in 0.608s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:32:46 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-a34bb5e8-cfd7-4052-8678-ccf702ac92bc tempest-VolumesSnapshotTestJSON-1802230238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-74f595d0-131a-4ab4-880c-584a910b9957.d07e98e9-2ee3-4c64-969d-1411bc32340e {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:32:46 devstack sudo[98685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-74f595d0-131a-4ab4-880c-584a910b9957.d07e98e9-2ee3-4c64-969d-1411bc32340e
Nov 03 18:32:46 devstack sudo[98685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:32:47 devstack sudo[98685]: pam_unix(sudo:session): session closed for user root
Nov 03 18:32:47 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-a34bb5e8-cfd7-4052-8678-ccf702ac92bc tempest-VolumesSnapshotTestJSON-1802230238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-74f595d0-131a-4ab4-880c-584a910b9957.d07e98e9-2ee3-4c64-969d-1411bc32340e" returned: 0 in 0.464s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:32:47 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-a34bb5e8-cfd7-4052-8678-ccf702ac92bc tempest-VolumesSnapshotTestJSON-1802230238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-74f595d0-131a-4ab4-880c-584a910b9957.d07e98e9-2ee3-4c64-969d-1411bc32340e {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:32:47 devstack sudo[98691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-74f595d0-131a-4ab4-880c-584a910b9957.d07e98e9-2ee3-4c64-969d-1411bc32340e
Nov 03 18:32:47 devstack sudo[98691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:32:47 devstack sudo[98691]: pam_unix(sudo:session): session closed for user root
Nov 03 18:32:47 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-a34bb5e8-cfd7-4052-8678-ccf702ac92bc tempest-VolumesSnapshotTestJSON-1802230238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-74f595d0-131a-4ab4-880c-584a910b9957.d07e98e9-2ee3-4c64-969d-1411bc32340e" returned: 0 in 0.275s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:32:47 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-a34bb5e8-cfd7-4052-8678-ccf702ac92bc tempest-VolumesSnapshotTestJSON-1802230238 None] Lock "cinder-quobyte-d07e98e9-2ee3-4c64-969d-1411bc32340e" released by "_delete_snapshot" :: held 2.126s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:32:47 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-a34bb5e8-cfd7-4052-8678-ccf702ac92bc tempest-VolumesSnapshotTestJSON-1802230238 None] Lock "cinder-quobyte-74f595d0-131a-4ab4-880c-584a910b9957" released by "delete_snapshot" :: held 2.180s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:32:47 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-a34bb5e8-cfd7-4052-8678-ccf702ac92bc tempest-VolumesSnapshotTestJSON-1802230238 None] Created reservations ['c66148ee-f2f2-4bea-bc5a-6572aebbaed5', '95bc0f09-91e1-4644-828e-7e7d6581b277', 'fd95d9ad-dd1f-48bc-95df-3ac22f9f4c96', 'f15870c0-c700-466e-9e3c-1fa6a011b63b'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:32:47 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-a34bb5e8-cfd7-4052-8678-ccf702ac92bc tempest-VolumesSnapshotTestJSON-1802230238 None] Delete snapshot completed successfully.
Nov 03 18:32:47 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-a34bb5e8-cfd7-4052-8678-ccf702ac92bc tempest-VolumesSnapshotTestJSON-1802230238 None] Lock "cinder-d07e98e9-2ee3-4c64-969d-1411bc32340e-delete_snapshot" released by "delete_snapshot" :: held 2.395s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:32:47 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-02a4a6d9-d178-4cf1-8213-ff1a4237975e tempest-VolumesListAdminTestJSON-636854584 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:32:47 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-02a4a6d9-d178-4cf1-8213-ff1a4237975e tempest-VolumesListAdminTestJSON-636854584 None] Flow 'volume_create_manager' (63386121-8a37-40d4-97b1-8d9604554cde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:32:48 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-02a4a6d9-d178-4cf1-8213-ff1a4237975e tempest-VolumesListAdminTestJSON-636854584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c06577e-8d00-4095-9165-dcfb29cf3e35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:32:48 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-02a4a6d9-d178-4cf1-8213-ff1a4237975e tempest-VolumesListAdminTestJSON-636854584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c06577e-8d00-4095-9165-dcfb29cf3e35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:32:48Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94f1c259-45bd-4c9b-a63c-247b0b7aa17a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='854df37ad5034104afb80ec5b5223a8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:32:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:32:48Z,use_quota=True,user_id='271986617e5a4143b6c1cdf728677194',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:32:48 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-02a4a6d9-d178-4cf1-8213-ff1a4237975e tempest-VolumesListAdminTestJSON-636854584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df9730fb-1ae3-4a13-a9a2-e62277d228f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:32:48 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-02a4a6d9-d178-4cf1-8213-ff1a4237975e tempest-VolumesListAdminTestJSON-636854584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df9730fb-1ae3-4a13-a9a2-e62277d228f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:32:48 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-02a4a6d9-d178-4cf1-8213-ff1a4237975e tempest-VolumesListAdminTestJSON-636854584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6e7fa51-05a5-4ad4-b45e-44e452f6fb92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:32:48 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-02a4a6d9-d178-4cf1-8213-ff1a4237975e tempest-VolumesListAdminTestJSON-636854584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6e7fa51-05a5-4ad4-b45e-44e452f6fb92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94f1c259-45bd-4c9b-a63c-247b0b7aa17a', 'volume_name': 'volume-94f1c259-45bd-4c9b-a63c-247b0b7aa17a', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:32:48 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-02a4a6d9-d178-4cf1-8213-ff1a4237975e tempest-VolumesListAdminTestJSON-636854584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cdd7a43-d730-4616-9120-2ddbf20e2089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:32:48 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-02a4a6d9-d178-4cf1-8213-ff1a4237975e tempest-VolumesListAdminTestJSON-636854584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cdd7a43-d730-4616-9120-2ddbf20e2089) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:32:48 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-02a4a6d9-d178-4cf1-8213-ff1a4237975e tempest-VolumesListAdminTestJSON-636854584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e5c5de2-9b81-400e-8327-653897ea4a8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:32:48 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-02a4a6d9-d178-4cf1-8213-ff1a4237975e tempest-VolumesListAdminTestJSON-636854584 None] Volume 94f1c259-45bd-4c9b-a63c-247b0b7aa17a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94f1c259-45bd-4c9b-a63c-247b0b7aa17a', 'volume_size': 1}
Nov 03 18:32:48 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-02a4a6d9-d178-4cf1-8213-ff1a4237975e tempest-VolumesListAdminTestJSON-636854584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:32:48 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-02a4a6d9-d178-4cf1-8213-ff1a4237975e tempest-VolumesListAdminTestJSON-636854584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:32:48 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-02a4a6d9-d178-4cf1-8213-ff1a4237975e tempest-VolumesListAdminTestJSON-636854584 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:32:48Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94f1c259-45bd-4c9b-a63c-247b0b7aa17a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='854df37ad5034104afb80ec5b5223a8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:32:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:32:48Z,use_quota=True,user_id='271986617e5a4143b6c1cdf728677194',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:32:48 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-02a4a6d9-d178-4cf1-8213-ff1a4237975e tempest-VolumesListAdminTestJSON-636854584 None] Creating volume 94f1c259-45bd-4c9b-a63c-247b0b7aa17a {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:32:48 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-02a4a6d9-d178-4cf1-8213-ff1a4237975e tempest-VolumesListAdminTestJSON-636854584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:32:48 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-02a4a6d9-d178-4cf1-8213-ff1a4237975e tempest-VolumesListAdminTestJSON-636854584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:32:48 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-02a4a6d9-d178-4cf1-8213-ff1a4237975e tempest-VolumesListAdminTestJSON-636854584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:32:48 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-02a4a6d9-d178-4cf1-8213-ff1a4237975e tempest-VolumesListAdminTestJSON-636854584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:32:48 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-02a4a6d9-d178-4cf1-8213-ff1a4237975e tempest-VolumesListAdminTestJSON-636854584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:32:48 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-02a4a6d9-d178-4cf1-8213-ff1a4237975e tempest-VolumesListAdminTestJSON-636854584 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:32:48 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-02a4a6d9-d178-4cf1-8213-ff1a4237975e tempest-VolumesListAdminTestJSON-636854584 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:32:48 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-02a4a6d9-d178-4cf1-8213-ff1a4237975e tempest-VolumesListAdminTestJSON-636854584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-94f1c259-45bd-4c9b-a63c-247b0b7aa17a 1073741824 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:32:48 devstack sudo[98694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-94f1c259-45bd-4c9b-a63c-247b0b7aa17a 1073741824
Nov 03 18:32:48 devstack sudo[98694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:32:48 devstack sudo[98694]: pam_unix(sudo:session): session closed for user root
Nov 03 18:32:48 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-02a4a6d9-d178-4cf1-8213-ff1a4237975e tempest-VolumesListAdminTestJSON-636854584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-94f1c259-45bd-4c9b-a63c-247b0b7aa17a 1073741824" returned: 0 in 0.544s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:32:48 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-02a4a6d9-d178-4cf1-8213-ff1a4237975e tempest-VolumesListAdminTestJSON-636854584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-94f1c259-45bd-4c9b-a63c-247b0b7aa17a {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:32:48 devstack sudo[98700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-94f1c259-45bd-4c9b-a63c-247b0b7aa17a
Nov 03 18:32:48 devstack sudo[98700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:32:48 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-140298d1-638e-4e63-bcc4-3a31ccdf3959 tempest-VolumesSnapshotTestJSON-1802230238 None] Acquiring lock "cinder-74f595d0-131a-4ab4-880c-584a910b9957-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:32:48 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-140298d1-638e-4e63-bcc4-3a31ccdf3959 tempest-VolumesSnapshotTestJSON-1802230238 None] Lock "cinder-74f595d0-131a-4ab4-880c-584a910b9957-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:32:49 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-140298d1-638e-4e63-bcc4-3a31ccdf3959 tempest-VolumesSnapshotTestJSON-1802230238 None] Acquiring lock "cinder-quobyte-74f595d0-131a-4ab4-880c-584a910b9957" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:32:49 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-140298d1-638e-4e63-bcc4-3a31ccdf3959 tempest-VolumesSnapshotTestJSON-1802230238 None] Lock "cinder-quobyte-74f595d0-131a-4ab4-880c-584a910b9957" acquired by "delete_volume" :: waited 0.025s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:32:49 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ad05efa-a6cd-479a-ad64-3435c23eb047]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:32:49 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-140298d1-638e-4e63-bcc4-3a31ccdf3959 tempest-VolumesSnapshotTestJSON-1802230238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-74f595d0-131a-4ab4-880c-584a910b9957 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:32:49 devstack sudo[98700]: pam_unix(sudo:session): session closed for user root
Nov 03 18:32:49 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-02a4a6d9-d178-4cf1-8213-ff1a4237975e tempest-VolumesListAdminTestJSON-636854584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-94f1c259-45bd-4c9b-a63c-247b0b7aa17a" returned: 0 in 0.507s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:32:49 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-02a4a6d9-d178-4cf1-8213-ff1a4237975e tempest-VolumesListAdminTestJSON-636854584 None] <== create_volume: return (1112ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:32:49 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-02a4a6d9-d178-4cf1-8213-ff1a4237975e tempest-VolumesListAdminTestJSON-636854584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.117s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:32:49 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-02a4a6d9-d178-4cf1-8213-ff1a4237975e tempest-VolumesListAdminTestJSON-636854584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e5c5de2-9b81-400e-8327-653897ea4a8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94f1c259-45bd-4c9b-a63c-247b0b7aa17a', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:32:49 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-02a4a6d9-d178-4cf1-8213-ff1a4237975e tempest-VolumesListAdminTestJSON-636854584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68d9f9af-49ec-41b2-a355-3eab1305a74d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:32:49 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-02a4a6d9-d178-4cf1-8213-ff1a4237975e tempest-VolumesListAdminTestJSON-636854584 None] Volume volume-94f1c259-45bd-4c9b-a63c-247b0b7aa17a (94f1c259-45bd-4c9b-a63c-247b0b7aa17a): created successfully
Nov 03 18:32:49 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-02a4a6d9-d178-4cf1-8213-ff1a4237975e tempest-VolumesListAdminTestJSON-636854584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68d9f9af-49ec-41b2-a355-3eab1305a74d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:32:49 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-02a4a6d9-d178-4cf1-8213-ff1a4237975e tempest-VolumesListAdminTestJSON-636854584 None] Flow 'volume_create_manager' (63386121-8a37-40d4-97b1-8d9604554cde) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:32:49 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-02a4a6d9-d178-4cf1-8213-ff1a4237975e tempest-VolumesListAdminTestJSON-636854584 None] Created volume successfully.
Nov 03 18:32:49 devstack sudo[98704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-74f595d0-131a-4ab4-880c-584a910b9957
Nov 03 18:32:49 devstack sudo[98704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:32:49 devstack sudo[98704]: pam_unix(sudo:session): session closed for user root
Nov 03 18:32:49 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-140298d1-638e-4e63-bcc4-3a31ccdf3959 tempest-VolumesSnapshotTestJSON-1802230238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-74f595d0-131a-4ab4-880c-584a910b9957" returned: 0 in 0.480s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:32:49 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-140298d1-638e-4e63-bcc4-3a31ccdf3959 tempest-VolumesSnapshotTestJSON-1802230238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-74f595d0-131a-4ab4-880c-584a910b9957 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:32:49 devstack sudo[98710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-74f595d0-131a-4ab4-880c-584a910b9957
Nov 03 18:32:49 devstack sudo[98710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:32:49 devstack sudo[98710]: pam_unix(sudo:session): session closed for user root
Nov 03 18:32:49 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-140298d1-638e-4e63-bcc4-3a31ccdf3959 tempest-VolumesSnapshotTestJSON-1802230238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-74f595d0-131a-4ab4-880c-584a910b9957" returned: 0 in 0.336s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:32:49 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-140298d1-638e-4e63-bcc4-3a31ccdf3959 tempest-VolumesSnapshotTestJSON-1802230238 None] Lock "cinder-quobyte-74f595d0-131a-4ab4-880c-584a910b9957" released by "delete_volume" :: held 0.914s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:32:50 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-140298d1-638e-4e63-bcc4-3a31ccdf3959 tempest-VolumesSnapshotTestJSON-1802230238 None] Created reservations ['6a3a68f0-b367-48d9-9a5a-535eef2a4414', 'f01bd2f9-bafa-42cc-9d78-138668c225bb', '381434af-5a42-4fc6-b6e0-ff114b2223ac', '3a4bf2cc-eaec-4e4e-9102-fb8e601bb782'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:32:50 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-fcb0c243-92f3-4b4c-b905-87e32bd3ccab tempest-VolumesListAdminTestJSON-636854584 None] Acquiring lock "cinder-94f1c259-45bd-4c9b-a63c-247b0b7aa17a-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:32:50 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-fcb0c243-92f3-4b4c-b905-87e32bd3ccab tempest-VolumesListAdminTestJSON-636854584 None] Lock "cinder-94f1c259-45bd-4c9b-a63c-247b0b7aa17a-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:32:50 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-140298d1-638e-4e63-bcc4-3a31ccdf3959 tempest-VolumesSnapshotTestJSON-1802230238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:32:50 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-140298d1-638e-4e63-bcc4-3a31ccdf3959 tempest-VolumesSnapshotTestJSON-1802230238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:32:50 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-140298d1-638e-4e63-bcc4-3a31ccdf3959 tempest-VolumesSnapshotTestJSON-1802230238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:32:50 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-140298d1-638e-4e63-bcc4-3a31ccdf3959 tempest-VolumesSnapshotTestJSON-1802230238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:32:50 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-140298d1-638e-4e63-bcc4-3a31ccdf3959 tempest-VolumesSnapshotTestJSON-1802230238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:32:50 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-140298d1-638e-4e63-bcc4-3a31ccdf3959 tempest-VolumesSnapshotTestJSON-1802230238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:32:50 devstack sudo[98714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:32:50 devstack sudo[98714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:32:50 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-fcb0c243-92f3-4b4c-b905-87e32bd3ccab tempest-VolumesListAdminTestJSON-636854584 None] Acquiring lock "cinder-quobyte-94f1c259-45bd-4c9b-a63c-247b0b7aa17a" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:32:50 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-fcb0c243-92f3-4b4c-b905-87e32bd3ccab tempest-VolumesListAdminTestJSON-636854584 None] Lock "cinder-quobyte-94f1c259-45bd-4c9b-a63c-247b0b7aa17a" acquired by "delete_volume" :: waited 0.029s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:32:50 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-2b8da255-08b1-471d-8280-f9f54f08f95d tempest-VolumesListAdminTestJSON-527344037 None] Acquiring lock "cinder-cb31ff6e-9212-49b0-a718-a3c789bbfdd3-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:32:50 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-2b8da255-08b1-471d-8280-f9f54f08f95d tempest-VolumesListAdminTestJSON-527344037 None] Lock "cinder-cb31ff6e-9212-49b0-a718-a3c789bbfdd3-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:32:50 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[247756c3-447e-40e7-92c0-49d33dc77f8d]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:32:50 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-fcb0c243-92f3-4b4c-b905-87e32bd3ccab tempest-VolumesListAdminTestJSON-636854584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-94f1c259-45bd-4c9b-a63c-247b0b7aa17a {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:32:50 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-2b8da255-08b1-471d-8280-f9f54f08f95d tempest-VolumesListAdminTestJSON-527344037 None] Acquiring lock "cinder-quobyte-cb31ff6e-9212-49b0-a718-a3c789bbfdd3" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:32:50 devstack sudo[98714]: pam_unix(sudo:session): session closed for user root
Nov 03 18:32:50 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-2b8da255-08b1-471d-8280-f9f54f08f95d tempest-VolumesListAdminTestJSON-527344037 None] Lock "cinder-quobyte-cb31ff6e-9212-49b0-a718-a3c789bbfdd3" acquired by "delete_volume" :: waited 0.031s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:32:50 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-140298d1-638e-4e63-bcc4-3a31ccdf3959 tempest-VolumesSnapshotTestJSON-1802230238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.382s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:32:50 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-140298d1-638e-4e63-bcc4-3a31ccdf3959 tempest-VolumesSnapshotTestJSON-1802230238 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:32:50 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-140298d1-638e-4e63-bcc4-3a31ccdf3959 tempest-VolumesSnapshotTestJSON-1802230238 None] Deleted volume successfully.
Nov 03 18:32:50 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf82eb80-263d-4a1a-871b-3634d8f2dea0]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:32:50 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-2b8da255-08b1-471d-8280-f9f54f08f95d tempest-VolumesListAdminTestJSON-527344037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-cb31ff6e-9212-49b0-a718-a3c789bbfdd3 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:32:50 devstack sudo[98716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-94f1c259-45bd-4c9b-a63c-247b0b7aa17a
Nov 03 18:32:50 devstack sudo[98716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:32:50 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-140298d1-638e-4e63-bcc4-3a31ccdf3959 tempest-VolumesSnapshotTestJSON-1802230238 None] Lock "cinder-74f595d0-131a-4ab4-880c-584a910b9957-delete_volume" released by "delete_volume" :: held 1.729s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:32:50 devstack sudo[98718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-cb31ff6e-9212-49b0-a718-a3c789bbfdd3
Nov 03 18:32:50 devstack sudo[98718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:32:50 devstack sudo[98716]: pam_unix(sudo:session): session closed for user root
Nov 03 18:32:50 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-fcb0c243-92f3-4b4c-b905-87e32bd3ccab tempest-VolumesListAdminTestJSON-636854584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-94f1c259-45bd-4c9b-a63c-247b0b7aa17a" returned: 0 in 0.496s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:32:50 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-fcb0c243-92f3-4b4c-b905-87e32bd3ccab tempest-VolumesListAdminTestJSON-636854584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-94f1c259-45bd-4c9b-a63c-247b0b7aa17a {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:32:51 devstack sudo[98724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-94f1c259-45bd-4c9b-a63c-247b0b7aa17a
Nov 03 18:32:51 devstack sudo[98724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:32:51 devstack sudo[98718]: pam_unix(sudo:session): session closed for user root
Nov 03 18:32:51 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-2b8da255-08b1-471d-8280-f9f54f08f95d tempest-VolumesListAdminTestJSON-527344037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-cb31ff6e-9212-49b0-a718-a3c789bbfdd3" returned: 0 in 0.444s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:32:51 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-2b8da255-08b1-471d-8280-f9f54f08f95d tempest-VolumesListAdminTestJSON-527344037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-cb31ff6e-9212-49b0-a718-a3c789bbfdd3 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:32:51 devstack sudo[98729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-cb31ff6e-9212-49b0-a718-a3c789bbfdd3
Nov 03 18:32:51 devstack sudo[98729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:32:51 devstack sudo[98724]: pam_unix(sudo:session): session closed for user root
Nov 03 18:32:51 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-fcb0c243-92f3-4b4c-b905-87e32bd3ccab tempest-VolumesListAdminTestJSON-636854584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-94f1c259-45bd-4c9b-a63c-247b0b7aa17a" returned: 0 in 0.285s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:32:51 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-fcb0c243-92f3-4b4c-b905-87e32bd3ccab tempest-VolumesListAdminTestJSON-636854584 None] Lock "cinder-quobyte-94f1c259-45bd-4c9b-a63c-247b0b7aa17a" released by "delete_volume" :: held 0.938s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:32:51 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-4879cc40-4cfe-4bd6-bc03-0e6d699676a2 tempest-VolumesSnapshotTestJSON-1802230238 None] Acquiring lock "cinder-376626e4-96de-4582-83fb-6fb52291bcb5-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:32:51 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-fcb0c243-92f3-4b4c-b905-87e32bd3ccab tempest-VolumesListAdminTestJSON-636854584 None] Created reservations ['5ee0597f-99dc-40d3-af60-4a70759b66cd', 'd16308a8-6310-41f5-96c9-7742e3e5d4c1', '4424803d-8ee3-4014-bf70-0edb72a01e0f', '08b01ddc-3d2c-497f-8033-ff6b93252068'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:32:51 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-4879cc40-4cfe-4bd6-bc03-0e6d699676a2 tempest-VolumesSnapshotTestJSON-1802230238 None] Lock "cinder-376626e4-96de-4582-83fb-6fb52291bcb5-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:32:51 devstack sudo[98729]: pam_unix(sudo:session): session closed for user root
Nov 03 18:32:51 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-2b8da255-08b1-471d-8280-f9f54f08f95d tempest-VolumesListAdminTestJSON-527344037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-cb31ff6e-9212-49b0-a718-a3c789bbfdd3" returned: 0 in 0.354s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:32:51 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-4879cc40-4cfe-4bd6-bc03-0e6d699676a2 tempest-VolumesSnapshotTestJSON-1802230238 None] Acquiring lock "cinder-quobyte-376626e4-96de-4582-83fb-6fb52291bcb5" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:32:51 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-2b8da255-08b1-471d-8280-f9f54f08f95d tempest-VolumesListAdminTestJSON-527344037 None] Lock "cinder-quobyte-cb31ff6e-9212-49b0-a718-a3c789bbfdd3" released by "delete_volume" :: held 0.903s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:32:51 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-4879cc40-4cfe-4bd6-bc03-0e6d699676a2 tempest-VolumesSnapshotTestJSON-1802230238 None] Lock "cinder-quobyte-376626e4-96de-4582-83fb-6fb52291bcb5" acquired by "delete_volume" :: waited 0.080s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:32:51 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceb7fb47-d3f7-4fae-959a-f78a52597fb4]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:32:51 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-fcb0c243-92f3-4b4c-b905-87e32bd3ccab tempest-VolumesListAdminTestJSON-636854584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:32:51 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-fcb0c243-92f3-4b4c-b905-87e32bd3ccab tempest-VolumesListAdminTestJSON-636854584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:32:51 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-fcb0c243-92f3-4b4c-b905-87e32bd3ccab tempest-VolumesListAdminTestJSON-636854584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:32:51 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-fcb0c243-92f3-4b4c-b905-87e32bd3ccab tempest-VolumesListAdminTestJSON-636854584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:32:51 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-fcb0c243-92f3-4b4c-b905-87e32bd3ccab tempest-VolumesListAdminTestJSON-636854584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:32:51 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-fcb0c243-92f3-4b4c-b905-87e32bd3ccab tempest-VolumesListAdminTestJSON-636854584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:32:51 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-4879cc40-4cfe-4bd6-bc03-0e6d699676a2 tempest-VolumesSnapshotTestJSON-1802230238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-376626e4-96de-4582-83fb-6fb52291bcb5 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:32:51 devstack sudo[98733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:32:51 devstack sudo[98733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:32:51 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-2b8da255-08b1-471d-8280-f9f54f08f95d tempest-VolumesListAdminTestJSON-527344037 None] Created reservations ['36057b84-7d9b-4553-b743-20ae0f700fa6', '868a0f8a-42e4-4969-9db2-8cfcb8e5373e', '59dde54d-6e62-4532-9390-8d490c0d027b', 'ef4da970-56bc-422e-9a3c-c8372343a08f'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:32:51 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-2b8da255-08b1-471d-8280-f9f54f08f95d tempest-VolumesListAdminTestJSON-527344037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:32:51 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-2b8da255-08b1-471d-8280-f9f54f08f95d tempest-VolumesListAdminTestJSON-527344037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:32:51 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-2b8da255-08b1-471d-8280-f9f54f08f95d tempest-VolumesListAdminTestJSON-527344037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:32:51 devstack sudo[98734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-376626e4-96de-4582-83fb-6fb52291bcb5
Nov 03 18:32:51 devstack sudo[98734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:32:51 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-2b8da255-08b1-471d-8280-f9f54f08f95d tempest-VolumesListAdminTestJSON-527344037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:32:51 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-2b8da255-08b1-471d-8280-f9f54f08f95d tempest-VolumesListAdminTestJSON-527344037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:32:51 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-2b8da255-08b1-471d-8280-f9f54f08f95d tempest-VolumesListAdminTestJSON-527344037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:32:51 devstack sudo[98737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:32:51 devstack sudo[98737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:32:51 devstack sudo[98733]: pam_unix(sudo:session): session closed for user root
Nov 03 18:32:51 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-fcb0c243-92f3-4b4c-b905-87e32bd3ccab tempest-VolumesListAdminTestJSON-636854584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.296s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:32:51 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-fcb0c243-92f3-4b4c-b905-87e32bd3ccab tempest-VolumesListAdminTestJSON-636854584 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:32:51 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-fcb0c243-92f3-4b4c-b905-87e32bd3ccab tempest-VolumesListAdminTestJSON-636854584 None] Deleted volume successfully.
Nov 03 18:32:51 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-fcb0c243-92f3-4b4c-b905-87e32bd3ccab tempest-VolumesListAdminTestJSON-636854584 None] Lock "cinder-94f1c259-45bd-4c9b-a63c-247b0b7aa17a-delete_volume" released by "delete_volume" :: held 1.761s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:32:52 devstack sudo[98737]: pam_unix(sudo:session): session closed for user root
Nov 03 18:32:52 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-2b8da255-08b1-471d-8280-f9f54f08f95d tempest-VolumesListAdminTestJSON-527344037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.307s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:32:52 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-2b8da255-08b1-471d-8280-f9f54f08f95d tempest-VolumesListAdminTestJSON-527344037 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:32:52 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-2b8da255-08b1-471d-8280-f9f54f08f95d tempest-VolumesListAdminTestJSON-527344037 None] Deleted volume successfully.
Nov 03 18:32:52 devstack sudo[98734]: pam_unix(sudo:session): session closed for user root
Nov 03 18:32:52 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-4879cc40-4cfe-4bd6-bc03-0e6d699676a2 tempest-VolumesSnapshotTestJSON-1802230238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-376626e4-96de-4582-83fb-6fb52291bcb5" returned: 0 in 0.511s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:32:52 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-4879cc40-4cfe-4bd6-bc03-0e6d699676a2 tempest-VolumesSnapshotTestJSON-1802230238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-376626e4-96de-4582-83fb-6fb52291bcb5 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:32:52 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-2b8da255-08b1-471d-8280-f9f54f08f95d tempest-VolumesListAdminTestJSON-527344037 None] Lock "cinder-cb31ff6e-9212-49b0-a718-a3c789bbfdd3-delete_volume" released by "delete_volume" :: held 1.758s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:32:52 devstack sudo[98744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-376626e4-96de-4582-83fb-6fb52291bcb5
Nov 03 18:32:52 devstack sudo[98744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:32:52 devstack sudo[98744]: pam_unix(sudo:session): session closed for user root
Nov 03 18:32:52 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-4879cc40-4cfe-4bd6-bc03-0e6d699676a2 tempest-VolumesSnapshotTestJSON-1802230238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-376626e4-96de-4582-83fb-6fb52291bcb5" returned: 0 in 0.279s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:32:52 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-4879cc40-4cfe-4bd6-bc03-0e6d699676a2 tempest-VolumesSnapshotTestJSON-1802230238 None] Lock "cinder-quobyte-376626e4-96de-4582-83fb-6fb52291bcb5" released by "delete_volume" :: held 0.894s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:32:52 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-4879cc40-4cfe-4bd6-bc03-0e6d699676a2 tempest-VolumesSnapshotTestJSON-1802230238 None] Created reservations ['2e9df7f5-8dec-40a1-bb74-9be4275d53a4', '1723be86-e8d1-4488-8315-d9e024dad5a3', '2f84da31-9068-4e58-b19d-e4fdb41313aa', '8d341d2a-9804-4f9f-94d5-725188d88825'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:32:52 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-4879cc40-4cfe-4bd6-bc03-0e6d699676a2 tempest-VolumesSnapshotTestJSON-1802230238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:32:52 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-4879cc40-4cfe-4bd6-bc03-0e6d699676a2 tempest-VolumesSnapshotTestJSON-1802230238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:32:52 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-4879cc40-4cfe-4bd6-bc03-0e6d699676a2 tempest-VolumesSnapshotTestJSON-1802230238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:32:52 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-4879cc40-4cfe-4bd6-bc03-0e6d699676a2 tempest-VolumesSnapshotTestJSON-1802230238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:32:52 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-4879cc40-4cfe-4bd6-bc03-0e6d699676a2 tempest-VolumesSnapshotTestJSON-1802230238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:32:52 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-4879cc40-4cfe-4bd6-bc03-0e6d699676a2 tempest-VolumesSnapshotTestJSON-1802230238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:32:52 devstack sudo[98747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:32:52 devstack sudo[98747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:32:52 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-b1d974cc-c754-46cc-91fa-b240e3d59278 tempest-VolumesListAdminTestJSON-527344037 None] Acquiring lock "cinder-36451a7a-9f0f-4802-acdc-8cf23415b960-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:32:52 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-b1d974cc-c754-46cc-91fa-b240e3d59278 tempest-VolumesListAdminTestJSON-527344037 None] Lock "cinder-36451a7a-9f0f-4802-acdc-8cf23415b960-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:32:52 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-b1d974cc-c754-46cc-91fa-b240e3d59278 tempest-VolumesListAdminTestJSON-527344037 None] Acquiring lock "cinder-quobyte-36451a7a-9f0f-4802-acdc-8cf23415b960" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:32:52 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-b1d974cc-c754-46cc-91fa-b240e3d59278 tempest-VolumesListAdminTestJSON-527344037 None] Lock "cinder-quobyte-36451a7a-9f0f-4802-acdc-8cf23415b960" acquired by "delete_volume" :: waited 0.024s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:32:52 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fc07c72-7fe9-41fd-ac19-08d3ce5ff161]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:32:52 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b1d974cc-c754-46cc-91fa-b240e3d59278 tempest-VolumesListAdminTestJSON-527344037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-36451a7a-9f0f-4802-acdc-8cf23415b960 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:32:52 devstack sudo[98747]: pam_unix(sudo:session): session closed for user root
Nov 03 18:32:52 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-4879cc40-4cfe-4bd6-bc03-0e6d699676a2 tempest-VolumesSnapshotTestJSON-1802230238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.331s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:32:52 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-4879cc40-4cfe-4bd6-bc03-0e6d699676a2 tempest-VolumesSnapshotTestJSON-1802230238 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:32:52 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-4879cc40-4cfe-4bd6-bc03-0e6d699676a2 tempest-VolumesSnapshotTestJSON-1802230238 None] Deleted volume successfully.
Nov 03 18:32:52 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-4879cc40-4cfe-4bd6-bc03-0e6d699676a2 tempest-VolumesSnapshotTestJSON-1802230238 None] Lock "cinder-376626e4-96de-4582-83fb-6fb52291bcb5-delete_volume" released by "delete_volume" :: held 1.581s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:32:52 devstack sudo[98749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-36451a7a-9f0f-4802-acdc-8cf23415b960
Nov 03 18:32:52 devstack sudo[98749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:32:53 devstack sudo[98749]: pam_unix(sudo:session): session closed for user root
Nov 03 18:32:53 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b1d974cc-c754-46cc-91fa-b240e3d59278 tempest-VolumesListAdminTestJSON-527344037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-36451a7a-9f0f-4802-acdc-8cf23415b960" returned: 0 in 0.391s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:32:53 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b1d974cc-c754-46cc-91fa-b240e3d59278 tempest-VolumesListAdminTestJSON-527344037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-36451a7a-9f0f-4802-acdc-8cf23415b960 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:32:53 devstack sudo[98755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-36451a7a-9f0f-4802-acdc-8cf23415b960
Nov 03 18:32:53 devstack sudo[98755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:32:53 devstack sudo[98755]: pam_unix(sudo:session): session closed for user root
Nov 03 18:32:53 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b1d974cc-c754-46cc-91fa-b240e3d59278 tempest-VolumesListAdminTestJSON-527344037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-36451a7a-9f0f-4802-acdc-8cf23415b960" returned: 0 in 0.288s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:32:53 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-b1d974cc-c754-46cc-91fa-b240e3d59278 tempest-VolumesListAdminTestJSON-527344037 None] Lock "cinder-quobyte-36451a7a-9f0f-4802-acdc-8cf23415b960" released by "delete_volume" :: held 0.737s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:32:53 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-b1d974cc-c754-46cc-91fa-b240e3d59278 tempest-VolumesListAdminTestJSON-527344037 None] Created reservations ['6d20a97b-0f3b-4f61-a71c-c81d2c5ab80e', '403b7887-c3d3-4dcd-8891-45cb86fa7733', 'b0e4a127-63d5-40b9-8ed0-7d687707d695', '3c102019-2377-4c8b-ad1e-f6d14525a709'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:32:53 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-b1d974cc-c754-46cc-91fa-b240e3d59278 tempest-VolumesListAdminTestJSON-527344037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:32:53 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-b1d974cc-c754-46cc-91fa-b240e3d59278 tempest-VolumesListAdminTestJSON-527344037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:32:53 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-b1d974cc-c754-46cc-91fa-b240e3d59278 tempest-VolumesListAdminTestJSON-527344037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:32:53 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-b1d974cc-c754-46cc-91fa-b240e3d59278 tempest-VolumesListAdminTestJSON-527344037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:32:53 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-b1d974cc-c754-46cc-91fa-b240e3d59278 tempest-VolumesListAdminTestJSON-527344037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:32:53 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b1d974cc-c754-46cc-91fa-b240e3d59278 tempest-VolumesListAdminTestJSON-527344037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:32:53 devstack sudo[98784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:32:53 devstack sudo[98784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:32:54 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-0d21164c-3d18-4c52-bdc6-5cce69a88de8 tempest-VolumesListAdminTestJSON-527344037 None] Acquiring lock "cinder-d2eda2f0-7a2a-469f-8e90-c6ff9a044d5a-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:32:54 devstack sudo[98784]: pam_unix(sudo:session): session closed for user root
Nov 03 18:32:54 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b1d974cc-c754-46cc-91fa-b240e3d59278 tempest-VolumesListAdminTestJSON-527344037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.403s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:32:54 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-b1d974cc-c754-46cc-91fa-b240e3d59278 tempest-VolumesListAdminTestJSON-527344037 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:32:54 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-b1d974cc-c754-46cc-91fa-b240e3d59278 tempest-VolumesListAdminTestJSON-527344037 None] Deleted volume successfully.
Nov 03 18:32:54 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-0d21164c-3d18-4c52-bdc6-5cce69a88de8 tempest-VolumesListAdminTestJSON-527344037 None] Lock "cinder-d2eda2f0-7a2a-469f-8e90-c6ff9a044d5a-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:32:54 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-b1d974cc-c754-46cc-91fa-b240e3d59278 tempest-VolumesListAdminTestJSON-527344037 None] Lock "cinder-36451a7a-9f0f-4802-acdc-8cf23415b960-delete_volume" released by "delete_volume" :: held 1.455s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:32:54 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-0d21164c-3d18-4c52-bdc6-5cce69a88de8 tempest-VolumesListAdminTestJSON-527344037 None] Acquiring lock "cinder-quobyte-d2eda2f0-7a2a-469f-8e90-c6ff9a044d5a" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:32:54 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-0d21164c-3d18-4c52-bdc6-5cce69a88de8 tempest-VolumesListAdminTestJSON-527344037 None] Lock "cinder-quobyte-d2eda2f0-7a2a-469f-8e90-c6ff9a044d5a" acquired by "delete_volume" :: waited 0.025s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:32:54 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bc9e070-86bd-4d03-a8ca-6a9351fcbb9e]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:32:54 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-0d21164c-3d18-4c52-bdc6-5cce69a88de8 tempest-VolumesListAdminTestJSON-527344037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d2eda2f0-7a2a-469f-8e90-c6ff9a044d5a {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:32:54 devstack sudo[98793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d2eda2f0-7a2a-469f-8e90-c6ff9a044d5a
Nov 03 18:32:54 devstack sudo[98793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:32:54 devstack sudo[98793]: pam_unix(sudo:session): session closed for user root
Nov 03 18:32:54 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-0d21164c-3d18-4c52-bdc6-5cce69a88de8 tempest-VolumesListAdminTestJSON-527344037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d2eda2f0-7a2a-469f-8e90-c6ff9a044d5a" returned: 0 in 0.467s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:32:54 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-0d21164c-3d18-4c52-bdc6-5cce69a88de8 tempest-VolumesListAdminTestJSON-527344037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d2eda2f0-7a2a-469f-8e90-c6ff9a044d5a {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:32:54 devstack sudo[98805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d2eda2f0-7a2a-469f-8e90-c6ff9a044d5a
Nov 03 18:32:54 devstack sudo[98805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:32:55 devstack sudo[98805]: pam_unix(sudo:session): session closed for user root
Nov 03 18:32:55 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-0d21164c-3d18-4c52-bdc6-5cce69a88de8 tempest-VolumesListAdminTestJSON-527344037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d2eda2f0-7a2a-469f-8e90-c6ff9a044d5a" returned: 0 in 0.396s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:32:55 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-0d21164c-3d18-4c52-bdc6-5cce69a88de8 tempest-VolumesListAdminTestJSON-527344037 None] Lock "cinder-quobyte-d2eda2f0-7a2a-469f-8e90-c6ff9a044d5a" released by "delete_volume" :: held 0.926s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:32:55 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-0d21164c-3d18-4c52-bdc6-5cce69a88de8 tempest-VolumesListAdminTestJSON-527344037 None] Created reservations ['468fb778-06d9-4b9d-97b4-218732945f36', '87a054f9-e459-4726-b63b-34685d7971e8', 'cd373fad-1d7b-4412-a55c-50e89c60abde', 'd3ea8916-39df-48db-8854-3ab43504fa93'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:32:55 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-0d21164c-3d18-4c52-bdc6-5cce69a88de8 tempest-VolumesListAdminTestJSON-527344037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:32:55 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-0d21164c-3d18-4c52-bdc6-5cce69a88de8 tempest-VolumesListAdminTestJSON-527344037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:32:55 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-0d21164c-3d18-4c52-bdc6-5cce69a88de8 tempest-VolumesListAdminTestJSON-527344037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:32:55 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-0d21164c-3d18-4c52-bdc6-5cce69a88de8 tempest-VolumesListAdminTestJSON-527344037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:32:55 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-0d21164c-3d18-4c52-bdc6-5cce69a88de8 tempest-VolumesListAdminTestJSON-527344037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:32:55 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-0d21164c-3d18-4c52-bdc6-5cce69a88de8 tempest-VolumesListAdminTestJSON-527344037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:32:55 devstack sudo[98808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:32:55 devstack sudo[98808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:32:55 devstack sudo[98808]: pam_unix(sudo:session): session closed for user root
Nov 03 18:32:55 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-0d21164c-3d18-4c52-bdc6-5cce69a88de8 tempest-VolumesListAdminTestJSON-527344037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.294s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:32:55 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-0d21164c-3d18-4c52-bdc6-5cce69a88de8 tempest-VolumesListAdminTestJSON-527344037 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:32:55 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-0d21164c-3d18-4c52-bdc6-5cce69a88de8 tempest-VolumesListAdminTestJSON-527344037 None] Deleted volume successfully.
Nov 03 18:32:55 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-0d21164c-3d18-4c52-bdc6-5cce69a88de8 tempest-VolumesListAdminTestJSON-527344037 None] Lock "cinder-d2eda2f0-7a2a-469f-8e90-c6ff9a044d5a-delete_volume" released by "delete_volume" :: held 1.548s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:33:02 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b307ece-0b06-4322-aa76-16b344aa412c tempest-VolumesImageMetadata-250582937 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:33:02 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-9b307ece-0b06-4322-aa76-16b344aa412c tempest-VolumesImageMetadata-250582937 None] Flow 'volume_create_manager' (154fd826-7552-4e73-be15-df18174beaa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:33:02 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-9b307ece-0b06-4322-aa76-16b344aa412c tempest-VolumesImageMetadata-250582937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5be3b7a4-b491-4f93-82ba-fa833f793fd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:33:02 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-9b307ece-0b06-4322-aa76-16b344aa412c tempest-VolumesImageMetadata-250582937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5be3b7a4-b491-4f93-82ba-fa833f793fd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:33:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-604287058',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25daef7e-d3aa-4729-b859-4f4cdf10d20c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6b9a35e1e1f47148aede49191051c0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:33:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:33:02Z,use_quota=True,user_id='96bdca601e084444bdb136c042c8899b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:33:02 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-9b307ece-0b06-4322-aa76-16b344aa412c tempest-VolumesImageMetadata-250582937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86f5c1be-f9f9-4984-8533-69a637145fb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:33:02 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-9b307ece-0b06-4322-aa76-16b344aa412c tempest-VolumesImageMetadata-250582937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86f5c1be-f9f9-4984-8533-69a637145fb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:33:02 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-9b307ece-0b06-4322-aa76-16b344aa412c tempest-VolumesImageMetadata-250582937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9c89537-b67a-4285-8a92-b8e820c171eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:33:02 devstack cinder-volume[86120]: DEBUG cinder.image.glance [None req-9b307ece-0b06-4322-aa76-16b344aa412c tempest-VolumesImageMetadata-250582937 None] Creating Keystone auth plugin from conf {{(pid=86120) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 03 18:33:02 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-9b307ece-0b06-4322-aa76-16b344aa412c tempest-VolumesImageMetadata-250582937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9c89537-b67a-4285-8a92-b8e820c171eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '25daef7e-d3aa-4729-b859-4f4cdf10d20c', 'volume_name': 'volume-25daef7e-d3aa-4729-b859-4f4cdf10d20c', 'volume_size': 1, 'image_id': '83b28d58-14b6-4404-8354-5cfe237c5c95', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/83b28d58-14b6-4404-8354-5cfe237c5c95', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4b0f900e807a4827ba1f8686981981d9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '83b28d58-14b6-4404-8354-5cfe237c5c95', 'created_at': datetime.datetime(2026, 11, 3, 17, 17, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 17, 17, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/83b28d58-14b6-4404-8354-5cfe237c5c95/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7a8d3c5f4aa0>}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:33:02 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-9b307ece-0b06-4322-aa76-16b344aa412c tempest-VolumesImageMetadata-250582937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b96b2773-650b-458a-9d56-791796cb129c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:33:02 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-9b307ece-0b06-4322-aa76-16b344aa412c tempest-VolumesImageMetadata-250582937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b96b2773-650b-458a-9d56-791796cb129c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:33:02 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-9b307ece-0b06-4322-aa76-16b344aa412c tempest-VolumesImageMetadata-250582937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (862c4108-16aa-4a1c-b4dd-45da6d5df1ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:33:02 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-9b307ece-0b06-4322-aa76-16b344aa412c tempest-VolumesImageMetadata-250582937 None] Volume 25daef7e-d3aa-4729-b859-4f4cdf10d20c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-25daef7e-d3aa-4729-b859-4f4cdf10d20c', 'volume_size': 1, 'image_id': '83b28d58-14b6-4404-8354-5cfe237c5c95', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/83b28d58-14b6-4404-8354-5cfe237c5c95', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4b0f900e807a4827ba1f8686981981d9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '83b28d58-14b6-4404-8354-5cfe237c5c95', 'created_at': datetime.datetime(2026, 11, 3, 17, 17, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 17, 17, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/83b28d58-14b6-4404-8354-5cfe237c5c95/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7a8d3c5f4aa0>}
Nov 03 18:33:02 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b307ece-0b06-4322-aa76-16b344aa412c tempest-VolumesImageMetadata-250582937 None] Trying to clone 25daef7e-d3aa-4729-b859-4f4cdf10d20c from image 83b28d58-14b6-4404-8354-5cfe237c5c95 at location (None, [{'url': 'file:///opt/stack/data/glance/images/83b28d58-14b6-4404-8354-5cfe237c5c95', 'metadata': {}}]). {{(pid=86120) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 03 18:33:03 devstack cinder-volume[86120]: DEBUG cinder.image.image_utils [None req-9b307ece-0b06-4322-aa76-16b344aa412c tempest-VolumesImageMetadata-250582937 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_83b28d58-14b6-4404-8354-5cfe237c5c95_ehfb2xyzdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86120) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 03 18:33:03 devstack cinder-volume[86120]: INFO cinder.image.image_utils [None req-9b307ece-0b06-4322-aa76-16b344aa412c tempest-VolumesImageMetadata-250582937 None] Image download 20.69 MB at 20.69 MB/s
Nov 03 18:33:03 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ef68e82-b7aa-4130-be92-f1b551ed8a40]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:33:03 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-9b307ece-0b06-4322-aa76-16b344aa412c tempest-VolumesImageMetadata-250582937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_83b28d58-14b6-4404-8354-5cfe237c5c95_ehfb2xyzdevstack@QuobyteHD {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:33:03 devstack sudo[98848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_83b28d58-14b6-4404-8354-5cfe237c5c95_ehfb2xyzdevstack@QuobyteHD
Nov 03 18:33:03 devstack sudo[98848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:33:03 devstack sudo[98848]: pam_unix(sudo:session): session closed for user root
Nov 03 18:33:03 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-9b307ece-0b06-4322-aa76-16b344aa412c tempest-VolumesImageMetadata-250582937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_83b28d58-14b6-4404-8354-5cfe237c5c95_ehfb2xyzdevstack@QuobyteHD" returned: 0 in 0.374s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:33:03 devstack cinder-volume[86120]: DEBUG cinder.image.image_utils [None req-9b307ece-0b06-4322-aa76-16b344aa412c tempest-VolumesImageMetadata-250582937 None] Temporary image 83b28d58-14b6-4404-8354-5cfe237c5c95 is fetched for user 96bdca601e084444bdb136c042c8899b. {{(pid=86120) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 03 18:33:03 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[3384609d-e845-4b60-ba81-9fe7c58de813]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:33:03 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-9b307ece-0b06-4322-aa76-16b344aa412c tempest-VolumesImageMetadata-250582937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_83b28d58-14b6-4404-8354-5cfe237c5c95_ehfb2xyzdevstack@QuobyteHD {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:33:03 devstack sudo[98853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_83b28d58-14b6-4404-8354-5cfe237c5c95_ehfb2xyzdevstack@QuobyteHD
Nov 03 18:33:03 devstack sudo[98853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:33:03 devstack sudo[98853]: pam_unix(sudo:session): session closed for user root
Nov 03 18:33:03 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-9b307ece-0b06-4322-aa76-16b344aa412c tempest-VolumesImageMetadata-250582937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_83b28d58-14b6-4404-8354-5cfe237c5c95_ehfb2xyzdevstack@QuobyteHD" returned: 0 in 0.376s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:33:03 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-9b307ece-0b06-4322-aa76-16b344aa412c tempest-VolumesImageMetadata-250582937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:33:03 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-9b307ece-0b06-4322-aa76-16b344aa412c tempest-VolumesImageMetadata-250582937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:33:03 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-9b307ece-0b06-4322-aa76-16b344aa412c tempest-VolumesImageMetadata-250582937 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:33:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-604287058',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25daef7e-d3aa-4729-b859-4f4cdf10d20c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6b9a35e1e1f47148aede49191051c0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:33:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:33:02Z,use_quota=True,user_id='96bdca601e084444bdb136c042c8899b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:33:03 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-9b307ece-0b06-4322-aa76-16b344aa412c tempest-VolumesImageMetadata-250582937 None] Creating volume 25daef7e-d3aa-4729-b859-4f4cdf10d20c {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:33:03 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-9b307ece-0b06-4322-aa76-16b344aa412c tempest-VolumesImageMetadata-250582937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:33:03 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-9b307ece-0b06-4322-aa76-16b344aa412c tempest-VolumesImageMetadata-250582937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:33:03 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-9b307ece-0b06-4322-aa76-16b344aa412c tempest-VolumesImageMetadata-250582937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:33:03 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-9b307ece-0b06-4322-aa76-16b344aa412c tempest-VolumesImageMetadata-250582937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:33:03 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-9b307ece-0b06-4322-aa76-16b344aa412c tempest-VolumesImageMetadata-250582937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:33:03 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-9b307ece-0b06-4322-aa76-16b344aa412c tempest-VolumesImageMetadata-250582937 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:33:03 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-9b307ece-0b06-4322-aa76-16b344aa412c tempest-VolumesImageMetadata-250582937 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:33:03 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-9b307ece-0b06-4322-aa76-16b344aa412c tempest-VolumesImageMetadata-250582937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-25daef7e-d3aa-4729-b859-4f4cdf10d20c 1073741824 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:33:03 devstack sudo[98858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-25daef7e-d3aa-4729-b859-4f4cdf10d20c 1073741824
Nov 03 18:33:03 devstack sudo[98858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:33:04 devstack sudo[98858]: pam_unix(sudo:session): session closed for user root
Nov 03 18:33:04 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-9b307ece-0b06-4322-aa76-16b344aa412c tempest-VolumesImageMetadata-250582937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-25daef7e-d3aa-4729-b859-4f4cdf10d20c 1073741824" returned: 0 in 0.432s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:33:04 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-9b307ece-0b06-4322-aa76-16b344aa412c tempest-VolumesImageMetadata-250582937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-25daef7e-d3aa-4729-b859-4f4cdf10d20c {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:33:04 devstack sudo[98864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-25daef7e-d3aa-4729-b859-4f4cdf10d20c
Nov 03 18:33:04 devstack sudo[98864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:33:04 devstack sudo[98864]: pam_unix(sudo:session): session closed for user root
Nov 03 18:33:04 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-9b307ece-0b06-4322-aa76-16b344aa412c tempest-VolumesImageMetadata-250582937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-25daef7e-d3aa-4729-b859-4f4cdf10d20c" returned: 0 in 0.260s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:33:04 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-9b307ece-0b06-4322-aa76-16b344aa412c tempest-VolumesImageMetadata-250582937 None] <== create_volume: return (745ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:33:04 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-9b307ece-0b06-4322-aa76-16b344aa412c tempest-VolumesImageMetadata-250582937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.752s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:33:04 devstack cinder-volume[86120]: DEBUG cinder.volume.volume_utils [None req-9b307ece-0b06-4322-aa76-16b344aa412c tempest-VolumesImageMetadata-250582937 None] Attempting download of 83b28d58-14b6-4404-8354-5cfe237c5c95 ((None, [{'url': 'file:///opt/stack/data/glance/images/83b28d58-14b6-4404-8354-5cfe237c5c95', 'metadata': {}}])) to volume 25daef7e-d3aa-4729-b859-4f4cdf10d20c. {{(pid=86120) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 03 18:33:04 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cc51a0d-a075-4585-866f-f4b43256941e]: (4, 'raw') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:33:04 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-9b307ece-0b06-4322-aa76-16b344aa412c tempest-VolumesImageMetadata-250582937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_83b28d58-14b6-4404-8354-5cfe237c5c95_yewgfora {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:33:04 devstack sudo[98867]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_83b28d58-14b6-4404-8354-5cfe237c5c95_yewgfora
Nov 03 18:33:04 devstack sudo[98867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:33:05 devstack sudo[98867]: pam_unix(sudo:session): session closed for user root
Nov 03 18:33:05 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-9b307ece-0b06-4322-aa76-16b344aa412c tempest-VolumesImageMetadata-250582937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_83b28d58-14b6-4404-8354-5cfe237c5c95_yewgfora" returned: 0 in 0.374s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:33:05 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-9b307ece-0b06-4322-aa76-16b344aa412c tempest-VolumesImageMetadata-250582937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_83b28d58-14b6-4404-8354-5cfe237c5c95_yewgfora {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:33:05 devstack sudo[98871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_83b28d58-14b6-4404-8354-5cfe237c5c95_yewgfora
Nov 03 18:33:05 devstack sudo[98871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:33:05 devstack sudo[98871]: pam_unix(sudo:session): session closed for user root
Nov 03 18:33:05 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-9b307ece-0b06-4322-aa76-16b344aa412c tempest-VolumesImageMetadata-250582937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_83b28d58-14b6-4404-8354-5cfe237c5c95_yewgfora" returned: 1 in 0.346s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:33:05 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-9b307ece-0b06-4322-aa76-16b344aa412c tempest-VolumesImageMetadata-250582937 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_83b28d58-14b6-4404-8354-5cfe237c5c95_yewgfora' failed. Not Retrying. {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 03 18:33:05 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[56de3b82-277d-4b54-8aa3-414bd56b5bd9]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:33:05 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-9b307ece-0b06-4322-aa76-16b344aa412c tempest-VolumesImageMetadata-250582937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_83b28d58-14b6-4404-8354-5cfe237c5c95_ehfb2xyzdevstack@QuobyteHD {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:33:05 devstack sudo[98875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_83b28d58-14b6-4404-8354-5cfe237c5c95_ehfb2xyzdevstack@QuobyteHD
Nov 03 18:33:05 devstack sudo[98875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:33:05 devstack sudo[98875]: pam_unix(sudo:session): session closed for user root
Nov 03 18:33:05 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-9b307ece-0b06-4322-aa76-16b344aa412c tempest-VolumesImageMetadata-250582937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_83b28d58-14b6-4404-8354-5cfe237c5c95_ehfb2xyzdevstack@QuobyteHD" returned: 0 in 0.369s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:33:05 devstack cinder-volume[86120]: DEBUG cinder.image.image_utils [None req-9b307ece-0b06-4322-aa76-16b344aa412c tempest-VolumesImageMetadata-250582937 None] 83b28d58-14b6-4404-8354-5cfe237c5c95 was qcow2, converting to qcow2 {{(pid=86120) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 03 18:33:05 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-9b307ece-0b06-4322-aa76-16b344aa412c tempest-VolumesImageMetadata-250582937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_83b28d58-14b6-4404-8354-5cfe237c5c95_ehfb2xyzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-25daef7e-d3aa-4729-b859-4f4cdf10d20c {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:33:05 devstack sudo[98880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_83b28d58-14b6-4404-8354-5cfe237c5c95_ehfb2xyzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-25daef7e-d3aa-4729-b859-4f4cdf10d20c
Nov 03 18:33:05 devstack sudo[98880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:33:08 devstack sudo[98880]: pam_unix(sudo:session): session closed for user root
Nov 03 18:33:08 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-9b307ece-0b06-4322-aa76-16b344aa412c tempest-VolumesImageMetadata-250582937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_83b28d58-14b6-4404-8354-5cfe237c5c95_ehfb2xyzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-25daef7e-d3aa-4729-b859-4f4cdf10d20c" returned: 0 in 2.293s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:33:08 devstack cinder-volume[86120]: DEBUG cinder.image.image_utils [None req-9b307ece-0b06-4322-aa76-16b344aa412c tempest-VolumesImageMetadata-250582937 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_83b28d58-14b6-4404-8354-5cfe237c5c95_ehfb2xyzdevstack@QuobyteHD, size 112.00 MB, duration 2.29 sec, destination /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-25daef7e-d3aa-4729-b859-4f4cdf10d20c {{(pid=86120) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 03 18:33:08 devstack cinder-volume[86120]: INFO cinder.image.image_utils [None req-9b307ece-0b06-4322-aa76-16b344aa412c tempest-VolumesImageMetadata-250582937 None] Converted 112.00 MB image at 48.82 MB/s
Nov 03 18:33:08 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-9b307ece-0b06-4322-aa76-16b344aa412c tempest-VolumesImageMetadata-250582937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-25daef7e-d3aa-4729-b859-4f4cdf10d20c 1G {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:33:08 devstack sudo[98891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-25daef7e-d3aa-4729-b859-4f4cdf10d20c 1G
Nov 03 18:33:08 devstack sudo[98891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:33:08 devstack sudo[98891]: pam_unix(sudo:session): session closed for user root
Nov 03 18:33:08 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-9b307ece-0b06-4322-aa76-16b344aa412c tempest-VolumesImageMetadata-250582937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-25daef7e-d3aa-4729-b859-4f4cdf10d20c 1G" returned: 0 in 0.392s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:33:08 devstack cinder-volume[86120]: DEBUG cinder.volume.volume_utils [None req-9b307ece-0b06-4322-aa76-16b344aa412c tempest-VolumesImageMetadata-250582937 None] Downloaded image 83b28d58-14b6-4404-8354-5cfe237c5c95 ((None, [{'url': 'file:///opt/stack/data/glance/images/83b28d58-14b6-4404-8354-5cfe237c5c95', 'metadata': {}}])) to volume 25daef7e-d3aa-4729-b859-4f4cdf10d20c successfully. {{(pid=86120) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 03 18:33:08 devstack cinder-volume[86120]: DEBUG cinder.image.image_utils [None req-9b307ece-0b06-4322-aa76-16b344aa412c tempest-VolumesImageMetadata-250582937 None] Temporary image 83b28d58-14b6-4404-8354-5cfe237c5c95 for user 96bdca601e084444bdb136c042c8899b is deleted. {{(pid=86120) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 03 18:33:08 devstack cinder-volume[86120]: DEBUG cinder.volume.volume_utils [None req-9b307ece-0b06-4322-aa76-16b344aa412c tempest-VolumesImageMetadata-250582937 None] Marking volume 25daef7e-d3aa-4729-b859-4f4cdf10d20c as bootable. {{(pid=86120) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 03 18:33:08 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b307ece-0b06-4322-aa76-16b344aa412c tempest-VolumesImageMetadata-250582937 None] Copying metadata from image 83b28d58-14b6-4404-8354-5cfe237c5c95 to 25daef7e-d3aa-4729-b859-4f4cdf10d20c. {{(pid=86120) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 03 18:33:08 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b307ece-0b06-4322-aa76-16b344aa412c tempest-VolumesImageMetadata-250582937 None] Creating volume glance metadata for volume 25daef7e-d3aa-4729-b859-4f4cdf10d20c backed by image 83b28d58-14b6-4404-8354-5cfe237c5c95 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '83b28d58-14b6-4404-8354-5cfe237c5c95', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86120) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 03 18:33:08 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-9b307ece-0b06-4322-aa76-16b344aa412c tempest-VolumesImageMetadata-250582937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (862c4108-16aa-4a1c-b4dd-45da6d5df1ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25daef7e-d3aa-4729-b859-4f4cdf10d20c', 'volume_size': 1, 'image_id': '83b28d58-14b6-4404-8354-5cfe237c5c95', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/83b28d58-14b6-4404-8354-5cfe237c5c95', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4b0f900e807a4827ba1f8686981981d9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '83b28d58-14b6-4404-8354-5cfe237c5c95', 'created_at': datetime.datetime(2026, 11, 3, 17, 17, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 17, 17, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/83b28d58-14b6-4404-8354-5cfe237c5c95/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7a8d3c5f4aa0>}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:33:08 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-9b307ece-0b06-4322-aa76-16b344aa412c tempest-VolumesImageMetadata-250582937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d42ef66f-11b1-4920-b978-ced4f9af83a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:33:08 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-9b307ece-0b06-4322-aa76-16b344aa412c tempest-VolumesImageMetadata-250582937 None] Volume volume-25daef7e-d3aa-4729-b859-4f4cdf10d20c (25daef7e-d3aa-4729-b859-4f4cdf10d20c): created successfully
Nov 03 18:33:08 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-9b307ece-0b06-4322-aa76-16b344aa412c tempest-VolumesImageMetadata-250582937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d42ef66f-11b1-4920-b978-ced4f9af83a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:33:08 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-9b307ece-0b06-4322-aa76-16b344aa412c tempest-VolumesImageMetadata-250582937 None] Flow 'volume_create_manager' (154fd826-7552-4e73-be15-df18174beaa3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:33:08 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-9b307ece-0b06-4322-aa76-16b344aa412c tempest-VolumesImageMetadata-250582937 None] Created volume successfully.
Nov 03 18:33:10 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-14864a2c-d387-4ce7-b564-af2306266a13 tempest-VolumesImageMetadata-250582937 None] Acquiring lock "cinder-25daef7e-d3aa-4729-b859-4f4cdf10d20c-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:33:10 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-14864a2c-d387-4ce7-b564-af2306266a13 tempest-VolumesImageMetadata-250582937 None] Lock "cinder-25daef7e-d3aa-4729-b859-4f4cdf10d20c-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:33:10 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-14864a2c-d387-4ce7-b564-af2306266a13 tempest-VolumesImageMetadata-250582937 None] Acquiring lock "cinder-quobyte-25daef7e-d3aa-4729-b859-4f4cdf10d20c" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:33:10 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-14864a2c-d387-4ce7-b564-af2306266a13 tempest-VolumesImageMetadata-250582937 None] Lock "cinder-quobyte-25daef7e-d3aa-4729-b859-4f4cdf10d20c" acquired by "delete_volume" :: waited 0.019s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:33:10 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee15c9eb-47a0-4f48-b1d3-1755a286f6e5]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:33:10 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-14864a2c-d387-4ce7-b564-af2306266a13 tempest-VolumesImageMetadata-250582937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-25daef7e-d3aa-4729-b859-4f4cdf10d20c {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:33:10 devstack sudo[98923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-25daef7e-d3aa-4729-b859-4f4cdf10d20c
Nov 03 18:33:10 devstack sudo[98923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:33:11 devstack sudo[98923]: pam_unix(sudo:session): session closed for user root
Nov 03 18:33:11 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-14864a2c-d387-4ce7-b564-af2306266a13 tempest-VolumesImageMetadata-250582937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-25daef7e-d3aa-4729-b859-4f4cdf10d20c" returned: 0 in 0.432s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:33:11 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-14864a2c-d387-4ce7-b564-af2306266a13 tempest-VolumesImageMetadata-250582937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-25daef7e-d3aa-4729-b859-4f4cdf10d20c {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:33:11 devstack sudo[98930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-25daef7e-d3aa-4729-b859-4f4cdf10d20c
Nov 03 18:33:11 devstack sudo[98930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:33:11 devstack sudo[98930]: pam_unix(sudo:session): session closed for user root
Nov 03 18:33:11 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-14864a2c-d387-4ce7-b564-af2306266a13 tempest-VolumesImageMetadata-250582937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-25daef7e-d3aa-4729-b859-4f4cdf10d20c" returned: 0 in 0.363s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:33:11 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-14864a2c-d387-4ce7-b564-af2306266a13 tempest-VolumesImageMetadata-250582937 None] Lock "cinder-quobyte-25daef7e-d3aa-4729-b859-4f4cdf10d20c" released by "delete_volume" :: held 0.845s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:33:11 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-14864a2c-d387-4ce7-b564-af2306266a13 tempest-VolumesImageMetadata-250582937 None] Created reservations ['e44d9e1f-027e-41cb-bdfc-ab5f8056cbac', 'a3660964-f326-41f4-813a-58b6c884c29b', '0f1fb21a-4afa-4d50-864a-9dcf27bd1f3d', 'f73ad016-2cf5-483c-8670-9676405e1792'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:33:11 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-14864a2c-d387-4ce7-b564-af2306266a13 tempest-VolumesImageMetadata-250582937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:33:11 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-14864a2c-d387-4ce7-b564-af2306266a13 tempest-VolumesImageMetadata-250582937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:33:11 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-14864a2c-d387-4ce7-b564-af2306266a13 tempest-VolumesImageMetadata-250582937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:33:11 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-14864a2c-d387-4ce7-b564-af2306266a13 tempest-VolumesImageMetadata-250582937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:33:11 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-14864a2c-d387-4ce7-b564-af2306266a13 tempest-VolumesImageMetadata-250582937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:33:11 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-14864a2c-d387-4ce7-b564-af2306266a13 tempest-VolumesImageMetadata-250582937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:33:11 devstack sudo[98933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:33:11 devstack sudo[98933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:33:12 devstack sudo[98933]: pam_unix(sudo:session): session closed for user root
Nov 03 18:33:12 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-14864a2c-d387-4ce7-b564-af2306266a13 tempest-VolumesImageMetadata-250582937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.316s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:33:12 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-14864a2c-d387-4ce7-b564-af2306266a13 tempest-VolumesImageMetadata-250582937 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:33:12 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-14864a2c-d387-4ce7-b564-af2306266a13 tempest-VolumesImageMetadata-250582937 None] Deleted volume successfully.
Nov 03 18:33:12 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-14864a2c-d387-4ce7-b564-af2306266a13 tempest-VolumesImageMetadata-250582937 None] Lock "cinder-25daef7e-d3aa-4729-b859-4f4cdf10d20c-delete_volume" released by "delete_volume" :: held 1.417s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:33:14 devstack cinder-volume[86120]: DEBUG oslo_service.periodic_task [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86120) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 18:33:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:33:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:33:14 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:33:14 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:33:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:33:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:33:15 devstack sudo[98944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:33:15 devstack sudo[98944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:33:15 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.335s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:33:15 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:33:15 devstack sudo[98944]: pam_unix(sudo:session): session closed for user root
Nov 03 18:33:15 devstack cinder-volume[86120]: DEBUG oslo_service.periodic_task [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Running periodic task VolumeManager._thread_info {{(pid=86120) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 18:33:15 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] thread count: 28 {{(pid=86120) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 03 18:33:15 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] thread info: [<_MainThread(MainThread, started 134747145822336)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134747033686336)>, <Thread(Thread-3 (stat_writer), started daemon 134747030828736)>, <Thread(Rabbit-heartbeat, started daemon 134747035433408)>, <Thread(Thread-5 (_runner), started daemon 134747029587392)>, <Thread(Thread-7 (_runner), started daemon 134747029784256)>, <Thread(fd_logger, started daemon 134747027909120)>, <Thread(privsep_reader, started daemon 134747027006592)>, <Thread(tpool_thread_0, started daemon 134747018950336)>, <Thread(tpool_thread_1, started daemon 134747010541248)>, <Thread(tpool_thread_2, started daemon 134747002132160)>, <Thread(tpool_thread_3, started daemon 134746993723072)>, <Thread(tpool_thread_4, started daemon 134746985313984)>, <Thread(tpool_thread_5, started daemon 134746976904896)>, <Thread(tpool_thread_6, started daemon 134746968495808)>, <Thread(tpool_thread_7, started daemon 134746960086720)>, <Thread(tpool_thread_8, started daemon 134746951677632)>, <Thread(tpool_thread_9, started daemon 134746943268544)>, <Thread(tpool_thread_10, started daemon 134746934859456)>, <Thread(tpool_thread_11, started daemon 134746926450368)>, <Thread(tpool_thread_12, started daemon 134746918041280)>, <Thread(tpool_thread_13, started daemon 134746909632192)>, <Thread(tpool_thread_14, started daemon 134746901223104)>, <Thread(tpool_thread_15, started daemon 134746892814016)>, <Thread(tpool_thread_16, started daemon 134746884404928)>, <Thread(tpool_thread_17, started daemon 134746875995840)>, <Thread(tpool_thread_18, started daemon 134746867586752)>, <Thread(tpool_thread_19, started daemon 134746859177664)>] {{(pid=86120) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 03 18:33:15 devstack cinder-volume[86120]: INFO cinder.volume.manager [req-a3e16247-a3df-4a27-9e81-92fa40e76307 req-ef36d079-196d-4f90-b918-5408f00b30d0 tempest-AttachVolumeNegativeTest-621877883 None] Terminate volume connection completed successfully.
Nov 03 18:33:15 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [req-a3e16247-a3df-4a27-9e81-92fa40e76307 req-ef36d079-196d-4f90-b918-5408f00b30d0 tempest-AttachVolumeNegativeTest-621877883 None] Deleting attachment 9505ca91-3a76-4afa-8d94-3224bfdc9b82. {{(pid=86120) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 03 18:33:17 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8cabcc5-3bc6-46b3-8971-1f6e40c0c6e4 tempest-AbsoluteLimitsTests-1720031265 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:33:17 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-b8cabcc5-3bc6-46b3-8971-1f6e40c0c6e4 tempest-AbsoluteLimitsTests-1720031265 None] Flow 'volume_create_manager' (77a84346-2962-4fc2-a210-1067c6970667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:33:17 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-b8cabcc5-3bc6-46b3-8971-1f6e40c0c6e4 tempest-AbsoluteLimitsTests-1720031265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d72609c-a105-4e3a-a6d8-8e5b9bc945e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:33:17 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-b8cabcc5-3bc6-46b3-8971-1f6e40c0c6e4 tempest-AbsoluteLimitsTests-1720031265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d72609c-a105-4e3a-a6d8-8e5b9bc945e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:33:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1965776772',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92d3288c-6b74-41dd-a2d2-9dde638e3f33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c084ac2bb964d9990a327aef0687aaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:33:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:33:18Z,use_quota=True,user_id='73f88fd7a0d045449026ded87a313dce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:33:17 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-b8cabcc5-3bc6-46b3-8971-1f6e40c0c6e4 tempest-AbsoluteLimitsTests-1720031265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23e9590a-cc84-4bd0-99c9-8300ab313e19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:33:17 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-b8cabcc5-3bc6-46b3-8971-1f6e40c0c6e4 tempest-AbsoluteLimitsTests-1720031265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23e9590a-cc84-4bd0-99c9-8300ab313e19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:33:17 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-b8cabcc5-3bc6-46b3-8971-1f6e40c0c6e4 tempest-AbsoluteLimitsTests-1720031265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1121607-9c03-403b-be18-eb18f0a31425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:33:17 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-b8cabcc5-3bc6-46b3-8971-1f6e40c0c6e4 tempest-AbsoluteLimitsTests-1720031265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1121607-9c03-403b-be18-eb18f0a31425) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92d3288c-6b74-41dd-a2d2-9dde638e3f33', 'volume_name': 'volume-92d3288c-6b74-41dd-a2d2-9dde638e3f33', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:33:17 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-b8cabcc5-3bc6-46b3-8971-1f6e40c0c6e4 tempest-AbsoluteLimitsTests-1720031265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94bb31de-93fe-4509-9b66-a97cbe52dc83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:33:17 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-b8cabcc5-3bc6-46b3-8971-1f6e40c0c6e4 tempest-AbsoluteLimitsTests-1720031265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94bb31de-93fe-4509-9b66-a97cbe52dc83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:33:17 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-b8cabcc5-3bc6-46b3-8971-1f6e40c0c6e4 tempest-AbsoluteLimitsTests-1720031265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de0ab1e7-43cb-406b-b67d-2f7e3d9fe371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:33:17 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-b8cabcc5-3bc6-46b3-8971-1f6e40c0c6e4 tempest-AbsoluteLimitsTests-1720031265 None] Volume 92d3288c-6b74-41dd-a2d2-9dde638e3f33: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92d3288c-6b74-41dd-a2d2-9dde638e3f33', 'volume_size': 1}
Nov 03 18:33:17 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-b8cabcc5-3bc6-46b3-8971-1f6e40c0c6e4 tempest-AbsoluteLimitsTests-1720031265 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:33:17 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-b8cabcc5-3bc6-46b3-8971-1f6e40c0c6e4 tempest-AbsoluteLimitsTests-1720031265 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:33:17 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-b8cabcc5-3bc6-46b3-8971-1f6e40c0c6e4 tempest-AbsoluteLimitsTests-1720031265 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:33:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1965776772',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92d3288c-6b74-41dd-a2d2-9dde638e3f33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c084ac2bb964d9990a327aef0687aaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:33:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:33:18Z,use_quota=True,user_id='73f88fd7a0d045449026ded87a313dce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:33:17 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-b8cabcc5-3bc6-46b3-8971-1f6e40c0c6e4 tempest-AbsoluteLimitsTests-1720031265 None] Creating volume 92d3288c-6b74-41dd-a2d2-9dde638e3f33 {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:33:17 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-b8cabcc5-3bc6-46b3-8971-1f6e40c0c6e4 tempest-AbsoluteLimitsTests-1720031265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:33:17 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-b8cabcc5-3bc6-46b3-8971-1f6e40c0c6e4 tempest-AbsoluteLimitsTests-1720031265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:33:17 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-b8cabcc5-3bc6-46b3-8971-1f6e40c0c6e4 tempest-AbsoluteLimitsTests-1720031265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:33:17 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-b8cabcc5-3bc6-46b3-8971-1f6e40c0c6e4 tempest-AbsoluteLimitsTests-1720031265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:33:17 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-b8cabcc5-3bc6-46b3-8971-1f6e40c0c6e4 tempest-AbsoluteLimitsTests-1720031265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:33:17 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-b8cabcc5-3bc6-46b3-8971-1f6e40c0c6e4 tempest-AbsoluteLimitsTests-1720031265 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:33:17 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-b8cabcc5-3bc6-46b3-8971-1f6e40c0c6e4 tempest-AbsoluteLimitsTests-1720031265 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:33:17 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b8cabcc5-3bc6-46b3-8971-1f6e40c0c6e4 tempest-AbsoluteLimitsTests-1720031265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-92d3288c-6b74-41dd-a2d2-9dde638e3f33 1073741824 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:33:17 devstack sudo[98971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-92d3288c-6b74-41dd-a2d2-9dde638e3f33 1073741824
Nov 03 18:33:17 devstack sudo[98971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:33:18 devstack sudo[98971]: pam_unix(sudo:session): session closed for user root
Nov 03 18:33:18 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b8cabcc5-3bc6-46b3-8971-1f6e40c0c6e4 tempest-AbsoluteLimitsTests-1720031265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-92d3288c-6b74-41dd-a2d2-9dde638e3f33 1073741824" returned: 0 in 0.511s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:33:18 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b8cabcc5-3bc6-46b3-8971-1f6e40c0c6e4 tempest-AbsoluteLimitsTests-1720031265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-92d3288c-6b74-41dd-a2d2-9dde638e3f33 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:33:18 devstack sudo[98979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-92d3288c-6b74-41dd-a2d2-9dde638e3f33
Nov 03 18:33:18 devstack sudo[98979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:33:18 devstack sudo[98979]: pam_unix(sudo:session): session closed for user root
Nov 03 18:33:18 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b8cabcc5-3bc6-46b3-8971-1f6e40c0c6e4 tempest-AbsoluteLimitsTests-1720031265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-92d3288c-6b74-41dd-a2d2-9dde638e3f33" returned: 0 in 0.272s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:33:18 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-b8cabcc5-3bc6-46b3-8971-1f6e40c0c6e4 tempest-AbsoluteLimitsTests-1720031265 None] <== create_volume: return (845ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:33:18 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-b8cabcc5-3bc6-46b3-8971-1f6e40c0c6e4 tempest-AbsoluteLimitsTests-1720031265 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.849s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:33:18 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-b8cabcc5-3bc6-46b3-8971-1f6e40c0c6e4 tempest-AbsoluteLimitsTests-1720031265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de0ab1e7-43cb-406b-b67d-2f7e3d9fe371) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92d3288c-6b74-41dd-a2d2-9dde638e3f33', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:33:18 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-b8cabcc5-3bc6-46b3-8971-1f6e40c0c6e4 tempest-AbsoluteLimitsTests-1720031265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f544fac9-ec4c-4738-863f-ceb01ab2896d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:33:18 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-b8cabcc5-3bc6-46b3-8971-1f6e40c0c6e4 tempest-AbsoluteLimitsTests-1720031265 None] Volume volume-92d3288c-6b74-41dd-a2d2-9dde638e3f33 (92d3288c-6b74-41dd-a2d2-9dde638e3f33): created successfully
Nov 03 18:33:18 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-b8cabcc5-3bc6-46b3-8971-1f6e40c0c6e4 tempest-AbsoluteLimitsTests-1720031265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f544fac9-ec4c-4738-863f-ceb01ab2896d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:33:18 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-b8cabcc5-3bc6-46b3-8971-1f6e40c0c6e4 tempest-AbsoluteLimitsTests-1720031265 None] Flow 'volume_create_manager' (77a84346-2962-4fc2-a210-1067c6970667) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:33:18 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-b8cabcc5-3bc6-46b3-8971-1f6e40c0c6e4 tempest-AbsoluteLimitsTests-1720031265 None] Created volume successfully.
Nov 03 18:33:20 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-e6d7f30b-22c0-4d67-9014-2e80ea3c2950 tempest-AbsoluteLimitsTests-1720031265 None] Acquiring lock "cinder-92d3288c-6b74-41dd-a2d2-9dde638e3f33-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:33:20 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-e6d7f30b-22c0-4d67-9014-2e80ea3c2950 tempest-AbsoluteLimitsTests-1720031265 None] Lock "cinder-92d3288c-6b74-41dd-a2d2-9dde638e3f33-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:33:20 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-e6d7f30b-22c0-4d67-9014-2e80ea3c2950 tempest-AbsoluteLimitsTests-1720031265 None] Acquiring lock "cinder-quobyte-92d3288c-6b74-41dd-a2d2-9dde638e3f33" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:33:20 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-e6d7f30b-22c0-4d67-9014-2e80ea3c2950 tempest-AbsoluteLimitsTests-1720031265 None] Lock "cinder-quobyte-92d3288c-6b74-41dd-a2d2-9dde638e3f33" acquired by "delete_volume" :: waited 0.017s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:33:20 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d56c9fc-3574-402b-bec5-16a4c261bd50]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:33:20 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-e6d7f30b-22c0-4d67-9014-2e80ea3c2950 tempest-AbsoluteLimitsTests-1720031265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-92d3288c-6b74-41dd-a2d2-9dde638e3f33 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:33:20 devstack sudo[98984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-92d3288c-6b74-41dd-a2d2-9dde638e3f33
Nov 03 18:33:20 devstack sudo[98984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:33:20 devstack sudo[98984]: pam_unix(sudo:session): session closed for user root
Nov 03 18:33:20 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-e6d7f30b-22c0-4d67-9014-2e80ea3c2950 tempest-AbsoluteLimitsTests-1720031265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-92d3288c-6b74-41dd-a2d2-9dde638e3f33" returned: 0 in 0.450s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:33:20 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-e6d7f30b-22c0-4d67-9014-2e80ea3c2950 tempest-AbsoluteLimitsTests-1720031265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-92d3288c-6b74-41dd-a2d2-9dde638e3f33 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:33:20 devstack sudo[98989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-92d3288c-6b74-41dd-a2d2-9dde638e3f33
Nov 03 18:33:20 devstack sudo[98989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:33:20 devstack sudo[98989]: pam_unix(sudo:session): session closed for user root
Nov 03 18:33:20 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-e6d7f30b-22c0-4d67-9014-2e80ea3c2950 tempest-AbsoluteLimitsTests-1720031265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-92d3288c-6b74-41dd-a2d2-9dde638e3f33" returned: 0 in 0.292s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:33:20 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-e6d7f30b-22c0-4d67-9014-2e80ea3c2950 tempest-AbsoluteLimitsTests-1720031265 None] Lock "cinder-quobyte-92d3288c-6b74-41dd-a2d2-9dde638e3f33" released by "delete_volume" :: held 0.796s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:33:21 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-e6d7f30b-22c0-4d67-9014-2e80ea3c2950 tempest-AbsoluteLimitsTests-1720031265 None] Created reservations ['ee91fe9a-8e6d-4132-ac42-be37e0f0483e', '34aefa16-05f6-4feb-bacb-4bffb281a315', '072af786-2182-4b87-badd-27dc15e29352', '916f37c0-fe24-48bc-9c3c-63de5997378b'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:33:21 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-e6d7f30b-22c0-4d67-9014-2e80ea3c2950 tempest-AbsoluteLimitsTests-1720031265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:33:21 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-e6d7f30b-22c0-4d67-9014-2e80ea3c2950 tempest-AbsoluteLimitsTests-1720031265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:33:21 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-e6d7f30b-22c0-4d67-9014-2e80ea3c2950 tempest-AbsoluteLimitsTests-1720031265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:33:21 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-e6d7f30b-22c0-4d67-9014-2e80ea3c2950 tempest-AbsoluteLimitsTests-1720031265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:33:21 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-e6d7f30b-22c0-4d67-9014-2e80ea3c2950 tempest-AbsoluteLimitsTests-1720031265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:33:21 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-e6d7f30b-22c0-4d67-9014-2e80ea3c2950 tempest-AbsoluteLimitsTests-1720031265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:33:21 devstack sudo[98992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:33:21 devstack sudo[98992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:33:21 devstack sudo[98992]: pam_unix(sudo:session): session closed for user root
Nov 03 18:33:21 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-e6d7f30b-22c0-4d67-9014-2e80ea3c2950 tempest-AbsoluteLimitsTests-1720031265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.409s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:33:21 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-e6d7f30b-22c0-4d67-9014-2e80ea3c2950 tempest-AbsoluteLimitsTests-1720031265 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:33:21 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-e6d7f30b-22c0-4d67-9014-2e80ea3c2950 tempest-AbsoluteLimitsTests-1720031265 None] Deleted volume successfully.
Nov 03 18:33:21 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-e6d7f30b-22c0-4d67-9014-2e80ea3c2950 tempest-AbsoluteLimitsTests-1720031265 None] Lock "cinder-92d3288c-6b74-41dd-a2d2-9dde638e3f33-delete_volume" released by "delete_volume" :: held 1.475s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:33:30 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-0cba585d-436b-470d-aa67-a4241d87961f tempest-TestStampPattern-2051953486 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:33:30 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-0cba585d-436b-470d-aa67-a4241d87961f tempest-TestStampPattern-2051953486 None] Flow 'volume_create_manager' (3b755d1b-ecea-401a-9b25-e6b1dce91d65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:33:30 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-0cba585d-436b-470d-aa67-a4241d87961f tempest-TestStampPattern-2051953486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6334057-f36b-4d39-b63c-5c9fcc87acb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:33:30 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-0cba585d-436b-470d-aa67-a4241d87961f tempest-TestStampPattern-2051953486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6334057-f36b-4d39-b63c-5c9fcc87acb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:33:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-708345053',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=261b681b-c984-43e5-abdb-a2acaaf9e6e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ee78a679e784b79b4c5c5d37b22ba4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:33:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:33:30Z,use_quota=True,user_id='f5eac2c8508245e49b3aa55495ee9f16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:33:30 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-0cba585d-436b-470d-aa67-a4241d87961f tempest-TestStampPattern-2051953486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55b519b5-b94c-416b-9a92-87e29c6f7964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:33:30 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-0cba585d-436b-470d-aa67-a4241d87961f tempest-TestStampPattern-2051953486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55b519b5-b94c-416b-9a92-87e29c6f7964) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:33:30 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-0cba585d-436b-470d-aa67-a4241d87961f tempest-TestStampPattern-2051953486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (446f48c0-a995-4cc2-af80-3c77cdd96b95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:33:30 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-0cba585d-436b-470d-aa67-a4241d87961f tempest-TestStampPattern-2051953486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (446f48c0-a995-4cc2-af80-3c77cdd96b95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '261b681b-c984-43e5-abdb-a2acaaf9e6e1', 'volume_name': 'volume-261b681b-c984-43e5-abdb-a2acaaf9e6e1', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:33:30 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-0cba585d-436b-470d-aa67-a4241d87961f tempest-TestStampPattern-2051953486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1473900-adb0-441a-8d38-c46260778ca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:33:30 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-0cba585d-436b-470d-aa67-a4241d87961f tempest-TestStampPattern-2051953486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1473900-adb0-441a-8d38-c46260778ca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:33:30 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-0cba585d-436b-470d-aa67-a4241d87961f tempest-TestStampPattern-2051953486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f62bc683-3440-463f-9a60-be0b5bb4089f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:33:30 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-0cba585d-436b-470d-aa67-a4241d87961f tempest-TestStampPattern-2051953486 None] Volume 261b681b-c984-43e5-abdb-a2acaaf9e6e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-261b681b-c984-43e5-abdb-a2acaaf9e6e1', 'volume_size': 1}
Nov 03 18:33:30 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-0cba585d-436b-470d-aa67-a4241d87961f tempest-TestStampPattern-2051953486 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:33:30 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-0cba585d-436b-470d-aa67-a4241d87961f tempest-TestStampPattern-2051953486 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:33:30 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-0cba585d-436b-470d-aa67-a4241d87961f tempest-TestStampPattern-2051953486 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:33:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-708345053',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=261b681b-c984-43e5-abdb-a2acaaf9e6e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ee78a679e784b79b4c5c5d37b22ba4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:33:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:33:30Z,use_quota=True,user_id='f5eac2c8508245e49b3aa55495ee9f16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:33:30 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-0cba585d-436b-470d-aa67-a4241d87961f tempest-TestStampPattern-2051953486 None] Creating volume 261b681b-c984-43e5-abdb-a2acaaf9e6e1 {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:33:30 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-0cba585d-436b-470d-aa67-a4241d87961f tempest-TestStampPattern-2051953486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:33:30 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-0cba585d-436b-470d-aa67-a4241d87961f tempest-TestStampPattern-2051953486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:33:30 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-0cba585d-436b-470d-aa67-a4241d87961f tempest-TestStampPattern-2051953486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:33:30 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-0cba585d-436b-470d-aa67-a4241d87961f tempest-TestStampPattern-2051953486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:33:30 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-0cba585d-436b-470d-aa67-a4241d87961f tempest-TestStampPattern-2051953486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:33:30 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-0cba585d-436b-470d-aa67-a4241d87961f tempest-TestStampPattern-2051953486 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:33:30 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-0cba585d-436b-470d-aa67-a4241d87961f tempest-TestStampPattern-2051953486 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:33:30 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-0cba585d-436b-470d-aa67-a4241d87961f tempest-TestStampPattern-2051953486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-261b681b-c984-43e5-abdb-a2acaaf9e6e1 1073741824 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:33:30 devstack sudo[99038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-261b681b-c984-43e5-abdb-a2acaaf9e6e1 1073741824
Nov 03 18:33:30 devstack sudo[99038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:33:30 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-d59f3ff2-1fde-425e-b7a4-ed2b9988d523 tempest-VolumesListTestJSON-1713017889 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:33:30 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-d59f3ff2-1fde-425e-b7a4-ed2b9988d523 tempest-VolumesListTestJSON-1713017889 None] Flow 'volume_create_manager' (65898c0b-d86e-48f1-b389-4427fdf79bce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:33:30 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-d59f3ff2-1fde-425e-b7a4-ed2b9988d523 tempest-VolumesListTestJSON-1713017889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64011a58-a743-41bf-80ca-4c684dbc4e94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:33:30 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-d59f3ff2-1fde-425e-b7a4-ed2b9988d523 tempest-VolumesListTestJSON-1713017889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64011a58-a743-41bf-80ca-4c684dbc4e94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:33:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1140634235',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14a0f0eb-34ac-4bab-a567-ee431d3b17f7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='416c420f10cc496dabf30942dbd2d482',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:33:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:33:31Z,use_quota=True,user_id='87d426ab02ec487ca0d5267731615fba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:33:30 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-d59f3ff2-1fde-425e-b7a4-ed2b9988d523 tempest-VolumesListTestJSON-1713017889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bc2098c-e869-4596-af4a-4be8790f75ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:33:30 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-d59f3ff2-1fde-425e-b7a4-ed2b9988d523 tempest-VolumesListTestJSON-1713017889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bc2098c-e869-4596-af4a-4be8790f75ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:33:30 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-d59f3ff2-1fde-425e-b7a4-ed2b9988d523 tempest-VolumesListTestJSON-1713017889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b71f69a7-71dd-4791-b08a-f3cf567b7d25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:33:31 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-d59f3ff2-1fde-425e-b7a4-ed2b9988d523 tempest-VolumesListTestJSON-1713017889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b71f69a7-71dd-4791-b08a-f3cf567b7d25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14a0f0eb-34ac-4bab-a567-ee431d3b17f7', 'volume_name': 'volume-14a0f0eb-34ac-4bab-a567-ee431d3b17f7', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:33:31 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-d59f3ff2-1fde-425e-b7a4-ed2b9988d523 tempest-VolumesListTestJSON-1713017889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67047d93-9a8b-4970-9b5c-0b0b9d76dbe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:33:31 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-d59f3ff2-1fde-425e-b7a4-ed2b9988d523 tempest-VolumesListTestJSON-1713017889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67047d93-9a8b-4970-9b5c-0b0b9d76dbe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:33:31 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-d59f3ff2-1fde-425e-b7a4-ed2b9988d523 tempest-VolumesListTestJSON-1713017889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24f3ba4f-b300-4ff1-a970-3dc3cd55e9c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:33:31 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-d59f3ff2-1fde-425e-b7a4-ed2b9988d523 tempest-VolumesListTestJSON-1713017889 None] Volume 14a0f0eb-34ac-4bab-a567-ee431d3b17f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14a0f0eb-34ac-4bab-a567-ee431d3b17f7', 'volume_size': 1}
Nov 03 18:33:31 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-d59f3ff2-1fde-425e-b7a4-ed2b9988d523 tempest-VolumesListTestJSON-1713017889 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:33:31 devstack sudo[99038]: pam_unix(sudo:session): session closed for user root
Nov 03 18:33:31 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-0cba585d-436b-470d-aa67-a4241d87961f tempest-TestStampPattern-2051953486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-261b681b-c984-43e5-abdb-a2acaaf9e6e1 1073741824" returned: 0 in 0.702s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:33:31 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-0cba585d-436b-470d-aa67-a4241d87961f tempest-TestStampPattern-2051953486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-261b681b-c984-43e5-abdb-a2acaaf9e6e1 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:33:31 devstack sudo[99060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-261b681b-c984-43e5-abdb-a2acaaf9e6e1
Nov 03 18:33:31 devstack sudo[99060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:33:31 devstack sudo[99060]: pam_unix(sudo:session): session closed for user root
Nov 03 18:33:31 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-0cba585d-436b-470d-aa67-a4241d87961f tempest-TestStampPattern-2051953486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-261b681b-c984-43e5-abdb-a2acaaf9e6e1" returned: 0 in 0.266s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:33:31 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-0cba585d-436b-470d-aa67-a4241d87961f tempest-TestStampPattern-2051953486 None] <== create_volume: return (1016ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:33:31 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-0cba585d-436b-470d-aa67-a4241d87961f tempest-TestStampPattern-2051953486 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.018s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:33:31 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-d59f3ff2-1fde-425e-b7a4-ed2b9988d523 tempest-VolumesListTestJSON-1713017889 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.638s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:33:31 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-d59f3ff2-1fde-425e-b7a4-ed2b9988d523 tempest-VolumesListTestJSON-1713017889 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:33:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1140634235',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14a0f0eb-34ac-4bab-a567-ee431d3b17f7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='416c420f10cc496dabf30942dbd2d482',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:33:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:33:31Z,use_quota=True,user_id='87d426ab02ec487ca0d5267731615fba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:33:31 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-d59f3ff2-1fde-425e-b7a4-ed2b9988d523 tempest-VolumesListTestJSON-1713017889 None] Creating volume 14a0f0eb-34ac-4bab-a567-ee431d3b17f7 {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:33:31 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-d59f3ff2-1fde-425e-b7a4-ed2b9988d523 tempest-VolumesListTestJSON-1713017889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:33:31 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-d59f3ff2-1fde-425e-b7a4-ed2b9988d523 tempest-VolumesListTestJSON-1713017889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:33:31 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-d59f3ff2-1fde-425e-b7a4-ed2b9988d523 tempest-VolumesListTestJSON-1713017889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:33:31 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-d59f3ff2-1fde-425e-b7a4-ed2b9988d523 tempest-VolumesListTestJSON-1713017889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:33:31 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-d59f3ff2-1fde-425e-b7a4-ed2b9988d523 tempest-VolumesListTestJSON-1713017889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:33:31 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-d59f3ff2-1fde-425e-b7a4-ed2b9988d523 tempest-VolumesListTestJSON-1713017889 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:33:31 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-d59f3ff2-1fde-425e-b7a4-ed2b9988d523 tempest-VolumesListTestJSON-1713017889 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:33:31 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-d59f3ff2-1fde-425e-b7a4-ed2b9988d523 tempest-VolumesListTestJSON-1713017889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-14a0f0eb-34ac-4bab-a567-ee431d3b17f7 1073741824 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:33:31 devstack sudo[99063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-14a0f0eb-34ac-4bab-a567-ee431d3b17f7 1073741824
Nov 03 18:33:31 devstack sudo[99063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:33:31 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-0cba585d-436b-470d-aa67-a4241d87961f tempest-TestStampPattern-2051953486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f62bc683-3440-463f-9a60-be0b5bb4089f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-261b681b-c984-43e5-abdb-a2acaaf9e6e1', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:33:31 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-0cba585d-436b-470d-aa67-a4241d87961f tempest-TestStampPattern-2051953486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04024cb6-eb93-40d9-935b-0fe17a2b5b36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:33:31 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-0cba585d-436b-470d-aa67-a4241d87961f tempest-TestStampPattern-2051953486 None] Volume volume-261b681b-c984-43e5-abdb-a2acaaf9e6e1 (261b681b-c984-43e5-abdb-a2acaaf9e6e1): created successfully
Nov 03 18:33:31 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-0cba585d-436b-470d-aa67-a4241d87961f tempest-TestStampPattern-2051953486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04024cb6-eb93-40d9-935b-0fe17a2b5b36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:33:31 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-0cba585d-436b-470d-aa67-a4241d87961f tempest-TestStampPattern-2051953486 None] Flow 'volume_create_manager' (3b755d1b-ecea-401a-9b25-e6b1dce91d65) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:33:31 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-0cba585d-436b-470d-aa67-a4241d87961f tempest-TestStampPattern-2051953486 None] Created volume successfully.
Nov 03 18:33:32 devstack sudo[99063]: pam_unix(sudo:session): session closed for user root
Nov 03 18:33:32 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-d59f3ff2-1fde-425e-b7a4-ed2b9988d523 tempest-VolumesListTestJSON-1713017889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-14a0f0eb-34ac-4bab-a567-ee431d3b17f7 1073741824" returned: 0 in 0.580s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:33:32 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-d59f3ff2-1fde-425e-b7a4-ed2b9988d523 tempest-VolumesListTestJSON-1713017889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-14a0f0eb-34ac-4bab-a567-ee431d3b17f7 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:33:32 devstack sudo[99072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-14a0f0eb-34ac-4bab-a567-ee431d3b17f7
Nov 03 18:33:32 devstack sudo[99072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:33:32 devstack sudo[99072]: pam_unix(sudo:session): session closed for user root
Nov 03 18:33:32 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-d59f3ff2-1fde-425e-b7a4-ed2b9988d523 tempest-VolumesListTestJSON-1713017889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-14a0f0eb-34ac-4bab-a567-ee431d3b17f7" returned: 0 in 0.324s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:33:32 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-d59f3ff2-1fde-425e-b7a4-ed2b9988d523 tempest-VolumesListTestJSON-1713017889 None] <== create_volume: return (951ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:33:32 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-d59f3ff2-1fde-425e-b7a4-ed2b9988d523 tempest-VolumesListTestJSON-1713017889 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.958s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:33:32 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-d59f3ff2-1fde-425e-b7a4-ed2b9988d523 tempest-VolumesListTestJSON-1713017889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24f3ba4f-b300-4ff1-a970-3dc3cd55e9c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14a0f0eb-34ac-4bab-a567-ee431d3b17f7', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:33:32 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-d59f3ff2-1fde-425e-b7a4-ed2b9988d523 tempest-VolumesListTestJSON-1713017889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (725aa692-5813-4bb5-b2d5-2c20b0698278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:33:32 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-d59f3ff2-1fde-425e-b7a4-ed2b9988d523 tempest-VolumesListTestJSON-1713017889 None] Volume volume-14a0f0eb-34ac-4bab-a567-ee431d3b17f7 (14a0f0eb-34ac-4bab-a567-ee431d3b17f7): created successfully
Nov 03 18:33:32 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-d59f3ff2-1fde-425e-b7a4-ed2b9988d523 tempest-VolumesListTestJSON-1713017889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (725aa692-5813-4bb5-b2d5-2c20b0698278) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:33:32 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-d59f3ff2-1fde-425e-b7a4-ed2b9988d523 tempest-VolumesListTestJSON-1713017889 None] Flow 'volume_create_manager' (65898c0b-d86e-48f1-b389-4427fdf79bce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:33:32 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-d59f3ff2-1fde-425e-b7a4-ed2b9988d523 tempest-VolumesListTestJSON-1713017889 None] Created volume successfully.
Nov 03 18:33:33 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-66441b04-d46c-4cd8-897c-2fbc07749c08 tempest-VolumesListTestJSON-1713017889 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:33:33 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-66441b04-d46c-4cd8-897c-2fbc07749c08 tempest-VolumesListTestJSON-1713017889 None] Flow 'volume_create_manager' (559f36bd-3c0e-4c5d-8d97-4b337b12647a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:33:33 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-66441b04-d46c-4cd8-897c-2fbc07749c08 tempest-VolumesListTestJSON-1713017889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28ee815b-0155-4f07-9bf2-02d5af7128e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:33:33 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-66441b04-d46c-4cd8-897c-2fbc07749c08 tempest-VolumesListTestJSON-1713017889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28ee815b-0155-4f07-9bf2-02d5af7128e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:33:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-902947256',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5bea503-b028-46eb-a348-6c76f0b8b123,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='416c420f10cc496dabf30942dbd2d482',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:33:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:33:33Z,use_quota=True,user_id='87d426ab02ec487ca0d5267731615fba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:33:33 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-66441b04-d46c-4cd8-897c-2fbc07749c08 tempest-VolumesListTestJSON-1713017889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85b8242b-99d8-486c-83c4-448feb384d62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:33:33 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-66441b04-d46c-4cd8-897c-2fbc07749c08 tempest-VolumesListTestJSON-1713017889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85b8242b-99d8-486c-83c4-448feb384d62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:33:33 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-66441b04-d46c-4cd8-897c-2fbc07749c08 tempest-VolumesListTestJSON-1713017889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e2a13ed-eea4-4ef4-ac60-aca076d23aef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:33:33 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-66441b04-d46c-4cd8-897c-2fbc07749c08 tempest-VolumesListTestJSON-1713017889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e2a13ed-eea4-4ef4-ac60-aca076d23aef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5bea503-b028-46eb-a348-6c76f0b8b123', 'volume_name': 'volume-b5bea503-b028-46eb-a348-6c76f0b8b123', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:33:33 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-66441b04-d46c-4cd8-897c-2fbc07749c08 tempest-VolumesListTestJSON-1713017889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (319431b9-71b4-4456-8ec3-c67c8a9efe76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:33:33 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-66441b04-d46c-4cd8-897c-2fbc07749c08 tempest-VolumesListTestJSON-1713017889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (319431b9-71b4-4456-8ec3-c67c8a9efe76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:33:33 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-66441b04-d46c-4cd8-897c-2fbc07749c08 tempest-VolumesListTestJSON-1713017889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4751d96-6cc5-4ed0-981e-cd3d3ccdb1cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:33:33 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-66441b04-d46c-4cd8-897c-2fbc07749c08 tempest-VolumesListTestJSON-1713017889 None] Volume b5bea503-b028-46eb-a348-6c76f0b8b123: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5bea503-b028-46eb-a348-6c76f0b8b123', 'volume_size': 1}
Nov 03 18:33:33 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-66441b04-d46c-4cd8-897c-2fbc07749c08 tempest-VolumesListTestJSON-1713017889 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:33:33 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-66441b04-d46c-4cd8-897c-2fbc07749c08 tempest-VolumesListTestJSON-1713017889 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:33:33 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-66441b04-d46c-4cd8-897c-2fbc07749c08 tempest-VolumesListTestJSON-1713017889 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:33:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-902947256',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5bea503-b028-46eb-a348-6c76f0b8b123,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='416c420f10cc496dabf30942dbd2d482',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:33:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:33:33Z,use_quota=True,user_id='87d426ab02ec487ca0d5267731615fba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:33:33 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-66441b04-d46c-4cd8-897c-2fbc07749c08 tempest-VolumesListTestJSON-1713017889 None] Creating volume b5bea503-b028-46eb-a348-6c76f0b8b123 {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:33:33 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-66441b04-d46c-4cd8-897c-2fbc07749c08 tempest-VolumesListTestJSON-1713017889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:33:33 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-66441b04-d46c-4cd8-897c-2fbc07749c08 tempest-VolumesListTestJSON-1713017889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:33:33 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-66441b04-d46c-4cd8-897c-2fbc07749c08 tempest-VolumesListTestJSON-1713017889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:33:33 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-66441b04-d46c-4cd8-897c-2fbc07749c08 tempest-VolumesListTestJSON-1713017889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:33:33 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-66441b04-d46c-4cd8-897c-2fbc07749c08 tempest-VolumesListTestJSON-1713017889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:33:33 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-66441b04-d46c-4cd8-897c-2fbc07749c08 tempest-VolumesListTestJSON-1713017889 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:33:33 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-66441b04-d46c-4cd8-897c-2fbc07749c08 tempest-VolumesListTestJSON-1713017889 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:33:33 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-66441b04-d46c-4cd8-897c-2fbc07749c08 tempest-VolumesListTestJSON-1713017889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-b5bea503-b028-46eb-a348-6c76f0b8b123 1073741824 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:33:33 devstack sudo[99090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-b5bea503-b028-46eb-a348-6c76f0b8b123 1073741824
Nov 03 18:33:33 devstack sudo[99090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:33:34 devstack sudo[99090]: pam_unix(sudo:session): session closed for user root
Nov 03 18:33:34 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-66441b04-d46c-4cd8-897c-2fbc07749c08 tempest-VolumesListTestJSON-1713017889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-b5bea503-b028-46eb-a348-6c76f0b8b123 1073741824" returned: 0 in 1.098s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:33:34 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-66441b04-d46c-4cd8-897c-2fbc07749c08 tempest-VolumesListTestJSON-1713017889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-b5bea503-b028-46eb-a348-6c76f0b8b123 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:33:35 devstack sudo[99156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-b5bea503-b028-46eb-a348-6c76f0b8b123
Nov 03 18:33:35 devstack sudo[99156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:33:35 devstack sudo[99156]: pam_unix(sudo:session): session closed for user root
Nov 03 18:33:35 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-66441b04-d46c-4cd8-897c-2fbc07749c08 tempest-VolumesListTestJSON-1713017889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-b5bea503-b028-46eb-a348-6c76f0b8b123" returned: 0 in 0.442s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:33:35 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-66441b04-d46c-4cd8-897c-2fbc07749c08 tempest-VolumesListTestJSON-1713017889 None] <== create_volume: return (1656ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:33:35 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-66441b04-d46c-4cd8-897c-2fbc07749c08 tempest-VolumesListTestJSON-1713017889 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.663s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:33:35 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-66441b04-d46c-4cd8-897c-2fbc07749c08 tempest-VolumesListTestJSON-1713017889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4751d96-6cc5-4ed0-981e-cd3d3ccdb1cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5bea503-b028-46eb-a348-6c76f0b8b123', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:33:35 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-66441b04-d46c-4cd8-897c-2fbc07749c08 tempest-VolumesListTestJSON-1713017889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b4c7dbb-d7f3-4d71-92fa-2c14f96597c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:33:35 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-66441b04-d46c-4cd8-897c-2fbc07749c08 tempest-VolumesListTestJSON-1713017889 None] Volume volume-b5bea503-b028-46eb-a348-6c76f0b8b123 (b5bea503-b028-46eb-a348-6c76f0b8b123): created successfully
Nov 03 18:33:35 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-66441b04-d46c-4cd8-897c-2fbc07749c08 tempest-VolumesListTestJSON-1713017889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b4c7dbb-d7f3-4d71-92fa-2c14f96597c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:33:35 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-66441b04-d46c-4cd8-897c-2fbc07749c08 tempest-VolumesListTestJSON-1713017889 None] Flow 'volume_create_manager' (559f36bd-3c0e-4c5d-8d97-4b337b12647a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:33:35 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-66441b04-d46c-4cd8-897c-2fbc07749c08 tempest-VolumesListTestJSON-1713017889 None] Created volume successfully.
Nov 03 18:33:36 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-c821356e-dc72-4619-9f4c-1225a5cd4835 tempest-VolumesListTestJSON-1713017889 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:33:36 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-c821356e-dc72-4619-9f4c-1225a5cd4835 tempest-VolumesListTestJSON-1713017889 None] Flow 'volume_create_manager' (66c47e1f-bbb4-4838-a9e6-1cd503bb5aee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:33:36 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-c821356e-dc72-4619-9f4c-1225a5cd4835 tempest-VolumesListTestJSON-1713017889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4888dbd-691e-46a0-9fac-cbcf6fb95bd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:33:36 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-c821356e-dc72-4619-9f4c-1225a5cd4835 tempest-VolumesListTestJSON-1713017889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4888dbd-691e-46a0-9fac-cbcf6fb95bd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:33:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1248285743',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c88c1373-8f7d-46d5-8a1b-fb36920ca871,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='416c420f10cc496dabf30942dbd2d482',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:33:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:33:37Z,use_quota=True,user_id='87d426ab02ec487ca0d5267731615fba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:33:36 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-c821356e-dc72-4619-9f4c-1225a5cd4835 tempest-VolumesListTestJSON-1713017889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7347de40-df25-4b72-80d3-664ef9cd3795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:33:36 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-c821356e-dc72-4619-9f4c-1225a5cd4835 tempest-VolumesListTestJSON-1713017889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7347de40-df25-4b72-80d3-664ef9cd3795) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:33:36 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-c821356e-dc72-4619-9f4c-1225a5cd4835 tempest-VolumesListTestJSON-1713017889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4515d72-2660-4209-afca-1a91815e1940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:33:36 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-c821356e-dc72-4619-9f4c-1225a5cd4835 tempest-VolumesListTestJSON-1713017889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4515d72-2660-4209-afca-1a91815e1940) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c88c1373-8f7d-46d5-8a1b-fb36920ca871', 'volume_name': 'volume-c88c1373-8f7d-46d5-8a1b-fb36920ca871', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:33:36 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-c821356e-dc72-4619-9f4c-1225a5cd4835 tempest-VolumesListTestJSON-1713017889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3792e0b5-dbb0-4e1a-9c7e-1df07659adec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:33:36 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-c821356e-dc72-4619-9f4c-1225a5cd4835 tempest-VolumesListTestJSON-1713017889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3792e0b5-dbb0-4e1a-9c7e-1df07659adec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:33:36 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-c821356e-dc72-4619-9f4c-1225a5cd4835 tempest-VolumesListTestJSON-1713017889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43d3b440-0611-424b-9222-3500aae6a82a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:33:36 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-c821356e-dc72-4619-9f4c-1225a5cd4835 tempest-VolumesListTestJSON-1713017889 None] Volume c88c1373-8f7d-46d5-8a1b-fb36920ca871: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c88c1373-8f7d-46d5-8a1b-fb36920ca871', 'volume_size': 1}
Nov 03 18:33:36 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-c821356e-dc72-4619-9f4c-1225a5cd4835 tempest-VolumesListTestJSON-1713017889 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:33:36 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-c821356e-dc72-4619-9f4c-1225a5cd4835 tempest-VolumesListTestJSON-1713017889 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:33:36 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-c821356e-dc72-4619-9f4c-1225a5cd4835 tempest-VolumesListTestJSON-1713017889 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:33:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1248285743',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c88c1373-8f7d-46d5-8a1b-fb36920ca871,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='416c420f10cc496dabf30942dbd2d482',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:33:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:33:37Z,use_quota=True,user_id='87d426ab02ec487ca0d5267731615fba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:33:36 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-c821356e-dc72-4619-9f4c-1225a5cd4835 tempest-VolumesListTestJSON-1713017889 None] Creating volume c88c1373-8f7d-46d5-8a1b-fb36920ca871 {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:33:36 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-c821356e-dc72-4619-9f4c-1225a5cd4835 tempest-VolumesListTestJSON-1713017889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:33:36 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-c821356e-dc72-4619-9f4c-1225a5cd4835 tempest-VolumesListTestJSON-1713017889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:33:36 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-c821356e-dc72-4619-9f4c-1225a5cd4835 tempest-VolumesListTestJSON-1713017889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:33:36 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-c821356e-dc72-4619-9f4c-1225a5cd4835 tempest-VolumesListTestJSON-1713017889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:33:36 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-c821356e-dc72-4619-9f4c-1225a5cd4835 tempest-VolumesListTestJSON-1713017889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:33:36 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-c821356e-dc72-4619-9f4c-1225a5cd4835 tempest-VolumesListTestJSON-1713017889 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:33:36 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-c821356e-dc72-4619-9f4c-1225a5cd4835 tempest-VolumesListTestJSON-1713017889 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:33:36 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-c821356e-dc72-4619-9f4c-1225a5cd4835 tempest-VolumesListTestJSON-1713017889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-c88c1373-8f7d-46d5-8a1b-fb36920ca871 1073741824 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:33:36 devstack sudo[99171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-c88c1373-8f7d-46d5-8a1b-fb36920ca871 1073741824
Nov 03 18:33:36 devstack sudo[99171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:33:37 devstack sudo[99171]: pam_unix(sudo:session): session closed for user root
Nov 03 18:33:37 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-c821356e-dc72-4619-9f4c-1225a5cd4835 tempest-VolumesListTestJSON-1713017889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-c88c1373-8f7d-46d5-8a1b-fb36920ca871 1073741824" returned: 0 in 0.734s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:33:37 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-c821356e-dc72-4619-9f4c-1225a5cd4835 tempest-VolumesListTestJSON-1713017889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-c88c1373-8f7d-46d5-8a1b-fb36920ca871 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:33:37 devstack sudo[99178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-c88c1373-8f7d-46d5-8a1b-fb36920ca871
Nov 03 18:33:37 devstack sudo[99178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:33:37 devstack sudo[99178]: pam_unix(sudo:session): session closed for user root
Nov 03 18:33:37 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-c821356e-dc72-4619-9f4c-1225a5cd4835 tempest-VolumesListTestJSON-1713017889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-c88c1373-8f7d-46d5-8a1b-fb36920ca871" returned: 0 in 0.403s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:33:37 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-c821356e-dc72-4619-9f4c-1225a5cd4835 tempest-VolumesListTestJSON-1713017889 None] <== create_volume: return (1259ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:33:37 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-c821356e-dc72-4619-9f4c-1225a5cd4835 tempest-VolumesListTestJSON-1713017889 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.262s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:33:38 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-c821356e-dc72-4619-9f4c-1225a5cd4835 tempest-VolumesListTestJSON-1713017889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43d3b440-0611-424b-9222-3500aae6a82a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c88c1373-8f7d-46d5-8a1b-fb36920ca871', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:33:38 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-c821356e-dc72-4619-9f4c-1225a5cd4835 tempest-VolumesListTestJSON-1713017889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a6e3f45-a24d-44b0-917d-83e9c39d93ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:33:38 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-c821356e-dc72-4619-9f4c-1225a5cd4835 tempest-VolumesListTestJSON-1713017889 None] Volume volume-c88c1373-8f7d-46d5-8a1b-fb36920ca871 (c88c1373-8f7d-46d5-8a1b-fb36920ca871): created successfully
Nov 03 18:33:38 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-c821356e-dc72-4619-9f4c-1225a5cd4835 tempest-VolumesListTestJSON-1713017889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a6e3f45-a24d-44b0-917d-83e9c39d93ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:33:38 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-c821356e-dc72-4619-9f4c-1225a5cd4835 tempest-VolumesListTestJSON-1713017889 None] Flow 'volume_create_manager' (66c47e1f-bbb4-4838-a9e6-1cd503bb5aee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:33:38 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-c821356e-dc72-4619-9f4c-1225a5cd4835 tempest-VolumesListTestJSON-1713017889 None] Created volume successfully.
Nov 03 18:33:43 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-a1a801ea-83e7-4167-bbad-5cb837734254 tempest-VolumesListTestJSON-1713017889 None] Acquiring lock "cinder-c88c1373-8f7d-46d5-8a1b-fb36920ca871-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:33:43 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-a1a801ea-83e7-4167-bbad-5cb837734254 tempest-VolumesListTestJSON-1713017889 None] Lock "cinder-c88c1373-8f7d-46d5-8a1b-fb36920ca871-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:33:43 devstack cinder-volume[86120]: DEBUG dbcounter [-] [86120] Writing DB stats cinder:SELECT=84,cinder:INSERT=25,cinder:UPDATE=103,cinder:DELETE=8 {{(pid=86120) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 18:33:43 devstack cinder-volume[86120]: DEBUG dbcounter [-] [86120] Writing DB stats cinder:UPDATE=113,cinder:SELECT=71,cinder:INSERT=38,cinder:DELETE=11 {{(pid=86120) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 18:33:43 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-a1a801ea-83e7-4167-bbad-5cb837734254 tempest-VolumesListTestJSON-1713017889 None] Acquiring lock "cinder-quobyte-c88c1373-8f7d-46d5-8a1b-fb36920ca871" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:33:43 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-a1a801ea-83e7-4167-bbad-5cb837734254 tempest-VolumesListTestJSON-1713017889 None] Lock "cinder-quobyte-c88c1373-8f7d-46d5-8a1b-fb36920ca871" acquired by "delete_volume" :: waited 0.035s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:33:43 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3b9969d-78f9-46ec-a3d8-94a9d01e5876]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:33:43 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-a1a801ea-83e7-4167-bbad-5cb837734254 tempest-VolumesListTestJSON-1713017889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-c88c1373-8f7d-46d5-8a1b-fb36920ca871 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:33:43 devstack sudo[99258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-c88c1373-8f7d-46d5-8a1b-fb36920ca871
Nov 03 18:33:43 devstack sudo[99258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:33:43 devstack sudo[99258]: pam_unix(sudo:session): session closed for user root
Nov 03 18:33:43 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-a1a801ea-83e7-4167-bbad-5cb837734254 tempest-VolumesListTestJSON-1713017889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-c88c1373-8f7d-46d5-8a1b-fb36920ca871" returned: 0 in 0.483s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:33:43 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-a1a801ea-83e7-4167-bbad-5cb837734254 tempest-VolumesListTestJSON-1713017889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-c88c1373-8f7d-46d5-8a1b-fb36920ca871 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:33:43 devstack sudo[99263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-c88c1373-8f7d-46d5-8a1b-fb36920ca871
Nov 03 18:33:43 devstack sudo[99263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:33:44 devstack sudo[99263]: pam_unix(sudo:session): session closed for user root
Nov 03 18:33:44 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-a1a801ea-83e7-4167-bbad-5cb837734254 tempest-VolumesListTestJSON-1713017889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-c88c1373-8f7d-46d5-8a1b-fb36920ca871" returned: 0 in 0.282s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:33:44 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-a1a801ea-83e7-4167-bbad-5cb837734254 tempest-VolumesListTestJSON-1713017889 None] Lock "cinder-quobyte-c88c1373-8f7d-46d5-8a1b-fb36920ca871" released by "delete_volume" :: held 0.837s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:33:44 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-a1a801ea-83e7-4167-bbad-5cb837734254 tempest-VolumesListTestJSON-1713017889 None] Created reservations ['c9e83d3e-f224-406d-831c-01e57ff41ec5', 'a6fb118d-36ef-4318-94d9-6e5fb6d51d6c', '0b556f99-5663-44cd-834d-a9657a44a0a0', 'e0e1cc3c-a19e-4d34-abf0-4a213bd73d67'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:33:44 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-a1a801ea-83e7-4167-bbad-5cb837734254 tempest-VolumesListTestJSON-1713017889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:33:44 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-a1a801ea-83e7-4167-bbad-5cb837734254 tempest-VolumesListTestJSON-1713017889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:33:44 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-a1a801ea-83e7-4167-bbad-5cb837734254 tempest-VolumesListTestJSON-1713017889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:33:44 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-a1a801ea-83e7-4167-bbad-5cb837734254 tempest-VolumesListTestJSON-1713017889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:33:44 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-a1a801ea-83e7-4167-bbad-5cb837734254 tempest-VolumesListTestJSON-1713017889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:33:44 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-a1a801ea-83e7-4167-bbad-5cb837734254 tempest-VolumesListTestJSON-1713017889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:33:44 devstack sudo[99266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:33:44 devstack sudo[99266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:33:44 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-bc6b689e-947c-4987-a995-e17ac22b4616 tempest-VolumesListTestJSON-1713017889 None] Acquiring lock "cinder-b5bea503-b028-46eb-a348-6c76f0b8b123-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:33:44 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-bc6b689e-947c-4987-a995-e17ac22b4616 tempest-VolumesListTestJSON-1713017889 None] Lock "cinder-b5bea503-b028-46eb-a348-6c76f0b8b123-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:33:44 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-bc6b689e-947c-4987-a995-e17ac22b4616 tempest-VolumesListTestJSON-1713017889 None] Acquiring lock "cinder-quobyte-b5bea503-b028-46eb-a348-6c76f0b8b123" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:33:44 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-bc6b689e-947c-4987-a995-e17ac22b4616 tempest-VolumesListTestJSON-1713017889 None] Lock "cinder-quobyte-b5bea503-b028-46eb-a348-6c76f0b8b123" acquired by "delete_volume" :: waited 0.034s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:33:44 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[e92b2e1d-924d-4960-a1de-cd7987cc5933]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:33:44 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-bc6b689e-947c-4987-a995-e17ac22b4616 tempest-VolumesListTestJSON-1713017889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-b5bea503-b028-46eb-a348-6c76f0b8b123 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:33:44 devstack sudo[99266]: pam_unix(sudo:session): session closed for user root
Nov 03 18:33:45 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-a1a801ea-83e7-4167-bbad-5cb837734254 tempest-VolumesListTestJSON-1713017889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.543s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:33:45 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-a1a801ea-83e7-4167-bbad-5cb837734254 tempest-VolumesListTestJSON-1713017889 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:33:45 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-a1a801ea-83e7-4167-bbad-5cb837734254 tempest-VolumesListTestJSON-1713017889 None] Deleted volume successfully.
Nov 03 18:33:45 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-a1a801ea-83e7-4167-bbad-5cb837734254 tempest-VolumesListTestJSON-1713017889 None] Lock "cinder-c88c1373-8f7d-46d5-8a1b-fb36920ca871-delete_volume" released by "delete_volume" :: held 1.801s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:33:45 devstack sudo[99270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-b5bea503-b028-46eb-a348-6c76f0b8b123
Nov 03 18:33:45 devstack sudo[99270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:33:45 devstack sudo[99270]: pam_unix(sudo:session): session closed for user root
Nov 03 18:33:45 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-bc6b689e-947c-4987-a995-e17ac22b4616 tempest-VolumesListTestJSON-1713017889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-b5bea503-b028-46eb-a348-6c76f0b8b123" returned: 0 in 0.573s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:33:45 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-bc6b689e-947c-4987-a995-e17ac22b4616 tempest-VolumesListTestJSON-1713017889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-b5bea503-b028-46eb-a348-6c76f0b8b123 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:33:45 devstack sudo[99276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-b5bea503-b028-46eb-a348-6c76f0b8b123
Nov 03 18:33:45 devstack sudo[99276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:33:45 devstack sudo[99276]: pam_unix(sudo:session): session closed for user root
Nov 03 18:33:45 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-bc6b689e-947c-4987-a995-e17ac22b4616 tempest-VolumesListTestJSON-1713017889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-b5bea503-b028-46eb-a348-6c76f0b8b123" returned: 0 in 0.276s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:33:45 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-bc6b689e-947c-4987-a995-e17ac22b4616 tempest-VolumesListTestJSON-1713017889 None] Lock "cinder-quobyte-b5bea503-b028-46eb-a348-6c76f0b8b123" released by "delete_volume" :: held 0.924s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:33:45 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-bc6b689e-947c-4987-a995-e17ac22b4616 tempest-VolumesListTestJSON-1713017889 None] Created reservations ['cb727026-c507-423d-b2fd-f34a49fbdea1', '3d6e209f-7d91-4e61-bcb0-c68728b2e29e', 'b14ad560-ece0-46e3-a432-1270f8a99d95', '212ba45f-ced9-4f04-8b4e-bdebb52d7ff6'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:33:45 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-bc6b689e-947c-4987-a995-e17ac22b4616 tempest-VolumesListTestJSON-1713017889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:33:45 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-bc6b689e-947c-4987-a995-e17ac22b4616 tempest-VolumesListTestJSON-1713017889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:33:45 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-bc6b689e-947c-4987-a995-e17ac22b4616 tempest-VolumesListTestJSON-1713017889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:33:45 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-bc6b689e-947c-4987-a995-e17ac22b4616 tempest-VolumesListTestJSON-1713017889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:33:45 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-bc6b689e-947c-4987-a995-e17ac22b4616 tempest-VolumesListTestJSON-1713017889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:33:45 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-bc6b689e-947c-4987-a995-e17ac22b4616 tempest-VolumesListTestJSON-1713017889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:33:46 devstack sudo[99279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:33:46 devstack sudo[99279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:33:46 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-b1745dea-5e49-4ff0-91af-f7987791dc8b tempest-VolumesListTestJSON-1713017889 None] Acquiring lock "cinder-14a0f0eb-34ac-4bab-a567-ee431d3b17f7-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:33:46 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-b1745dea-5e49-4ff0-91af-f7987791dc8b tempest-VolumesListTestJSON-1713017889 None] Lock "cinder-14a0f0eb-34ac-4bab-a567-ee431d3b17f7-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:33:46 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-b1745dea-5e49-4ff0-91af-f7987791dc8b tempest-VolumesListTestJSON-1713017889 None] Acquiring lock "cinder-quobyte-14a0f0eb-34ac-4bab-a567-ee431d3b17f7" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:33:46 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-b1745dea-5e49-4ff0-91af-f7987791dc8b tempest-VolumesListTestJSON-1713017889 None] Lock "cinder-quobyte-14a0f0eb-34ac-4bab-a567-ee431d3b17f7" acquired by "delete_volume" :: waited 0.023s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:33:46 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d61ff58-d513-43db-afe3-464fdcaef72a]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:33:46 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b1745dea-5e49-4ff0-91af-f7987791dc8b tempest-VolumesListTestJSON-1713017889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-14a0f0eb-34ac-4bab-a567-ee431d3b17f7 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:33:46 devstack sudo[99279]: pam_unix(sudo:session): session closed for user root
Nov 03 18:33:46 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-bc6b689e-947c-4987-a995-e17ac22b4616 tempest-VolumesListTestJSON-1713017889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.376s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:33:46 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-bc6b689e-947c-4987-a995-e17ac22b4616 tempest-VolumesListTestJSON-1713017889 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:33:46 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-bc6b689e-947c-4987-a995-e17ac22b4616 tempest-VolumesListTestJSON-1713017889 None] Deleted volume successfully.
Nov 03 18:33:46 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-bc6b689e-947c-4987-a995-e17ac22b4616 tempest-VolumesListTestJSON-1713017889 None] Lock "cinder-b5bea503-b028-46eb-a348-6c76f0b8b123-delete_volume" released by "delete_volume" :: held 1.650s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:33:46 devstack sudo[99282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-14a0f0eb-34ac-4bab-a567-ee431d3b17f7
Nov 03 18:33:46 devstack sudo[99282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:33:46 devstack sudo[99282]: pam_unix(sudo:session): session closed for user root
Nov 03 18:33:46 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b1745dea-5e49-4ff0-91af-f7987791dc8b tempest-VolumesListTestJSON-1713017889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-14a0f0eb-34ac-4bab-a567-ee431d3b17f7" returned: 0 in 0.401s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:33:46 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b1745dea-5e49-4ff0-91af-f7987791dc8b tempest-VolumesListTestJSON-1713017889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-14a0f0eb-34ac-4bab-a567-ee431d3b17f7 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:33:46 devstack sudo[99287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-14a0f0eb-34ac-4bab-a567-ee431d3b17f7
Nov 03 18:33:46 devstack sudo[99287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:33:47 devstack sudo[99287]: pam_unix(sudo:session): session closed for user root
Nov 03 18:33:47 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b1745dea-5e49-4ff0-91af-f7987791dc8b tempest-VolumesListTestJSON-1713017889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-14a0f0eb-34ac-4bab-a567-ee431d3b17f7" returned: 0 in 0.254s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:33:47 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-b1745dea-5e49-4ff0-91af-f7987791dc8b tempest-VolumesListTestJSON-1713017889 None] Lock "cinder-quobyte-14a0f0eb-34ac-4bab-a567-ee431d3b17f7" released by "delete_volume" :: held 0.719s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:33:47 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-b1745dea-5e49-4ff0-91af-f7987791dc8b tempest-VolumesListTestJSON-1713017889 None] Created reservations ['63bb8f78-ab12-4e11-a64f-89042d7603cb', 'b20addf7-14ed-4b8f-b30a-3a3f5fb85d66', 'ef4e221d-377f-4398-9e6c-b5082017b5b7', '2de6e0fc-7b54-44ff-a65a-50206d5966df'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:33:47 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-b1745dea-5e49-4ff0-91af-f7987791dc8b tempest-VolumesListTestJSON-1713017889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:33:47 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-b1745dea-5e49-4ff0-91af-f7987791dc8b tempest-VolumesListTestJSON-1713017889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:33:47 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-b1745dea-5e49-4ff0-91af-f7987791dc8b tempest-VolumesListTestJSON-1713017889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:33:47 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-b1745dea-5e49-4ff0-91af-f7987791dc8b tempest-VolumesListTestJSON-1713017889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:33:47 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-b1745dea-5e49-4ff0-91af-f7987791dc8b tempest-VolumesListTestJSON-1713017889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:33:47 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b1745dea-5e49-4ff0-91af-f7987791dc8b tempest-VolumesListTestJSON-1713017889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:33:47 devstack sudo[99290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:33:47 devstack sudo[99290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:33:47 devstack sudo[99290]: pam_unix(sudo:session): session closed for user root
Nov 03 18:33:47 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b1745dea-5e49-4ff0-91af-f7987791dc8b tempest-VolumesListTestJSON-1713017889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.283s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:33:47 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-b1745dea-5e49-4ff0-91af-f7987791dc8b tempest-VolumesListTestJSON-1713017889 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:33:47 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-b1745dea-5e49-4ff0-91af-f7987791dc8b tempest-VolumesListTestJSON-1713017889 None] Deleted volume successfully.
Nov 03 18:33:47 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-b1745dea-5e49-4ff0-91af-f7987791dc8b tempest-VolumesListTestJSON-1713017889 None] Lock "cinder-14a0f0eb-34ac-4bab-a567-ee431d3b17f7-delete_volume" released by "delete_volume" :: held 1.285s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:33:51 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-99ed8ea9-a26e-4211-b8ba-a83d504afa09 tempest-VolumesNegativeTest-534165261 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:33:51 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-99ed8ea9-a26e-4211-b8ba-a83d504afa09 tempest-VolumesNegativeTest-534165261 None] Flow 'volume_create_manager' (f5d02a4a-2ae2-4c52-9499-4b90e1c06813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:33:51 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-99ed8ea9-a26e-4211-b8ba-a83d504afa09 tempest-VolumesNegativeTest-534165261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ed33e95-efed-4db1-b51b-6d7fb8d85943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:33:51 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-99ed8ea9-a26e-4211-b8ba-a83d504afa09 tempest-VolumesNegativeTest-534165261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ed33e95-efed-4db1-b51b-6d7fb8d85943) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:33:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1852184603',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bbff509-b8f6-446a-bf2a-9c3aba253498,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3b9a4512668435a9de18cc50ccdb070',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:33:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:33:51Z,use_quota=True,user_id='112c872e1bd54caf91562e76dcdee0f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:33:51 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-99ed8ea9-a26e-4211-b8ba-a83d504afa09 tempest-VolumesNegativeTest-534165261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4de44ad8-0927-4259-8199-62c5485863c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:33:51 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-99ed8ea9-a26e-4211-b8ba-a83d504afa09 tempest-VolumesNegativeTest-534165261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4de44ad8-0927-4259-8199-62c5485863c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:33:51 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-99ed8ea9-a26e-4211-b8ba-a83d504afa09 tempest-VolumesNegativeTest-534165261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (682ab96a-a201-40cc-a0c3-3183d6afa4b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:33:51 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-99ed8ea9-a26e-4211-b8ba-a83d504afa09 tempest-VolumesNegativeTest-534165261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (682ab96a-a201-40cc-a0c3-3183d6afa4b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2bbff509-b8f6-446a-bf2a-9c3aba253498', 'volume_name': 'volume-2bbff509-b8f6-446a-bf2a-9c3aba253498', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:33:51 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-99ed8ea9-a26e-4211-b8ba-a83d504afa09 tempest-VolumesNegativeTest-534165261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f923c39-ca76-495d-be4f-9c4f52994927) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:33:51 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-99ed8ea9-a26e-4211-b8ba-a83d504afa09 tempest-VolumesNegativeTest-534165261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f923c39-ca76-495d-be4f-9c4f52994927) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:33:51 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-99ed8ea9-a26e-4211-b8ba-a83d504afa09 tempest-VolumesNegativeTest-534165261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9b0fa3c-47ad-494f-b792-4fa4a59ad26b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:33:51 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-99ed8ea9-a26e-4211-b8ba-a83d504afa09 tempest-VolumesNegativeTest-534165261 None] Volume 2bbff509-b8f6-446a-bf2a-9c3aba253498: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2bbff509-b8f6-446a-bf2a-9c3aba253498', 'volume_size': 1}
Nov 03 18:33:51 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-99ed8ea9-a26e-4211-b8ba-a83d504afa09 tempest-VolumesNegativeTest-534165261 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:33:51 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-99ed8ea9-a26e-4211-b8ba-a83d504afa09 tempest-VolumesNegativeTest-534165261 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:33:51 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-99ed8ea9-a26e-4211-b8ba-a83d504afa09 tempest-VolumesNegativeTest-534165261 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:33:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1852184603',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bbff509-b8f6-446a-bf2a-9c3aba253498,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3b9a4512668435a9de18cc50ccdb070',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:33:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:33:51Z,use_quota=True,user_id='112c872e1bd54caf91562e76dcdee0f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:33:51 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-99ed8ea9-a26e-4211-b8ba-a83d504afa09 tempest-VolumesNegativeTest-534165261 None] Creating volume 2bbff509-b8f6-446a-bf2a-9c3aba253498 {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:33:51 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-99ed8ea9-a26e-4211-b8ba-a83d504afa09 tempest-VolumesNegativeTest-534165261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:33:51 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-99ed8ea9-a26e-4211-b8ba-a83d504afa09 tempest-VolumesNegativeTest-534165261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:33:51 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-99ed8ea9-a26e-4211-b8ba-a83d504afa09 tempest-VolumesNegativeTest-534165261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:33:51 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-99ed8ea9-a26e-4211-b8ba-a83d504afa09 tempest-VolumesNegativeTest-534165261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:33:51 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-99ed8ea9-a26e-4211-b8ba-a83d504afa09 tempest-VolumesNegativeTest-534165261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:33:51 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-99ed8ea9-a26e-4211-b8ba-a83d504afa09 tempest-VolumesNegativeTest-534165261 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:33:51 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-99ed8ea9-a26e-4211-b8ba-a83d504afa09 tempest-VolumesNegativeTest-534165261 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:33:51 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-99ed8ea9-a26e-4211-b8ba-a83d504afa09 tempest-VolumesNegativeTest-534165261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2bbff509-b8f6-446a-bf2a-9c3aba253498 1073741824 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:33:51 devstack sudo[99316]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2bbff509-b8f6-446a-bf2a-9c3aba253498 1073741824
Nov 03 18:33:51 devstack sudo[99316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:33:51 devstack sudo[99316]: pam_unix(sudo:session): session closed for user root
Nov 03 18:33:51 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-99ed8ea9-a26e-4211-b8ba-a83d504afa09 tempest-VolumesNegativeTest-534165261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2bbff509-b8f6-446a-bf2a-9c3aba253498 1073741824" returned: 0 in 0.444s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:33:52 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-99ed8ea9-a26e-4211-b8ba-a83d504afa09 tempest-VolumesNegativeTest-534165261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2bbff509-b8f6-446a-bf2a-9c3aba253498 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:33:52 devstack sudo[99321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2bbff509-b8f6-446a-bf2a-9c3aba253498
Nov 03 18:33:52 devstack sudo[99321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:33:52 devstack sudo[99321]: pam_unix(sudo:session): session closed for user root
Nov 03 18:33:52 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-99ed8ea9-a26e-4211-b8ba-a83d504afa09 tempest-VolumesNegativeTest-534165261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2bbff509-b8f6-446a-bf2a-9c3aba253498" returned: 0 in 0.258s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:33:52 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-99ed8ea9-a26e-4211-b8ba-a83d504afa09 tempest-VolumesNegativeTest-534165261 None] <== create_volume: return (750ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:33:52 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-99ed8ea9-a26e-4211-b8ba-a83d504afa09 tempest-VolumesNegativeTest-534165261 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.752s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:33:52 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-99ed8ea9-a26e-4211-b8ba-a83d504afa09 tempest-VolumesNegativeTest-534165261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9b0fa3c-47ad-494f-b792-4fa4a59ad26b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2bbff509-b8f6-446a-bf2a-9c3aba253498', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:33:52 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-99ed8ea9-a26e-4211-b8ba-a83d504afa09 tempest-VolumesNegativeTest-534165261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da78e1a2-e11c-4934-97fc-9ba233d90455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:33:52 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-99ed8ea9-a26e-4211-b8ba-a83d504afa09 tempest-VolumesNegativeTest-534165261 None] Volume volume-2bbff509-b8f6-446a-bf2a-9c3aba253498 (2bbff509-b8f6-446a-bf2a-9c3aba253498): created successfully
Nov 03 18:33:52 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-99ed8ea9-a26e-4211-b8ba-a83d504afa09 tempest-VolumesNegativeTest-534165261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da78e1a2-e11c-4934-97fc-9ba233d90455) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:33:52 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-99ed8ea9-a26e-4211-b8ba-a83d504afa09 tempest-VolumesNegativeTest-534165261 None] Flow 'volume_create_manager' (f5d02a4a-2ae2-4c52-9499-4b90e1c06813) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:33:52 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-99ed8ea9-a26e-4211-b8ba-a83d504afa09 tempest-VolumesNegativeTest-534165261 None] Created volume successfully.
Nov 03 18:33:59 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-3dabfbea-de40-4991-99fb-f3319bdc1b38 tempest-AttachVolumeNegativeTest-621877883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:33:59 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-3dabfbea-de40-4991-99fb-f3319bdc1b38 tempest-AttachVolumeNegativeTest-621877883 None] Flow 'volume_create_manager' (320000f5-a92f-4992-97e7-67802d571342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:33:59 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-3dabfbea-de40-4991-99fb-f3319bdc1b38 tempest-AttachVolumeNegativeTest-621877883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abbb0c93-3fc9-4e04-8b87-57fe8a754c19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:33:59 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-3dabfbea-de40-4991-99fb-f3319bdc1b38 tempest-AttachVolumeNegativeTest-621877883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abbb0c93-3fc9-4e04-8b87-57fe8a754c19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:33:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-415435644',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44c8359e-2f5f-4df0-a0e1-96557b7e9b04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='947da25973cf48a4afa1ef1957395d16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:34:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:34:00Z,use_quota=True,user_id='f08080986d0446f99591e76938d047cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:33:59 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-3dabfbea-de40-4991-99fb-f3319bdc1b38 tempest-AttachVolumeNegativeTest-621877883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db604b57-10ee-4443-a2ad-e8ef213e1016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:33:59 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-3dabfbea-de40-4991-99fb-f3319bdc1b38 tempest-AttachVolumeNegativeTest-621877883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db604b57-10ee-4443-a2ad-e8ef213e1016) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:33:59 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-3dabfbea-de40-4991-99fb-f3319bdc1b38 tempest-AttachVolumeNegativeTest-621877883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9eb61e5-0dc6-4582-9ac0-cf8c2ccdad9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:33:59 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-3dabfbea-de40-4991-99fb-f3319bdc1b38 tempest-AttachVolumeNegativeTest-621877883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9eb61e5-0dc6-4582-9ac0-cf8c2ccdad9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44c8359e-2f5f-4df0-a0e1-96557b7e9b04', 'volume_name': 'volume-44c8359e-2f5f-4df0-a0e1-96557b7e9b04', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:33:59 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-3dabfbea-de40-4991-99fb-f3319bdc1b38 tempest-AttachVolumeNegativeTest-621877883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8af5641f-ae2b-4e15-9d76-b712846d12e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:33:59 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-3dabfbea-de40-4991-99fb-f3319bdc1b38 tempest-AttachVolumeNegativeTest-621877883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8af5641f-ae2b-4e15-9d76-b712846d12e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:33:59 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-3dabfbea-de40-4991-99fb-f3319bdc1b38 tempest-AttachVolumeNegativeTest-621877883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a8829de-9831-421d-852b-3e1cc409a5ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:33:59 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-3dabfbea-de40-4991-99fb-f3319bdc1b38 tempest-AttachVolumeNegativeTest-621877883 None] Volume 44c8359e-2f5f-4df0-a0e1-96557b7e9b04: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44c8359e-2f5f-4df0-a0e1-96557b7e9b04', 'volume_size': 1}
Nov 03 18:33:59 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-3dabfbea-de40-4991-99fb-f3319bdc1b38 tempest-AttachVolumeNegativeTest-621877883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:33:59 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-3dabfbea-de40-4991-99fb-f3319bdc1b38 tempest-AttachVolumeNegativeTest-621877883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:33:59 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-3dabfbea-de40-4991-99fb-f3319bdc1b38 tempest-AttachVolumeNegativeTest-621877883 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:33:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-415435644',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44c8359e-2f5f-4df0-a0e1-96557b7e9b04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='947da25973cf48a4afa1ef1957395d16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:34:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:34:00Z,use_quota=True,user_id='f08080986d0446f99591e76938d047cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:33:59 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-3dabfbea-de40-4991-99fb-f3319bdc1b38 tempest-AttachVolumeNegativeTest-621877883 None] Creating volume 44c8359e-2f5f-4df0-a0e1-96557b7e9b04 {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:33:59 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-3dabfbea-de40-4991-99fb-f3319bdc1b38 tempest-AttachVolumeNegativeTest-621877883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:33:59 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-3dabfbea-de40-4991-99fb-f3319bdc1b38 tempest-AttachVolumeNegativeTest-621877883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:33:59 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-3dabfbea-de40-4991-99fb-f3319bdc1b38 tempest-AttachVolumeNegativeTest-621877883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:33:59 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-3dabfbea-de40-4991-99fb-f3319bdc1b38 tempest-AttachVolumeNegativeTest-621877883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:33:59 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-3dabfbea-de40-4991-99fb-f3319bdc1b38 tempest-AttachVolumeNegativeTest-621877883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:33:59 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-3dabfbea-de40-4991-99fb-f3319bdc1b38 tempest-AttachVolumeNegativeTest-621877883 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:33:59 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-3dabfbea-de40-4991-99fb-f3319bdc1b38 tempest-AttachVolumeNegativeTest-621877883 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:33:59 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-3dabfbea-de40-4991-99fb-f3319bdc1b38 tempest-AttachVolumeNegativeTest-621877883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-44c8359e-2f5f-4df0-a0e1-96557b7e9b04 1073741824 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:33:59 devstack sudo[99445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-44c8359e-2f5f-4df0-a0e1-96557b7e9b04 1073741824
Nov 03 18:33:59 devstack sudo[99445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:34:00 devstack sudo[99445]: pam_unix(sudo:session): session closed for user root
Nov 03 18:34:00 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-3dabfbea-de40-4991-99fb-f3319bdc1b38 tempest-AttachVolumeNegativeTest-621877883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-44c8359e-2f5f-4df0-a0e1-96557b7e9b04 1073741824" returned: 0 in 0.413s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:34:00 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-3dabfbea-de40-4991-99fb-f3319bdc1b38 tempest-AttachVolumeNegativeTest-621877883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-44c8359e-2f5f-4df0-a0e1-96557b7e9b04 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:34:00 devstack sudo[99451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-44c8359e-2f5f-4df0-a0e1-96557b7e9b04
Nov 03 18:34:00 devstack sudo[99451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:34:00 devstack sudo[99451]: pam_unix(sudo:session): session closed for user root
Nov 03 18:34:00 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-3dabfbea-de40-4991-99fb-f3319bdc1b38 tempest-AttachVolumeNegativeTest-621877883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-44c8359e-2f5f-4df0-a0e1-96557b7e9b04" returned: 0 in 0.292s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:34:00 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-3dabfbea-de40-4991-99fb-f3319bdc1b38 tempest-AttachVolumeNegativeTest-621877883 None] <== create_volume: return (755ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:34:00 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-3dabfbea-de40-4991-99fb-f3319bdc1b38 tempest-AttachVolumeNegativeTest-621877883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.757s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:34:00 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-3dabfbea-de40-4991-99fb-f3319bdc1b38 tempest-AttachVolumeNegativeTest-621877883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a8829de-9831-421d-852b-3e1cc409a5ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44c8359e-2f5f-4df0-a0e1-96557b7e9b04', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:34:00 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-3dabfbea-de40-4991-99fb-f3319bdc1b38 tempest-AttachVolumeNegativeTest-621877883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0634f97-2648-44a9-b022-f5795cea1820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:34:00 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-3dabfbea-de40-4991-99fb-f3319bdc1b38 tempest-AttachVolumeNegativeTest-621877883 None] Volume volume-44c8359e-2f5f-4df0-a0e1-96557b7e9b04 (44c8359e-2f5f-4df0-a0e1-96557b7e9b04): created successfully
Nov 03 18:34:00 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-3dabfbea-de40-4991-99fb-f3319bdc1b38 tempest-AttachVolumeNegativeTest-621877883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0634f97-2648-44a9-b022-f5795cea1820) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:34:00 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-3dabfbea-de40-4991-99fb-f3319bdc1b38 tempest-AttachVolumeNegativeTest-621877883 None] Flow 'volume_create_manager' (320000f5-a92f-4992-97e7-67802d571342) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:34:00 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-3dabfbea-de40-4991-99fb-f3319bdc1b38 tempest-AttachVolumeNegativeTest-621877883 None] Created volume successfully.
Nov 03 18:34:02 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [req-a4967228-6fef-440a-97aa-2160ee8f5fb9 req-2d0f42da-2c9e-44c1-828a-52ee52241ede tempest-AttachVolumeNegativeTest-621877883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:34:02 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [req-a4967228-6fef-440a-97aa-2160ee8f5fb9 req-2d0f42da-2c9e-44c1-828a-52ee52241ede tempest-AttachVolumeNegativeTest-621877883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:34:02 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [req-a4967228-6fef-440a-97aa-2160ee8f5fb9 req-2d0f42da-2c9e-44c1-828a-52ee52241ede tempest-AttachVolumeNegativeTest-621877883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:34:02 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [req-a4967228-6fef-440a-97aa-2160ee8f5fb9 req-2d0f42da-2c9e-44c1-828a-52ee52241ede tempest-AttachVolumeNegativeTest-621877883 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c', 'name': 'volume-44c8359e-2f5f-4df0-a0e1-96557b7e9b04', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4442e8ee-46fd-4a74-9a7e-8de04b92bdd8', 'enforce_multipath': True} {{(pid=86120) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 03 18:34:02 devstack cinder-volume[86120]: INFO cinder.volume.manager [req-a4967228-6fef-440a-97aa-2160ee8f5fb9 req-2d0f42da-2c9e-44c1-828a-52ee52241ede tempest-AttachVolumeNegativeTest-621877883 None] attachment_update completed successfully.
Nov 03 18:34:04 devstack cinder-volume[86120]: INFO cinder.volume.manager [req-0a037815-f727-43ff-a6d0-a1326fe82b6c req-50412b40-553d-4df7-878a-9755f9f23e58 tempest-AttachVolumeNegativeTest-621877883 None] Terminate volume connection completed successfully.
Nov 03 18:34:04 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [req-0a037815-f727-43ff-a6d0-a1326fe82b6c req-50412b40-553d-4df7-878a-9755f9f23e58 tempest-AttachVolumeNegativeTest-621877883 None] Deleting attachment 4442e8ee-46fd-4a74-9a7e-8de04b92bdd8. {{(pid=86120) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 03 18:34:05 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [req-3dfa1032-103f-4885-a4ad-202d01498a3a req-6049236a-f0e8-4f6a-b313-4eb224cb9f01 tempest-TestStampPattern-2051953486 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:34:05 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [req-3dfa1032-103f-4885-a4ad-202d01498a3a req-6049236a-f0e8-4f6a-b313-4eb224cb9f01 tempest-TestStampPattern-2051953486 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:34:05 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [req-3dfa1032-103f-4885-a4ad-202d01498a3a req-6049236a-f0e8-4f6a-b313-4eb224cb9f01 tempest-TestStampPattern-2051953486 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:34:05 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [req-3dfa1032-103f-4885-a4ad-202d01498a3a req-6049236a-f0e8-4f6a-b313-4eb224cb9f01 tempest-TestStampPattern-2051953486 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c', 'name': 'volume-261b681b-c984-43e5-abdb-a2acaaf9e6e1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '84969ea3-1a84-453d-88c1-053e9e0c571d', 'enforce_multipath': True} {{(pid=86120) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 03 18:34:06 devstack cinder-volume[86120]: INFO cinder.volume.manager [req-3dfa1032-103f-4885-a4ad-202d01498a3a req-6049236a-f0e8-4f6a-b313-4eb224cb9f01 tempest-TestStampPattern-2051953486 None] attachment_update completed successfully.
Nov 03 18:34:11 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-5789a1bb-84a7-4b04-99a9-6f4e9f3ea200 tempest-VolumesNegativeTest-534165261 None] Acquiring lock "cinder-2bbff509-b8f6-446a-bf2a-9c3aba253498-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:34:11 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-5789a1bb-84a7-4b04-99a9-6f4e9f3ea200 tempest-VolumesNegativeTest-534165261 None] Lock "cinder-2bbff509-b8f6-446a-bf2a-9c3aba253498-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:34:11 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-5789a1bb-84a7-4b04-99a9-6f4e9f3ea200 tempest-VolumesNegativeTest-534165261 None] Acquiring lock "cinder-quobyte-2bbff509-b8f6-446a-bf2a-9c3aba253498" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:34:11 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-5789a1bb-84a7-4b04-99a9-6f4e9f3ea200 tempest-VolumesNegativeTest-534165261 None] Lock "cinder-quobyte-2bbff509-b8f6-446a-bf2a-9c3aba253498" acquired by "delete_volume" :: waited 0.020s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:34:11 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cb34995-ed7f-4d19-a4ba-037fca5cfaff]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:34:11 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-5789a1bb-84a7-4b04-99a9-6f4e9f3ea200 tempest-VolumesNegativeTest-534165261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2bbff509-b8f6-446a-bf2a-9c3aba253498 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:34:11 devstack sudo[100404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2bbff509-b8f6-446a-bf2a-9c3aba253498
Nov 03 18:34:11 devstack sudo[100404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:34:11 devstack sudo[100404]: pam_unix(sudo:session): session closed for user root
Nov 03 18:34:11 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-5789a1bb-84a7-4b04-99a9-6f4e9f3ea200 tempest-VolumesNegativeTest-534165261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2bbff509-b8f6-446a-bf2a-9c3aba253498" returned: 0 in 0.460s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:34:11 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-5789a1bb-84a7-4b04-99a9-6f4e9f3ea200 tempest-VolumesNegativeTest-534165261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2bbff509-b8f6-446a-bf2a-9c3aba253498 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:34:11 devstack sudo[100409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2bbff509-b8f6-446a-bf2a-9c3aba253498
Nov 03 18:34:11 devstack sudo[100409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:34:11 devstack cinder-volume[86120]: INFO cinder.volume.manager [req-fb7dfdf0-d19f-4e16-b588-a64bd627b8dd req-e2f91544-0bfa-41b3-974b-a929467ae541 tempest-TestStampPattern-2051953486 None] Terminate volume connection completed successfully.
Nov 03 18:34:11 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [req-fb7dfdf0-d19f-4e16-b588-a64bd627b8dd req-e2f91544-0bfa-41b3-974b-a929467ae541 tempest-TestStampPattern-2051953486 None] Deleting attachment 84969ea3-1a84-453d-88c1-053e9e0c571d. {{(pid=86120) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 03 18:34:11 devstack sudo[100409]: pam_unix(sudo:session): session closed for user root
Nov 03 18:34:11 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-5789a1bb-84a7-4b04-99a9-6f4e9f3ea200 tempest-VolumesNegativeTest-534165261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2bbff509-b8f6-446a-bf2a-9c3aba253498" returned: 0 in 0.306s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:34:11 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-5789a1bb-84a7-4b04-99a9-6f4e9f3ea200 tempest-VolumesNegativeTest-534165261 None] Lock "cinder-quobyte-2bbff509-b8f6-446a-bf2a-9c3aba253498" released by "delete_volume" :: held 0.817s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:34:12 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-5789a1bb-84a7-4b04-99a9-6f4e9f3ea200 tempest-VolumesNegativeTest-534165261 None] Created reservations ['6689a540-c033-4573-9c70-2ee138ce6d72', '45e82b33-6af8-4892-a3b9-25dbb67a95c2', 'c9fbcc30-55f2-4e42-a1f2-024e14cde01c', '0e7244fb-9433-487f-9c8e-f98110c82892'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:34:12 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-5789a1bb-84a7-4b04-99a9-6f4e9f3ea200 tempest-VolumesNegativeTest-534165261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:34:12 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-5789a1bb-84a7-4b04-99a9-6f4e9f3ea200 tempest-VolumesNegativeTest-534165261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:34:12 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-5789a1bb-84a7-4b04-99a9-6f4e9f3ea200 tempest-VolumesNegativeTest-534165261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:34:12 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-5789a1bb-84a7-4b04-99a9-6f4e9f3ea200 tempest-VolumesNegativeTest-534165261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:34:12 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-5789a1bb-84a7-4b04-99a9-6f4e9f3ea200 tempest-VolumesNegativeTest-534165261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:34:12 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-5789a1bb-84a7-4b04-99a9-6f4e9f3ea200 tempest-VolumesNegativeTest-534165261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:34:12 devstack sudo[100439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:34:12 devstack sudo[100439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:34:12 devstack sudo[100439]: pam_unix(sudo:session): session closed for user root
Nov 03 18:34:12 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-5789a1bb-84a7-4b04-99a9-6f4e9f3ea200 tempest-VolumesNegativeTest-534165261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.277s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:34:12 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-5789a1bb-84a7-4b04-99a9-6f4e9f3ea200 tempest-VolumesNegativeTest-534165261 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:34:12 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-5789a1bb-84a7-4b04-99a9-6f4e9f3ea200 tempest-VolumesNegativeTest-534165261 None] Deleted volume successfully.
Nov 03 18:34:12 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-5789a1bb-84a7-4b04-99a9-6f4e9f3ea200 tempest-VolumesNegativeTest-534165261 None] Lock "cinder-2bbff509-b8f6-446a-bf2a-9c3aba253498-delete_volume" released by "delete_volume" :: held 1.362s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:34:12 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-dafd5517-8464-4c9f-80b8-4a21e3284b48 tempest-TestStampPattern-2051953486 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:34:12 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-dafd5517-8464-4c9f-80b8-4a21e3284b48 tempest-TestStampPattern-2051953486 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:34:12 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-dafd5517-8464-4c9f-80b8-4a21e3284b48 tempest-TestStampPattern-2051953486 None] Creating offline snapshot 7e96fe29-8ea6-44ec-bc8d-e11c48f530fc of volume 261b681b-c984-43e5-abdb-a2acaaf9e6e1 {{(pid=86120) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 18:34:12 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[be6b8417-014f-4178-b22b-d1cc7c67a985]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:34:12 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-dafd5517-8464-4c9f-80b8-4a21e3284b48 tempest-TestStampPattern-2051953486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-261b681b-c984-43e5-abdb-a2acaaf9e6e1 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:34:12 devstack sudo[100442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-261b681b-c984-43e5-abdb-a2acaaf9e6e1
Nov 03 18:34:12 devstack sudo[100442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:34:13 devstack sudo[100442]: pam_unix(sudo:session): session closed for user root
Nov 03 18:34:13 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-dafd5517-8464-4c9f-80b8-4a21e3284b48 tempest-TestStampPattern-2051953486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-261b681b-c984-43e5-abdb-a2acaaf9e6e1" returned: 0 in 0.410s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:34:13 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-dafd5517-8464-4c9f-80b8-4a21e3284b48 tempest-TestStampPattern-2051953486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-261b681b-c984-43e5-abdb-a2acaaf9e6e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-261b681b-c984-43e5-abdb-a2acaaf9e6e1.7e96fe29-8ea6-44ec-bc8d-e11c48f530fc 1G {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:34:13 devstack sudo[100447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-261b681b-c984-43e5-abdb-a2acaaf9e6e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-261b681b-c984-43e5-abdb-a2acaaf9e6e1.7e96fe29-8ea6-44ec-bc8d-e11c48f530fc 1G
Nov 03 18:34:13 devstack sudo[100447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:34:13 devstack sudo[100447]: pam_unix(sudo:session): session closed for user root
Nov 03 18:34:13 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-dafd5517-8464-4c9f-80b8-4a21e3284b48 tempest-TestStampPattern-2051953486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-261b681b-c984-43e5-abdb-a2acaaf9e6e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-261b681b-c984-43e5-abdb-a2acaaf9e6e1.7e96fe29-8ea6-44ec-bc8d-e11c48f530fc 1G" returned: 0 in 0.529s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:34:13 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-dafd5517-8464-4c9f-80b8-4a21e3284b48 tempest-TestStampPattern-2051953486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-261b681b-c984-43e5-abdb-a2acaaf9e6e1 -F qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-261b681b-c984-43e5-abdb-a2acaaf9e6e1.7e96fe29-8ea6-44ec-bc8d-e11c48f530fc {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:34:13 devstack sudo[100456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-261b681b-c984-43e5-abdb-a2acaaf9e6e1 -F qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-261b681b-c984-43e5-abdb-a2acaaf9e6e1.7e96fe29-8ea6-44ec-bc8d-e11c48f530fc
Nov 03 18:34:13 devstack sudo[100456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:34:14 devstack sudo[100456]: pam_unix(sudo:session): session closed for user root
Nov 03 18:34:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-dafd5517-8464-4c9f-80b8-4a21e3284b48 tempest-TestStampPattern-2051953486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-261b681b-c984-43e5-abdb-a2acaaf9e6e1 -F qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-261b681b-c984-43e5-abdb-a2acaaf9e6e1.7e96fe29-8ea6-44ec-bc8d-e11c48f530fc" returned: 0 in 0.400s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:34:14 devstack cinder-volume[86120]: WARNING cinder.volume.drivers.remotefs [None req-dafd5517-8464-4c9f-80b8-4a21e3284b48 tempest-TestStampPattern-2051953486 None] /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-261b681b-c984-43e5-abdb-a2acaaf9e6e1.7e96fe29-8ea6-44ec-bc8d-e11c48f530fc is being set with open permissions: ugo+rw
Nov 03 18:34:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-dafd5517-8464-4c9f-80b8-4a21e3284b48 tempest-TestStampPattern-2051953486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-261b681b-c984-43e5-abdb-a2acaaf9e6e1.7e96fe29-8ea6-44ec-bc8d-e11c48f530fc {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:34:14 devstack sudo[100467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-261b681b-c984-43e5-abdb-a2acaaf9e6e1.7e96fe29-8ea6-44ec-bc8d-e11c48f530fc
Nov 03 18:34:14 devstack sudo[100467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:34:14 devstack sudo[100467]: pam_unix(sudo:session): session closed for user root
Nov 03 18:34:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-dafd5517-8464-4c9f-80b8-4a21e3284b48 tempest-TestStampPattern-2051953486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-261b681b-c984-43e5-abdb-a2acaaf9e6e1.7e96fe29-8ea6-44ec-bc8d-e11c48f530fc" returned: 0 in 0.273s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:34:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-dafd5517-8464-4c9f-80b8-4a21e3284b48 tempest-TestStampPattern-2051953486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-261b681b-c984-43e5-abdb-a2acaaf9e6e1.info {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:34:14 devstack sudo[100470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-261b681b-c984-43e5-abdb-a2acaaf9e6e1.info
Nov 03 18:34:14 devstack sudo[100470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:34:14 devstack sudo[100470]: pam_unix(sudo:session): session closed for user root
Nov 03 18:34:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-dafd5517-8464-4c9f-80b8-4a21e3284b48 tempest-TestStampPattern-2051953486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-261b681b-c984-43e5-abdb-a2acaaf9e6e1.info" returned: 0 in 0.299s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:34:14 devstack cinder-volume[86120]: WARNING cinder.volume.drivers.remotefs [None req-dafd5517-8464-4c9f-80b8-4a21e3284b48 tempest-TestStampPattern-2051953486 None] /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-261b681b-c984-43e5-abdb-a2acaaf9e6e1.info is being set with open permissions: ugo+rw
Nov 03 18:34:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-dafd5517-8464-4c9f-80b8-4a21e3284b48 tempest-TestStampPattern-2051953486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-261b681b-c984-43e5-abdb-a2acaaf9e6e1.info {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:34:14 devstack sudo[100473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-261b681b-c984-43e5-abdb-a2acaaf9e6e1.info
Nov 03 18:34:14 devstack sudo[100473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:34:14 devstack cinder-volume[86120]: DEBUG oslo_service.periodic_task [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86120) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 18:34:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:34:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:34:14 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:34:14 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:34:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:34:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:34:15 devstack sudo[100475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:34:15 devstack sudo[100475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:34:15 devstack sudo[100473]: pam_unix(sudo:session): session closed for user root
Nov 03 18:34:15 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-dafd5517-8464-4c9f-80b8-4a21e3284b48 tempest-TestStampPattern-2051953486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-261b681b-c984-43e5-abdb-a2acaaf9e6e1.info" returned: 0 in 0.382s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:34:15 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-dafd5517-8464-4c9f-80b8-4a21e3284b48 tempest-TestStampPattern-2051953486 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.443s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:34:15 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-dafd5517-8464-4c9f-80b8-4a21e3284b48 tempest-TestStampPattern-2051953486 None] Create snapshot completed successfully
Nov 03 18:34:15 devstack sudo[100475]: pam_unix(sudo:session): session closed for user root
Nov 03 18:34:15 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.432s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:34:15 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:34:15 devstack cinder-volume[86120]: DEBUG oslo_service.periodic_task [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Running periodic task VolumeManager._thread_info {{(pid=86120) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 18:34:15 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] thread count: 28 {{(pid=86120) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 03 18:34:15 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] thread info: [<_MainThread(MainThread, started 134747145822336)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134747033686336)>, <Thread(Thread-3 (stat_writer), started daemon 134747030828736)>, <Thread(Rabbit-heartbeat, started daemon 134747035433408)>, <Thread(Thread-5 (_runner), started daemon 134747029587392)>, <Thread(Thread-7 (_runner), started daemon 134747029784256)>, <Thread(fd_logger, started daemon 134747027909120)>, <Thread(privsep_reader, started daemon 134747027006592)>, <Thread(tpool_thread_0, started daemon 134747018950336)>, <Thread(tpool_thread_1, started daemon 134747010541248)>, <Thread(tpool_thread_2, started daemon 134747002132160)>, <Thread(tpool_thread_3, started daemon 134746993723072)>, <Thread(tpool_thread_4, started daemon 134746985313984)>, <Thread(tpool_thread_5, started daemon 134746976904896)>, <Thread(tpool_thread_6, started daemon 134746968495808)>, <Thread(tpool_thread_7, started daemon 134746960086720)>, <Thread(tpool_thread_8, started daemon 134746951677632)>, <Thread(tpool_thread_9, started daemon 134746943268544)>, <Thread(tpool_thread_10, started daemon 134746934859456)>, <Thread(tpool_thread_11, started daemon 134746926450368)>, <Thread(tpool_thread_12, started daemon 134746918041280)>, <Thread(tpool_thread_13, started daemon 134746909632192)>, <Thread(tpool_thread_14, started daemon 134746901223104)>, <Thread(tpool_thread_15, started daemon 134746892814016)>, <Thread(tpool_thread_16, started daemon 134746884404928)>, <Thread(tpool_thread_17, started daemon 134746875995840)>, <Thread(tpool_thread_18, started daemon 134746867586752)>, <Thread(tpool_thread_19, started daemon 134746859177664)>] {{(pid=86120) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 03 18:34:25 devstack cinder-volume[86120]: DEBUG dbcounter [-] [86120] Writing DB stats cinder:SELECT=43,cinder:INSERT=11,cinder:UPDATE=46,cinder:DELETE=4 {{(pid=86120) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 18:34:25 devstack cinder-volume[86120]: DEBUG dbcounter [-] [86120] Writing DB stats cinder:SELECT=42,cinder:INSERT=8,cinder:UPDATE=39,cinder:DELETE=3 {{(pid=86120) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 18:34:25 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0a0a54d-c8c7-47fe-a8da-0a52ffbcc445 tempest-TestStampPattern-2051953486 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:34:25 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-a0a0a54d-c8c7-47fe-a8da-0a52ffbcc445 tempest-TestStampPattern-2051953486 None] Flow 'volume_create_manager' (dbffd44f-37a1-49ff-821f-b266960689e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:34:25 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-a0a0a54d-c8c7-47fe-a8da-0a52ffbcc445 tempest-TestStampPattern-2051953486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ad1e551-b0ba-47cb-998f-0d93d45726ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:34:25 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-a0a0a54d-c8c7-47fe-a8da-0a52ffbcc445 tempest-TestStampPattern-2051953486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ad1e551-b0ba-47cb-998f-0d93d45726ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:34:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-588638625',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec90430d-c8b6-41c5-8b87-697757832b3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ee78a679e784b79b4c5c5d37b22ba4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:34:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=7e96fe29-8ea6-44ec-bc8d-e11c48f530fc,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:34:25Z,use_quota=True,user_id='f5eac2c8508245e49b3aa55495ee9f16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:34:25 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-a0a0a54d-c8c7-47fe-a8da-0a52ffbcc445 tempest-TestStampPattern-2051953486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (073ae050-21fb-4c0a-aec2-9ef3899a0494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:34:25 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-a0a0a54d-c8c7-47fe-a8da-0a52ffbcc445 tempest-TestStampPattern-2051953486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (073ae050-21fb-4c0a-aec2-9ef3899a0494) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:34:25 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-a0a0a54d-c8c7-47fe-a8da-0a52ffbcc445 tempest-TestStampPattern-2051953486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a7c8da3-3a66-4af3-8bcb-bc215b0673fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:34:25 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-a0a0a54d-c8c7-47fe-a8da-0a52ffbcc445 tempest-TestStampPattern-2051953486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a7c8da3-3a66-4af3-8bcb-bc215b0673fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ec90430d-c8b6-41c5-8b87-697757832b3e', 'volume_name': 'volume-ec90430d-c8b6-41c5-8b87-697757832b3e', 'volume_size': 1, 'snapshot_id': '7e96fe29-8ea6-44ec-bc8d-e11c48f530fc'}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:34:25 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-a0a0a54d-c8c7-47fe-a8da-0a52ffbcc445 tempest-TestStampPattern-2051953486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1def3ca-b609-4921-83a5-b108cb34ef1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:34:25 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-a0a0a54d-c8c7-47fe-a8da-0a52ffbcc445 tempest-TestStampPattern-2051953486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1def3ca-b609-4921-83a5-b108cb34ef1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:34:25 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-a0a0a54d-c8c7-47fe-a8da-0a52ffbcc445 tempest-TestStampPattern-2051953486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e20aee84-4f99-4e7e-9d7e-de30e52e99d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:34:25 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-a0a0a54d-c8c7-47fe-a8da-0a52ffbcc445 tempest-TestStampPattern-2051953486 None] Volume ec90430d-c8b6-41c5-8b87-697757832b3e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ec90430d-c8b6-41c5-8b87-697757832b3e', 'volume_size': 1, 'snapshot_id': '7e96fe29-8ea6-44ec-bc8d-e11c48f530fc'}
Nov 03 18:34:25 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-a0a0a54d-c8c7-47fe-a8da-0a52ffbcc445 tempest-TestStampPattern-2051953486 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:34:25 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-a0a0a54d-c8c7-47fe-a8da-0a52ffbcc445 tempest-TestStampPattern-2051953486 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:34:25 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-a0a0a54d-c8c7-47fe-a8da-0a52ffbcc445 tempest-TestStampPattern-2051953486 None] Acquiring lock "cinder-quobyte-7e96fe29-8ea6-44ec-bc8d-e11c48f530fc-ec90430d-c8b6-41c5-8b87-697757832b3e" by "_create_volume_from_snapshot" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:34:25 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-a0a0a54d-c8c7-47fe-a8da-0a52ffbcc445 tempest-TestStampPattern-2051953486 None] Lock "cinder-quobyte-7e96fe29-8ea6-44ec-bc8d-e11c48f530fc-ec90430d-c8b6-41c5-8b87-697757832b3e" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:34:25 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-a0a0a54d-c8c7-47fe-a8da-0a52ffbcc445 tempest-TestStampPattern-2051953486 None] Creating volume ec90430d-c8b6-41c5-8b87-697757832b3e from snapshot 7e96fe29-8ea6-44ec-bc8d-e11c48f530fc {{(pid=86120) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 03 18:34:25 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-a0a0a54d-c8c7-47fe-a8da-0a52ffbcc445 tempest-TestStampPattern-2051953486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:34:25 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-a0a0a54d-c8c7-47fe-a8da-0a52ffbcc445 tempest-TestStampPattern-2051953486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:34:25 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-a0a0a54d-c8c7-47fe-a8da-0a52ffbcc445 tempest-TestStampPattern-2051953486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:34:25 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-a0a0a54d-c8c7-47fe-a8da-0a52ffbcc445 tempest-TestStampPattern-2051953486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:34:25 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-a0a0a54d-c8c7-47fe-a8da-0a52ffbcc445 tempest-TestStampPattern-2051953486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:34:25 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-a0a0a54d-c8c7-47fe-a8da-0a52ffbcc445 tempest-TestStampPattern-2051953486 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:34:25 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-a0a0a54d-c8c7-47fe-a8da-0a52ffbcc445 tempest-TestStampPattern-2051953486 None] Acquiring lock "cinder-quobyte-ec90430d-c8b6-41c5-8b87-697757832b3e" by "_copy_volume_from_snapshot" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:34:25 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-a0a0a54d-c8c7-47fe-a8da-0a52ffbcc445 tempest-TestStampPattern-2051953486 None] Lock "cinder-quobyte-ec90430d-c8b6-41c5-8b87-697757832b3e" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:34:25 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-a0a0a54d-c8c7-47fe-a8da-0a52ffbcc445 tempest-TestStampPattern-2051953486 None] snapshot: 7e96fe29-8ea6-44ec-bc8d-e11c48f530fc, volume: ec90430d-c8b6-41c5-8b87-697757832b3e,  {{(pid=86120) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 03 18:34:25 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-a0a0a54d-c8c7-47fe-a8da-0a52ffbcc445 tempest-TestStampPattern-2051953486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:34:25 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-a0a0a54d-c8c7-47fe-a8da-0a52ffbcc445 tempest-TestStampPattern-2051953486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:34:25 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-a0a0a54d-c8c7-47fe-a8da-0a52ffbcc445 tempest-TestStampPattern-2051953486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:34:25 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-a0a0a54d-c8c7-47fe-a8da-0a52ffbcc445 tempest-TestStampPattern-2051953486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:34:25 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-a0a0a54d-c8c7-47fe-a8da-0a52ffbcc445 tempest-TestStampPattern-2051953486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:34:25 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[624eb4dd-ef84-4f69-908b-ef9f0e8cee68]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:34:25 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-a0a0a54d-c8c7-47fe-a8da-0a52ffbcc445 tempest-TestStampPattern-2051953486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-261b681b-c984-43e5-abdb-a2acaaf9e6e1.7e96fe29-8ea6-44ec-bc8d-e11c48f530fc {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:34:25 devstack sudo[100595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-261b681b-c984-43e5-abdb-a2acaaf9e6e1.7e96fe29-8ea6-44ec-bc8d-e11c48f530fc
Nov 03 18:34:25 devstack sudo[100595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:34:26 devstack sudo[100595]: pam_unix(sudo:session): session closed for user root
Nov 03 18:34:26 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-a0a0a54d-c8c7-47fe-a8da-0a52ffbcc445 tempest-TestStampPattern-2051953486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-261b681b-c984-43e5-abdb-a2acaaf9e6e1.7e96fe29-8ea6-44ec-bc8d-e11c48f530fc" returned: 0 in 0.469s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:34:26 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-a0a0a54d-c8c7-47fe-a8da-0a52ffbcc445 tempest-TestStampPattern-2051953486 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-261b681b-c984-43e5-abdb-a2acaaf9e6e1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86120) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 18:34:26 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[76300247-b5e8-4a30-bdd3-ee4594963fac]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:34:26 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-a0a0a54d-c8c7-47fe-a8da-0a52ffbcc445 tempest-TestStampPattern-2051953486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-261b681b-c984-43e5-abdb-a2acaaf9e6e1 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:34:26 devstack sudo[100601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-261b681b-c984-43e5-abdb-a2acaaf9e6e1
Nov 03 18:34:26 devstack sudo[100601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:34:26 devstack sudo[100601]: pam_unix(sudo:session): session closed for user root
Nov 03 18:34:26 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-a0a0a54d-c8c7-47fe-a8da-0a52ffbcc445 tempest-TestStampPattern-2051953486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-261b681b-c984-43e5-abdb-a2acaaf9e6e1" returned: 0 in 0.518s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:34:26 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-a0a0a54d-c8c7-47fe-a8da-0a52ffbcc445 tempest-TestStampPattern-2051953486 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-261b681b-c984-43e5-abdb-a2acaaf9e6e1 {{(pid=86120) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 03 18:34:26 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-a0a0a54d-c8c7-47fe-a8da-0a52ffbcc445 tempest-TestStampPattern-2051953486 None] Creating direct copy from snapshot {{(pid=86120) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 03 18:34:26 devstack cinder-volume[86120]: DEBUG cinder.utils [None req-a0a0a54d-c8c7-47fe-a8da-0a52ffbcc445 tempest-TestStampPattern-2051953486 None] Path /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ec90430d-c8b6-41c5-8b87-697757832b3e not found in is_blk_device check {{(pid=86120) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 03 18:34:26 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-a0a0a54d-c8c7-47fe-a8da-0a52ffbcc445 tempest-TestStampPattern-2051953486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-261b681b-c984-43e5-abdb-a2acaaf9e6e1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ec90430d-c8b6-41c5-8b87-697757832b3e {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:34:26 devstack sudo[100609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-261b681b-c984-43e5-abdb-a2acaaf9e6e1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ec90430d-c8b6-41c5-8b87-697757832b3e
Nov 03 18:34:26 devstack sudo[100609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:34:35 devstack cinder-volume[86120]: DEBUG dbcounter [-] [86120] Writing DB stats cinder:SELECT=2 {{(pid=86120) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 18:34:35 devstack cinder-volume[86120]: DEBUG dbcounter [-] [86120] Writing DB stats cinder:UPDATE=1,cinder:SELECT=2 {{(pid=86120) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 18:34:37 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-a0a0a54d-c8c7-47fe-a8da-0a52ffbcc445 tempest-TestStampPattern-2051953486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-261b681b-c984-43e5-abdb-a2acaaf9e6e1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ec90430d-c8b6-41c5-8b87-697757832b3e" returned: 0 in 10.761s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:34:37 devstack cinder-volume[86120]: DEBUG cinder.image.image_utils [None req-a0a0a54d-c8c7-47fe-a8da-0a52ffbcc445 tempest-TestStampPattern-2051953486 None] Image conversion details: src /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-261b681b-c984-43e5-abdb-a2acaaf9e6e1, size 1024.00 MB, duration 10.76 sec, destination /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ec90430d-c8b6-41c5-8b87-697757832b3e {{(pid=86120) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 03 18:34:37 devstack cinder-volume[86120]: INFO cinder.image.image_utils [None req-a0a0a54d-c8c7-47fe-a8da-0a52ffbcc445 tempest-TestStampPattern-2051953486 None] Converted 1024.00 MB image at 95.15 MB/s
Nov 03 18:34:37 devstack cinder-volume[86120]: WARNING cinder.volume.drivers.remotefs [None req-a0a0a54d-c8c7-47fe-a8da-0a52ffbcc445 tempest-TestStampPattern-2051953486 None] /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ec90430d-c8b6-41c5-8b87-697757832b3e is being set with open permissions: ugo+rw
Nov 03 18:34:37 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-a0a0a54d-c8c7-47fe-a8da-0a52ffbcc445 tempest-TestStampPattern-2051953486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ec90430d-c8b6-41c5-8b87-697757832b3e {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:34:37 devstack sudo[100714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ec90430d-c8b6-41c5-8b87-697757832b3e
Nov 03 18:34:37 devstack sudo[100714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:34:38 devstack sudo[100714]: pam_unix(sudo:session): session closed for user root
Nov 03 18:34:38 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-a0a0a54d-c8c7-47fe-a8da-0a52ffbcc445 tempest-TestStampPattern-2051953486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ec90430d-c8b6-41c5-8b87-697757832b3e" returned: 0 in 0.482s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:34:38 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-a0a0a54d-c8c7-47fe-a8da-0a52ffbcc445 tempest-TestStampPattern-2051953486 None] Lock "cinder-quobyte-ec90430d-c8b6-41c5-8b87-697757832b3e" released by "_copy_volume_from_snapshot" :: held 12.366s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:34:38 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-a0a0a54d-c8c7-47fe-a8da-0a52ffbcc445 tempest-TestStampPattern-2051953486 None] Lock "cinder-quobyte-7e96fe29-8ea6-44ec-bc8d-e11c48f530fc-ec90430d-c8b6-41c5-8b87-697757832b3e" released by "_create_volume_from_snapshot" :: held 12.483s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:34:38 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-a0a0a54d-c8c7-47fe-a8da-0a52ffbcc445 tempest-TestStampPattern-2051953486 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.506s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:34:38 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-a0a0a54d-c8c7-47fe-a8da-0a52ffbcc445 tempest-TestStampPattern-2051953486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e20aee84-4f99-4e7e-9d7e-de30e52e99d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec90430d-c8b6-41c5-8b87-697757832b3e', 'volume_size': 1, 'snapshot_id': '7e96fe29-8ea6-44ec-bc8d-e11c48f530fc'}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:34:38 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-a0a0a54d-c8c7-47fe-a8da-0a52ffbcc445 tempest-TestStampPattern-2051953486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9053b21f-1257-45cf-92a4-f9534243b9fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:34:38 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-a0a0a54d-c8c7-47fe-a8da-0a52ffbcc445 tempest-TestStampPattern-2051953486 None] Volume volume-ec90430d-c8b6-41c5-8b87-697757832b3e (ec90430d-c8b6-41c5-8b87-697757832b3e): created successfully
Nov 03 18:34:38 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-a0a0a54d-c8c7-47fe-a8da-0a52ffbcc445 tempest-TestStampPattern-2051953486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9053b21f-1257-45cf-92a4-f9534243b9fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:34:38 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-a0a0a54d-c8c7-47fe-a8da-0a52ffbcc445 tempest-TestStampPattern-2051953486 None] Flow 'volume_create_manager' (dbffd44f-37a1-49ff-821f-b266960689e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:34:38 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-a0a0a54d-c8c7-47fe-a8da-0a52ffbcc445 tempest-TestStampPattern-2051953486 None] Created volume successfully.
Nov 03 18:34:43 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-5dd78f98-97b7-49aa-b4c1-eb0304ca05d5 tempest-AttachVolumeNegativeTest-621877883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:34:43 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-5dd78f98-97b7-49aa-b4c1-eb0304ca05d5 tempest-AttachVolumeNegativeTest-621877883 None] Flow 'volume_create_manager' (1c476ab4-1eab-4ecf-b845-4247a11b2882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:34:43 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-5dd78f98-97b7-49aa-b4c1-eb0304ca05d5 tempest-AttachVolumeNegativeTest-621877883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66e356c6-2548-40be-8fc0-a5f396648ab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:34:43 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-5dd78f98-97b7-49aa-b4c1-eb0304ca05d5 tempest-AttachVolumeNegativeTest-621877883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66e356c6-2548-40be-8fc0-a5f396648ab4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:34:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-117269611',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e9206d4-a35d-41ee-bb03-79dd2e8a494e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='947da25973cf48a4afa1ef1957395d16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:34:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:34:43Z,use_quota=True,user_id='f08080986d0446f99591e76938d047cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:34:43 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-5dd78f98-97b7-49aa-b4c1-eb0304ca05d5 tempest-AttachVolumeNegativeTest-621877883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1401efe-862c-4d75-ac21-237312ba37f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:34:43 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-5dd78f98-97b7-49aa-b4c1-eb0304ca05d5 tempest-AttachVolumeNegativeTest-621877883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1401efe-862c-4d75-ac21-237312ba37f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:34:43 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-5dd78f98-97b7-49aa-b4c1-eb0304ca05d5 tempest-AttachVolumeNegativeTest-621877883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cce6575-d30a-4464-be23-ee8fe149f7bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:34:43 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-5dd78f98-97b7-49aa-b4c1-eb0304ca05d5 tempest-AttachVolumeNegativeTest-621877883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cce6575-d30a-4464-be23-ee8fe149f7bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e9206d4-a35d-41ee-bb03-79dd2e8a494e', 'volume_name': 'volume-4e9206d4-a35d-41ee-bb03-79dd2e8a494e', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:34:43 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-5dd78f98-97b7-49aa-b4c1-eb0304ca05d5 tempest-AttachVolumeNegativeTest-621877883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1ca5a34-8536-4755-a0b4-880cb575e680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:34:43 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-5dd78f98-97b7-49aa-b4c1-eb0304ca05d5 tempest-AttachVolumeNegativeTest-621877883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1ca5a34-8536-4755-a0b4-880cb575e680) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:34:43 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-5dd78f98-97b7-49aa-b4c1-eb0304ca05d5 tempest-AttachVolumeNegativeTest-621877883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bcbbbed-c942-4fc2-95a5-4bab7d4039a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:34:43 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-5dd78f98-97b7-49aa-b4c1-eb0304ca05d5 tempest-AttachVolumeNegativeTest-621877883 None] Volume 4e9206d4-a35d-41ee-bb03-79dd2e8a494e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e9206d4-a35d-41ee-bb03-79dd2e8a494e', 'volume_size': 1}
Nov 03 18:34:43 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-5dd78f98-97b7-49aa-b4c1-eb0304ca05d5 tempest-AttachVolumeNegativeTest-621877883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:34:43 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-5dd78f98-97b7-49aa-b4c1-eb0304ca05d5 tempest-AttachVolumeNegativeTest-621877883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:34:43 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-5dd78f98-97b7-49aa-b4c1-eb0304ca05d5 tempest-AttachVolumeNegativeTest-621877883 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:34:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-117269611',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e9206d4-a35d-41ee-bb03-79dd2e8a494e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='947da25973cf48a4afa1ef1957395d16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:34:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:34:43Z,use_quota=True,user_id='f08080986d0446f99591e76938d047cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:34:43 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-5dd78f98-97b7-49aa-b4c1-eb0304ca05d5 tempest-AttachVolumeNegativeTest-621877883 None] Creating volume 4e9206d4-a35d-41ee-bb03-79dd2e8a494e {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:34:43 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-5dd78f98-97b7-49aa-b4c1-eb0304ca05d5 tempest-AttachVolumeNegativeTest-621877883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:34:43 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-5dd78f98-97b7-49aa-b4c1-eb0304ca05d5 tempest-AttachVolumeNegativeTest-621877883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:34:43 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-5dd78f98-97b7-49aa-b4c1-eb0304ca05d5 tempest-AttachVolumeNegativeTest-621877883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:34:43 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-5dd78f98-97b7-49aa-b4c1-eb0304ca05d5 tempest-AttachVolumeNegativeTest-621877883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:34:43 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-5dd78f98-97b7-49aa-b4c1-eb0304ca05d5 tempest-AttachVolumeNegativeTest-621877883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:34:43 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-5dd78f98-97b7-49aa-b4c1-eb0304ca05d5 tempest-AttachVolumeNegativeTest-621877883 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:34:43 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-5dd78f98-97b7-49aa-b4c1-eb0304ca05d5 tempest-AttachVolumeNegativeTest-621877883 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:34:43 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-5dd78f98-97b7-49aa-b4c1-eb0304ca05d5 tempest-AttachVolumeNegativeTest-621877883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-4e9206d4-a35d-41ee-bb03-79dd2e8a494e 1073741824 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:34:43 devstack sudo[100756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-4e9206d4-a35d-41ee-bb03-79dd2e8a494e 1073741824
Nov 03 18:34:43 devstack sudo[100756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:34:44 devstack sudo[100756]: pam_unix(sudo:session): session closed for user root
Nov 03 18:34:44 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-5dd78f98-97b7-49aa-b4c1-eb0304ca05d5 tempest-AttachVolumeNegativeTest-621877883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-4e9206d4-a35d-41ee-bb03-79dd2e8a494e 1073741824" returned: 0 in 0.570s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:34:44 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-5dd78f98-97b7-49aa-b4c1-eb0304ca05d5 tempest-AttachVolumeNegativeTest-621877883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-4e9206d4-a35d-41ee-bb03-79dd2e8a494e {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:34:44 devstack sudo[100762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-4e9206d4-a35d-41ee-bb03-79dd2e8a494e
Nov 03 18:34:44 devstack sudo[100762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:34:44 devstack sudo[100762]: pam_unix(sudo:session): session closed for user root
Nov 03 18:34:44 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-5dd78f98-97b7-49aa-b4c1-eb0304ca05d5 tempest-AttachVolumeNegativeTest-621877883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-4e9206d4-a35d-41ee-bb03-79dd2e8a494e" returned: 0 in 0.429s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:34:44 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-5dd78f98-97b7-49aa-b4c1-eb0304ca05d5 tempest-AttachVolumeNegativeTest-621877883 None] <== create_volume: return (1059ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:34:44 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-5dd78f98-97b7-49aa-b4c1-eb0304ca05d5 tempest-AttachVolumeNegativeTest-621877883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.065s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:34:44 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-5dd78f98-97b7-49aa-b4c1-eb0304ca05d5 tempest-AttachVolumeNegativeTest-621877883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bcbbbed-c942-4fc2-95a5-4bab7d4039a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e9206d4-a35d-41ee-bb03-79dd2e8a494e', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:34:44 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-5dd78f98-97b7-49aa-b4c1-eb0304ca05d5 tempest-AttachVolumeNegativeTest-621877883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d63eb158-9288-49fe-9d8c-8f90cb83fdae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:34:44 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-5dd78f98-97b7-49aa-b4c1-eb0304ca05d5 tempest-AttachVolumeNegativeTest-621877883 None] Volume volume-4e9206d4-a35d-41ee-bb03-79dd2e8a494e (4e9206d4-a35d-41ee-bb03-79dd2e8a494e): created successfully
Nov 03 18:34:44 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-5dd78f98-97b7-49aa-b4c1-eb0304ca05d5 tempest-AttachVolumeNegativeTest-621877883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d63eb158-9288-49fe-9d8c-8f90cb83fdae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:34:44 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-5dd78f98-97b7-49aa-b4c1-eb0304ca05d5 tempest-AttachVolumeNegativeTest-621877883 None] Flow 'volume_create_manager' (1c476ab4-1eab-4ecf-b845-4247a11b2882) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:34:44 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-5dd78f98-97b7-49aa-b4c1-eb0304ca05d5 tempest-AttachVolumeNegativeTest-621877883 None] Created volume successfully.
Nov 03 18:34:46 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [req-58f201df-164d-4759-8235-cc50eb0e51e1 req-b9a277bc-dfbe-4f8b-a891-0467a652d48f tempest-AttachVolumeNegativeTest-621877883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:34:46 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [req-58f201df-164d-4759-8235-cc50eb0e51e1 req-b9a277bc-dfbe-4f8b-a891-0467a652d48f tempest-AttachVolumeNegativeTest-621877883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:34:46 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [req-58f201df-164d-4759-8235-cc50eb0e51e1 req-b9a277bc-dfbe-4f8b-a891-0467a652d48f tempest-AttachVolumeNegativeTest-621877883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:34:46 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [req-58f201df-164d-4759-8235-cc50eb0e51e1 req-b9a277bc-dfbe-4f8b-a891-0467a652d48f tempest-AttachVolumeNegativeTest-621877883 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c', 'name': 'volume-4e9206d4-a35d-41ee-bb03-79dd2e8a494e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '994d36cd-2485-44d7-adc0-ca42ddc0e98a', 'enforce_multipath': True} {{(pid=86120) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 03 18:34:46 devstack cinder-volume[86120]: INFO cinder.volume.manager [req-58f201df-164d-4759-8235-cc50eb0e51e1 req-b9a277bc-dfbe-4f8b-a891-0467a652d48f tempest-AttachVolumeNegativeTest-621877883 None] attachment_update completed successfully.
Nov 03 18:34:49 devstack cinder-volume[86120]: INFO cinder.volume.manager [req-b58370c8-e056-4f73-8f67-7cb57909f92b req-b4a551b2-6183-43d5-8615-82b728bd8f7b tempest-AttachVolumeNegativeTest-621877883 None] Terminate volume connection completed successfully.
Nov 03 18:34:49 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [req-b58370c8-e056-4f73-8f67-7cb57909f92b req-b4a551b2-6183-43d5-8615-82b728bd8f7b tempest-AttachVolumeNegativeTest-621877883 None] Deleting attachment 994d36cd-2485-44d7-adc0-ca42ddc0e98a. {{(pid=86120) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 03 18:34:54 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-b8411a05-6fd1-4123-9d24-65f2f44551cd tempest-AttachVolumeNegativeTest-621877883 None] Acquiring lock "cinder-4e9206d4-a35d-41ee-bb03-79dd2e8a494e-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:34:54 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-b8411a05-6fd1-4123-9d24-65f2f44551cd tempest-AttachVolumeNegativeTest-621877883 None] Lock "cinder-4e9206d4-a35d-41ee-bb03-79dd2e8a494e-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:34:54 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-b8411a05-6fd1-4123-9d24-65f2f44551cd tempest-AttachVolumeNegativeTest-621877883 None] Acquiring lock "cinder-quobyte-4e9206d4-a35d-41ee-bb03-79dd2e8a494e" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:34:54 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-b8411a05-6fd1-4123-9d24-65f2f44551cd tempest-AttachVolumeNegativeTest-621877883 None] Lock "cinder-quobyte-4e9206d4-a35d-41ee-bb03-79dd2e8a494e" acquired by "delete_volume" :: waited 0.020s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:34:54 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[18d8993c-cb65-45ff-971b-974332182b5d]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:34:54 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b8411a05-6fd1-4123-9d24-65f2f44551cd tempest-AttachVolumeNegativeTest-621877883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-4e9206d4-a35d-41ee-bb03-79dd2e8a494e {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:34:54 devstack sudo[101273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-4e9206d4-a35d-41ee-bb03-79dd2e8a494e
Nov 03 18:34:54 devstack sudo[101273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:34:55 devstack sudo[101273]: pam_unix(sudo:session): session closed for user root
Nov 03 18:34:55 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b8411a05-6fd1-4123-9d24-65f2f44551cd tempest-AttachVolumeNegativeTest-621877883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-4e9206d4-a35d-41ee-bb03-79dd2e8a494e" returned: 0 in 0.437s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:34:55 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b8411a05-6fd1-4123-9d24-65f2f44551cd tempest-AttachVolumeNegativeTest-621877883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-4e9206d4-a35d-41ee-bb03-79dd2e8a494e {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:34:55 devstack sudo[101279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-4e9206d4-a35d-41ee-bb03-79dd2e8a494e
Nov 03 18:34:55 devstack sudo[101279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:34:55 devstack sudo[101279]: pam_unix(sudo:session): session closed for user root
Nov 03 18:34:55 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b8411a05-6fd1-4123-9d24-65f2f44551cd tempest-AttachVolumeNegativeTest-621877883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-4e9206d4-a35d-41ee-bb03-79dd2e8a494e" returned: 0 in 0.311s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:34:55 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-b8411a05-6fd1-4123-9d24-65f2f44551cd tempest-AttachVolumeNegativeTest-621877883 None] Lock "cinder-quobyte-4e9206d4-a35d-41ee-bb03-79dd2e8a494e" released by "delete_volume" :: held 0.819s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:34:55 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-b8411a05-6fd1-4123-9d24-65f2f44551cd tempest-AttachVolumeNegativeTest-621877883 None] Created reservations ['32193471-94f3-48ec-88b0-645126341b18', '8398de69-34d1-4b07-bc23-91ae4f5fb01d', '50a2b493-bbfa-43c0-8a48-bd48cfe03aec', 'ee1c015a-1b0e-4684-abbe-7ee3fbeac989'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:34:55 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-b8411a05-6fd1-4123-9d24-65f2f44551cd tempest-AttachVolumeNegativeTest-621877883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:34:55 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-b8411a05-6fd1-4123-9d24-65f2f44551cd tempest-AttachVolumeNegativeTest-621877883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:34:55 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-b8411a05-6fd1-4123-9d24-65f2f44551cd tempest-AttachVolumeNegativeTest-621877883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:34:55 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-b8411a05-6fd1-4123-9d24-65f2f44551cd tempest-AttachVolumeNegativeTest-621877883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:34:55 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-b8411a05-6fd1-4123-9d24-65f2f44551cd tempest-AttachVolumeNegativeTest-621877883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:34:55 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b8411a05-6fd1-4123-9d24-65f2f44551cd tempest-AttachVolumeNegativeTest-621877883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:34:55 devstack sudo[101282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:34:55 devstack sudo[101282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:34:56 devstack sudo[101282]: pam_unix(sudo:session): session closed for user root
Nov 03 18:34:56 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b8411a05-6fd1-4123-9d24-65f2f44551cd tempest-AttachVolumeNegativeTest-621877883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.354s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:34:56 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-b8411a05-6fd1-4123-9d24-65f2f44551cd tempest-AttachVolumeNegativeTest-621877883 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:34:56 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-b8411a05-6fd1-4123-9d24-65f2f44551cd tempest-AttachVolumeNegativeTest-621877883 None] Deleted volume successfully.
Nov 03 18:34:56 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-ebaa36fd-bc73-418e-881e-ad3db1031bcd tempest-AttachVolumeNegativeTest-621877883 None] Acquiring lock "cinder-44c8359e-2f5f-4df0-a0e1-96557b7e9b04-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:34:56 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-b8411a05-6fd1-4123-9d24-65f2f44551cd tempest-AttachVolumeNegativeTest-621877883 None] Lock "cinder-4e9206d4-a35d-41ee-bb03-79dd2e8a494e-delete_volume" released by "delete_volume" :: held 1.467s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:34:56 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-ebaa36fd-bc73-418e-881e-ad3db1031bcd tempest-AttachVolumeNegativeTest-621877883 None] Lock "cinder-44c8359e-2f5f-4df0-a0e1-96557b7e9b04-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:34:56 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-ebaa36fd-bc73-418e-881e-ad3db1031bcd tempest-AttachVolumeNegativeTest-621877883 None] Acquiring lock "cinder-quobyte-44c8359e-2f5f-4df0-a0e1-96557b7e9b04" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:34:56 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-ebaa36fd-bc73-418e-881e-ad3db1031bcd tempest-AttachVolumeNegativeTest-621877883 None] Lock "cinder-quobyte-44c8359e-2f5f-4df0-a0e1-96557b7e9b04" acquired by "delete_volume" :: waited 0.023s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:34:56 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[76513f64-d706-4e8a-a853-242631dee51e]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:34:56 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-ebaa36fd-bc73-418e-881e-ad3db1031bcd tempest-AttachVolumeNegativeTest-621877883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-44c8359e-2f5f-4df0-a0e1-96557b7e9b04 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:34:56 devstack sudo[101294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-44c8359e-2f5f-4df0-a0e1-96557b7e9b04
Nov 03 18:34:56 devstack sudo[101294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:34:56 devstack sudo[101294]: pam_unix(sudo:session): session closed for user root
Nov 03 18:34:56 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-ebaa36fd-bc73-418e-881e-ad3db1031bcd tempest-AttachVolumeNegativeTest-621877883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-44c8359e-2f5f-4df0-a0e1-96557b7e9b04" returned: 0 in 0.410s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:34:56 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-ebaa36fd-bc73-418e-881e-ad3db1031bcd tempest-AttachVolumeNegativeTest-621877883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-44c8359e-2f5f-4df0-a0e1-96557b7e9b04 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:34:56 devstack sudo[101303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-44c8359e-2f5f-4df0-a0e1-96557b7e9b04
Nov 03 18:34:56 devstack sudo[101303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:34:56 devstack sudo[101303]: pam_unix(sudo:session): session closed for user root
Nov 03 18:34:56 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-ebaa36fd-bc73-418e-881e-ad3db1031bcd tempest-AttachVolumeNegativeTest-621877883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-44c8359e-2f5f-4df0-a0e1-96557b7e9b04" returned: 0 in 0.281s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:34:56 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-ebaa36fd-bc73-418e-881e-ad3db1031bcd tempest-AttachVolumeNegativeTest-621877883 None] Lock "cinder-quobyte-44c8359e-2f5f-4df0-a0e1-96557b7e9b04" released by "delete_volume" :: held 0.754s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:34:57 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-ebaa36fd-bc73-418e-881e-ad3db1031bcd tempest-AttachVolumeNegativeTest-621877883 None] Created reservations ['dbcd913c-4ca5-4a92-8499-830a5d15c864', 'd3da61ef-488a-40b3-8a5d-1b98995d0601', '20a9aa80-d028-456b-ac2c-7f0613e542c4', '77cab1d2-d228-491f-b5a0-abbccfe63f17'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:34:57 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-ebaa36fd-bc73-418e-881e-ad3db1031bcd tempest-AttachVolumeNegativeTest-621877883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:34:57 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-ebaa36fd-bc73-418e-881e-ad3db1031bcd tempest-AttachVolumeNegativeTest-621877883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:34:57 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-ebaa36fd-bc73-418e-881e-ad3db1031bcd tempest-AttachVolumeNegativeTest-621877883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:34:57 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-ebaa36fd-bc73-418e-881e-ad3db1031bcd tempest-AttachVolumeNegativeTest-621877883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:34:57 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-ebaa36fd-bc73-418e-881e-ad3db1031bcd tempest-AttachVolumeNegativeTest-621877883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:34:57 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-ebaa36fd-bc73-418e-881e-ad3db1031bcd tempest-AttachVolumeNegativeTest-621877883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:34:57 devstack sudo[101318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:34:57 devstack sudo[101318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:34:57 devstack sudo[101318]: pam_unix(sudo:session): session closed for user root
Nov 03 18:34:57 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-ebaa36fd-bc73-418e-881e-ad3db1031bcd tempest-AttachVolumeNegativeTest-621877883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.277s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:34:57 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-ebaa36fd-bc73-418e-881e-ad3db1031bcd tempest-AttachVolumeNegativeTest-621877883 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:34:57 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-ebaa36fd-bc73-418e-881e-ad3db1031bcd tempest-AttachVolumeNegativeTest-621877883 None] Deleted volume successfully.
Nov 03 18:34:57 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-ebaa36fd-bc73-418e-881e-ad3db1031bcd tempest-AttachVolumeNegativeTest-621877883 None] Lock "cinder-44c8359e-2f5f-4df0-a0e1-96557b7e9b04-delete_volume" released by "delete_volume" :: held 1.342s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:34:57 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-7b352730-42ca-40eb-a198-183429360389 tempest-AttachVolumeNegativeTest-621877883 None] Acquiring lock "cinder-8fa467b2-7d0b-4623-894e-084590495828-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:34:57 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-7b352730-42ca-40eb-a198-183429360389 tempest-AttachVolumeNegativeTest-621877883 None] Lock "cinder-8fa467b2-7d0b-4623-894e-084590495828-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:34:57 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-7b352730-42ca-40eb-a198-183429360389 tempest-AttachVolumeNegativeTest-621877883 None] Acquiring lock "cinder-quobyte-8fa467b2-7d0b-4623-894e-084590495828" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:34:57 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-7b352730-42ca-40eb-a198-183429360389 tempest-AttachVolumeNegativeTest-621877883 None] Lock "cinder-quobyte-8fa467b2-7d0b-4623-894e-084590495828" acquired by "delete_volume" :: waited 0.018s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:34:57 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[50eebbd6-3d02-4da7-8bf8-0fedd3cb67cc]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:34:57 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-7b352730-42ca-40eb-a198-183429360389 tempest-AttachVolumeNegativeTest-621877883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8fa467b2-7d0b-4623-894e-084590495828 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:34:57 devstack sudo[101325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8fa467b2-7d0b-4623-894e-084590495828
Nov 03 18:34:57 devstack sudo[101325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:34:58 devstack sudo[101325]: pam_unix(sudo:session): session closed for user root
Nov 03 18:34:58 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-7b352730-42ca-40eb-a198-183429360389 tempest-AttachVolumeNegativeTest-621877883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8fa467b2-7d0b-4623-894e-084590495828" returned: 0 in 0.431s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:34:58 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-7b352730-42ca-40eb-a198-183429360389 tempest-AttachVolumeNegativeTest-621877883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8fa467b2-7d0b-4623-894e-084590495828 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:34:58 devstack sudo[101341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8fa467b2-7d0b-4623-894e-084590495828
Nov 03 18:34:58 devstack sudo[101341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:34:58 devstack sudo[101341]: pam_unix(sudo:session): session closed for user root
Nov 03 18:34:58 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-7b352730-42ca-40eb-a198-183429360389 tempest-AttachVolumeNegativeTest-621877883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8fa467b2-7d0b-4623-894e-084590495828" returned: 0 in 0.506s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:34:58 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-7b352730-42ca-40eb-a198-183429360389 tempest-AttachVolumeNegativeTest-621877883 None] Lock "cinder-quobyte-8fa467b2-7d0b-4623-894e-084590495828" released by "delete_volume" :: held 1.018s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:34:58 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-7b352730-42ca-40eb-a198-183429360389 tempest-AttachVolumeNegativeTest-621877883 None] Created reservations ['1101835d-ef25-4d12-bb7e-d3acf892750a', '308927f8-61c0-4c19-a561-448d534eacce', 'f02b0f47-b2c6-4759-9f44-5c3b425de992', 'c25a4cab-bfee-49f7-bda4-f5d8f5b92257'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:34:58 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-7b352730-42ca-40eb-a198-183429360389 tempest-AttachVolumeNegativeTest-621877883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:34:58 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-7b352730-42ca-40eb-a198-183429360389 tempest-AttachVolumeNegativeTest-621877883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:34:58 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-7b352730-42ca-40eb-a198-183429360389 tempest-AttachVolumeNegativeTest-621877883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:34:58 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-7b352730-42ca-40eb-a198-183429360389 tempest-AttachVolumeNegativeTest-621877883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:34:58 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-7b352730-42ca-40eb-a198-183429360389 tempest-AttachVolumeNegativeTest-621877883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:34:58 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-7b352730-42ca-40eb-a198-183429360389 tempest-AttachVolumeNegativeTest-621877883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:34:58 devstack sudo[101390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:34:58 devstack sudo[101390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:34:59 devstack sudo[101390]: pam_unix(sudo:session): session closed for user root
Nov 03 18:34:59 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-7b352730-42ca-40eb-a198-183429360389 tempest-AttachVolumeNegativeTest-621877883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.394s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:34:59 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-7b352730-42ca-40eb-a198-183429360389 tempest-AttachVolumeNegativeTest-621877883 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:34:59 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-7b352730-42ca-40eb-a198-183429360389 tempest-AttachVolumeNegativeTest-621877883 None] Deleted volume successfully.
Nov 03 18:34:59 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-7b352730-42ca-40eb-a198-183429360389 tempest-AttachVolumeNegativeTest-621877883 None] Lock "cinder-8fa467b2-7d0b-4623-894e-084590495828-delete_volume" released by "delete_volume" :: held 1.743s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:35:01 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-9353966c-80a5-48ca-b0aa-f7f4a8d3b952 tempest-TestMinimumBasicScenario-16604406 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:35:01 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-9353966c-80a5-48ca-b0aa-f7f4a8d3b952 tempest-TestMinimumBasicScenario-16604406 None] Flow 'volume_create_manager' (6690eb57-53a5-4273-b1e4-a24e97a5f381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:35:01 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-9353966c-80a5-48ca-b0aa-f7f4a8d3b952 tempest-TestMinimumBasicScenario-16604406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43bd731a-c892-40d6-952d-a07a7f98a130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:35:01 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-9353966c-80a5-48ca-b0aa-f7f4a8d3b952 tempest-TestMinimumBasicScenario-16604406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43bd731a-c892-40d6-952d-a07a7f98a130) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:35:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-414226470',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef0f5a5e-3d2f-4f78-97ec-8014cda60150,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96d93250bf8a444a96b80df7fd52682b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:35:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:35:02Z,use_quota=True,user_id='17ac2ea356d74bea995b5c2e378dd14d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:35:01 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-9353966c-80a5-48ca-b0aa-f7f4a8d3b952 tempest-TestMinimumBasicScenario-16604406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea44f2ce-984c-43b5-8391-44789241be20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:35:01 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-9353966c-80a5-48ca-b0aa-f7f4a8d3b952 tempest-TestMinimumBasicScenario-16604406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea44f2ce-984c-43b5-8391-44789241be20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:35:01 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-9353966c-80a5-48ca-b0aa-f7f4a8d3b952 tempest-TestMinimumBasicScenario-16604406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ddc7b95-4feb-49d6-a4c7-51670acc75ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:35:01 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-9353966c-80a5-48ca-b0aa-f7f4a8d3b952 tempest-TestMinimumBasicScenario-16604406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ddc7b95-4feb-49d6-a4c7-51670acc75ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef0f5a5e-3d2f-4f78-97ec-8014cda60150', 'volume_name': 'volume-ef0f5a5e-3d2f-4f78-97ec-8014cda60150', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:35:01 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-9353966c-80a5-48ca-b0aa-f7f4a8d3b952 tempest-TestMinimumBasicScenario-16604406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84384373-3552-4b8f-8582-59e45e71d197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:35:01 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-9353966c-80a5-48ca-b0aa-f7f4a8d3b952 tempest-TestMinimumBasicScenario-16604406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84384373-3552-4b8f-8582-59e45e71d197) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:35:01 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-9353966c-80a5-48ca-b0aa-f7f4a8d3b952 tempest-TestMinimumBasicScenario-16604406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (865f6825-c733-4b8f-b8da-0a313b8e4ba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:35:01 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-9353966c-80a5-48ca-b0aa-f7f4a8d3b952 tempest-TestMinimumBasicScenario-16604406 None] Volume ef0f5a5e-3d2f-4f78-97ec-8014cda60150: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef0f5a5e-3d2f-4f78-97ec-8014cda60150', 'volume_size': 1}
Nov 03 18:35:01 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-9353966c-80a5-48ca-b0aa-f7f4a8d3b952 tempest-TestMinimumBasicScenario-16604406 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:35:01 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-9353966c-80a5-48ca-b0aa-f7f4a8d3b952 tempest-TestMinimumBasicScenario-16604406 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:35:01 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-9353966c-80a5-48ca-b0aa-f7f4a8d3b952 tempest-TestMinimumBasicScenario-16604406 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:35:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-414226470',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef0f5a5e-3d2f-4f78-97ec-8014cda60150,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96d93250bf8a444a96b80df7fd52682b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:35:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:35:02Z,use_quota=True,user_id='17ac2ea356d74bea995b5c2e378dd14d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:35:01 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-9353966c-80a5-48ca-b0aa-f7f4a8d3b952 tempest-TestMinimumBasicScenario-16604406 None] Creating volume ef0f5a5e-3d2f-4f78-97ec-8014cda60150 {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:35:01 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-9353966c-80a5-48ca-b0aa-f7f4a8d3b952 tempest-TestMinimumBasicScenario-16604406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:35:01 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-9353966c-80a5-48ca-b0aa-f7f4a8d3b952 tempest-TestMinimumBasicScenario-16604406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:35:01 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-9353966c-80a5-48ca-b0aa-f7f4a8d3b952 tempest-TestMinimumBasicScenario-16604406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:35:01 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-9353966c-80a5-48ca-b0aa-f7f4a8d3b952 tempest-TestMinimumBasicScenario-16604406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:35:01 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-9353966c-80a5-48ca-b0aa-f7f4a8d3b952 tempest-TestMinimumBasicScenario-16604406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:35:01 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-9353966c-80a5-48ca-b0aa-f7f4a8d3b952 tempest-TestMinimumBasicScenario-16604406 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:35:01 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-9353966c-80a5-48ca-b0aa-f7f4a8d3b952 tempest-TestMinimumBasicScenario-16604406 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:35:01 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-9353966c-80a5-48ca-b0aa-f7f4a8d3b952 tempest-TestMinimumBasicScenario-16604406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ef0f5a5e-3d2f-4f78-97ec-8014cda60150 1073741824 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:35:01 devstack sudo[101409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ef0f5a5e-3d2f-4f78-97ec-8014cda60150 1073741824
Nov 03 18:35:01 devstack sudo[101409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:35:02 devstack sudo[101409]: pam_unix(sudo:session): session closed for user root
Nov 03 18:35:02 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-9353966c-80a5-48ca-b0aa-f7f4a8d3b952 tempest-TestMinimumBasicScenario-16604406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ef0f5a5e-3d2f-4f78-97ec-8014cda60150 1073741824" returned: 0 in 0.492s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:35:02 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-9353966c-80a5-48ca-b0aa-f7f4a8d3b952 tempest-TestMinimumBasicScenario-16604406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ef0f5a5e-3d2f-4f78-97ec-8014cda60150 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:35:02 devstack sudo[101415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ef0f5a5e-3d2f-4f78-97ec-8014cda60150
Nov 03 18:35:02 devstack sudo[101415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:35:02 devstack sudo[101415]: pam_unix(sudo:session): session closed for user root
Nov 03 18:35:02 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-9353966c-80a5-48ca-b0aa-f7f4a8d3b952 tempest-TestMinimumBasicScenario-16604406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ef0f5a5e-3d2f-4f78-97ec-8014cda60150" returned: 0 in 0.335s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:35:02 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-9353966c-80a5-48ca-b0aa-f7f4a8d3b952 tempest-TestMinimumBasicScenario-16604406 None] <== create_volume: return (882ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:35:02 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-9353966c-80a5-48ca-b0aa-f7f4a8d3b952 tempest-TestMinimumBasicScenario-16604406 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.885s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:35:02 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-9353966c-80a5-48ca-b0aa-f7f4a8d3b952 tempest-TestMinimumBasicScenario-16604406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (865f6825-c733-4b8f-b8da-0a313b8e4ba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef0f5a5e-3d2f-4f78-97ec-8014cda60150', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:35:02 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-9353966c-80a5-48ca-b0aa-f7f4a8d3b952 tempest-TestMinimumBasicScenario-16604406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (409110af-3a2a-43a0-af00-f648beea7a8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:35:02 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-9353966c-80a5-48ca-b0aa-f7f4a8d3b952 tempest-TestMinimumBasicScenario-16604406 None] Volume volume-ef0f5a5e-3d2f-4f78-97ec-8014cda60150 (ef0f5a5e-3d2f-4f78-97ec-8014cda60150): created successfully
Nov 03 18:35:02 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-9353966c-80a5-48ca-b0aa-f7f4a8d3b952 tempest-TestMinimumBasicScenario-16604406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (409110af-3a2a-43a0-af00-f648beea7a8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:35:02 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-9353966c-80a5-48ca-b0aa-f7f4a8d3b952 tempest-TestMinimumBasicScenario-16604406 None] Flow 'volume_create_manager' (6690eb57-53a5-4273-b1e4-a24e97a5f381) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:35:02 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-9353966c-80a5-48ca-b0aa-f7f4a8d3b952 tempest-TestMinimumBasicScenario-16604406 None] Created volume successfully.
Nov 03 18:35:05 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [req-3714e425-5878-4585-aafd-4a76bc575e8a req-58cd7131-8bcb-4fc2-9946-cd4b33643526 tempest-TestMinimumBasicScenario-16604406 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:35:05 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [req-3714e425-5878-4585-aafd-4a76bc575e8a req-58cd7131-8bcb-4fc2-9946-cd4b33643526 tempest-TestMinimumBasicScenario-16604406 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:35:05 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [req-3714e425-5878-4585-aafd-4a76bc575e8a req-58cd7131-8bcb-4fc2-9946-cd4b33643526 tempest-TestMinimumBasicScenario-16604406 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.037s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:35:05 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [req-3714e425-5878-4585-aafd-4a76bc575e8a req-58cd7131-8bcb-4fc2-9946-cd4b33643526 tempest-TestMinimumBasicScenario-16604406 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c', 'name': 'volume-ef0f5a5e-3d2f-4f78-97ec-8014cda60150', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '39582adf-9ac4-4f9f-bc63-068d22bb4fa5', 'enforce_multipath': True} {{(pid=86120) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 03 18:35:05 devstack cinder-volume[86120]: INFO cinder.volume.manager [req-3714e425-5878-4585-aafd-4a76bc575e8a req-58cd7131-8bcb-4fc2-9946-cd4b33643526 tempest-TestMinimumBasicScenario-16604406 None] attachment_update completed successfully.
Nov 03 18:35:08 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [req-6b1680f1-2ca7-4360-bd7b-010fdaff0b8e req-5762e823-7280-405f-a131-8b626d7d7e0a tempest-TestStampPattern-2051953486 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:35:08 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [req-6b1680f1-2ca7-4360-bd7b-010fdaff0b8e req-5762e823-7280-405f-a131-8b626d7d7e0a tempest-TestStampPattern-2051953486 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:35:08 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [req-6b1680f1-2ca7-4360-bd7b-010fdaff0b8e req-5762e823-7280-405f-a131-8b626d7d7e0a tempest-TestStampPattern-2051953486 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:35:08 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [req-6b1680f1-2ca7-4360-bd7b-010fdaff0b8e req-5762e823-7280-405f-a131-8b626d7d7e0a tempest-TestStampPattern-2051953486 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c', 'name': 'volume-ec90430d-c8b6-41c5-8b87-697757832b3e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c1eaf5e4-5196-4219-a94c-5d7c5107456c', 'enforce_multipath': True} {{(pid=86120) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 03 18:35:08 devstack cinder-volume[86120]: INFO cinder.volume.manager [req-6b1680f1-2ca7-4360-bd7b-010fdaff0b8e req-5762e823-7280-405f-a131-8b626d7d7e0a tempest-TestStampPattern-2051953486 None] attachment_update completed successfully.
Nov 03 18:35:10 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [req-204b889f-d414-4bfb-a21b-af07eeadc98f req-4c8fc036-86d9-42de-b88d-f79be432c4bb tempest-VolumesSnapshotsTestJSON-1832530690 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:35:10 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [req-204b889f-d414-4bfb-a21b-af07eeadc98f req-4c8fc036-86d9-42de-b88d-f79be432c4bb tempest-VolumesSnapshotsTestJSON-1832530690 None] Flow 'volume_create_manager' (a412b40b-4644-465a-add2-dc70303ce7ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:35:10 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [req-204b889f-d414-4bfb-a21b-af07eeadc98f req-4c8fc036-86d9-42de-b88d-f79be432c4bb tempest-VolumesSnapshotsTestJSON-1832530690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68594b10-84b3-41d9-a9e3-edc94d62ba8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:35:10 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [req-204b889f-d414-4bfb-a21b-af07eeadc98f req-4c8fc036-86d9-42de-b88d-f79be432c4bb tempest-VolumesSnapshotsTestJSON-1832530690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68594b10-84b3-41d9-a9e3-edc94d62ba8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:35:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-491429360',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df822d0f-a182-4298-8ba5-d786acaa4936,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94d5a734a4514dbaa65a7ee9af4a8044',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:35:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:35:10Z,use_quota=True,user_id='f7219086dffe4c87a3ccd8791599717a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:35:10 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [req-204b889f-d414-4bfb-a21b-af07eeadc98f req-4c8fc036-86d9-42de-b88d-f79be432c4bb tempest-VolumesSnapshotsTestJSON-1832530690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c20295ea-c694-44dc-a8a0-d684d51681b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:35:10 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [req-204b889f-d414-4bfb-a21b-af07eeadc98f req-4c8fc036-86d9-42de-b88d-f79be432c4bb tempest-VolumesSnapshotsTestJSON-1832530690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c20295ea-c694-44dc-a8a0-d684d51681b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:35:10 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [req-204b889f-d414-4bfb-a21b-af07eeadc98f req-4c8fc036-86d9-42de-b88d-f79be432c4bb tempest-VolumesSnapshotsTestJSON-1832530690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1dce3544-8efe-4638-834d-b5bafdac932e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:35:10 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [req-204b889f-d414-4bfb-a21b-af07eeadc98f req-4c8fc036-86d9-42de-b88d-f79be432c4bb tempest-VolumesSnapshotsTestJSON-1832530690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1dce3544-8efe-4638-834d-b5bafdac932e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df822d0f-a182-4298-8ba5-d786acaa4936', 'volume_name': 'volume-df822d0f-a182-4298-8ba5-d786acaa4936', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:35:10 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [req-204b889f-d414-4bfb-a21b-af07eeadc98f req-4c8fc036-86d9-42de-b88d-f79be432c4bb tempest-VolumesSnapshotsTestJSON-1832530690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f29be0b-66ba-4a8b-9c7f-144faa5a0c9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:35:10 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [req-204b889f-d414-4bfb-a21b-af07eeadc98f req-4c8fc036-86d9-42de-b88d-f79be432c4bb tempest-VolumesSnapshotsTestJSON-1832530690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f29be0b-66ba-4a8b-9c7f-144faa5a0c9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:35:10 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [req-204b889f-d414-4bfb-a21b-af07eeadc98f req-4c8fc036-86d9-42de-b88d-f79be432c4bb tempest-VolumesSnapshotsTestJSON-1832530690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a616ace5-57f7-4cd3-8e8b-61f4d4f4947b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:35:10 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [req-204b889f-d414-4bfb-a21b-af07eeadc98f req-4c8fc036-86d9-42de-b88d-f79be432c4bb tempest-VolumesSnapshotsTestJSON-1832530690 None] Volume df822d0f-a182-4298-8ba5-d786acaa4936: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df822d0f-a182-4298-8ba5-d786acaa4936', 'volume_size': 1}
Nov 03 18:35:10 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [req-204b889f-d414-4bfb-a21b-af07eeadc98f req-4c8fc036-86d9-42de-b88d-f79be432c4bb tempest-VolumesSnapshotsTestJSON-1832530690 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:35:10 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [req-204b889f-d414-4bfb-a21b-af07eeadc98f req-4c8fc036-86d9-42de-b88d-f79be432c4bb tempest-VolumesSnapshotsTestJSON-1832530690 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:35:10 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [req-204b889f-d414-4bfb-a21b-af07eeadc98f req-4c8fc036-86d9-42de-b88d-f79be432c4bb tempest-VolumesSnapshotsTestJSON-1832530690 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:35:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-491429360',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df822d0f-a182-4298-8ba5-d786acaa4936,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94d5a734a4514dbaa65a7ee9af4a8044',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:35:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:35:10Z,use_quota=True,user_id='f7219086dffe4c87a3ccd8791599717a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:35:10 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [req-204b889f-d414-4bfb-a21b-af07eeadc98f req-4c8fc036-86d9-42de-b88d-f79be432c4bb tempest-VolumesSnapshotsTestJSON-1832530690 None] Creating volume df822d0f-a182-4298-8ba5-d786acaa4936 {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:35:10 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [req-204b889f-d414-4bfb-a21b-af07eeadc98f req-4c8fc036-86d9-42de-b88d-f79be432c4bb tempest-VolumesSnapshotsTestJSON-1832530690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:35:10 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [req-204b889f-d414-4bfb-a21b-af07eeadc98f req-4c8fc036-86d9-42de-b88d-f79be432c4bb tempest-VolumesSnapshotsTestJSON-1832530690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:35:10 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [req-204b889f-d414-4bfb-a21b-af07eeadc98f req-4c8fc036-86d9-42de-b88d-f79be432c4bb tempest-VolumesSnapshotsTestJSON-1832530690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:35:10 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [req-204b889f-d414-4bfb-a21b-af07eeadc98f req-4c8fc036-86d9-42de-b88d-f79be432c4bb tempest-VolumesSnapshotsTestJSON-1832530690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:35:10 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [req-204b889f-d414-4bfb-a21b-af07eeadc98f req-4c8fc036-86d9-42de-b88d-f79be432c4bb tempest-VolumesSnapshotsTestJSON-1832530690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:35:10 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [req-204b889f-d414-4bfb-a21b-af07eeadc98f req-4c8fc036-86d9-42de-b88d-f79be432c4bb tempest-VolumesSnapshotsTestJSON-1832530690 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:35:10 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [req-204b889f-d414-4bfb-a21b-af07eeadc98f req-4c8fc036-86d9-42de-b88d-f79be432c4bb tempest-VolumesSnapshotsTestJSON-1832530690 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:35:10 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [req-204b889f-d414-4bfb-a21b-af07eeadc98f req-4c8fc036-86d9-42de-b88d-f79be432c4bb tempest-VolumesSnapshotsTestJSON-1832530690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-df822d0f-a182-4298-8ba5-d786acaa4936 1073741824 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:35:10 devstack sudo[101867]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-df822d0f-a182-4298-8ba5-d786acaa4936 1073741824
Nov 03 18:35:10 devstack sudo[101867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:35:10 devstack sudo[101867]: pam_unix(sudo:session): session closed for user root
Nov 03 18:35:10 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [req-204b889f-d414-4bfb-a21b-af07eeadc98f req-4c8fc036-86d9-42de-b88d-f79be432c4bb tempest-VolumesSnapshotsTestJSON-1832530690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-df822d0f-a182-4298-8ba5-d786acaa4936 1073741824" returned: 0 in 0.598s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:35:10 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [req-204b889f-d414-4bfb-a21b-af07eeadc98f req-4c8fc036-86d9-42de-b88d-f79be432c4bb tempest-VolumesSnapshotsTestJSON-1832530690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-df822d0f-a182-4298-8ba5-d786acaa4936 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:35:10 devstack sudo[101884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-df822d0f-a182-4298-8ba5-d786acaa4936
Nov 03 18:35:10 devstack sudo[101884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:35:11 devstack sudo[101884]: pam_unix(sudo:session): session closed for user root
Nov 03 18:35:11 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [req-204b889f-d414-4bfb-a21b-af07eeadc98f req-4c8fc036-86d9-42de-b88d-f79be432c4bb tempest-VolumesSnapshotsTestJSON-1832530690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-df822d0f-a182-4298-8ba5-d786acaa4936" returned: 0 in 0.311s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:35:11 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [req-204b889f-d414-4bfb-a21b-af07eeadc98f req-4c8fc036-86d9-42de-b88d-f79be432c4bb tempest-VolumesSnapshotsTestJSON-1832530690 None] <== create_volume: return (952ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:35:11 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [req-204b889f-d414-4bfb-a21b-af07eeadc98f req-4c8fc036-86d9-42de-b88d-f79be432c4bb tempest-VolumesSnapshotsTestJSON-1832530690 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.955s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:35:11 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [req-204b889f-d414-4bfb-a21b-af07eeadc98f req-4c8fc036-86d9-42de-b88d-f79be432c4bb tempest-VolumesSnapshotsTestJSON-1832530690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a616ace5-57f7-4cd3-8e8b-61f4d4f4947b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df822d0f-a182-4298-8ba5-d786acaa4936', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:35:11 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [req-204b889f-d414-4bfb-a21b-af07eeadc98f req-4c8fc036-86d9-42de-b88d-f79be432c4bb tempest-VolumesSnapshotsTestJSON-1832530690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ff73069-9b10-44ee-b65d-b7b2279c4c77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:35:11 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [req-204b889f-d414-4bfb-a21b-af07eeadc98f req-4c8fc036-86d9-42de-b88d-f79be432c4bb tempest-VolumesSnapshotsTestJSON-1832530690 None] Volume volume-df822d0f-a182-4298-8ba5-d786acaa4936 (df822d0f-a182-4298-8ba5-d786acaa4936): created successfully
Nov 03 18:35:11 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [req-204b889f-d414-4bfb-a21b-af07eeadc98f req-4c8fc036-86d9-42de-b88d-f79be432c4bb tempest-VolumesSnapshotsTestJSON-1832530690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ff73069-9b10-44ee-b65d-b7b2279c4c77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:35:11 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [req-204b889f-d414-4bfb-a21b-af07eeadc98f req-4c8fc036-86d9-42de-b88d-f79be432c4bb tempest-VolumesSnapshotsTestJSON-1832530690 None] Flow 'volume_create_manager' (a412b40b-4644-465a-add2-dc70303ce7ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:35:11 devstack cinder-volume[86120]: INFO cinder.volume.manager [req-204b889f-d414-4bfb-a21b-af07eeadc98f req-4c8fc036-86d9-42de-b88d-f79be432c4bb tempest-VolumesSnapshotsTestJSON-1832530690 None] Created volume successfully.
Nov 03 18:35:12 devstack cinder-volume[86120]: INFO cinder.volume.manager [req-4c888c30-4998-45e3-85e1-590d972f6898 req-7dbcdb94-9184-476f-964b-01cc77243f6f tempest-TestStampPattern-2051953486 None] Terminate volume connection completed successfully.
Nov 03 18:35:12 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [req-4c888c30-4998-45e3-85e1-590d972f6898 req-7dbcdb94-9184-476f-964b-01cc77243f6f tempest-TestStampPattern-2051953486 None] Deleting attachment c1eaf5e4-5196-4219-a94c-5d7c5107456c. {{(pid=86120) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 03 18:35:12 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [req-64282895-342d-4c2c-814b-5349ff37820c req-1278282e-ec39-4bd2-8f82-5360016ee7a9 tempest-VolumesSnapshotsTestJSON-1832530690 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:35:12 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [req-64282895-342d-4c2c-814b-5349ff37820c req-1278282e-ec39-4bd2-8f82-5360016ee7a9 tempest-VolumesSnapshotsTestJSON-1832530690 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:35:12 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [req-64282895-342d-4c2c-814b-5349ff37820c req-1278282e-ec39-4bd2-8f82-5360016ee7a9 tempest-VolumesSnapshotsTestJSON-1832530690 None] Creating offline snapshot d839fc15-6c45-499d-a85d-cc9df3d9436d of volume df822d0f-a182-4298-8ba5-d786acaa4936 {{(pid=86120) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 18:35:12 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[a61ace3d-0188-4a04-852d-69dfe8927210]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:35:12 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [req-64282895-342d-4c2c-814b-5349ff37820c req-1278282e-ec39-4bd2-8f82-5360016ee7a9 tempest-VolumesSnapshotsTestJSON-1832530690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-df822d0f-a182-4298-8ba5-d786acaa4936 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:35:13 devstack sudo[101922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-df822d0f-a182-4298-8ba5-d786acaa4936
Nov 03 18:35:13 devstack sudo[101922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:35:13 devstack sudo[101922]: pam_unix(sudo:session): session closed for user root
Nov 03 18:35:13 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [req-64282895-342d-4c2c-814b-5349ff37820c req-1278282e-ec39-4bd2-8f82-5360016ee7a9 tempest-VolumesSnapshotsTestJSON-1832530690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-df822d0f-a182-4298-8ba5-d786acaa4936" returned: 0 in 0.561s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:35:13 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [req-64282895-342d-4c2c-814b-5349ff37820c req-1278282e-ec39-4bd2-8f82-5360016ee7a9 tempest-VolumesSnapshotsTestJSON-1832530690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-df822d0f-a182-4298-8ba5-d786acaa4936,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-df822d0f-a182-4298-8ba5-d786acaa4936.d839fc15-6c45-499d-a85d-cc9df3d9436d 1G {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:35:13 devstack sudo[101928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-df822d0f-a182-4298-8ba5-d786acaa4936,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-df822d0f-a182-4298-8ba5-d786acaa4936.d839fc15-6c45-499d-a85d-cc9df3d9436d 1G
Nov 03 18:35:13 devstack sudo[101928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:35:13 devstack sudo[101928]: pam_unix(sudo:session): session closed for user root
Nov 03 18:35:13 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [req-64282895-342d-4c2c-814b-5349ff37820c req-1278282e-ec39-4bd2-8f82-5360016ee7a9 tempest-VolumesSnapshotsTestJSON-1832530690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-df822d0f-a182-4298-8ba5-d786acaa4936,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-df822d0f-a182-4298-8ba5-d786acaa4936.d839fc15-6c45-499d-a85d-cc9df3d9436d 1G" returned: 0 in 0.534s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:35:13 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [req-64282895-342d-4c2c-814b-5349ff37820c req-1278282e-ec39-4bd2-8f82-5360016ee7a9 tempest-VolumesSnapshotsTestJSON-1832530690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df822d0f-a182-4298-8ba5-d786acaa4936 -F qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-df822d0f-a182-4298-8ba5-d786acaa4936.d839fc15-6c45-499d-a85d-cc9df3d9436d {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:35:13 devstack sudo[101936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df822d0f-a182-4298-8ba5-d786acaa4936 -F qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-df822d0f-a182-4298-8ba5-d786acaa4936.d839fc15-6c45-499d-a85d-cc9df3d9436d
Nov 03 18:35:13 devstack sudo[101936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:35:14 devstack sudo[101936]: pam_unix(sudo:session): session closed for user root
Nov 03 18:35:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [req-64282895-342d-4c2c-814b-5349ff37820c req-1278282e-ec39-4bd2-8f82-5360016ee7a9 tempest-VolumesSnapshotsTestJSON-1832530690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df822d0f-a182-4298-8ba5-d786acaa4936 -F qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-df822d0f-a182-4298-8ba5-d786acaa4936.d839fc15-6c45-499d-a85d-cc9df3d9436d" returned: 0 in 0.388s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:35:14 devstack cinder-volume[86120]: WARNING cinder.volume.drivers.remotefs [req-64282895-342d-4c2c-814b-5349ff37820c req-1278282e-ec39-4bd2-8f82-5360016ee7a9 tempest-VolumesSnapshotsTestJSON-1832530690 None] /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-df822d0f-a182-4298-8ba5-d786acaa4936.d839fc15-6c45-499d-a85d-cc9df3d9436d is being set with open permissions: ugo+rw
Nov 03 18:35:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [req-64282895-342d-4c2c-814b-5349ff37820c req-1278282e-ec39-4bd2-8f82-5360016ee7a9 tempest-VolumesSnapshotsTestJSON-1832530690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-df822d0f-a182-4298-8ba5-d786acaa4936.d839fc15-6c45-499d-a85d-cc9df3d9436d {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:35:14 devstack sudo[101953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-df822d0f-a182-4298-8ba5-d786acaa4936.d839fc15-6c45-499d-a85d-cc9df3d9436d
Nov 03 18:35:14 devstack sudo[101953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:35:14 devstack sudo[101953]: pam_unix(sudo:session): session closed for user root
Nov 03 18:35:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [req-64282895-342d-4c2c-814b-5349ff37820c req-1278282e-ec39-4bd2-8f82-5360016ee7a9 tempest-VolumesSnapshotsTestJSON-1832530690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-df822d0f-a182-4298-8ba5-d786acaa4936.d839fc15-6c45-499d-a85d-cc9df3d9436d" returned: 0 in 0.452s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:35:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [req-64282895-342d-4c2c-814b-5349ff37820c req-1278282e-ec39-4bd2-8f82-5360016ee7a9 tempest-VolumesSnapshotsTestJSON-1832530690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-df822d0f-a182-4298-8ba5-d786acaa4936.info {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:35:14 devstack sudo[101974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-df822d0f-a182-4298-8ba5-d786acaa4936.info
Nov 03 18:35:14 devstack sudo[101974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:35:14 devstack cinder-volume[86120]: DEBUG oslo_service.periodic_task [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86120) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 18:35:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:35:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:35:14 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:35:14 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:35:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:35:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:35:15 devstack sudo[101977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:35:15 devstack sudo[101977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:35:15 devstack sudo[101974]: pam_unix(sudo:session): session closed for user root
Nov 03 18:35:15 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [req-64282895-342d-4c2c-814b-5349ff37820c req-1278282e-ec39-4bd2-8f82-5360016ee7a9 tempest-VolumesSnapshotsTestJSON-1832530690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-df822d0f-a182-4298-8ba5-d786acaa4936.info" returned: 0 in 0.322s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:35:15 devstack cinder-volume[86120]: WARNING cinder.volume.drivers.remotefs [req-64282895-342d-4c2c-814b-5349ff37820c req-1278282e-ec39-4bd2-8f82-5360016ee7a9 tempest-VolumesSnapshotsTestJSON-1832530690 None] /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-df822d0f-a182-4298-8ba5-d786acaa4936.info is being set with open permissions: ugo+rw
Nov 03 18:35:15 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [req-64282895-342d-4c2c-814b-5349ff37820c req-1278282e-ec39-4bd2-8f82-5360016ee7a9 tempest-VolumesSnapshotsTestJSON-1832530690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-df822d0f-a182-4298-8ba5-d786acaa4936.info {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:35:15 devstack sudo[101980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-df822d0f-a182-4298-8ba5-d786acaa4936.info
Nov 03 18:35:15 devstack sudo[101980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:35:15 devstack sudo[101977]: pam_unix(sudo:session): session closed for user root
Nov 03 18:35:15 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.359s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:35:15 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:35:15 devstack cinder-volume[86120]: DEBUG oslo_service.periodic_task [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Running periodic task VolumeManager._thread_info {{(pid=86120) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 18:35:15 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] thread count: 28 {{(pid=86120) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 03 18:35:15 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] thread info: [<_MainThread(MainThread, started 134747145822336)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134747033686336)>, <Thread(Thread-3 (stat_writer), started daemon 134747030828736)>, <Thread(Rabbit-heartbeat, started daemon 134747035433408)>, <Thread(Thread-5 (_runner), started daemon 134747029587392)>, <Thread(Thread-7 (_runner), started daemon 134747029784256)>, <Thread(fd_logger, started daemon 134747027909120)>, <Thread(privsep_reader, started daemon 134747027006592)>, <Thread(tpool_thread_0, started daemon 134747018950336)>, <Thread(tpool_thread_1, started daemon 134747010541248)>, <Thread(tpool_thread_2, started daemon 134747002132160)>, <Thread(tpool_thread_3, started daemon 134746993723072)>, <Thread(tpool_thread_4, started daemon 134746985313984)>, <Thread(tpool_thread_5, started daemon 134746976904896)>, <Thread(tpool_thread_6, started daemon 134746968495808)>, <Thread(tpool_thread_7, started daemon 134746960086720)>, <Thread(tpool_thread_8, started daemon 134746951677632)>, <Thread(tpool_thread_9, started daemon 134746943268544)>, <Thread(tpool_thread_10, started daemon 134746934859456)>, <Thread(tpool_thread_11, started daemon 134746926450368)>, <Thread(tpool_thread_12, started daemon 134746918041280)>, <Thread(tpool_thread_13, started daemon 134746909632192)>, <Thread(tpool_thread_14, started daemon 134746901223104)>, <Thread(tpool_thread_15, started daemon 134746892814016)>, <Thread(tpool_thread_16, started daemon 134746884404928)>, <Thread(tpool_thread_17, started daemon 134746875995840)>, <Thread(tpool_thread_18, started daemon 134746867586752)>, <Thread(tpool_thread_19, started daemon 134746859177664)>] {{(pid=86120) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 03 18:35:15 devstack sudo[101980]: pam_unix(sudo:session): session closed for user root
Nov 03 18:35:15 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [req-64282895-342d-4c2c-814b-5349ff37820c req-1278282e-ec39-4bd2-8f82-5360016ee7a9 tempest-VolumesSnapshotsTestJSON-1832530690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-df822d0f-a182-4298-8ba5-d786acaa4936.info" returned: 0 in 0.371s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:35:15 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [req-64282895-342d-4c2c-814b-5349ff37820c req-1278282e-ec39-4bd2-8f82-5360016ee7a9 tempest-VolumesSnapshotsTestJSON-1832530690 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.784s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:35:15 devstack cinder-volume[86120]: INFO cinder.volume.manager [req-64282895-342d-4c2c-814b-5349ff37820c req-1278282e-ec39-4bd2-8f82-5360016ee7a9 tempest-VolumesSnapshotsTestJSON-1832530690 None] Create snapshot completed successfully
Nov 03 18:35:15 devstack cinder-volume[86120]: DEBUG cinder.coordination [req-e93ed93e-335b-47ac-b846-7138d3fae48d req-5d2c34d9-f79d-4f09-bbec-faec99ad08b9 tempest-VolumesSnapshotsTestJSON-1832530690 None] Acquiring lock "cinder-d839fc15-6c45-499d-a85d-cc9df3d9436d-delete_snapshot" by "delete_snapshot" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:35:15 devstack cinder-volume[86120]: DEBUG cinder.coordination [req-e93ed93e-335b-47ac-b846-7138d3fae48d req-5d2c34d9-f79d-4f09-bbec-faec99ad08b9 tempest-VolumesSnapshotsTestJSON-1832530690 None] Lock "cinder-d839fc15-6c45-499d-a85d-cc9df3d9436d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:35:15 devstack cinder-volume[86120]: DEBUG cinder.coordination [req-e93ed93e-335b-47ac-b846-7138d3fae48d req-5d2c34d9-f79d-4f09-bbec-faec99ad08b9 tempest-VolumesSnapshotsTestJSON-1832530690 None] Acquiring lock "cinder-quobyte-df822d0f-a182-4298-8ba5-d786acaa4936" by "delete_snapshot" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:35:15 devstack cinder-volume[86120]: DEBUG cinder.coordination [req-e93ed93e-335b-47ac-b846-7138d3fae48d req-5d2c34d9-f79d-4f09-bbec-faec99ad08b9 tempest-VolumesSnapshotsTestJSON-1832530690 None] Lock "cinder-quobyte-df822d0f-a182-4298-8ba5-d786acaa4936" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:35:15 devstack cinder-volume[86120]: DEBUG cinder.coordination [req-e93ed93e-335b-47ac-b846-7138d3fae48d req-5d2c34d9-f79d-4f09-bbec-faec99ad08b9 tempest-VolumesSnapshotsTestJSON-1832530690 None] Acquiring lock "cinder-quobyte-d839fc15-6c45-499d-a85d-cc9df3d9436d" by "_delete_snapshot" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:35:15 devstack cinder-volume[86120]: DEBUG cinder.coordination [req-e93ed93e-335b-47ac-b846-7138d3fae48d req-5d2c34d9-f79d-4f09-bbec-faec99ad08b9 tempest-VolumesSnapshotsTestJSON-1832530690 None] Lock "cinder-quobyte-d839fc15-6c45-499d-a85d-cc9df3d9436d" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:35:15 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [req-e93ed93e-335b-47ac-b846-7138d3fae48d req-5d2c34d9-f79d-4f09-bbec-faec99ad08b9 tempest-VolumesSnapshotsTestJSON-1832530690 None] Deleting offline snapshot d839fc15-6c45-499d-a85d-cc9df3d9436d of volume df822d0f-a182-4298-8ba5-d786acaa4936 {{(pid=86120) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 18:35:16 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [req-e93ed93e-335b-47ac-b846-7138d3fae48d req-5d2c34d9-f79d-4f09-bbec-faec99ad08b9 tempest-VolumesSnapshotsTestJSON-1832530690 None] snapshot_file for this snap is: volume-df822d0f-a182-4298-8ba5-d786acaa4936.d839fc15-6c45-499d-a85d-cc9df3d9436d {{(pid=86120) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 18:35:16 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[3abfbba0-dad6-4647-8cbb-f928eca2e2af]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:35:16 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [req-e93ed93e-335b-47ac-b846-7138d3fae48d req-5d2c34d9-f79d-4f09-bbec-faec99ad08b9 tempest-VolumesSnapshotsTestJSON-1832530690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-df822d0f-a182-4298-8ba5-d786acaa4936.d839fc15-6c45-499d-a85d-cc9df3d9436d {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:35:16 devstack sudo[101987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-df822d0f-a182-4298-8ba5-d786acaa4936.d839fc15-6c45-499d-a85d-cc9df3d9436d
Nov 03 18:35:16 devstack sudo[101987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:35:16 devstack sudo[101987]: pam_unix(sudo:session): session closed for user root
Nov 03 18:35:16 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [req-e93ed93e-335b-47ac-b846-7138d3fae48d req-5d2c34d9-f79d-4f09-bbec-faec99ad08b9 tempest-VolumesSnapshotsTestJSON-1832530690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-df822d0f-a182-4298-8ba5-d786acaa4936.d839fc15-6c45-499d-a85d-cc9df3d9436d" returned: 0 in 0.447s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:35:16 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [req-e93ed93e-335b-47ac-b846-7138d3fae48d req-5d2c34d9-f79d-4f09-bbec-faec99ad08b9 tempest-VolumesSnapshotsTestJSON-1832530690 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-df822d0f-a182-4298-8ba5-d786acaa4936(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86120) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 18:35:16 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[c52deecb-d88a-4014-b036-2cd0c1298ecc]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:35:16 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [req-e93ed93e-335b-47ac-b846-7138d3fae48d req-5d2c34d9-f79d-4f09-bbec-faec99ad08b9 tempest-VolumesSnapshotsTestJSON-1832530690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-df822d0f-a182-4298-8ba5-d786acaa4936 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:35:16 devstack sudo[101992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-df822d0f-a182-4298-8ba5-d786acaa4936
Nov 03 18:35:16 devstack sudo[101992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:35:16 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-10a516cf-5f78-42f6-a105-b799713c1d6c tempest-TestStampPattern-2051953486 None] Acquiring lock "cinder-ec90430d-c8b6-41c5-8b87-697757832b3e-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:35:16 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-10a516cf-5f78-42f6-a105-b799713c1d6c tempest-TestStampPattern-2051953486 None] Lock "cinder-ec90430d-c8b6-41c5-8b87-697757832b3e-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:35:16 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-10a516cf-5f78-42f6-a105-b799713c1d6c tempest-TestStampPattern-2051953486 None] Acquiring lock "cinder-quobyte-ec90430d-c8b6-41c5-8b87-697757832b3e" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:35:16 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-10a516cf-5f78-42f6-a105-b799713c1d6c tempest-TestStampPattern-2051953486 None] Lock "cinder-quobyte-ec90430d-c8b6-41c5-8b87-697757832b3e" acquired by "delete_volume" :: waited 0.017s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:35:16 devstack sudo[101992]: pam_unix(sudo:session): session closed for user root
Nov 03 18:35:16 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [req-e93ed93e-335b-47ac-b846-7138d3fae48d req-5d2c34d9-f79d-4f09-bbec-faec99ad08b9 tempest-VolumesSnapshotsTestJSON-1832530690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-df822d0f-a182-4298-8ba5-d786acaa4936" returned: 0 in 0.443s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:35:16 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [req-e93ed93e-335b-47ac-b846-7138d3fae48d req-5d2c34d9-f79d-4f09-bbec-faec99ad08b9 tempest-VolumesSnapshotsTestJSON-1832530690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-df822d0f-a182-4298-8ba5-d786acaa4936.d839fc15-6c45-499d-a85d-cc9df3d9436d {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:35:17 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[33cdf018-5976-41a4-b87e-824dca037e26]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:35:17 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-10a516cf-5f78-42f6-a105-b799713c1d6c tempest-TestStampPattern-2051953486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ec90430d-c8b6-41c5-8b87-697757832b3e {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:35:17 devstack sudo[101997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-df822d0f-a182-4298-8ba5-d786acaa4936.d839fc15-6c45-499d-a85d-cc9df3d9436d
Nov 03 18:35:17 devstack sudo[101997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:35:17 devstack sudo[101998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ec90430d-c8b6-41c5-8b87-697757832b3e
Nov 03 18:35:17 devstack sudo[101998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:35:17 devstack sudo[101997]: pam_unix(sudo:session): session closed for user root
Nov 03 18:35:17 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [req-e93ed93e-335b-47ac-b846-7138d3fae48d req-5d2c34d9-f79d-4f09-bbec-faec99ad08b9 tempest-VolumesSnapshotsTestJSON-1832530690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-df822d0f-a182-4298-8ba5-d786acaa4936.d839fc15-6c45-499d-a85d-cc9df3d9436d" returned: 0 in 0.390s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:35:17 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [req-e93ed93e-335b-47ac-b846-7138d3fae48d req-5d2c34d9-f79d-4f09-bbec-faec99ad08b9 tempest-VolumesSnapshotsTestJSON-1832530690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-df822d0f-a182-4298-8ba5-d786acaa4936.d839fc15-6c45-499d-a85d-cc9df3d9436d {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:35:17 devstack sudo[101998]: pam_unix(sudo:session): session closed for user root
Nov 03 18:35:17 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-10a516cf-5f78-42f6-a105-b799713c1d6c tempest-TestStampPattern-2051953486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ec90430d-c8b6-41c5-8b87-697757832b3e" returned: 0 in 0.396s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:35:17 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-10a516cf-5f78-42f6-a105-b799713c1d6c tempest-TestStampPattern-2051953486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ec90430d-c8b6-41c5-8b87-697757832b3e {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:35:17 devstack sudo[102007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-df822d0f-a182-4298-8ba5-d786acaa4936.d839fc15-6c45-499d-a85d-cc9df3d9436d
Nov 03 18:35:17 devstack sudo[102007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:35:17 devstack sudo[102009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ec90430d-c8b6-41c5-8b87-697757832b3e
Nov 03 18:35:17 devstack sudo[102009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:35:17 devstack sudo[102007]: pam_unix(sudo:session): session closed for user root
Nov 03 18:35:17 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [req-e93ed93e-335b-47ac-b846-7138d3fae48d req-5d2c34d9-f79d-4f09-bbec-faec99ad08b9 tempest-VolumesSnapshotsTestJSON-1832530690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-df822d0f-a182-4298-8ba5-d786acaa4936.d839fc15-6c45-499d-a85d-cc9df3d9436d" returned: 0 in 0.279s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:35:17 devstack sudo[102009]: pam_unix(sudo:session): session closed for user root
Nov 03 18:35:17 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-10a516cf-5f78-42f6-a105-b799713c1d6c tempest-TestStampPattern-2051953486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ec90430d-c8b6-41c5-8b87-697757832b3e" returned: 0 in 0.269s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:35:17 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-10a516cf-5f78-42f6-a105-b799713c1d6c tempest-TestStampPattern-2051953486 None] Lock "cinder-quobyte-ec90430d-c8b6-41c5-8b87-697757832b3e" released by "delete_volume" :: held 0.736s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:35:17 devstack cinder-volume[86120]: DEBUG cinder.coordination [req-e93ed93e-335b-47ac-b846-7138d3fae48d req-5d2c34d9-f79d-4f09-bbec-faec99ad08b9 tempest-VolumesSnapshotsTestJSON-1832530690 None] Lock "cinder-quobyte-d839fc15-6c45-499d-a85d-cc9df3d9436d" released by "_delete_snapshot" :: held 1.751s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:35:17 devstack cinder-volume[86120]: DEBUG cinder.coordination [req-e93ed93e-335b-47ac-b846-7138d3fae48d req-5d2c34d9-f79d-4f09-bbec-faec99ad08b9 tempest-VolumesSnapshotsTestJSON-1832530690 None] Lock "cinder-quobyte-df822d0f-a182-4298-8ba5-d786acaa4936" released by "delete_snapshot" :: held 1.797s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:35:17 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-10a516cf-5f78-42f6-a105-b799713c1d6c tempest-TestStampPattern-2051953486 None] Created reservations ['8ba10078-0934-4499-b6ff-a621da8324a9', '2dc3c9f4-5a0b-46e2-a1eb-d0bf14677c01', 'd511a1ed-6e44-45c2-9d71-0163f6b206f8', 'bfc9bba3-654c-49f5-8a67-9b870546c688'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:35:17 devstack cinder-volume[86120]: DEBUG cinder.quota [req-e93ed93e-335b-47ac-b846-7138d3fae48d req-5d2c34d9-f79d-4f09-bbec-faec99ad08b9 tempest-VolumesSnapshotsTestJSON-1832530690 None] Created reservations ['71251781-2e76-45f4-8e59-f90f7e38271e', 'a16ffa59-62af-4fee-b2d6-8e4e7f7d89ca', '2ff023c6-f3ef-49f6-ac12-5de6d405c32a', '46d319c5-7390-438c-b358-ab28e279cd02'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:35:17 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-10a516cf-5f78-42f6-a105-b799713c1d6c tempest-TestStampPattern-2051953486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:35:17 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-10a516cf-5f78-42f6-a105-b799713c1d6c tempest-TestStampPattern-2051953486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:35:17 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-10a516cf-5f78-42f6-a105-b799713c1d6c tempest-TestStampPattern-2051953486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:35:17 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-10a516cf-5f78-42f6-a105-b799713c1d6c tempest-TestStampPattern-2051953486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:35:17 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-10a516cf-5f78-42f6-a105-b799713c1d6c tempest-TestStampPattern-2051953486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:35:17 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-10a516cf-5f78-42f6-a105-b799713c1d6c tempest-TestStampPattern-2051953486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:35:17 devstack sudo[102013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:35:17 devstack sudo[102013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:35:17 devstack cinder-volume[86120]: INFO cinder.volume.manager [req-e93ed93e-335b-47ac-b846-7138d3fae48d req-5d2c34d9-f79d-4f09-bbec-faec99ad08b9 tempest-VolumesSnapshotsTestJSON-1832530690 None] Delete snapshot completed successfully.
Nov 03 18:35:17 devstack cinder-volume[86120]: DEBUG cinder.coordination [req-e93ed93e-335b-47ac-b846-7138d3fae48d req-5d2c34d9-f79d-4f09-bbec-faec99ad08b9 tempest-VolumesSnapshotsTestJSON-1832530690 None] Lock "cinder-d839fc15-6c45-499d-a85d-cc9df3d9436d-delete_snapshot" released by "delete_snapshot" :: held 2.056s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:35:18 devstack sudo[102013]: pam_unix(sudo:session): session closed for user root
Nov 03 18:35:18 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-10a516cf-5f78-42f6-a105-b799713c1d6c tempest-TestStampPattern-2051953486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.274s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:35:18 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-10a516cf-5f78-42f6-a105-b799713c1d6c tempest-TestStampPattern-2051953486 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:35:18 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-10a516cf-5f78-42f6-a105-b799713c1d6c tempest-TestStampPattern-2051953486 None] Deleted volume successfully.
Nov 03 18:35:18 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-10a516cf-5f78-42f6-a105-b799713c1d6c tempest-TestStampPattern-2051953486 None] Lock "cinder-ec90430d-c8b6-41c5-8b87-697757832b3e-delete_volume" released by "delete_volume" :: held 1.301s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:35:18 devstack cinder-volume[86120]: DEBUG cinder.coordination [req-b63df3ef-a810-4a97-87e7-49f304b721fc req-491b0d16-6d8c-4b60-a4af-96e2fdb1e21e tempest-VolumesSnapshotsTestJSON-1832530690 None] Acquiring lock "cinder-df822d0f-a182-4298-8ba5-d786acaa4936-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:35:18 devstack cinder-volume[86120]: DEBUG cinder.coordination [req-b63df3ef-a810-4a97-87e7-49f304b721fc req-491b0d16-6d8c-4b60-a4af-96e2fdb1e21e tempest-VolumesSnapshotsTestJSON-1832530690 None] Lock "cinder-df822d0f-a182-4298-8ba5-d786acaa4936-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:35:18 devstack cinder-volume[86120]: DEBUG cinder.coordination [req-b63df3ef-a810-4a97-87e7-49f304b721fc req-491b0d16-6d8c-4b60-a4af-96e2fdb1e21e tempest-VolumesSnapshotsTestJSON-1832530690 None] Acquiring lock "cinder-quobyte-df822d0f-a182-4298-8ba5-d786acaa4936" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:35:18 devstack cinder-volume[86120]: DEBUG cinder.coordination [req-b63df3ef-a810-4a97-87e7-49f304b721fc req-491b0d16-6d8c-4b60-a4af-96e2fdb1e21e tempest-VolumesSnapshotsTestJSON-1832530690 None] Lock "cinder-quobyte-df822d0f-a182-4298-8ba5-d786acaa4936" acquired by "delete_volume" :: waited 0.018s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:35:18 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-35649c26-7d25-4240-a40b-720601366e92 tempest-TestStampPattern-2051953486 None] Acquiring lock "cinder-7e96fe29-8ea6-44ec-bc8d-e11c48f530fc-delete_snapshot" by "delete_snapshot" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:35:18 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[81e198c9-0740-4a1e-abbc-170cd04bae50]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:35:18 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [req-b63df3ef-a810-4a97-87e7-49f304b721fc req-491b0d16-6d8c-4b60-a4af-96e2fdb1e21e tempest-VolumesSnapshotsTestJSON-1832530690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-df822d0f-a182-4298-8ba5-d786acaa4936 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:35:18 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-35649c26-7d25-4240-a40b-720601366e92 tempest-TestStampPattern-2051953486 None] Lock "cinder-7e96fe29-8ea6-44ec-bc8d-e11c48f530fc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:35:18 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-35649c26-7d25-4240-a40b-720601366e92 tempest-TestStampPattern-2051953486 None] Acquiring lock "cinder-quobyte-261b681b-c984-43e5-abdb-a2acaaf9e6e1" by "delete_snapshot" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:35:18 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-35649c26-7d25-4240-a40b-720601366e92 tempest-TestStampPattern-2051953486 None] Lock "cinder-quobyte-261b681b-c984-43e5-abdb-a2acaaf9e6e1" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:35:18 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-35649c26-7d25-4240-a40b-720601366e92 tempest-TestStampPattern-2051953486 None] Acquiring lock "cinder-quobyte-7e96fe29-8ea6-44ec-bc8d-e11c48f530fc" by "_delete_snapshot" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:35:18 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-35649c26-7d25-4240-a40b-720601366e92 tempest-TestStampPattern-2051953486 None] Lock "cinder-quobyte-7e96fe29-8ea6-44ec-bc8d-e11c48f530fc" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:35:18 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-35649c26-7d25-4240-a40b-720601366e92 tempest-TestStampPattern-2051953486 None] Deleting offline snapshot 7e96fe29-8ea6-44ec-bc8d-e11c48f530fc of volume 261b681b-c984-43e5-abdb-a2acaaf9e6e1 {{(pid=86120) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 18:35:18 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-35649c26-7d25-4240-a40b-720601366e92 tempest-TestStampPattern-2051953486 None] snapshot_file for this snap is: volume-261b681b-c984-43e5-abdb-a2acaaf9e6e1.7e96fe29-8ea6-44ec-bc8d-e11c48f530fc {{(pid=86120) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 18:35:18 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f6201ab-80d8-4275-ac9f-26fde6effe19]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:35:18 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-35649c26-7d25-4240-a40b-720601366e92 tempest-TestStampPattern-2051953486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-261b681b-c984-43e5-abdb-a2acaaf9e6e1.7e96fe29-8ea6-44ec-bc8d-e11c48f530fc {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:35:18 devstack sudo[102016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-df822d0f-a182-4298-8ba5-d786acaa4936
Nov 03 18:35:18 devstack sudo[102016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:35:18 devstack sudo[102017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-261b681b-c984-43e5-abdb-a2acaaf9e6e1.7e96fe29-8ea6-44ec-bc8d-e11c48f530fc
Nov 03 18:35:18 devstack sudo[102017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:35:18 devstack sudo[102016]: pam_unix(sudo:session): session closed for user root
Nov 03 18:35:18 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [req-b63df3ef-a810-4a97-87e7-49f304b721fc req-491b0d16-6d8c-4b60-a4af-96e2fdb1e21e tempest-VolumesSnapshotsTestJSON-1832530690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-df822d0f-a182-4298-8ba5-d786acaa4936" returned: 0 in 0.419s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:35:18 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [req-b63df3ef-a810-4a97-87e7-49f304b721fc req-491b0d16-6d8c-4b60-a4af-96e2fdb1e21e tempest-VolumesSnapshotsTestJSON-1832530690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-df822d0f-a182-4298-8ba5-d786acaa4936 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:35:18 devstack sudo[102025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-df822d0f-a182-4298-8ba5-d786acaa4936
Nov 03 18:35:18 devstack sudo[102025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:35:18 devstack sudo[102017]: pam_unix(sudo:session): session closed for user root
Nov 03 18:35:18 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-35649c26-7d25-4240-a40b-720601366e92 tempest-TestStampPattern-2051953486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-261b681b-c984-43e5-abdb-a2acaaf9e6e1.7e96fe29-8ea6-44ec-bc8d-e11c48f530fc" returned: 0 in 0.411s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:35:18 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-35649c26-7d25-4240-a40b-720601366e92 tempest-TestStampPattern-2051953486 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-261b681b-c984-43e5-abdb-a2acaaf9e6e1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86120) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 18:35:18 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[12596cd1-a45c-4e23-b9bd-02eadb1a2f47]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:35:18 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-35649c26-7d25-4240-a40b-720601366e92 tempest-TestStampPattern-2051953486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-261b681b-c984-43e5-abdb-a2acaaf9e6e1 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:35:19 devstack sudo[102028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-261b681b-c984-43e5-abdb-a2acaaf9e6e1
Nov 03 18:35:19 devstack sudo[102028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:35:19 devstack sudo[102025]: pam_unix(sudo:session): session closed for user root
Nov 03 18:35:19 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [req-b63df3ef-a810-4a97-87e7-49f304b721fc req-491b0d16-6d8c-4b60-a4af-96e2fdb1e21e tempest-VolumesSnapshotsTestJSON-1832530690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-df822d0f-a182-4298-8ba5-d786acaa4936" returned: 0 in 0.302s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:35:19 devstack cinder-volume[86120]: DEBUG cinder.coordination [req-b63df3ef-a810-4a97-87e7-49f304b721fc req-491b0d16-6d8c-4b60-a4af-96e2fdb1e21e tempest-VolumesSnapshotsTestJSON-1832530690 None] Lock "cinder-quobyte-df822d0f-a182-4298-8ba5-d786acaa4936" released by "delete_volume" :: held 0.805s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:35:19 devstack cinder-volume[86120]: DEBUG cinder.quota [req-b63df3ef-a810-4a97-87e7-49f304b721fc req-491b0d16-6d8c-4b60-a4af-96e2fdb1e21e tempest-VolumesSnapshotsTestJSON-1832530690 None] Created reservations ['a6d36706-511d-494e-9e3f-7fc9e65b4b52', '8b8960fd-d59d-4aab-b468-1ee24d815616', '8959e11e-eb5e-48ba-be43-53f8684d5d87', '80dc6ac2-e086-439a-8a0d-345771d22ff1'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:35:19 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [req-b63df3ef-a810-4a97-87e7-49f304b721fc req-491b0d16-6d8c-4b60-a4af-96e2fdb1e21e tempest-VolumesSnapshotsTestJSON-1832530690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:35:19 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [req-b63df3ef-a810-4a97-87e7-49f304b721fc req-491b0d16-6d8c-4b60-a4af-96e2fdb1e21e tempest-VolumesSnapshotsTestJSON-1832530690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:35:19 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [req-b63df3ef-a810-4a97-87e7-49f304b721fc req-491b0d16-6d8c-4b60-a4af-96e2fdb1e21e tempest-VolumesSnapshotsTestJSON-1832530690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:35:19 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [req-b63df3ef-a810-4a97-87e7-49f304b721fc req-491b0d16-6d8c-4b60-a4af-96e2fdb1e21e tempest-VolumesSnapshotsTestJSON-1832530690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:35:19 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [req-b63df3ef-a810-4a97-87e7-49f304b721fc req-491b0d16-6d8c-4b60-a4af-96e2fdb1e21e tempest-VolumesSnapshotsTestJSON-1832530690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:35:19 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [req-b63df3ef-a810-4a97-87e7-49f304b721fc req-491b0d16-6d8c-4b60-a4af-96e2fdb1e21e tempest-VolumesSnapshotsTestJSON-1832530690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:35:19 devstack sudo[102034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:35:19 devstack sudo[102034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:35:19 devstack sudo[102034]: pam_unix(sudo:session): session closed for user root
Nov 03 18:35:19 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [req-b63df3ef-a810-4a97-87e7-49f304b721fc req-491b0d16-6d8c-4b60-a4af-96e2fdb1e21e tempest-VolumesSnapshotsTestJSON-1832530690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.302s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:35:19 devstack cinder-volume[86120]: DEBUG cinder.manager [req-b63df3ef-a810-4a97-87e7-49f304b721fc req-491b0d16-6d8c-4b60-a4af-96e2fdb1e21e tempest-VolumesSnapshotsTestJSON-1832530690 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:35:19 devstack cinder-volume[86120]: INFO cinder.volume.manager [req-b63df3ef-a810-4a97-87e7-49f304b721fc req-491b0d16-6d8c-4b60-a4af-96e2fdb1e21e tempest-VolumesSnapshotsTestJSON-1832530690 None] Deleted volume successfully.
Nov 03 18:35:19 devstack sudo[102028]: pam_unix(sudo:session): session closed for user root
Nov 03 18:35:19 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-35649c26-7d25-4240-a40b-720601366e92 tempest-TestStampPattern-2051953486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-261b681b-c984-43e5-abdb-a2acaaf9e6e1" returned: 0 in 0.669s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:35:19 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-35649c26-7d25-4240-a40b-720601366e92 tempest-TestStampPattern-2051953486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-261b681b-c984-43e5-abdb-a2acaaf9e6e1.7e96fe29-8ea6-44ec-bc8d-e11c48f530fc {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:35:19 devstack cinder-volume[86120]: DEBUG cinder.coordination [req-b63df3ef-a810-4a97-87e7-49f304b721fc req-491b0d16-6d8c-4b60-a4af-96e2fdb1e21e tempest-VolumesSnapshotsTestJSON-1832530690 None] Lock "cinder-df822d0f-a182-4298-8ba5-d786acaa4936-delete_volume" released by "delete_volume" :: held 1.379s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:35:19 devstack sudo[102038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-261b681b-c984-43e5-abdb-a2acaaf9e6e1.7e96fe29-8ea6-44ec-bc8d-e11c48f530fc
Nov 03 18:35:19 devstack sudo[102038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:35:19 devstack sudo[102038]: pam_unix(sudo:session): session closed for user root
Nov 03 18:35:19 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-35649c26-7d25-4240-a40b-720601366e92 tempest-TestStampPattern-2051953486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-261b681b-c984-43e5-abdb-a2acaaf9e6e1.7e96fe29-8ea6-44ec-bc8d-e11c48f530fc" returned: 0 in 0.366s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:35:19 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-35649c26-7d25-4240-a40b-720601366e92 tempest-TestStampPattern-2051953486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-261b681b-c984-43e5-abdb-a2acaaf9e6e1.7e96fe29-8ea6-44ec-bc8d-e11c48f530fc {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:35:20 devstack sudo[102044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-261b681b-c984-43e5-abdb-a2acaaf9e6e1.7e96fe29-8ea6-44ec-bc8d-e11c48f530fc
Nov 03 18:35:20 devstack sudo[102044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:35:20 devstack sudo[102044]: pam_unix(sudo:session): session closed for user root
Nov 03 18:35:20 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-35649c26-7d25-4240-a40b-720601366e92 tempest-TestStampPattern-2051953486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-261b681b-c984-43e5-abdb-a2acaaf9e6e1.7e96fe29-8ea6-44ec-bc8d-e11c48f530fc" returned: 0 in 0.286s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:35:20 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-35649c26-7d25-4240-a40b-720601366e92 tempest-TestStampPattern-2051953486 None] Lock "cinder-quobyte-7e96fe29-8ea6-44ec-bc8d-e11c48f530fc" released by "_delete_snapshot" :: held 1.874s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:35:20 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-35649c26-7d25-4240-a40b-720601366e92 tempest-TestStampPattern-2051953486 None] Lock "cinder-quobyte-261b681b-c984-43e5-abdb-a2acaaf9e6e1" released by "delete_snapshot" :: held 1.904s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:35:20 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-35649c26-7d25-4240-a40b-720601366e92 tempest-TestStampPattern-2051953486 None] Created reservations ['9756e335-e769-4519-9973-d0730b3bd0ca', '9122d318-916b-4f0f-a156-4727adf48249', 'c9560e7b-1a1e-428a-b2ef-fd26dacdc350', '7850d992-89ab-4d4c-a56e-a6e3d3d5a34a'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:35:20 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-35649c26-7d25-4240-a40b-720601366e92 tempest-TestStampPattern-2051953486 None] Delete snapshot completed successfully.
Nov 03 18:35:20 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-35649c26-7d25-4240-a40b-720601366e92 tempest-TestStampPattern-2051953486 None] Lock "cinder-7e96fe29-8ea6-44ec-bc8d-e11c48f530fc-delete_snapshot" released by "delete_snapshot" :: held 2.073s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:35:24 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-2b45dfa4-d2a4-4193-b08a-7a3f487fc87f tempest-TestStampPattern-2051953486 None] Acquiring lock "cinder-261b681b-c984-43e5-abdb-a2acaaf9e6e1-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:35:24 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-2b45dfa4-d2a4-4193-b08a-7a3f487fc87f tempest-TestStampPattern-2051953486 None] Lock "cinder-261b681b-c984-43e5-abdb-a2acaaf9e6e1-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:35:24 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-2b45dfa4-d2a4-4193-b08a-7a3f487fc87f tempest-TestStampPattern-2051953486 None] Acquiring lock "cinder-quobyte-261b681b-c984-43e5-abdb-a2acaaf9e6e1" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:35:24 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-2b45dfa4-d2a4-4193-b08a-7a3f487fc87f tempest-TestStampPattern-2051953486 None] Lock "cinder-quobyte-261b681b-c984-43e5-abdb-a2acaaf9e6e1" acquired by "delete_volume" :: waited 0.017s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:35:24 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[90fafa3f-a019-42d1-be8f-e0137f8cca4c]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:35:24 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-2b45dfa4-d2a4-4193-b08a-7a3f487fc87f tempest-TestStampPattern-2051953486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-261b681b-c984-43e5-abdb-a2acaaf9e6e1 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:35:24 devstack sudo[102076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-261b681b-c984-43e5-abdb-a2acaaf9e6e1
Nov 03 18:35:24 devstack sudo[102076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:35:24 devstack sudo[102076]: pam_unix(sudo:session): session closed for user root
Nov 03 18:35:24 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-2b45dfa4-d2a4-4193-b08a-7a3f487fc87f tempest-TestStampPattern-2051953486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-261b681b-c984-43e5-abdb-a2acaaf9e6e1" returned: 0 in 0.389s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:35:24 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-2b45dfa4-d2a4-4193-b08a-7a3f487fc87f tempest-TestStampPattern-2051953486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-261b681b-c984-43e5-abdb-a2acaaf9e6e1 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:35:24 devstack sudo[102081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-261b681b-c984-43e5-abdb-a2acaaf9e6e1
Nov 03 18:35:24 devstack sudo[102081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:35:25 devstack sudo[102081]: pam_unix(sudo:session): session closed for user root
Nov 03 18:35:25 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-2b45dfa4-d2a4-4193-b08a-7a3f487fc87f tempest-TestStampPattern-2051953486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-261b681b-c984-43e5-abdb-a2acaaf9e6e1" returned: 0 in 0.254s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:35:25 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-2b45dfa4-d2a4-4193-b08a-7a3f487fc87f tempest-TestStampPattern-2051953486 None] Lock "cinder-quobyte-261b681b-c984-43e5-abdb-a2acaaf9e6e1" released by "delete_volume" :: held 0.715s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:35:25 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-2b45dfa4-d2a4-4193-b08a-7a3f487fc87f tempest-TestStampPattern-2051953486 None] Created reservations ['23e84314-a65f-4312-a806-5986752b7657', 'e0914a91-3580-432b-a517-77ff5854f59a', '145edeb1-56f8-49d8-b87e-2792fbb43196', '744ce32a-a2e3-4f9d-bd73-0271e8742955'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:35:25 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-2b45dfa4-d2a4-4193-b08a-7a3f487fc87f tempest-TestStampPattern-2051953486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:35:25 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-2b45dfa4-d2a4-4193-b08a-7a3f487fc87f tempest-TestStampPattern-2051953486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:35:25 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-2b45dfa4-d2a4-4193-b08a-7a3f487fc87f tempest-TestStampPattern-2051953486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:35:25 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-2b45dfa4-d2a4-4193-b08a-7a3f487fc87f tempest-TestStampPattern-2051953486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:35:25 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-2b45dfa4-d2a4-4193-b08a-7a3f487fc87f tempest-TestStampPattern-2051953486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:35:25 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-2b45dfa4-d2a4-4193-b08a-7a3f487fc87f tempest-TestStampPattern-2051953486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:35:25 devstack sudo[102084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:35:25 devstack sudo[102084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:35:25 devstack sudo[102084]: pam_unix(sudo:session): session closed for user root
Nov 03 18:35:25 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-2b45dfa4-d2a4-4193-b08a-7a3f487fc87f tempest-TestStampPattern-2051953486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.279s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:35:25 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-2b45dfa4-d2a4-4193-b08a-7a3f487fc87f tempest-TestStampPattern-2051953486 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:35:25 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-2b45dfa4-d2a4-4193-b08a-7a3f487fc87f tempest-TestStampPattern-2051953486 None] Deleted volume successfully.
Nov 03 18:35:25 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-2b45dfa4-d2a4-4193-b08a-7a3f487fc87f tempest-TestStampPattern-2051953486 None] Lock "cinder-261b681b-c984-43e5-abdb-a2acaaf9e6e1-delete_volume" released by "delete_volume" :: held 1.229s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:35:31 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-388ca600-a7b2-4f61-8c7f-09a1e3882c9f tempest-GroupsV314Test-153471630 None] Group tempest-GroupsV314Test-Group-1947606271: creating
Nov 03 18:35:31 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-388ca600-a7b2-4f61-8c7f-09a1e3882c9f tempest-GroupsV314Test-153471630 None] Group tempest-GroupsV314Test-Group-1947606271: created successfully
Nov 03 18:35:31 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-388ca600-a7b2-4f61-8c7f-09a1e3882c9f tempest-GroupsV314Test-153471630 None] Create group completed successfully.
Nov 03 18:35:33 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-74bedf94-9dc3-4ee9-b46a-4026722d3b3d tempest-GroupsV314Test-153471630 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:35:33 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-74bedf94-9dc3-4ee9-b46a-4026722d3b3d tempest-GroupsV314Test-153471630 None] Flow 'volume_create_manager' (d65afb10-1333-49b4-bbce-f66146d5061a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:35:33 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-74bedf94-9dc3-4ee9-b46a-4026722d3b3d tempest-GroupsV314Test-153471630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (769cd194-2a6b-46a0-b1cb-b28cf083650d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:35:33 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-74bedf94-9dc3-4ee9-b46a-4026722d3b3d tempest-GroupsV314Test-153471630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (769cd194-2a6b-46a0-b1cb-b28cf083650d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:35:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1269392202',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=046bd1fe-3b5c-45ef-8acc-59e3996e8ade,host='devstack@QuobyteHD#QuobyteHD',id=f4797f92-75d2-43d0-b3e8-cb62ff151fef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e83e61f00a3b4f769677d07912d8ef8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:35:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:35:34Z,use_quota=True,user_id='74c9b7587e6a46e5bbc7618871ae2d3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d159a59-f673-4dc5-b86f-721122d2cc9d),volume_type_id=9d159a59-f673-4dc5-b86f-721122d2cc9d)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:35:33 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-74bedf94-9dc3-4ee9-b46a-4026722d3b3d tempest-GroupsV314Test-153471630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd61b520-0801-449f-8779-d51c4a8f1fe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:35:33 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-74bedf94-9dc3-4ee9-b46a-4026722d3b3d tempest-GroupsV314Test-153471630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd61b520-0801-449f-8779-d51c4a8f1fe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:35:33 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-74bedf94-9dc3-4ee9-b46a-4026722d3b3d tempest-GroupsV314Test-153471630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f11e52d1-d9fd-49ec-88e8-472e209670c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:35:33 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-74bedf94-9dc3-4ee9-b46a-4026722d3b3d tempest-GroupsV314Test-153471630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f11e52d1-d9fd-49ec-88e8-472e209670c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4797f92-75d2-43d0-b3e8-cb62ff151fef', 'volume_name': 'volume-f4797f92-75d2-43d0-b3e8-cb62ff151fef', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:35:33 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-74bedf94-9dc3-4ee9-b46a-4026722d3b3d tempest-GroupsV314Test-153471630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8062b335-9bd7-4deb-8965-7810c76f3123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:35:33 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-74bedf94-9dc3-4ee9-b46a-4026722d3b3d tempest-GroupsV314Test-153471630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8062b335-9bd7-4deb-8965-7810c76f3123) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:35:33 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-74bedf94-9dc3-4ee9-b46a-4026722d3b3d tempest-GroupsV314Test-153471630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd811d9e-6a43-4660-a442-1f095858b9ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:35:33 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-74bedf94-9dc3-4ee9-b46a-4026722d3b3d tempest-GroupsV314Test-153471630 None] Volume f4797f92-75d2-43d0-b3e8-cb62ff151fef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4797f92-75d2-43d0-b3e8-cb62ff151fef', 'volume_size': 1}
Nov 03 18:35:33 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-74bedf94-9dc3-4ee9-b46a-4026722d3b3d tempest-GroupsV314Test-153471630 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:35:33 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-74bedf94-9dc3-4ee9-b46a-4026722d3b3d tempest-GroupsV314Test-153471630 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:35:33 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-74bedf94-9dc3-4ee9-b46a-4026722d3b3d tempest-GroupsV314Test-153471630 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=046bd1fe-3b5c-45ef-8acc-59e3996e8ade,created_at=2026-11-03T17:35:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1269392202',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=046bd1fe-3b5c-45ef-8acc-59e3996e8ade,host='devstack@QuobyteHD#QuobyteHD',id=f4797f92-75d2-43d0-b3e8-cb62ff151fef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e83e61f00a3b4f769677d07912d8ef8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:35:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:35:34Z,use_quota=True,user_id='74c9b7587e6a46e5bbc7618871ae2d3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d159a59-f673-4dc5-b86f-721122d2cc9d),volume_type_id=9d159a59-f673-4dc5-b86f-721122d2cc9d)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:35:33 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-74bedf94-9dc3-4ee9-b46a-4026722d3b3d tempest-GroupsV314Test-153471630 None] Creating volume f4797f92-75d2-43d0-b3e8-cb62ff151fef {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:35:33 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-74bedf94-9dc3-4ee9-b46a-4026722d3b3d tempest-GroupsV314Test-153471630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:35:33 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-74bedf94-9dc3-4ee9-b46a-4026722d3b3d tempest-GroupsV314Test-153471630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:35:33 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-74bedf94-9dc3-4ee9-b46a-4026722d3b3d tempest-GroupsV314Test-153471630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:35:33 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-74bedf94-9dc3-4ee9-b46a-4026722d3b3d tempest-GroupsV314Test-153471630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:35:33 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-74bedf94-9dc3-4ee9-b46a-4026722d3b3d tempest-GroupsV314Test-153471630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:35:33 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-74bedf94-9dc3-4ee9-b46a-4026722d3b3d tempest-GroupsV314Test-153471630 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:35:33 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-74bedf94-9dc3-4ee9-b46a-4026722d3b3d tempest-GroupsV314Test-153471630 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:35:33 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-74bedf94-9dc3-4ee9-b46a-4026722d3b3d tempest-GroupsV314Test-153471630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f4797f92-75d2-43d0-b3e8-cb62ff151fef 1073741824 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:35:33 devstack sudo[102182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f4797f92-75d2-43d0-b3e8-cb62ff151fef 1073741824
Nov 03 18:35:33 devstack sudo[102182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:35:34 devstack sudo[102182]: pam_unix(sudo:session): session closed for user root
Nov 03 18:35:34 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-74bedf94-9dc3-4ee9-b46a-4026722d3b3d tempest-GroupsV314Test-153471630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f4797f92-75d2-43d0-b3e8-cb62ff151fef 1073741824" returned: 0 in 0.458s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:35:34 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-74bedf94-9dc3-4ee9-b46a-4026722d3b3d tempest-GroupsV314Test-153471630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f4797f92-75d2-43d0-b3e8-cb62ff151fef {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:35:34 devstack sudo[102188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f4797f92-75d2-43d0-b3e8-cb62ff151fef
Nov 03 18:35:34 devstack sudo[102188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:35:34 devstack sudo[102188]: pam_unix(sudo:session): session closed for user root
Nov 03 18:35:34 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-74bedf94-9dc3-4ee9-b46a-4026722d3b3d tempest-GroupsV314Test-153471630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f4797f92-75d2-43d0-b3e8-cb62ff151fef" returned: 0 in 0.266s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:35:34 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-74bedf94-9dc3-4ee9-b46a-4026722d3b3d tempest-GroupsV314Test-153471630 None] <== create_volume: return (774ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:35:34 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-74bedf94-9dc3-4ee9-b46a-4026722d3b3d tempest-GroupsV314Test-153471630 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.777s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:35:34 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-74bedf94-9dc3-4ee9-b46a-4026722d3b3d tempest-GroupsV314Test-153471630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd811d9e-6a43-4660-a442-1f095858b9ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4797f92-75d2-43d0-b3e8-cb62ff151fef', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:35:34 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-74bedf94-9dc3-4ee9-b46a-4026722d3b3d tempest-GroupsV314Test-153471630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b9f5d33-ab1a-46b4-8227-101932b2597d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:35:34 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-74bedf94-9dc3-4ee9-b46a-4026722d3b3d tempest-GroupsV314Test-153471630 None] Volume volume-f4797f92-75d2-43d0-b3e8-cb62ff151fef (f4797f92-75d2-43d0-b3e8-cb62ff151fef): created successfully
Nov 03 18:35:34 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-74bedf94-9dc3-4ee9-b46a-4026722d3b3d tempest-GroupsV314Test-153471630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b9f5d33-ab1a-46b4-8227-101932b2597d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:35:34 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-74bedf94-9dc3-4ee9-b46a-4026722d3b3d tempest-GroupsV314Test-153471630 None] Flow 'volume_create_manager' (d65afb10-1333-49b4-bbce-f66146d5061a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:35:34 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-74bedf94-9dc3-4ee9-b46a-4026722d3b3d tempest-GroupsV314Test-153471630 None] Created volume successfully.
Nov 03 18:35:35 devstack cinder-volume[86120]: DEBUG dbcounter [-] [86120] Writing DB stats cinder:SELECT=75,cinder:UPDATE=81,cinder:INSERT=22,cinder:DELETE=6 {{(pid=86120) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 18:35:35 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-c6f57558-6b25-4c35-9356-5fe3802fb33f tempest-GroupsV314Test-153471630 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:35:35 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-c6f57558-6b25-4c35-9356-5fe3802fb33f tempest-GroupsV314Test-153471630 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:35:35 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-c6f57558-6b25-4c35-9356-5fe3802fb33f tempest-GroupsV314Test-153471630 None] Cloning volume f4797f92-75d2-43d0-b3e8-cb62ff151fef to volume 79c03f7d-ff45-4893-83fd-98158317430e
Nov 03 18:35:35 devstack cinder-volume[86120]: DEBUG dbcounter [-] [86120] Writing DB stats cinder:SELECT=83,cinder:UPDATE=80,cinder:INSERT=17,cinder:DELETE=6 {{(pid=86120) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 18:35:35 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-c6f57558-6b25-4c35-9356-5fe3802fb33f tempest-GroupsV314Test-153471630 None] Creating offline snapshot 96137481-48ef-4b7b-925f-97c0a36572cd of volume f4797f92-75d2-43d0-b3e8-cb62ff151fef {{(pid=86120) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 18:35:35 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[42bfcd8e-0d8f-4881-a43c-92ef04be24ab]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:35:35 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-c6f57558-6b25-4c35-9356-5fe3802fb33f tempest-GroupsV314Test-153471630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f4797f92-75d2-43d0-b3e8-cb62ff151fef {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:35:36 devstack sudo[102192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f4797f92-75d2-43d0-b3e8-cb62ff151fef
Nov 03 18:35:36 devstack sudo[102192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:35:36 devstack sudo[102192]: pam_unix(sudo:session): session closed for user root
Nov 03 18:35:36 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-c6f57558-6b25-4c35-9356-5fe3802fb33f tempest-GroupsV314Test-153471630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f4797f92-75d2-43d0-b3e8-cb62ff151fef" returned: 0 in 0.496s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:35:36 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-c6f57558-6b25-4c35-9356-5fe3802fb33f tempest-GroupsV314Test-153471630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f4797f92-75d2-43d0-b3e8-cb62ff151fef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f4797f92-75d2-43d0-b3e8-cb62ff151fef.96137481-48ef-4b7b-925f-97c0a36572cd 1G {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:35:36 devstack sudo[102197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f4797f92-75d2-43d0-b3e8-cb62ff151fef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f4797f92-75d2-43d0-b3e8-cb62ff151fef.96137481-48ef-4b7b-925f-97c0a36572cd 1G
Nov 03 18:35:36 devstack sudo[102197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:35:36 devstack sudo[102197]: pam_unix(sudo:session): session closed for user root
Nov 03 18:35:36 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-c6f57558-6b25-4c35-9356-5fe3802fb33f tempest-GroupsV314Test-153471630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f4797f92-75d2-43d0-b3e8-cb62ff151fef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f4797f92-75d2-43d0-b3e8-cb62ff151fef.96137481-48ef-4b7b-925f-97c0a36572cd 1G" returned: 0 in 0.461s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:35:36 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-c6f57558-6b25-4c35-9356-5fe3802fb33f tempest-GroupsV314Test-153471630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4797f92-75d2-43d0-b3e8-cb62ff151fef -F qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f4797f92-75d2-43d0-b3e8-cb62ff151fef.96137481-48ef-4b7b-925f-97c0a36572cd {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:35:36 devstack sudo[102204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4797f92-75d2-43d0-b3e8-cb62ff151fef -F qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f4797f92-75d2-43d0-b3e8-cb62ff151fef.96137481-48ef-4b7b-925f-97c0a36572cd
Nov 03 18:35:36 devstack sudo[102204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:35:37 devstack sudo[102204]: pam_unix(sudo:session): session closed for user root
Nov 03 18:35:37 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-c6f57558-6b25-4c35-9356-5fe3802fb33f tempest-GroupsV314Test-153471630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4797f92-75d2-43d0-b3e8-cb62ff151fef -F qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f4797f92-75d2-43d0-b3e8-cb62ff151fef.96137481-48ef-4b7b-925f-97c0a36572cd" returned: 0 in 0.366s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:35:37 devstack cinder-volume[86120]: WARNING cinder.volume.drivers.remotefs [None req-c6f57558-6b25-4c35-9356-5fe3802fb33f tempest-GroupsV314Test-153471630 None] /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f4797f92-75d2-43d0-b3e8-cb62ff151fef.96137481-48ef-4b7b-925f-97c0a36572cd is being set with open permissions: ugo+rw: NotImplementedError
Nov 03 18:35:37 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-c6f57558-6b25-4c35-9356-5fe3802fb33f tempest-GroupsV314Test-153471630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f4797f92-75d2-43d0-b3e8-cb62ff151fef.96137481-48ef-4b7b-925f-97c0a36572cd {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:35:37 devstack sudo[102209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f4797f92-75d2-43d0-b3e8-cb62ff151fef.96137481-48ef-4b7b-925f-97c0a36572cd
Nov 03 18:35:37 devstack sudo[102209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:35:37 devstack sudo[102209]: pam_unix(sudo:session): session closed for user root
Nov 03 18:35:37 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-c6f57558-6b25-4c35-9356-5fe3802fb33f tempest-GroupsV314Test-153471630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f4797f92-75d2-43d0-b3e8-cb62ff151fef.96137481-48ef-4b7b-925f-97c0a36572cd" returned: 0 in 0.315s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:35:37 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-c6f57558-6b25-4c35-9356-5fe3802fb33f tempest-GroupsV314Test-153471630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f4797f92-75d2-43d0-b3e8-cb62ff151fef.info {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:35:37 devstack sudo[102212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f4797f92-75d2-43d0-b3e8-cb62ff151fef.info
Nov 03 18:35:37 devstack sudo[102212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:35:37 devstack sudo[102212]: pam_unix(sudo:session): session closed for user root
Nov 03 18:35:37 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-c6f57558-6b25-4c35-9356-5fe3802fb33f tempest-GroupsV314Test-153471630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f4797f92-75d2-43d0-b3e8-cb62ff151fef.info" returned: 0 in 0.285s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:35:37 devstack cinder-volume[86120]: WARNING cinder.volume.drivers.remotefs [None req-c6f57558-6b25-4c35-9356-5fe3802fb33f tempest-GroupsV314Test-153471630 None] /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f4797f92-75d2-43d0-b3e8-cb62ff151fef.info is being set with open permissions: ugo+rw: NotImplementedError
Nov 03 18:35:37 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-c6f57558-6b25-4c35-9356-5fe3802fb33f tempest-GroupsV314Test-153471630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f4797f92-75d2-43d0-b3e8-cb62ff151fef.info {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:35:37 devstack sudo[102215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f4797f92-75d2-43d0-b3e8-cb62ff151fef.info
Nov 03 18:35:37 devstack sudo[102215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:35:38 devstack sudo[102215]: pam_unix(sudo:session): session closed for user root
Nov 03 18:35:38 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-c6f57558-6b25-4c35-9356-5fe3802fb33f tempest-GroupsV314Test-153471630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f4797f92-75d2-43d0-b3e8-cb62ff151fef.info" returned: 0 in 0.293s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:35:38 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-c6f57558-6b25-4c35-9356-5fe3802fb33f tempest-GroupsV314Test-153471630 None] Acquiring lock "cinder-quobyte-79c03f7d-ff45-4893-83fd-98158317430e" by "_copy_volume_from_snapshot" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:35:38 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-c6f57558-6b25-4c35-9356-5fe3802fb33f tempest-GroupsV314Test-153471630 None] Lock "cinder-quobyte-79c03f7d-ff45-4893-83fd-98158317430e" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:35:38 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-c6f57558-6b25-4c35-9356-5fe3802fb33f tempest-GroupsV314Test-153471630 None] snapshot: 96137481-48ef-4b7b-925f-97c0a36572cd, volume: 79c03f7d-ff45-4893-83fd-98158317430e,  {{(pid=86120) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 03 18:35:38 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-c6f57558-6b25-4c35-9356-5fe3802fb33f tempest-GroupsV314Test-153471630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:35:38 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-c6f57558-6b25-4c35-9356-5fe3802fb33f tempest-GroupsV314Test-153471630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:35:38 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-c6f57558-6b25-4c35-9356-5fe3802fb33f tempest-GroupsV314Test-153471630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:35:38 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-c6f57558-6b25-4c35-9356-5fe3802fb33f tempest-GroupsV314Test-153471630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:35:38 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-c6f57558-6b25-4c35-9356-5fe3802fb33f tempest-GroupsV314Test-153471630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:35:38 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[992b1081-ecf6-49e2-b444-7a9f38b932b3]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:35:38 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-c6f57558-6b25-4c35-9356-5fe3802fb33f tempest-GroupsV314Test-153471630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f4797f92-75d2-43d0-b3e8-cb62ff151fef.96137481-48ef-4b7b-925f-97c0a36572cd {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:35:38 devstack sudo[102218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f4797f92-75d2-43d0-b3e8-cb62ff151fef.96137481-48ef-4b7b-925f-97c0a36572cd
Nov 03 18:35:38 devstack sudo[102218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:35:38 devstack sudo[102218]: pam_unix(sudo:session): session closed for user root
Nov 03 18:35:38 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-c6f57558-6b25-4c35-9356-5fe3802fb33f tempest-GroupsV314Test-153471630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f4797f92-75d2-43d0-b3e8-cb62ff151fef.96137481-48ef-4b7b-925f-97c0a36572cd" returned: 0 in 0.482s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:35:38 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-c6f57558-6b25-4c35-9356-5fe3802fb33f tempest-GroupsV314Test-153471630 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f4797f92-75d2-43d0-b3e8-cb62ff151fef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86120) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 18:35:38 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[67c27d25-22b1-4882-bd64-17ece0998144]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:35:38 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-c6f57558-6b25-4c35-9356-5fe3802fb33f tempest-GroupsV314Test-153471630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f4797f92-75d2-43d0-b3e8-cb62ff151fef {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:35:38 devstack sudo[102223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f4797f92-75d2-43d0-b3e8-cb62ff151fef
Nov 03 18:35:38 devstack sudo[102223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:35:39 devstack sudo[102223]: pam_unix(sudo:session): session closed for user root
Nov 03 18:35:39 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-c6f57558-6b25-4c35-9356-5fe3802fb33f tempest-GroupsV314Test-153471630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f4797f92-75d2-43d0-b3e8-cb62ff151fef" returned: 0 in 0.416s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:35:39 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-c6f57558-6b25-4c35-9356-5fe3802fb33f tempest-GroupsV314Test-153471630 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f4797f92-75d2-43d0-b3e8-cb62ff151fef {{(pid=86120) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 03 18:35:39 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-c6f57558-6b25-4c35-9356-5fe3802fb33f tempest-GroupsV314Test-153471630 None] Creating direct copy from snapshot {{(pid=86120) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 03 18:35:39 devstack cinder-volume[86120]: DEBUG cinder.utils [None req-c6f57558-6b25-4c35-9356-5fe3802fb33f tempest-GroupsV314Test-153471630 None] Path /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-79c03f7d-ff45-4893-83fd-98158317430e not found in is_blk_device check {{(pid=86120) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 03 18:35:39 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-c6f57558-6b25-4c35-9356-5fe3802fb33f tempest-GroupsV314Test-153471630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f4797f92-75d2-43d0-b3e8-cb62ff151fef /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-79c03f7d-ff45-4893-83fd-98158317430e {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:35:39 devstack sudo[102230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f4797f92-75d2-43d0-b3e8-cb62ff151fef /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-79c03f7d-ff45-4893-83fd-98158317430e
Nov 03 18:35:39 devstack sudo[102230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:35:44 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc5988ab-15ec-45de-b088-482133b2ee5f tempest-VolumeImageDependencyTests-1339477212 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:35:45 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-fc5988ab-15ec-45de-b088-482133b2ee5f tempest-VolumeImageDependencyTests-1339477212 None] Flow 'volume_create_manager' (f493898b-a53d-40a5-95e0-98f802afb00e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:35:45 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-fc5988ab-15ec-45de-b088-482133b2ee5f tempest-VolumeImageDependencyTests-1339477212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3fbfccf-709a-4a2b-9a4d-de12de65f7a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:35:45 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-fc5988ab-15ec-45de-b088-482133b2ee5f tempest-VolumeImageDependencyTests-1339477212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3fbfccf-709a-4a2b-9a4d-de12de65f7a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:35:44Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d328aa8d-5d63-478e-81aa-44e79398d9c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf70f7eef7964d93b277e81bcdac276e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:35:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:35:45Z,use_quota=True,user_id='3375728efd24476d9ee89b38f3e8b8de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:35:45 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-fc5988ab-15ec-45de-b088-482133b2ee5f tempest-VolumeImageDependencyTests-1339477212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6826310b-32eb-4f70-9ddd-4af0a5a3c6cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:35:45 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-fc5988ab-15ec-45de-b088-482133b2ee5f tempest-VolumeImageDependencyTests-1339477212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6826310b-32eb-4f70-9ddd-4af0a5a3c6cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:35:45 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-fc5988ab-15ec-45de-b088-482133b2ee5f tempest-VolumeImageDependencyTests-1339477212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f762138-3a04-411f-9903-150535078d3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:35:45 devstack cinder-volume[86120]: DEBUG cinder.image.glance [None req-fc5988ab-15ec-45de-b088-482133b2ee5f tempest-VolumeImageDependencyTests-1339477212 None] Creating Keystone auth plugin from conf {{(pid=86120) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 03 18:35:45 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-fc5988ab-15ec-45de-b088-482133b2ee5f tempest-VolumeImageDependencyTests-1339477212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f762138-3a04-411f-9903-150535078d3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd328aa8d-5d63-478e-81aa-44e79398d9c6', 'volume_name': 'volume-d328aa8d-5d63-478e-81aa-44e79398d9c6', 'volume_size': 1, 'image_id': 'cbfec43c-b871-47ea-8298-495914bf100c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cbfec43c-b871-47ea-8298-495914bf100c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'cfe2d4daa42c496a3922a6fa6e5a7757', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'bf70f7eef7964d93b277e81bcdac276e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2bb13900f3b6e52fcc26ebdeaa0f1141cae5f5625981afa4096ba6dec48f7520819588f3f92091af97bfb2525985e5a2d2ca598279ef60d29f983164f3639985', 'id': 'cbfec43c-b871-47ea-8298-495914bf100c', 'created_at': datetime.datetime(2026, 11, 3, 17, 35, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 17, 35, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cbfec43c-b871-47ea-8298-495914bf100c/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7a8d3c3fbb00>}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:35:45 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-fc5988ab-15ec-45de-b088-482133b2ee5f tempest-VolumeImageDependencyTests-1339477212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76e10f9b-e23d-4234-a8b3-2e57dc37a973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:35:45 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-fc5988ab-15ec-45de-b088-482133b2ee5f tempest-VolumeImageDependencyTests-1339477212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76e10f9b-e23d-4234-a8b3-2e57dc37a973) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:35:45 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-fc5988ab-15ec-45de-b088-482133b2ee5f tempest-VolumeImageDependencyTests-1339477212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01591799-3f43-467b-8f63-16a1fce297b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:35:45 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-fc5988ab-15ec-45de-b088-482133b2ee5f tempest-VolumeImageDependencyTests-1339477212 None] Volume d328aa8d-5d63-478e-81aa-44e79398d9c6: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d328aa8d-5d63-478e-81aa-44e79398d9c6', 'volume_size': 1, 'image_id': 'cbfec43c-b871-47ea-8298-495914bf100c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cbfec43c-b871-47ea-8298-495914bf100c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'cfe2d4daa42c496a3922a6fa6e5a7757', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'bf70f7eef7964d93b277e81bcdac276e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2bb13900f3b6e52fcc26ebdeaa0f1141cae5f5625981afa4096ba6dec48f7520819588f3f92091af97bfb2525985e5a2d2ca598279ef60d29f983164f3639985', 'id': 'cbfec43c-b871-47ea-8298-495914bf100c', 'created_at': datetime.datetime(2026, 11, 3, 17, 35, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 17, 35, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cbfec43c-b871-47ea-8298-495914bf100c/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7a8d3c3fbb00>}
Nov 03 18:35:45 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc5988ab-15ec-45de-b088-482133b2ee5f tempest-VolumeImageDependencyTests-1339477212 None] Trying to clone d328aa8d-5d63-478e-81aa-44e79398d9c6 from image cbfec43c-b871-47ea-8298-495914bf100c at location (None, [{'url': 'file:///opt/stack/data/glance/images/cbfec43c-b871-47ea-8298-495914bf100c', 'metadata': {}}]). {{(pid=86120) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 03 18:35:45 devstack cinder-volume[86120]: DEBUG cinder.image.image_utils [None req-fc5988ab-15ec-45de-b088-482133b2ee5f tempest-VolumeImageDependencyTests-1339477212 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_cbfec43c-b871-47ea-8298-495914bf100c_yg7eursjdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86120) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 03 18:35:45 devstack cinder-volume[86120]: INFO cinder.image.image_utils [None req-fc5988ab-15ec-45de-b088-482133b2ee5f tempest-VolumeImageDependencyTests-1339477212 None] Image download 0.00 MB at 0.00 MB/s
Nov 03 18:35:45 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[8596aa77-e1c4-41c8-b742-dfc4a1f98c42]: (4, 'raw') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:35:45 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-fc5988ab-15ec-45de-b088-482133b2ee5f tempest-VolumeImageDependencyTests-1339477212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cbfec43c-b871-47ea-8298-495914bf100c_yg7eursjdevstack@QuobyteHD {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:35:45 devstack sudo[102247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cbfec43c-b871-47ea-8298-495914bf100c_yg7eursjdevstack@QuobyteHD
Nov 03 18:35:45 devstack sudo[102247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:35:46 devstack sudo[102247]: pam_unix(sudo:session): session closed for user root
Nov 03 18:35:46 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-fc5988ab-15ec-45de-b088-482133b2ee5f tempest-VolumeImageDependencyTests-1339477212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cbfec43c-b871-47ea-8298-495914bf100c_yg7eursjdevstack@QuobyteHD" returned: 0 in 0.410s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:35:46 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-fc5988ab-15ec-45de-b088-482133b2ee5f tempest-VolumeImageDependencyTests-1339477212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cbfec43c-b871-47ea-8298-495914bf100c_yg7eursjdevstack@QuobyteHD {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:35:46 devstack sudo[102251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cbfec43c-b871-47ea-8298-495914bf100c_yg7eursjdevstack@QuobyteHD
Nov 03 18:35:46 devstack sudo[102251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:35:46 devstack sudo[102251]: pam_unix(sudo:session): session closed for user root
Nov 03 18:35:46 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-fc5988ab-15ec-45de-b088-482133b2ee5f tempest-VolumeImageDependencyTests-1339477212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cbfec43c-b871-47ea-8298-495914bf100c_yg7eursjdevstack@QuobyteHD" returned: 1 in 0.530s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:35:46 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-fc5988ab-15ec-45de-b088-482133b2ee5f tempest-VolumeImageDependencyTests-1339477212 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cbfec43c-b871-47ea-8298-495914bf100c_yg7eursjdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 03 18:35:46 devstack cinder-volume[86120]: DEBUG cinder.image.image_utils [None req-fc5988ab-15ec-45de-b088-482133b2ee5f tempest-VolumeImageDependencyTests-1339477212 None] Temporary image cbfec43c-b871-47ea-8298-495914bf100c is fetched for user 3375728efd24476d9ee89b38f3e8b8de. {{(pid=86120) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 03 18:35:46 devstack sudo[102230]: pam_unix(sudo:session): session closed for user root
Nov 03 18:35:46 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-c6f57558-6b25-4c35-9356-5fe3802fb33f tempest-GroupsV314Test-153471630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f4797f92-75d2-43d0-b3e8-cb62ff151fef /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-79c03f7d-ff45-4893-83fd-98158317430e" returned: 0 in 7.625s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:35:46 devstack cinder-volume[86120]: DEBUG cinder.image.image_utils [None req-c6f57558-6b25-4c35-9356-5fe3802fb33f tempest-GroupsV314Test-153471630 None] Image conversion details: src /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f4797f92-75d2-43d0-b3e8-cb62ff151fef, size 1024.00 MB, duration 7.63 sec, destination /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-79c03f7d-ff45-4893-83fd-98158317430e {{(pid=86120) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 03 18:35:46 devstack cinder-volume[86120]: INFO cinder.image.image_utils [None req-c6f57558-6b25-4c35-9356-5fe3802fb33f tempest-GroupsV314Test-153471630 None] Converted 1024.00 MB image at 134.26 MB/s
Nov 03 18:35:46 devstack cinder-volume[86120]: WARNING cinder.volume.drivers.remotefs [None req-c6f57558-6b25-4c35-9356-5fe3802fb33f tempest-GroupsV314Test-153471630 None] /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-79c03f7d-ff45-4893-83fd-98158317430e is being set with open permissions: ugo+rw: NotImplementedError
Nov 03 18:35:46 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-c6f57558-6b25-4c35-9356-5fe3802fb33f tempest-GroupsV314Test-153471630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-79c03f7d-ff45-4893-83fd-98158317430e {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:35:46 devstack sudo[102256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-79c03f7d-ff45-4893-83fd-98158317430e
Nov 03 18:35:46 devstack sudo[102256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:35:46 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f8a8915-b56a-43ce-a70d-df0e702a46fc]: (4, 'raw') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:35:46 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-fc5988ab-15ec-45de-b088-482133b2ee5f tempest-VolumeImageDependencyTests-1339477212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cbfec43c-b871-47ea-8298-495914bf100c_yg7eursjdevstack@QuobyteHD {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:35:46 devstack sudo[102258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cbfec43c-b871-47ea-8298-495914bf100c_yg7eursjdevstack@QuobyteHD
Nov 03 18:35:46 devstack sudo[102258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:35:47 devstack sudo[102256]: pam_unix(sudo:session): session closed for user root
Nov 03 18:35:47 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-c6f57558-6b25-4c35-9356-5fe3802fb33f tempest-GroupsV314Test-153471630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-79c03f7d-ff45-4893-83fd-98158317430e" returned: 0 in 0.240s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:35:47 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-c6f57558-6b25-4c35-9356-5fe3802fb33f tempest-GroupsV314Test-153471630 None] Lock "cinder-quobyte-79c03f7d-ff45-4893-83fd-98158317430e" released by "_copy_volume_from_snapshot" :: held 8.862s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:35:47 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-c6f57558-6b25-4c35-9356-5fe3802fb33f tempest-GroupsV314Test-153471630 None] Acquiring lock "cinder-quobyte-96137481-48ef-4b7b-925f-97c0a36572cd" by "_delete_snapshot" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:35:47 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-c6f57558-6b25-4c35-9356-5fe3802fb33f tempest-GroupsV314Test-153471630 None] Lock "cinder-quobyte-96137481-48ef-4b7b-925f-97c0a36572cd" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:35:47 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-c6f57558-6b25-4c35-9356-5fe3802fb33f tempest-GroupsV314Test-153471630 None] Deleting offline snapshot 96137481-48ef-4b7b-925f-97c0a36572cd of volume f4797f92-75d2-43d0-b3e8-cb62ff151fef {{(pid=86120) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 18:35:47 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-c6f57558-6b25-4c35-9356-5fe3802fb33f tempest-GroupsV314Test-153471630 None] snapshot_file for this snap is: volume-f4797f92-75d2-43d0-b3e8-cb62ff151fef.96137481-48ef-4b7b-925f-97c0a36572cd {{(pid=86120) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 18:35:47 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[41367747-1b3f-4a5f-9ffb-4d84cad2a978]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:35:47 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-c6f57558-6b25-4c35-9356-5fe3802fb33f tempest-GroupsV314Test-153471630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f4797f92-75d2-43d0-b3e8-cb62ff151fef.96137481-48ef-4b7b-925f-97c0a36572cd {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:35:47 devstack sudo[102258]: pam_unix(sudo:session): session closed for user root
Nov 03 18:35:47 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-fc5988ab-15ec-45de-b088-482133b2ee5f tempest-VolumeImageDependencyTests-1339477212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cbfec43c-b871-47ea-8298-495914bf100c_yg7eursjdevstack@QuobyteHD" returned: 0 in 0.345s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:35:47 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-fc5988ab-15ec-45de-b088-482133b2ee5f tempest-VolumeImageDependencyTests-1339477212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cbfec43c-b871-47ea-8298-495914bf100c_yg7eursjdevstack@QuobyteHD {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:35:47 devstack sudo[102261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f4797f92-75d2-43d0-b3e8-cb62ff151fef.96137481-48ef-4b7b-925f-97c0a36572cd
Nov 03 18:35:47 devstack sudo[102261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:35:47 devstack sudo[102264]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cbfec43c-b871-47ea-8298-495914bf100c_yg7eursjdevstack@QuobyteHD
Nov 03 18:35:47 devstack sudo[102264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:35:47 devstack sudo[102261]: pam_unix(sudo:session): session closed for user root
Nov 03 18:35:47 devstack sudo[102264]: pam_unix(sudo:session): session closed for user root
Nov 03 18:35:47 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-c6f57558-6b25-4c35-9356-5fe3802fb33f tempest-GroupsV314Test-153471630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f4797f92-75d2-43d0-b3e8-cb62ff151fef.96137481-48ef-4b7b-925f-97c0a36572cd" returned: 0 in 0.418s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:35:47 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-c6f57558-6b25-4c35-9356-5fe3802fb33f tempest-GroupsV314Test-153471630 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f4797f92-75d2-43d0-b3e8-cb62ff151fef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86120) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 18:35:47 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-fc5988ab-15ec-45de-b088-482133b2ee5f tempest-VolumeImageDependencyTests-1339477212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cbfec43c-b871-47ea-8298-495914bf100c_yg7eursjdevstack@QuobyteHD" returned: 1 in 0.372s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:35:47 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-fc5988ab-15ec-45de-b088-482133b2ee5f tempest-VolumeImageDependencyTests-1339477212 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cbfec43c-b871-47ea-8298-495914bf100c_yg7eursjdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 03 18:35:47 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-fc5988ab-15ec-45de-b088-482133b2ee5f tempest-VolumeImageDependencyTests-1339477212 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:35:47 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[04f1cf4a-7abb-4245-a165-38cc47668688]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:35:47 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-c6f57558-6b25-4c35-9356-5fe3802fb33f tempest-GroupsV314Test-153471630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f4797f92-75d2-43d0-b3e8-cb62ff151fef {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:35:47 devstack sudo[102273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f4797f92-75d2-43d0-b3e8-cb62ff151fef
Nov 03 18:35:47 devstack sudo[102273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:35:48 devstack sudo[102273]: pam_unix(sudo:session): session closed for user root
Nov 03 18:35:48 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-c6f57558-6b25-4c35-9356-5fe3802fb33f tempest-GroupsV314Test-153471630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f4797f92-75d2-43d0-b3e8-cb62ff151fef" returned: 0 in 0.568s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:35:48 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-c6f57558-6b25-4c35-9356-5fe3802fb33f tempest-GroupsV314Test-153471630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f4797f92-75d2-43d0-b3e8-cb62ff151fef.96137481-48ef-4b7b-925f-97c0a36572cd {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:35:48 devstack sudo[102278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f4797f92-75d2-43d0-b3e8-cb62ff151fef.96137481-48ef-4b7b-925f-97c0a36572cd
Nov 03 18:35:48 devstack sudo[102278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:35:48 devstack sudo[102278]: pam_unix(sudo:session): session closed for user root
Nov 03 18:35:48 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-c6f57558-6b25-4c35-9356-5fe3802fb33f tempest-GroupsV314Test-153471630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f4797f92-75d2-43d0-b3e8-cb62ff151fef.96137481-48ef-4b7b-925f-97c0a36572cd" returned: 0 in 0.372s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:35:48 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-c6f57558-6b25-4c35-9356-5fe3802fb33f tempest-GroupsV314Test-153471630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f4797f92-75d2-43d0-b3e8-cb62ff151fef.96137481-48ef-4b7b-925f-97c0a36572cd {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:35:48 devstack sudo[102284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f4797f92-75d2-43d0-b3e8-cb62ff151fef.96137481-48ef-4b7b-925f-97c0a36572cd
Nov 03 18:35:48 devstack sudo[102284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:35:48 devstack sudo[102284]: pam_unix(sudo:session): session closed for user root
Nov 03 18:35:48 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-c6f57558-6b25-4c35-9356-5fe3802fb33f tempest-GroupsV314Test-153471630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f4797f92-75d2-43d0-b3e8-cb62ff151fef.96137481-48ef-4b7b-925f-97c0a36572cd" returned: 0 in 0.269s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:35:48 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-c6f57558-6b25-4c35-9356-5fe3802fb33f tempest-GroupsV314Test-153471630 None] Lock "cinder-quobyte-96137481-48ef-4b7b-925f-97c0a36572cd" released by "_delete_snapshot" :: held 1.742s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:35:48 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-c6f57558-6b25-4c35-9356-5fe3802fb33f tempest-GroupsV314Test-153471630 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.088s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:35:48 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-fc5988ab-15ec-45de-b088-482133b2ee5f tempest-VolumeImageDependencyTests-1339477212 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.286s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:35:48 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-fc5988ab-15ec-45de-b088-482133b2ee5f tempest-VolumeImageDependencyTests-1339477212 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:35:44Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d328aa8d-5d63-478e-81aa-44e79398d9c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf70f7eef7964d93b277e81bcdac276e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:35:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:35:45Z,use_quota=True,user_id='3375728efd24476d9ee89b38f3e8b8de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:35:48 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-fc5988ab-15ec-45de-b088-482133b2ee5f tempest-VolumeImageDependencyTests-1339477212 None] Creating volume d328aa8d-5d63-478e-81aa-44e79398d9c6 {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:35:48 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-fc5988ab-15ec-45de-b088-482133b2ee5f tempest-VolumeImageDependencyTests-1339477212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:35:48 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-fc5988ab-15ec-45de-b088-482133b2ee5f tempest-VolumeImageDependencyTests-1339477212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:35:48 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-fc5988ab-15ec-45de-b088-482133b2ee5f tempest-VolumeImageDependencyTests-1339477212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:35:48 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-fc5988ab-15ec-45de-b088-482133b2ee5f tempest-VolumeImageDependencyTests-1339477212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:35:48 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-fc5988ab-15ec-45de-b088-482133b2ee5f tempest-VolumeImageDependencyTests-1339477212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:35:48 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-fc5988ab-15ec-45de-b088-482133b2ee5f tempest-VolumeImageDependencyTests-1339477212 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:35:48 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-fc5988ab-15ec-45de-b088-482133b2ee5f tempest-VolumeImageDependencyTests-1339477212 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:35:48 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-fc5988ab-15ec-45de-b088-482133b2ee5f tempest-VolumeImageDependencyTests-1339477212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d328aa8d-5d63-478e-81aa-44e79398d9c6 1073741824 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:35:48 devstack sudo[102287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d328aa8d-5d63-478e-81aa-44e79398d9c6 1073741824
Nov 03 18:35:48 devstack sudo[102287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:35:49 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-c6f57558-6b25-4c35-9356-5fe3802fb33f tempest-GroupsV314Test-153471630 None] Create group from source-group-046bd1fe-3b5c-45ef-8acc-59e3996e8ade completed successfully.
Nov 03 18:35:49 devstack sudo[102287]: pam_unix(sudo:session): session closed for user root
Nov 03 18:35:49 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-fc5988ab-15ec-45de-b088-482133b2ee5f tempest-VolumeImageDependencyTests-1339477212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d328aa8d-5d63-478e-81aa-44e79398d9c6 1073741824" returned: 0 in 0.487s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:35:49 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-fc5988ab-15ec-45de-b088-482133b2ee5f tempest-VolumeImageDependencyTests-1339477212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d328aa8d-5d63-478e-81aa-44e79398d9c6 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:35:49 devstack sudo[102294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d328aa8d-5d63-478e-81aa-44e79398d9c6
Nov 03 18:35:49 devstack sudo[102294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:35:49 devstack sudo[102294]: pam_unix(sudo:session): session closed for user root
Nov 03 18:35:49 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-fc5988ab-15ec-45de-b088-482133b2ee5f tempest-VolumeImageDependencyTests-1339477212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d328aa8d-5d63-478e-81aa-44e79398d9c6" returned: 0 in 0.242s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:35:49 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-fc5988ab-15ec-45de-b088-482133b2ee5f tempest-VolumeImageDependencyTests-1339477212 None] <== create_volume: return (792ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:35:49 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-fc5988ab-15ec-45de-b088-482133b2ee5f tempest-VolumeImageDependencyTests-1339477212 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.797s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:35:49 devstack cinder-volume[86120]: DEBUG cinder.volume.volume_utils [None req-fc5988ab-15ec-45de-b088-482133b2ee5f tempest-VolumeImageDependencyTests-1339477212 None] Attempting download of cbfec43c-b871-47ea-8298-495914bf100c ((None, [{'url': 'file:///opt/stack/data/glance/images/cbfec43c-b871-47ea-8298-495914bf100c', 'metadata': {}}])) to volume d328aa8d-5d63-478e-81aa-44e79398d9c6. {{(pid=86120) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 03 18:35:49 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[3661e6c5-72d2-4a03-a480-0bfcfae5e2a9]: (4, 'raw') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:35:49 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-fc5988ab-15ec-45de-b088-482133b2ee5f tempest-VolumeImageDependencyTests-1339477212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cbfec43c-b871-47ea-8298-495914bf100c_pl8ymj4r {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:35:49 devstack sudo[102301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cbfec43c-b871-47ea-8298-495914bf100c_pl8ymj4r
Nov 03 18:35:49 devstack sudo[102301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:35:50 devstack sudo[102301]: pam_unix(sudo:session): session closed for user root
Nov 03 18:35:50 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-fc5988ab-15ec-45de-b088-482133b2ee5f tempest-VolumeImageDependencyTests-1339477212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cbfec43c-b871-47ea-8298-495914bf100c_pl8ymj4r" returned: 0 in 0.335s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:35:50 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-fc5988ab-15ec-45de-b088-482133b2ee5f tempest-VolumeImageDependencyTests-1339477212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cbfec43c-b871-47ea-8298-495914bf100c_pl8ymj4r {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:35:50 devstack sudo[102305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cbfec43c-b871-47ea-8298-495914bf100c_pl8ymj4r
Nov 03 18:35:50 devstack sudo[102305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:35:50 devstack sudo[102305]: pam_unix(sudo:session): session closed for user root
Nov 03 18:35:50 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-fc5988ab-15ec-45de-b088-482133b2ee5f tempest-VolumeImageDependencyTests-1339477212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cbfec43c-b871-47ea-8298-495914bf100c_pl8ymj4r" returned: 1 in 0.345s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:35:50 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-fc5988ab-15ec-45de-b088-482133b2ee5f tempest-VolumeImageDependencyTests-1339477212 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cbfec43c-b871-47ea-8298-495914bf100c_pl8ymj4r' failed. Not Retrying. {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 03 18:35:50 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb4f22f9-d923-4d6a-9fdc-1643ed13e6e7]: (4, 'raw') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:35:50 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-fc5988ab-15ec-45de-b088-482133b2ee5f tempest-VolumeImageDependencyTests-1339477212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cbfec43c-b871-47ea-8298-495914bf100c_yg7eursjdevstack@QuobyteHD {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:35:50 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-5df03256-4f53-4ba3-b5ca-b594c1613637 tempest-GroupsV314Test-153471630 None] Acquiring lock "cinder-quobyte-79c03f7d-ff45-4893-83fd-98158317430e" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:35:50 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-5df03256-4f53-4ba3-b5ca-b594c1613637 tempest-GroupsV314Test-153471630 None] Lock "cinder-quobyte-79c03f7d-ff45-4893-83fd-98158317430e" acquired by "delete_volume" :: waited 0.024s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:35:50 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[b09fdfc3-34b9-4486-be1c-9cc0faf1c1ff]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:35:50 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-5df03256-4f53-4ba3-b5ca-b594c1613637 tempest-GroupsV314Test-153471630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-79c03f7d-ff45-4893-83fd-98158317430e {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:35:50 devstack sudo[102309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cbfec43c-b871-47ea-8298-495914bf100c_yg7eursjdevstack@QuobyteHD
Nov 03 18:35:50 devstack sudo[102309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:35:50 devstack sudo[102310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-79c03f7d-ff45-4893-83fd-98158317430e
Nov 03 18:35:50 devstack sudo[102310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:35:50 devstack sudo[102309]: pam_unix(sudo:session): session closed for user root
Nov 03 18:35:50 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-fc5988ab-15ec-45de-b088-482133b2ee5f tempest-VolumeImageDependencyTests-1339477212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cbfec43c-b871-47ea-8298-495914bf100c_yg7eursjdevstack@QuobyteHD" returned: 0 in 0.451s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:35:50 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-fc5988ab-15ec-45de-b088-482133b2ee5f tempest-VolumeImageDependencyTests-1339477212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cbfec43c-b871-47ea-8298-495914bf100c_yg7eursjdevstack@QuobyteHD {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:35:50 devstack sudo[102310]: pam_unix(sudo:session): session closed for user root
Nov 03 18:35:50 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-5df03256-4f53-4ba3-b5ca-b594c1613637 tempest-GroupsV314Test-153471630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-79c03f7d-ff45-4893-83fd-98158317430e" returned: 0 in 0.412s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:35:50 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-5df03256-4f53-4ba3-b5ca-b594c1613637 tempest-GroupsV314Test-153471630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-79c03f7d-ff45-4893-83fd-98158317430e {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:35:51 devstack sudo[102320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-79c03f7d-ff45-4893-83fd-98158317430e
Nov 03 18:35:51 devstack sudo[102320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:35:51 devstack sudo[102316]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cbfec43c-b871-47ea-8298-495914bf100c_yg7eursjdevstack@QuobyteHD
Nov 03 18:35:51 devstack sudo[102316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:35:51 devstack sudo[102316]: pam_unix(sudo:session): session closed for user root
Nov 03 18:35:51 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-fc5988ab-15ec-45de-b088-482133b2ee5f tempest-VolumeImageDependencyTests-1339477212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cbfec43c-b871-47ea-8298-495914bf100c_yg7eursjdevstack@QuobyteHD" returned: 1 in 0.431s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:35:51 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-fc5988ab-15ec-45de-b088-482133b2ee5f tempest-VolumeImageDependencyTests-1339477212 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cbfec43c-b871-47ea-8298-495914bf100c_yg7eursjdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 03 18:35:51 devstack cinder-volume[86120]: DEBUG cinder.image.image_utils [None req-fc5988ab-15ec-45de-b088-482133b2ee5f tempest-VolumeImageDependencyTests-1339477212 None] cbfec43c-b871-47ea-8298-495914bf100c was raw, converting to qcow2 {{(pid=86120) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 03 18:35:51 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-fc5988ab-15ec-45de-b088-482133b2ee5f tempest-VolumeImageDependencyTests-1339477212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_cbfec43c-b871-47ea-8298-495914bf100c_yg7eursjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d328aa8d-5d63-478e-81aa-44e79398d9c6 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:35:51 devstack sudo[102320]: pam_unix(sudo:session): session closed for user root
Nov 03 18:35:51 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-5df03256-4f53-4ba3-b5ca-b594c1613637 tempest-GroupsV314Test-153471630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-79c03f7d-ff45-4893-83fd-98158317430e" returned: 0 in 0.362s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:35:51 devstack sudo[102327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_cbfec43c-b871-47ea-8298-495914bf100c_yg7eursjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d328aa8d-5d63-478e-81aa-44e79398d9c6
Nov 03 18:35:51 devstack sudo[102327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:35:51 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-5df03256-4f53-4ba3-b5ca-b594c1613637 tempest-GroupsV314Test-153471630 None] Lock "cinder-quobyte-79c03f7d-ff45-4893-83fd-98158317430e" released by "delete_volume" :: held 0.847s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:35:51 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-5df03256-4f53-4ba3-b5ca-b594c1613637 tempest-GroupsV314Test-153471630 None] Created reservations ['ba9ff321-f0d9-45b1-8e2a-fc1df49ee269'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:35:51 devstack cinder-volume[86120]: WARNING cinder.quota [None req-5df03256-4f53-4ba3-b5ca-b594c1613637 tempest-GroupsV314Test-153471630 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1210622206 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1210622206, it is now deprecated. Please use the default quota class for default quota.
Nov 03 18:35:51 devstack cinder-volume[86120]: WARNING cinder.quota [None req-5df03256-4f53-4ba3-b5ca-b594c1613637 tempest-GroupsV314Test-153471630 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1210622206 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1210622206, it is now deprecated. Please use the default quota class for default quota.
Nov 03 18:35:51 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-5df03256-4f53-4ba3-b5ca-b594c1613637 tempest-GroupsV314Test-153471630 None] Created reservations ['e81c7674-ba1d-4edb-89b7-d63884b4fcee', '13fc3332-a142-43c5-91f3-820955260526', 'df507e0b-d2f8-4377-acdb-2f205d6c8842', '2810d209-3450-4d5b-b993-026082b21433'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:35:51 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-5df03256-4f53-4ba3-b5ca-b594c1613637 tempest-GroupsV314Test-153471630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:35:51 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-5df03256-4f53-4ba3-b5ca-b594c1613637 tempest-GroupsV314Test-153471630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:35:51 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-5df03256-4f53-4ba3-b5ca-b594c1613637 tempest-GroupsV314Test-153471630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:35:51 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-5df03256-4f53-4ba3-b5ca-b594c1613637 tempest-GroupsV314Test-153471630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:35:51 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-5df03256-4f53-4ba3-b5ca-b594c1613637 tempest-GroupsV314Test-153471630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:35:51 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-5df03256-4f53-4ba3-b5ca-b594c1613637 tempest-GroupsV314Test-153471630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:35:51 devstack sudo[102332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:35:51 devstack sudo[102332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:35:51 devstack sudo[102327]: pam_unix(sudo:session): session closed for user root
Nov 03 18:35:51 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-fc5988ab-15ec-45de-b088-482133b2ee5f tempest-VolumeImageDependencyTests-1339477212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_cbfec43c-b871-47ea-8298-495914bf100c_yg7eursjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d328aa8d-5d63-478e-81aa-44e79398d9c6" returned: 0 in 0.588s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:35:51 devstack cinder-volume[86120]: DEBUG cinder.image.image_utils [None req-fc5988ab-15ec-45de-b088-482133b2ee5f tempest-VolumeImageDependencyTests-1339477212 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_cbfec43c-b871-47ea-8298-495914bf100c_yg7eursjdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d328aa8d-5d63-478e-81aa-44e79398d9c6 {{(pid=86120) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 03 18:35:51 devstack cinder-volume[86120]: INFO cinder.image.image_utils [None req-fc5988ab-15ec-45de-b088-482133b2ee5f tempest-VolumeImageDependencyTests-1339477212 None] Converted 0.00 MB image at 0.00 MB/s
Nov 03 18:35:51 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-fc5988ab-15ec-45de-b088-482133b2ee5f tempest-VolumeImageDependencyTests-1339477212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d328aa8d-5d63-478e-81aa-44e79398d9c6 1G {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:35:51 devstack sudo[102335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d328aa8d-5d63-478e-81aa-44e79398d9c6 1G
Nov 03 18:35:51 devstack sudo[102335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:35:51 devstack sudo[102332]: pam_unix(sudo:session): session closed for user root
Nov 03 18:35:51 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-5df03256-4f53-4ba3-b5ca-b594c1613637 tempest-GroupsV314Test-153471630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.305s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:35:51 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-5df03256-4f53-4ba3-b5ca-b594c1613637 tempest-GroupsV314Test-153471630 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:35:51 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-5df03256-4f53-4ba3-b5ca-b594c1613637 tempest-GroupsV314Test-153471630 None] Delete group completed successfully.
Nov 03 18:35:52 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-23709e81-34c4-495e-b313-b29703a90a95 tempest-GroupsV314Test-153471630 None] Acquiring lock "cinder-quobyte-f4797f92-75d2-43d0-b3e8-cb62ff151fef" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:35:52 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-23709e81-34c4-495e-b313-b29703a90a95 tempest-GroupsV314Test-153471630 None] Lock "cinder-quobyte-f4797f92-75d2-43d0-b3e8-cb62ff151fef" acquired by "delete_volume" :: waited 0.023s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:35:52 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[d235f300-6d73-4f9e-ad06-4d833b085963]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:35:52 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-23709e81-34c4-495e-b313-b29703a90a95 tempest-GroupsV314Test-153471630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f4797f92-75d2-43d0-b3e8-cb62ff151fef {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:35:52 devstack sudo[102337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f4797f92-75d2-43d0-b3e8-cb62ff151fef
Nov 03 18:35:52 devstack sudo[102337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:35:52 devstack sudo[102335]: pam_unix(sudo:session): session closed for user root
Nov 03 18:35:52 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-fc5988ab-15ec-45de-b088-482133b2ee5f tempest-VolumeImageDependencyTests-1339477212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d328aa8d-5d63-478e-81aa-44e79398d9c6 1G" returned: 0 in 0.460s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:35:52 devstack cinder-volume[86120]: DEBUG cinder.volume.volume_utils [None req-fc5988ab-15ec-45de-b088-482133b2ee5f tempest-VolumeImageDependencyTests-1339477212 None] Downloaded image cbfec43c-b871-47ea-8298-495914bf100c ((None, [{'url': 'file:///opt/stack/data/glance/images/cbfec43c-b871-47ea-8298-495914bf100c', 'metadata': {}}])) to volume d328aa8d-5d63-478e-81aa-44e79398d9c6 successfully. {{(pid=86120) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 03 18:35:52 devstack cinder-volume[86120]: DEBUG cinder.image.image_utils [None req-fc5988ab-15ec-45de-b088-482133b2ee5f tempest-VolumeImageDependencyTests-1339477212 None] Temporary image cbfec43c-b871-47ea-8298-495914bf100c for user 3375728efd24476d9ee89b38f3e8b8de is deleted. {{(pid=86120) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 03 18:35:52 devstack cinder-volume[86120]: DEBUG cinder.volume.volume_utils [None req-fc5988ab-15ec-45de-b088-482133b2ee5f tempest-VolumeImageDependencyTests-1339477212 None] Marking volume d328aa8d-5d63-478e-81aa-44e79398d9c6 as bootable. {{(pid=86120) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 03 18:35:52 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc5988ab-15ec-45de-b088-482133b2ee5f tempest-VolumeImageDependencyTests-1339477212 None] Copying metadata from image cbfec43c-b871-47ea-8298-495914bf100c to d328aa8d-5d63-478e-81aa-44e79398d9c6. {{(pid=86120) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 03 18:35:52 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc5988ab-15ec-45de-b088-482133b2ee5f tempest-VolumeImageDependencyTests-1339477212 None] Creating volume glance metadata for volume d328aa8d-5d63-478e-81aa-44e79398d9c6 backed by image cbfec43c-b871-47ea-8298-495914bf100c with: {'image_id': 'cbfec43c-b871-47ea-8298-495914bf100c', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'cfe2d4daa42c496a3922a6fa6e5a7757', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86120) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 03 18:35:52 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-fc5988ab-15ec-45de-b088-482133b2ee5f tempest-VolumeImageDependencyTests-1339477212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01591799-3f43-467b-8f63-16a1fce297b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d328aa8d-5d63-478e-81aa-44e79398d9c6', 'volume_size': 1, 'image_id': 'cbfec43c-b871-47ea-8298-495914bf100c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cbfec43c-b871-47ea-8298-495914bf100c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'cfe2d4daa42c496a3922a6fa6e5a7757', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'bf70f7eef7964d93b277e81bcdac276e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2bb13900f3b6e52fcc26ebdeaa0f1141cae5f5625981afa4096ba6dec48f7520819588f3f92091af97bfb2525985e5a2d2ca598279ef60d29f983164f3639985', 'id': 'cbfec43c-b871-47ea-8298-495914bf100c', 'created_at': datetime.datetime(2026, 11, 3, 17, 35, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 17, 35, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cbfec43c-b871-47ea-8298-495914bf100c/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7a8d3c3fbb00>}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:35:52 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-fc5988ab-15ec-45de-b088-482133b2ee5f tempest-VolumeImageDependencyTests-1339477212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87367e13-ab9b-4a47-88e8-4c33340316ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:35:52 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-fc5988ab-15ec-45de-b088-482133b2ee5f tempest-VolumeImageDependencyTests-1339477212 None] Volume volume-d328aa8d-5d63-478e-81aa-44e79398d9c6 (d328aa8d-5d63-478e-81aa-44e79398d9c6): created successfully
Nov 03 18:35:52 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-fc5988ab-15ec-45de-b088-482133b2ee5f tempest-VolumeImageDependencyTests-1339477212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87367e13-ab9b-4a47-88e8-4c33340316ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:35:52 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-fc5988ab-15ec-45de-b088-482133b2ee5f tempest-VolumeImageDependencyTests-1339477212 None] Flow 'volume_create_manager' (f493898b-a53d-40a5-95e0-98f802afb00e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:35:52 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-fc5988ab-15ec-45de-b088-482133b2ee5f tempest-VolumeImageDependencyTests-1339477212 None] Created volume successfully.
Nov 03 18:35:52 devstack sudo[102337]: pam_unix(sudo:session): session closed for user root
Nov 03 18:35:52 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-23709e81-34c4-495e-b313-b29703a90a95 tempest-GroupsV314Test-153471630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f4797f92-75d2-43d0-b3e8-cb62ff151fef" returned: 0 in 0.554s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:35:52 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-23709e81-34c4-495e-b313-b29703a90a95 tempest-GroupsV314Test-153471630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f4797f92-75d2-43d0-b3e8-cb62ff151fef {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:35:52 devstack sudo[102348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f4797f92-75d2-43d0-b3e8-cb62ff151fef
Nov 03 18:35:52 devstack sudo[102348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:35:52 devstack sudo[102348]: pam_unix(sudo:session): session closed for user root
Nov 03 18:35:52 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-23709e81-34c4-495e-b313-b29703a90a95 tempest-GroupsV314Test-153471630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f4797f92-75d2-43d0-b3e8-cb62ff151fef" returned: 0 in 0.273s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:35:52 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-23709e81-34c4-495e-b313-b29703a90a95 tempest-GroupsV314Test-153471630 None] Lock "cinder-quobyte-f4797f92-75d2-43d0-b3e8-cb62ff151fef" released by "delete_volume" :: held 0.912s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:35:53 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-23709e81-34c4-495e-b313-b29703a90a95 tempest-GroupsV314Test-153471630 None] Created reservations ['1dbf7d5f-55c2-4f38-a959-d5e6d41ce631'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:35:53 devstack cinder-volume[86120]: INFO cinder.volume.manager [req-f95a638a-02f7-4df2-9b6d-869a12576610 req-a2d0072e-9c5d-46c4-8a05-99abc92aa5a0 tempest-TestMinimumBasicScenario-16604406 None] Terminate volume connection completed successfully.
Nov 03 18:35:53 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [req-f95a638a-02f7-4df2-9b6d-869a12576610 req-a2d0072e-9c5d-46c4-8a05-99abc92aa5a0 tempest-TestMinimumBasicScenario-16604406 None] Deleting attachment 39582adf-9ac4-4f9f-bc63-068d22bb4fa5. {{(pid=86120) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 03 18:35:53 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-23709e81-34c4-495e-b313-b29703a90a95 tempest-GroupsV314Test-153471630 None] Created reservations ['156c15cc-a00d-46c1-88b5-033383246a5b', '85cf435a-b089-4121-8259-5fbc090c1b61', 'cb2e44db-b513-416e-a645-a97275a4e28a', '58823332-507f-429a-b779-635f8eb07ac5'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:35:53 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-23709e81-34c4-495e-b313-b29703a90a95 tempest-GroupsV314Test-153471630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:35:53 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-23709e81-34c4-495e-b313-b29703a90a95 tempest-GroupsV314Test-153471630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:35:53 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-23709e81-34c4-495e-b313-b29703a90a95 tempest-GroupsV314Test-153471630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:35:53 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-23709e81-34c4-495e-b313-b29703a90a95 tempest-GroupsV314Test-153471630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:35:53 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-23709e81-34c4-495e-b313-b29703a90a95 tempest-GroupsV314Test-153471630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:35:53 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-23709e81-34c4-495e-b313-b29703a90a95 tempest-GroupsV314Test-153471630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:35:53 devstack sudo[102354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:35:53 devstack sudo[102354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:35:53 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-5c9791dd-edc9-41d7-89e7-3188455afa14 tempest-VolumeImageDependencyTests-1339477212 None] Acquiring lock "cinder-d328aa8d-5d63-478e-81aa-44e79398d9c6-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:35:53 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-5c9791dd-edc9-41d7-89e7-3188455afa14 tempest-VolumeImageDependencyTests-1339477212 None] Lock "cinder-d328aa8d-5d63-478e-81aa-44e79398d9c6-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:35:53 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-5c9791dd-edc9-41d7-89e7-3188455afa14 tempest-VolumeImageDependencyTests-1339477212 None] Acquiring lock "cinder-quobyte-d328aa8d-5d63-478e-81aa-44e79398d9c6" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:35:53 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-5c9791dd-edc9-41d7-89e7-3188455afa14 tempest-VolumeImageDependencyTests-1339477212 None] Lock "cinder-quobyte-d328aa8d-5d63-478e-81aa-44e79398d9c6" acquired by "delete_volume" :: waited 0.019s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:35:53 devstack sudo[102354]: pam_unix(sudo:session): session closed for user root
Nov 03 18:35:53 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-23709e81-34c4-495e-b313-b29703a90a95 tempest-GroupsV314Test-153471630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.319s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:35:53 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-23709e81-34c4-495e-b313-b29703a90a95 tempest-GroupsV314Test-153471630 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:35:53 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-23709e81-34c4-495e-b313-b29703a90a95 tempest-GroupsV314Test-153471630 None] Delete group completed successfully.
Nov 03 18:35:53 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c9ec0bc-ccfe-411e-8a2f-b0aae63232f7]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:35:53 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-5c9791dd-edc9-41d7-89e7-3188455afa14 tempest-VolumeImageDependencyTests-1339477212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d328aa8d-5d63-478e-81aa-44e79398d9c6 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:35:53 devstack sudo[102357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d328aa8d-5d63-478e-81aa-44e79398d9c6
Nov 03 18:35:53 devstack sudo[102357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:35:53 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-cc81b21c-2917-48fa-ad56-51fe08cb89eb tempest-TestMinimumBasicScenario-16604406 None] Acquiring lock "cinder-ef0f5a5e-3d2f-4f78-97ec-8014cda60150-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:35:53 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-cc81b21c-2917-48fa-ad56-51fe08cb89eb tempest-TestMinimumBasicScenario-16604406 None] Lock "cinder-ef0f5a5e-3d2f-4f78-97ec-8014cda60150-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:35:54 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-cc81b21c-2917-48fa-ad56-51fe08cb89eb tempest-TestMinimumBasicScenario-16604406 None] Acquiring lock "cinder-quobyte-ef0f5a5e-3d2f-4f78-97ec-8014cda60150" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:35:54 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-cc81b21c-2917-48fa-ad56-51fe08cb89eb tempest-TestMinimumBasicScenario-16604406 None] Lock "cinder-quobyte-ef0f5a5e-3d2f-4f78-97ec-8014cda60150" acquired by "delete_volume" :: waited 0.024s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:35:54 devstack sudo[102357]: pam_unix(sudo:session): session closed for user root
Nov 03 18:35:54 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-5c9791dd-edc9-41d7-89e7-3188455afa14 tempest-VolumeImageDependencyTests-1339477212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d328aa8d-5d63-478e-81aa-44e79398d9c6" returned: 0 in 0.477s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:35:54 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-5c9791dd-edc9-41d7-89e7-3188455afa14 tempest-VolumeImageDependencyTests-1339477212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d328aa8d-5d63-478e-81aa-44e79398d9c6 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:35:54 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[f846dce5-c412-46bb-9b7d-301452f283af]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:35:54 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-cc81b21c-2917-48fa-ad56-51fe08cb89eb tempest-TestMinimumBasicScenario-16604406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ef0f5a5e-3d2f-4f78-97ec-8014cda60150 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:35:54 devstack sudo[102362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d328aa8d-5d63-478e-81aa-44e79398d9c6
Nov 03 18:35:54 devstack sudo[102362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:35:54 devstack sudo[102364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ef0f5a5e-3d2f-4f78-97ec-8014cda60150
Nov 03 18:35:54 devstack sudo[102364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:35:54 devstack sudo[102362]: pam_unix(sudo:session): session closed for user root
Nov 03 18:35:54 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-5c9791dd-edc9-41d7-89e7-3188455afa14 tempest-VolumeImageDependencyTests-1339477212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d328aa8d-5d63-478e-81aa-44e79398d9c6" returned: 0 in 0.276s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:35:54 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-5c9791dd-edc9-41d7-89e7-3188455afa14 tempest-VolumeImageDependencyTests-1339477212 None] Lock "cinder-quobyte-d328aa8d-5d63-478e-81aa-44e79398d9c6" released by "delete_volume" :: held 0.816s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:35:54 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-5c9791dd-edc9-41d7-89e7-3188455afa14 tempest-VolumeImageDependencyTests-1339477212 None] Created reservations ['353c7d80-c2b7-4ce3-8f69-c33251458f30', '5ab20735-13cd-4da2-b03e-ad2bca25725e', 'fca381c8-2c28-44f0-bc44-e31d9bbe7851', '08ac7ae0-3caf-4c6a-8d6d-7ed1e2f33d81'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:35:54 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-5c9791dd-edc9-41d7-89e7-3188455afa14 tempest-VolumeImageDependencyTests-1339477212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:35:54 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-5c9791dd-edc9-41d7-89e7-3188455afa14 tempest-VolumeImageDependencyTests-1339477212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:35:54 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-5c9791dd-edc9-41d7-89e7-3188455afa14 tempest-VolumeImageDependencyTests-1339477212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:35:54 devstack sudo[102364]: pam_unix(sudo:session): session closed for user root
Nov 03 18:35:54 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-5c9791dd-edc9-41d7-89e7-3188455afa14 tempest-VolumeImageDependencyTests-1339477212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:35:54 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-5c9791dd-edc9-41d7-89e7-3188455afa14 tempest-VolumeImageDependencyTests-1339477212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:35:54 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-5c9791dd-edc9-41d7-89e7-3188455afa14 tempest-VolumeImageDependencyTests-1339477212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:35:54 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-cc81b21c-2917-48fa-ad56-51fe08cb89eb tempest-TestMinimumBasicScenario-16604406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ef0f5a5e-3d2f-4f78-97ec-8014cda60150" returned: 0 in 0.427s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:35:54 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-cc81b21c-2917-48fa-ad56-51fe08cb89eb tempest-TestMinimumBasicScenario-16604406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ef0f5a5e-3d2f-4f78-97ec-8014cda60150 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:35:54 devstack sudo[102370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:35:54 devstack sudo[102370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:35:54 devstack sudo[102371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ef0f5a5e-3d2f-4f78-97ec-8014cda60150
Nov 03 18:35:54 devstack sudo[102371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:35:54 devstack sudo[102370]: pam_unix(sudo:session): session closed for user root
Nov 03 18:35:54 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-5c9791dd-edc9-41d7-89e7-3188455afa14 tempest-VolumeImageDependencyTests-1339477212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.358s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:35:54 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-5c9791dd-edc9-41d7-89e7-3188455afa14 tempest-VolumeImageDependencyTests-1339477212 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:35:54 devstack sudo[102371]: pam_unix(sudo:session): session closed for user root
Nov 03 18:35:54 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-5c9791dd-edc9-41d7-89e7-3188455afa14 tempest-VolumeImageDependencyTests-1339477212 None] Deleted volume successfully.
Nov 03 18:35:54 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-cc81b21c-2917-48fa-ad56-51fe08cb89eb tempest-TestMinimumBasicScenario-16604406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ef0f5a5e-3d2f-4f78-97ec-8014cda60150" returned: 0 in 0.369s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:35:54 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-cc81b21c-2917-48fa-ad56-51fe08cb89eb tempest-TestMinimumBasicScenario-16604406 None] Lock "cinder-quobyte-ef0f5a5e-3d2f-4f78-97ec-8014cda60150" released by "delete_volume" :: held 0.858s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:35:54 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-5c9791dd-edc9-41d7-89e7-3188455afa14 tempest-VolumeImageDependencyTests-1339477212 None] Lock "cinder-d328aa8d-5d63-478e-81aa-44e79398d9c6-delete_volume" released by "delete_volume" :: held 1.435s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:35:54 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-cc81b21c-2917-48fa-ad56-51fe08cb89eb tempest-TestMinimumBasicScenario-16604406 None] Created reservations ['cce77b68-310a-4f64-aa17-0e0e03c5317b', '4e905d08-8c36-43ae-bb4d-2a728a41a9dd', 'bd496562-cd74-4b07-8bb2-28d3dd4ad552', 'a2952237-1c64-4662-991d-5e46ce2c73d9'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:35:55 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-cc81b21c-2917-48fa-ad56-51fe08cb89eb tempest-TestMinimumBasicScenario-16604406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:35:55 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-cc81b21c-2917-48fa-ad56-51fe08cb89eb tempest-TestMinimumBasicScenario-16604406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:35:55 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-cc81b21c-2917-48fa-ad56-51fe08cb89eb tempest-TestMinimumBasicScenario-16604406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:35:55 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-cc81b21c-2917-48fa-ad56-51fe08cb89eb tempest-TestMinimumBasicScenario-16604406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:35:55 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-cc81b21c-2917-48fa-ad56-51fe08cb89eb tempest-TestMinimumBasicScenario-16604406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:35:55 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-cc81b21c-2917-48fa-ad56-51fe08cb89eb tempest-TestMinimumBasicScenario-16604406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:35:55 devstack sudo[102376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:35:55 devstack sudo[102376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:35:55 devstack sudo[102376]: pam_unix(sudo:session): session closed for user root
Nov 03 18:35:55 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-cc81b21c-2917-48fa-ad56-51fe08cb89eb tempest-TestMinimumBasicScenario-16604406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.309s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:35:55 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-cc81b21c-2917-48fa-ad56-51fe08cb89eb tempest-TestMinimumBasicScenario-16604406 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:35:55 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-cc81b21c-2917-48fa-ad56-51fe08cb89eb tempest-TestMinimumBasicScenario-16604406 None] Deleted volume successfully.
Nov 03 18:35:55 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-cc81b21c-2917-48fa-ad56-51fe08cb89eb tempest-TestMinimumBasicScenario-16604406 None] Lock "cinder-ef0f5a5e-3d2f-4f78-97ec-8014cda60150-delete_volume" released by "delete_volume" :: held 1.447s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:36:05 devstack cinder-volume[86120]: DEBUG dbcounter [-] [86120] Writing DB stats cinder:SELECT=36,cinder:UPDATE=50,cinder:INSERT=11,cinder:DELETE=2 {{(pid=86120) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 18:36:05 devstack cinder-volume[86120]: DEBUG dbcounter [-] [86120] Writing DB stats cinder:SELECT=45,cinder:INSERT=18,cinder:UPDATE=42,cinder:DELETE=1 {{(pid=86120) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 18:36:07 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff148131-3e66-4d2f-84e1-4ebb12ca4288 tempest-VolumeQuotasAdminTestJSON-1620015207 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:36:07 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-ff148131-3e66-4d2f-84e1-4ebb12ca4288 tempest-VolumeQuotasAdminTestJSON-1620015207 None] Flow 'volume_create_manager' (5248eea8-fa92-4551-a63f-c6f58bee2e95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:36:07 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-ff148131-3e66-4d2f-84e1-4ebb12ca4288 tempest-VolumeQuotasAdminTestJSON-1620015207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4823b080-9e2b-454f-9333-052680d6f607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:36:07 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-ff148131-3e66-4d2f-84e1-4ebb12ca4288 tempest-VolumeQuotasAdminTestJSON-1620015207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4823b080-9e2b-454f-9333-052680d6f607) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:36:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1432231666',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3da04ca2-755d-4c30-b93d-fb044f50fee2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d21787c4be2a43e7baeef9108e5a4d1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:36:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:36:07Z,use_quota=True,user_id='8947898699344bdda2d63d6a958baa5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:36:07 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-ff148131-3e66-4d2f-84e1-4ebb12ca4288 tempest-VolumeQuotasAdminTestJSON-1620015207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07e175b4-dc4c-4501-8be1-527b28831b65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:36:07 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-ff148131-3e66-4d2f-84e1-4ebb12ca4288 tempest-VolumeQuotasAdminTestJSON-1620015207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07e175b4-dc4c-4501-8be1-527b28831b65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:36:07 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-ff148131-3e66-4d2f-84e1-4ebb12ca4288 tempest-VolumeQuotasAdminTestJSON-1620015207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0dca9f09-415e-45c0-a435-8ae2a8e9c3f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:36:07 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-ff148131-3e66-4d2f-84e1-4ebb12ca4288 tempest-VolumeQuotasAdminTestJSON-1620015207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0dca9f09-415e-45c0-a435-8ae2a8e9c3f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3da04ca2-755d-4c30-b93d-fb044f50fee2', 'volume_name': 'volume-3da04ca2-755d-4c30-b93d-fb044f50fee2', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:36:07 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-ff148131-3e66-4d2f-84e1-4ebb12ca4288 tempest-VolumeQuotasAdminTestJSON-1620015207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c4ffa69-3da4-4cf6-bae8-8dc71615147e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:36:07 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-ff148131-3e66-4d2f-84e1-4ebb12ca4288 tempest-VolumeQuotasAdminTestJSON-1620015207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c4ffa69-3da4-4cf6-bae8-8dc71615147e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:36:07 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-ff148131-3e66-4d2f-84e1-4ebb12ca4288 tempest-VolumeQuotasAdminTestJSON-1620015207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a38d3e2-6809-4f1f-8620-6da2a0c50d6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:36:07 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-ff148131-3e66-4d2f-84e1-4ebb12ca4288 tempest-VolumeQuotasAdminTestJSON-1620015207 None] Volume 3da04ca2-755d-4c30-b93d-fb044f50fee2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3da04ca2-755d-4c30-b93d-fb044f50fee2', 'volume_size': 1}
Nov 03 18:36:07 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-ff148131-3e66-4d2f-84e1-4ebb12ca4288 tempest-VolumeQuotasAdminTestJSON-1620015207 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:36:07 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-ff148131-3e66-4d2f-84e1-4ebb12ca4288 tempest-VolumeQuotasAdminTestJSON-1620015207 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:36:07 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-ff148131-3e66-4d2f-84e1-4ebb12ca4288 tempest-VolumeQuotasAdminTestJSON-1620015207 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:36:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1432231666',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3da04ca2-755d-4c30-b93d-fb044f50fee2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d21787c4be2a43e7baeef9108e5a4d1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:36:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:36:07Z,use_quota=True,user_id='8947898699344bdda2d63d6a958baa5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:36:07 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-ff148131-3e66-4d2f-84e1-4ebb12ca4288 tempest-VolumeQuotasAdminTestJSON-1620015207 None] Creating volume 3da04ca2-755d-4c30-b93d-fb044f50fee2 {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:36:07 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-ff148131-3e66-4d2f-84e1-4ebb12ca4288 tempest-VolumeQuotasAdminTestJSON-1620015207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:36:07 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-ff148131-3e66-4d2f-84e1-4ebb12ca4288 tempest-VolumeQuotasAdminTestJSON-1620015207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:36:07 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-ff148131-3e66-4d2f-84e1-4ebb12ca4288 tempest-VolumeQuotasAdminTestJSON-1620015207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:36:07 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-ff148131-3e66-4d2f-84e1-4ebb12ca4288 tempest-VolumeQuotasAdminTestJSON-1620015207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:36:07 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-ff148131-3e66-4d2f-84e1-4ebb12ca4288 tempest-VolumeQuotasAdminTestJSON-1620015207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:36:07 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-ff148131-3e66-4d2f-84e1-4ebb12ca4288 tempest-VolumeQuotasAdminTestJSON-1620015207 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:36:07 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-ff148131-3e66-4d2f-84e1-4ebb12ca4288 tempest-VolumeQuotasAdminTestJSON-1620015207 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:36:07 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-ff148131-3e66-4d2f-84e1-4ebb12ca4288 tempest-VolumeQuotasAdminTestJSON-1620015207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3da04ca2-755d-4c30-b93d-fb044f50fee2 1073741824 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:36:07 devstack sudo[102407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3da04ca2-755d-4c30-b93d-fb044f50fee2 1073741824
Nov 03 18:36:07 devstack sudo[102407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:36:07 devstack sudo[102407]: pam_unix(sudo:session): session closed for user root
Nov 03 18:36:07 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-ff148131-3e66-4d2f-84e1-4ebb12ca4288 tempest-VolumeQuotasAdminTestJSON-1620015207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3da04ca2-755d-4c30-b93d-fb044f50fee2 1073741824" returned: 0 in 0.449s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:36:07 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-ff148131-3e66-4d2f-84e1-4ebb12ca4288 tempest-VolumeQuotasAdminTestJSON-1620015207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3da04ca2-755d-4c30-b93d-fb044f50fee2 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:36:07 devstack sudo[102413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3da04ca2-755d-4c30-b93d-fb044f50fee2
Nov 03 18:36:07 devstack sudo[102413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:36:08 devstack sudo[102413]: pam_unix(sudo:session): session closed for user root
Nov 03 18:36:08 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-ff148131-3e66-4d2f-84e1-4ebb12ca4288 tempest-VolumeQuotasAdminTestJSON-1620015207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3da04ca2-755d-4c30-b93d-fb044f50fee2" returned: 0 in 0.251s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:36:08 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-ff148131-3e66-4d2f-84e1-4ebb12ca4288 tempest-VolumeQuotasAdminTestJSON-1620015207 None] <== create_volume: return (743ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:36:08 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-ff148131-3e66-4d2f-84e1-4ebb12ca4288 tempest-VolumeQuotasAdminTestJSON-1620015207 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.746s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:36:08 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-ff148131-3e66-4d2f-84e1-4ebb12ca4288 tempest-VolumeQuotasAdminTestJSON-1620015207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a38d3e2-6809-4f1f-8620-6da2a0c50d6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3da04ca2-755d-4c30-b93d-fb044f50fee2', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:36:08 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-ff148131-3e66-4d2f-84e1-4ebb12ca4288 tempest-VolumeQuotasAdminTestJSON-1620015207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5438c227-5e6f-41ba-afc4-baa3320c5204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:36:08 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-ff148131-3e66-4d2f-84e1-4ebb12ca4288 tempest-VolumeQuotasAdminTestJSON-1620015207 None] Volume volume-3da04ca2-755d-4c30-b93d-fb044f50fee2 (3da04ca2-755d-4c30-b93d-fb044f50fee2): created successfully
Nov 03 18:36:08 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-ff148131-3e66-4d2f-84e1-4ebb12ca4288 tempest-VolumeQuotasAdminTestJSON-1620015207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5438c227-5e6f-41ba-afc4-baa3320c5204) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:36:08 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-ff148131-3e66-4d2f-84e1-4ebb12ca4288 tempest-VolumeQuotasAdminTestJSON-1620015207 None] Flow 'volume_create_manager' (5248eea8-fa92-4551-a63f-c6f58bee2e95) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:36:08 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-ff148131-3e66-4d2f-84e1-4ebb12ca4288 tempest-VolumeQuotasAdminTestJSON-1620015207 None] Created volume successfully.
Nov 03 18:36:08 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-4944bb64-5f05-4040-9a1e-4d78472c0527 tempest-VolumeQuotasAdminTestJSON-1620015207 None] Acquiring lock "cinder-3da04ca2-755d-4c30-b93d-fb044f50fee2-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:36:08 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-4944bb64-5f05-4040-9a1e-4d78472c0527 tempest-VolumeQuotasAdminTestJSON-1620015207 None] Lock "cinder-3da04ca2-755d-4c30-b93d-fb044f50fee2-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:36:08 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-4944bb64-5f05-4040-9a1e-4d78472c0527 tempest-VolumeQuotasAdminTestJSON-1620015207 None] Acquiring lock "cinder-quobyte-3da04ca2-755d-4c30-b93d-fb044f50fee2" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:36:08 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-4944bb64-5f05-4040-9a1e-4d78472c0527 tempest-VolumeQuotasAdminTestJSON-1620015207 None] Lock "cinder-quobyte-3da04ca2-755d-4c30-b93d-fb044f50fee2" acquired by "delete_volume" :: waited 0.019s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:36:08 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[c886b63f-1833-462d-a80d-cd0633bcf4ac]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:36:08 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-4944bb64-5f05-4040-9a1e-4d78472c0527 tempest-VolumeQuotasAdminTestJSON-1620015207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3da04ca2-755d-4c30-b93d-fb044f50fee2 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:36:08 devstack sudo[102417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3da04ca2-755d-4c30-b93d-fb044f50fee2
Nov 03 18:36:08 devstack sudo[102417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:36:08 devstack sudo[102417]: pam_unix(sudo:session): session closed for user root
Nov 03 18:36:08 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-4944bb64-5f05-4040-9a1e-4d78472c0527 tempest-VolumeQuotasAdminTestJSON-1620015207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3da04ca2-755d-4c30-b93d-fb044f50fee2" returned: 0 in 0.378s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:36:08 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-4944bb64-5f05-4040-9a1e-4d78472c0527 tempest-VolumeQuotasAdminTestJSON-1620015207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3da04ca2-755d-4c30-b93d-fb044f50fee2 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:36:08 devstack sudo[102423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3da04ca2-755d-4c30-b93d-fb044f50fee2
Nov 03 18:36:08 devstack sudo[102423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:36:09 devstack sudo[102423]: pam_unix(sudo:session): session closed for user root
Nov 03 18:36:09 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-4944bb64-5f05-4040-9a1e-4d78472c0527 tempest-VolumeQuotasAdminTestJSON-1620015207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3da04ca2-755d-4c30-b93d-fb044f50fee2" returned: 0 in 0.278s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:36:09 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-4944bb64-5f05-4040-9a1e-4d78472c0527 tempest-VolumeQuotasAdminTestJSON-1620015207 None] Lock "cinder-quobyte-3da04ca2-755d-4c30-b93d-fb044f50fee2" released by "delete_volume" :: held 0.700s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:36:09 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-4944bb64-5f05-4040-9a1e-4d78472c0527 tempest-VolumeQuotasAdminTestJSON-1620015207 None] Created reservations ['f1bf3a54-7849-4601-94a5-ff25454557cb', 'b865314e-11ae-42fd-afb3-29660e511079', '71088dcc-0349-47bd-986c-da33ff9d669c', '1929640f-ed1f-4763-ad43-77c370714a05'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:36:09 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-4944bb64-5f05-4040-9a1e-4d78472c0527 tempest-VolumeQuotasAdminTestJSON-1620015207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:36:09 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-4944bb64-5f05-4040-9a1e-4d78472c0527 tempest-VolumeQuotasAdminTestJSON-1620015207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:36:09 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-4944bb64-5f05-4040-9a1e-4d78472c0527 tempest-VolumeQuotasAdminTestJSON-1620015207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:36:09 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-4944bb64-5f05-4040-9a1e-4d78472c0527 tempest-VolumeQuotasAdminTestJSON-1620015207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:36:09 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-4944bb64-5f05-4040-9a1e-4d78472c0527 tempest-VolumeQuotasAdminTestJSON-1620015207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:36:09 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-4944bb64-5f05-4040-9a1e-4d78472c0527 tempest-VolumeQuotasAdminTestJSON-1620015207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:36:09 devstack sudo[102427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:36:09 devstack sudo[102427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:36:09 devstack sudo[102427]: pam_unix(sudo:session): session closed for user root
Nov 03 18:36:09 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-4944bb64-5f05-4040-9a1e-4d78472c0527 tempest-VolumeQuotasAdminTestJSON-1620015207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.280s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:36:09 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-4944bb64-5f05-4040-9a1e-4d78472c0527 tempest-VolumeQuotasAdminTestJSON-1620015207 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:36:09 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-4944bb64-5f05-4040-9a1e-4d78472c0527 tempest-VolumeQuotasAdminTestJSON-1620015207 None] Deleted volume successfully.
Nov 03 18:36:09 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-4944bb64-5f05-4040-9a1e-4d78472c0527 tempest-VolumeQuotasAdminTestJSON-1620015207 None] Lock "cinder-3da04ca2-755d-4c30-b93d-fb044f50fee2-delete_volume" released by "delete_volume" :: held 1.234s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:36:10 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-46074a5b-b68c-4fb7-ae05-c05f3dd7c811 tempest-VolumeQuotasAdminTestJSON-1620015207 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:36:10 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-46074a5b-b68c-4fb7-ae05-c05f3dd7c811 tempest-VolumeQuotasAdminTestJSON-1620015207 None] Flow 'volume_create_manager' (41449f53-31ba-496d-bbad-08578d98f8d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:36:10 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-46074a5b-b68c-4fb7-ae05-c05f3dd7c811 tempest-VolumeQuotasAdminTestJSON-1620015207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f683cc66-9eab-4e2f-8be7-9da1e493dba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:36:10 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-46074a5b-b68c-4fb7-ae05-c05f3dd7c811 tempest-VolumeQuotasAdminTestJSON-1620015207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f683cc66-9eab-4e2f-8be7-9da1e493dba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:36:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-176466613',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d94f005d-0f92-4725-80c6-63b381b9df11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d21787c4be2a43e7baeef9108e5a4d1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:36:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:36:10Z,use_quota=True,user_id='8947898699344bdda2d63d6a958baa5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:36:10 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-46074a5b-b68c-4fb7-ae05-c05f3dd7c811 tempest-VolumeQuotasAdminTestJSON-1620015207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0dc2af4d-9e54-4a3a-99bb-5b36e954e208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:36:10 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-46074a5b-b68c-4fb7-ae05-c05f3dd7c811 tempest-VolumeQuotasAdminTestJSON-1620015207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0dc2af4d-9e54-4a3a-99bb-5b36e954e208) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:36:10 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-46074a5b-b68c-4fb7-ae05-c05f3dd7c811 tempest-VolumeQuotasAdminTestJSON-1620015207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a5a4905-aa7d-4411-bdbf-5c11e5867489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:36:10 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-46074a5b-b68c-4fb7-ae05-c05f3dd7c811 tempest-VolumeQuotasAdminTestJSON-1620015207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a5a4905-aa7d-4411-bdbf-5c11e5867489) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd94f005d-0f92-4725-80c6-63b381b9df11', 'volume_name': 'volume-d94f005d-0f92-4725-80c6-63b381b9df11', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:36:10 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-46074a5b-b68c-4fb7-ae05-c05f3dd7c811 tempest-VolumeQuotasAdminTestJSON-1620015207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c39260ed-5243-4a4d-a713-2eb97e7ac339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:36:10 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-46074a5b-b68c-4fb7-ae05-c05f3dd7c811 tempest-VolumeQuotasAdminTestJSON-1620015207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c39260ed-5243-4a4d-a713-2eb97e7ac339) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:36:10 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-46074a5b-b68c-4fb7-ae05-c05f3dd7c811 tempest-VolumeQuotasAdminTestJSON-1620015207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c13aa0a-0d74-4582-beb3-c217f1ab1bd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:36:10 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-46074a5b-b68c-4fb7-ae05-c05f3dd7c811 tempest-VolumeQuotasAdminTestJSON-1620015207 None] Volume d94f005d-0f92-4725-80c6-63b381b9df11: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d94f005d-0f92-4725-80c6-63b381b9df11', 'volume_size': 1}
Nov 03 18:36:10 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-46074a5b-b68c-4fb7-ae05-c05f3dd7c811 tempest-VolumeQuotasAdminTestJSON-1620015207 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:36:10 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-46074a5b-b68c-4fb7-ae05-c05f3dd7c811 tempest-VolumeQuotasAdminTestJSON-1620015207 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:36:10 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-46074a5b-b68c-4fb7-ae05-c05f3dd7c811 tempest-VolumeQuotasAdminTestJSON-1620015207 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:36:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-176466613',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d94f005d-0f92-4725-80c6-63b381b9df11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d21787c4be2a43e7baeef9108e5a4d1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:36:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:36:10Z,use_quota=True,user_id='8947898699344bdda2d63d6a958baa5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:36:10 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-46074a5b-b68c-4fb7-ae05-c05f3dd7c811 tempest-VolumeQuotasAdminTestJSON-1620015207 None] Creating volume d94f005d-0f92-4725-80c6-63b381b9df11 {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:36:10 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-46074a5b-b68c-4fb7-ae05-c05f3dd7c811 tempest-VolumeQuotasAdminTestJSON-1620015207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:36:10 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-46074a5b-b68c-4fb7-ae05-c05f3dd7c811 tempest-VolumeQuotasAdminTestJSON-1620015207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:36:10 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-46074a5b-b68c-4fb7-ae05-c05f3dd7c811 tempest-VolumeQuotasAdminTestJSON-1620015207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:36:10 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-46074a5b-b68c-4fb7-ae05-c05f3dd7c811 tempest-VolumeQuotasAdminTestJSON-1620015207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:36:10 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-46074a5b-b68c-4fb7-ae05-c05f3dd7c811 tempest-VolumeQuotasAdminTestJSON-1620015207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:36:10 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-46074a5b-b68c-4fb7-ae05-c05f3dd7c811 tempest-VolumeQuotasAdminTestJSON-1620015207 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:36:10 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-46074a5b-b68c-4fb7-ae05-c05f3dd7c811 tempest-VolumeQuotasAdminTestJSON-1620015207 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:36:10 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-46074a5b-b68c-4fb7-ae05-c05f3dd7c811 tempest-VolumeQuotasAdminTestJSON-1620015207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d94f005d-0f92-4725-80c6-63b381b9df11 1073741824 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:36:10 devstack sudo[102432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d94f005d-0f92-4725-80c6-63b381b9df11 1073741824
Nov 03 18:36:10 devstack sudo[102432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:36:10 devstack sudo[102432]: pam_unix(sudo:session): session closed for user root
Nov 03 18:36:10 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-46074a5b-b68c-4fb7-ae05-c05f3dd7c811 tempest-VolumeQuotasAdminTestJSON-1620015207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d94f005d-0f92-4725-80c6-63b381b9df11 1073741824" returned: 0 in 0.450s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:36:10 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-46074a5b-b68c-4fb7-ae05-c05f3dd7c811 tempest-VolumeQuotasAdminTestJSON-1620015207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d94f005d-0f92-4725-80c6-63b381b9df11 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:36:10 devstack sudo[102438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d94f005d-0f92-4725-80c6-63b381b9df11
Nov 03 18:36:10 devstack sudo[102438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:36:10 devstack sudo[102438]: pam_unix(sudo:session): session closed for user root
Nov 03 18:36:10 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-46074a5b-b68c-4fb7-ae05-c05f3dd7c811 tempest-VolumeQuotasAdminTestJSON-1620015207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d94f005d-0f92-4725-80c6-63b381b9df11" returned: 0 in 0.246s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:36:10 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-46074a5b-b68c-4fb7-ae05-c05f3dd7c811 tempest-VolumeQuotasAdminTestJSON-1620015207 None] <== create_volume: return (756ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:36:10 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-46074a5b-b68c-4fb7-ae05-c05f3dd7c811 tempest-VolumeQuotasAdminTestJSON-1620015207 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.758s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:36:10 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-46074a5b-b68c-4fb7-ae05-c05f3dd7c811 tempest-VolumeQuotasAdminTestJSON-1620015207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c13aa0a-0d74-4582-beb3-c217f1ab1bd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d94f005d-0f92-4725-80c6-63b381b9df11', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:36:10 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-46074a5b-b68c-4fb7-ae05-c05f3dd7c811 tempest-VolumeQuotasAdminTestJSON-1620015207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4747920f-6bbf-432e-9869-65b5a3bf9868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:36:10 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-46074a5b-b68c-4fb7-ae05-c05f3dd7c811 tempest-VolumeQuotasAdminTestJSON-1620015207 None] Volume volume-d94f005d-0f92-4725-80c6-63b381b9df11 (d94f005d-0f92-4725-80c6-63b381b9df11): created successfully
Nov 03 18:36:11 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-46074a5b-b68c-4fb7-ae05-c05f3dd7c811 tempest-VolumeQuotasAdminTestJSON-1620015207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4747920f-6bbf-432e-9869-65b5a3bf9868) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:36:11 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-46074a5b-b68c-4fb7-ae05-c05f3dd7c811 tempest-VolumeQuotasAdminTestJSON-1620015207 None] Flow 'volume_create_manager' (41449f53-31ba-496d-bbad-08578d98f8d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:36:11 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-46074a5b-b68c-4fb7-ae05-c05f3dd7c811 tempest-VolumeQuotasAdminTestJSON-1620015207 None] Created volume successfully.
Nov 03 18:36:11 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-a3b7eb18-5288-4f1e-af00-072f5b9b1c1e tempest-VolumeQuotasAdminTestJSON-1859278045 None] Transfer volume completed successfully.
Nov 03 18:36:12 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-cb5389a0-ada9-4665-be6a-5b4c4e574cdc tempest-VolumeQuotasAdminTestJSON-1290258719 None] Acquiring lock "cinder-d94f005d-0f92-4725-80c6-63b381b9df11-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:36:12 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-cb5389a0-ada9-4665-be6a-5b4c4e574cdc tempest-VolumeQuotasAdminTestJSON-1290258719 None] Lock "cinder-d94f005d-0f92-4725-80c6-63b381b9df11-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:36:12 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-cb5389a0-ada9-4665-be6a-5b4c4e574cdc tempest-VolumeQuotasAdminTestJSON-1290258719 None] Acquiring lock "cinder-quobyte-d94f005d-0f92-4725-80c6-63b381b9df11" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:36:12 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-cb5389a0-ada9-4665-be6a-5b4c4e574cdc tempest-VolumeQuotasAdminTestJSON-1290258719 None] Lock "cinder-quobyte-d94f005d-0f92-4725-80c6-63b381b9df11" acquired by "delete_volume" :: waited 0.015s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:36:12 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4f78bfe-12eb-443d-b8d1-683b7915168b]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:36:12 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-cb5389a0-ada9-4665-be6a-5b4c4e574cdc tempest-VolumeQuotasAdminTestJSON-1290258719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d94f005d-0f92-4725-80c6-63b381b9df11 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:36:12 devstack sudo[102441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d94f005d-0f92-4725-80c6-63b381b9df11
Nov 03 18:36:12 devstack sudo[102441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:36:12 devstack sudo[102441]: pam_unix(sudo:session): session closed for user root
Nov 03 18:36:12 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-cb5389a0-ada9-4665-be6a-5b4c4e574cdc tempest-VolumeQuotasAdminTestJSON-1290258719 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d94f005d-0f92-4725-80c6-63b381b9df11" returned: 0 in 0.382s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:36:12 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-cb5389a0-ada9-4665-be6a-5b4c4e574cdc tempest-VolumeQuotasAdminTestJSON-1290258719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d94f005d-0f92-4725-80c6-63b381b9df11 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:36:12 devstack sudo[102446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d94f005d-0f92-4725-80c6-63b381b9df11
Nov 03 18:36:12 devstack sudo[102446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:36:13 devstack sudo[102446]: pam_unix(sudo:session): session closed for user root
Nov 03 18:36:13 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-cb5389a0-ada9-4665-be6a-5b4c4e574cdc tempest-VolumeQuotasAdminTestJSON-1290258719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d94f005d-0f92-4725-80c6-63b381b9df11" returned: 0 in 0.245s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:36:13 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-cb5389a0-ada9-4665-be6a-5b4c4e574cdc tempest-VolumeQuotasAdminTestJSON-1290258719 None] Lock "cinder-quobyte-d94f005d-0f92-4725-80c6-63b381b9df11" released by "delete_volume" :: held 0.675s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:36:13 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-cb5389a0-ada9-4665-be6a-5b4c4e574cdc tempest-VolumeQuotasAdminTestJSON-1290258719 None] Created reservations ['9dfc4429-dbdd-47b5-bac3-87b1160f6fb9', '1a30331a-ffa4-4b69-94c2-6b48a8ad10da', '4f6db015-8413-4d34-a133-8bc0dbdbed6a', '9a4c336a-5f2a-4034-a424-801bac681113'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:36:13 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-cb5389a0-ada9-4665-be6a-5b4c4e574cdc tempest-VolumeQuotasAdminTestJSON-1290258719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:36:13 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-cb5389a0-ada9-4665-be6a-5b4c4e574cdc tempest-VolumeQuotasAdminTestJSON-1290258719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:36:13 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-cb5389a0-ada9-4665-be6a-5b4c4e574cdc tempest-VolumeQuotasAdminTestJSON-1290258719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:36:13 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-cb5389a0-ada9-4665-be6a-5b4c4e574cdc tempest-VolumeQuotasAdminTestJSON-1290258719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:36:13 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-cb5389a0-ada9-4665-be6a-5b4c4e574cdc tempest-VolumeQuotasAdminTestJSON-1290258719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:36:13 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-cb5389a0-ada9-4665-be6a-5b4c4e574cdc tempest-VolumeQuotasAdminTestJSON-1290258719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:36:13 devstack sudo[102449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:36:13 devstack sudo[102449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:36:13 devstack sudo[102449]: pam_unix(sudo:session): session closed for user root
Nov 03 18:36:13 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-cb5389a0-ada9-4665-be6a-5b4c4e574cdc tempest-VolumeQuotasAdminTestJSON-1290258719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.245s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:36:13 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-cb5389a0-ada9-4665-be6a-5b4c4e574cdc tempest-VolumeQuotasAdminTestJSON-1290258719 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:36:13 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-cb5389a0-ada9-4665-be6a-5b4c4e574cdc tempest-VolumeQuotasAdminTestJSON-1290258719 None] Deleted volume successfully.
Nov 03 18:36:13 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-cb5389a0-ada9-4665-be6a-5b4c4e574cdc tempest-VolumeQuotasAdminTestJSON-1290258719 None] Lock "cinder-d94f005d-0f92-4725-80c6-63b381b9df11-delete_volume" released by "delete_volume" :: held 1.152s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:36:14 devstack cinder-volume[86120]: DEBUG oslo_service.periodic_task [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86120) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 18:36:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:36:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:36:14 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:36:14 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:36:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:36:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:36:14 devstack sudo[102458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:36:14 devstack sudo[102458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:36:15 devstack sudo[102458]: pam_unix(sudo:session): session closed for user root
Nov 03 18:36:15 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.266s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:36:15 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:36:15 devstack cinder-volume[86120]: DEBUG oslo_service.periodic_task [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Running periodic task VolumeManager._thread_info {{(pid=86120) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 18:36:15 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] thread count: 28 {{(pid=86120) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 03 18:36:15 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] thread info: [<_MainThread(MainThread, started 134747145822336)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134747033686336)>, <Thread(Thread-3 (stat_writer), started daemon 134747030828736)>, <Thread(Rabbit-heartbeat, started daemon 134747035433408)>, <Thread(Thread-5 (_runner), started daemon 134747029587392)>, <Thread(Thread-7 (_runner), started daemon 134747029784256)>, <Thread(fd_logger, started daemon 134747027909120)>, <Thread(privsep_reader, started daemon 134747027006592)>, <Thread(tpool_thread_0, started daemon 134747018950336)>, <Thread(tpool_thread_1, started daemon 134747010541248)>, <Thread(tpool_thread_2, started daemon 134747002132160)>, <Thread(tpool_thread_3, started daemon 134746993723072)>, <Thread(tpool_thread_4, started daemon 134746985313984)>, <Thread(tpool_thread_5, started daemon 134746976904896)>, <Thread(tpool_thread_6, started daemon 134746968495808)>, <Thread(tpool_thread_7, started daemon 134746960086720)>, <Thread(tpool_thread_8, started daemon 134746951677632)>, <Thread(tpool_thread_9, started daemon 134746943268544)>, <Thread(tpool_thread_10, started daemon 134746934859456)>, <Thread(tpool_thread_11, started daemon 134746926450368)>, <Thread(tpool_thread_12, started daemon 134746918041280)>, <Thread(tpool_thread_13, started daemon 134746909632192)>, <Thread(tpool_thread_14, started daemon 134746901223104)>, <Thread(tpool_thread_15, started daemon 134746892814016)>, <Thread(tpool_thread_16, started daemon 134746884404928)>, <Thread(tpool_thread_17, started daemon 134746875995840)>, <Thread(tpool_thread_18, started daemon 134746867586752)>, <Thread(tpool_thread_19, started daemon 134746859177664)>] {{(pid=86120) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 03 18:36:21 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-67763a9a-b648-47f2-be55-48a981cb2db7 tempest-VolumeRetypeWithoutMigrationTest-1784221946 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:36:21 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-67763a9a-b648-47f2-be55-48a981cb2db7 tempest-VolumeRetypeWithoutMigrationTest-1784221946 None] Flow 'volume_create_manager' (5a4f839e-af08-4ae0-8e8c-c569c3aa2188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:36:21 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-67763a9a-b648-47f2-be55-48a981cb2db7 tempest-VolumeRetypeWithoutMigrationTest-1784221946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97232c90-ce78-476f-95c5-a08415a2ff49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:36:21 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-67763a9a-b648-47f2-be55-48a981cb2db7 tempest-VolumeRetypeWithoutMigrationTest-1784221946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97232c90-ce78-476f-95c5-a08415a2ff49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:36:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1216572012',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34b66a8b-3bcd-4f3a-92d9-d16462f85f68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63d3394ab9384bd8800cb93178ff3726',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:36:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:36:21Z,use_quota=True,user_id='3340f991ffbc42f58c38d789f200cb9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(80cb93b4-143f-4c2e-bae2-d97968785280),volume_type_id=80cb93b4-143f-4c2e-bae2-d97968785280)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:36:21 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-67763a9a-b648-47f2-be55-48a981cb2db7 tempest-VolumeRetypeWithoutMigrationTest-1784221946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ccf1bc2-dc93-4462-8ffb-1066ced44371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:36:21 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-67763a9a-b648-47f2-be55-48a981cb2db7 tempest-VolumeRetypeWithoutMigrationTest-1784221946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ccf1bc2-dc93-4462-8ffb-1066ced44371) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:36:21 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-67763a9a-b648-47f2-be55-48a981cb2db7 tempest-VolumeRetypeWithoutMigrationTest-1784221946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5006146-89a5-450d-b242-962585febd51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:36:21 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-67763a9a-b648-47f2-be55-48a981cb2db7 tempest-VolumeRetypeWithoutMigrationTest-1784221946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5006146-89a5-450d-b242-962585febd51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34b66a8b-3bcd-4f3a-92d9-d16462f85f68', 'volume_name': 'volume-34b66a8b-3bcd-4f3a-92d9-d16462f85f68', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:36:21 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-67763a9a-b648-47f2-be55-48a981cb2db7 tempest-VolumeRetypeWithoutMigrationTest-1784221946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (355f36ce-25bf-4a70-a265-83e6883fac7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:36:21 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-67763a9a-b648-47f2-be55-48a981cb2db7 tempest-VolumeRetypeWithoutMigrationTest-1784221946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (355f36ce-25bf-4a70-a265-83e6883fac7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:36:21 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-67763a9a-b648-47f2-be55-48a981cb2db7 tempest-VolumeRetypeWithoutMigrationTest-1784221946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b76ecf4-7fab-4bee-918d-ad3a6075b2da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:36:21 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-67763a9a-b648-47f2-be55-48a981cb2db7 tempest-VolumeRetypeWithoutMigrationTest-1784221946 None] Volume 34b66a8b-3bcd-4f3a-92d9-d16462f85f68: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34b66a8b-3bcd-4f3a-92d9-d16462f85f68', 'volume_size': 1}
Nov 03 18:36:21 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-67763a9a-b648-47f2-be55-48a981cb2db7 tempest-VolumeRetypeWithoutMigrationTest-1784221946 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:36:21 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-67763a9a-b648-47f2-be55-48a981cb2db7 tempest-VolumeRetypeWithoutMigrationTest-1784221946 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:36:21 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-67763a9a-b648-47f2-be55-48a981cb2db7 tempest-VolumeRetypeWithoutMigrationTest-1784221946 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:36:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1216572012',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34b66a8b-3bcd-4f3a-92d9-d16462f85f68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63d3394ab9384bd8800cb93178ff3726',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:36:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:36:21Z,use_quota=True,user_id='3340f991ffbc42f58c38d789f200cb9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(80cb93b4-143f-4c2e-bae2-d97968785280),volume_type_id=80cb93b4-143f-4c2e-bae2-d97968785280)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:36:21 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-67763a9a-b648-47f2-be55-48a981cb2db7 tempest-VolumeRetypeWithoutMigrationTest-1784221946 None] Creating volume 34b66a8b-3bcd-4f3a-92d9-d16462f85f68 {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:36:21 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-67763a9a-b648-47f2-be55-48a981cb2db7 tempest-VolumeRetypeWithoutMigrationTest-1784221946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:36:21 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-67763a9a-b648-47f2-be55-48a981cb2db7 tempest-VolumeRetypeWithoutMigrationTest-1784221946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:36:21 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-67763a9a-b648-47f2-be55-48a981cb2db7 tempest-VolumeRetypeWithoutMigrationTest-1784221946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:36:21 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-67763a9a-b648-47f2-be55-48a981cb2db7 tempest-VolumeRetypeWithoutMigrationTest-1784221946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:36:21 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-67763a9a-b648-47f2-be55-48a981cb2db7 tempest-VolumeRetypeWithoutMigrationTest-1784221946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:36:21 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-67763a9a-b648-47f2-be55-48a981cb2db7 tempest-VolumeRetypeWithoutMigrationTest-1784221946 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:36:21 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-67763a9a-b648-47f2-be55-48a981cb2db7 tempest-VolumeRetypeWithoutMigrationTest-1784221946 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:36:21 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-67763a9a-b648-47f2-be55-48a981cb2db7 tempest-VolumeRetypeWithoutMigrationTest-1784221946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-34b66a8b-3bcd-4f3a-92d9-d16462f85f68 1073741824 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:36:21 devstack sudo[102462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-34b66a8b-3bcd-4f3a-92d9-d16462f85f68 1073741824
Nov 03 18:36:21 devstack sudo[102462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:36:21 devstack sudo[102462]: pam_unix(sudo:session): session closed for user root
Nov 03 18:36:21 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-67763a9a-b648-47f2-be55-48a981cb2db7 tempest-VolumeRetypeWithoutMigrationTest-1784221946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-34b66a8b-3bcd-4f3a-92d9-d16462f85f68 1073741824" returned: 0 in 0.417s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:36:21 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-67763a9a-b648-47f2-be55-48a981cb2db7 tempest-VolumeRetypeWithoutMigrationTest-1784221946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-34b66a8b-3bcd-4f3a-92d9-d16462f85f68 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:36:21 devstack sudo[102467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-34b66a8b-3bcd-4f3a-92d9-d16462f85f68
Nov 03 18:36:21 devstack sudo[102467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:36:21 devstack sudo[102467]: pam_unix(sudo:session): session closed for user root
Nov 03 18:36:21 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-67763a9a-b648-47f2-be55-48a981cb2db7 tempest-VolumeRetypeWithoutMigrationTest-1784221946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-34b66a8b-3bcd-4f3a-92d9-d16462f85f68" returned: 0 in 0.240s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:36:21 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-67763a9a-b648-47f2-be55-48a981cb2db7 tempest-VolumeRetypeWithoutMigrationTest-1784221946 None] <== create_volume: return (700ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:36:21 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-67763a9a-b648-47f2-be55-48a981cb2db7 tempest-VolumeRetypeWithoutMigrationTest-1784221946 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.703s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:36:21 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-67763a9a-b648-47f2-be55-48a981cb2db7 tempest-VolumeRetypeWithoutMigrationTest-1784221946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b76ecf4-7fab-4bee-918d-ad3a6075b2da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34b66a8b-3bcd-4f3a-92d9-d16462f85f68', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:36:21 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-67763a9a-b648-47f2-be55-48a981cb2db7 tempest-VolumeRetypeWithoutMigrationTest-1784221946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f39d4a9b-2862-4007-b232-d6683a2556e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:36:21 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-67763a9a-b648-47f2-be55-48a981cb2db7 tempest-VolumeRetypeWithoutMigrationTest-1784221946 None] Volume volume-34b66a8b-3bcd-4f3a-92d9-d16462f85f68 (34b66a8b-3bcd-4f3a-92d9-d16462f85f68): created successfully
Nov 03 18:36:21 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-67763a9a-b648-47f2-be55-48a981cb2db7 tempest-VolumeRetypeWithoutMigrationTest-1784221946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f39d4a9b-2862-4007-b232-d6683a2556e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:36:21 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-67763a9a-b648-47f2-be55-48a981cb2db7 tempest-VolumeRetypeWithoutMigrationTest-1784221946 None] Flow 'volume_create_manager' (5a4f839e-af08-4ae0-8e8c-c569c3aa2188) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:36:22 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-67763a9a-b648-47f2-be55-48a981cb2db7 tempest-VolumeRetypeWithoutMigrationTest-1784221946 None] Created volume successfully.
Nov 03 18:36:22 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-767936ff-ae06-4b8a-86c6-211f8f69d603 tempest-VolumeRetypeWithoutMigrationTest-1784221946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:36:22 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-767936ff-ae06-4b8a-86c6-211f8f69d603 tempest-VolumeRetypeWithoutMigrationTest-1784221946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:36:22 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-767936ff-ae06-4b8a-86c6-211f8f69d603 tempest-VolumeRetypeWithoutMigrationTest-1784221946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:36:22 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-767936ff-ae06-4b8a-86c6-211f8f69d603 tempest-VolumeRetypeWithoutMigrationTest-1784221946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:36:22 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-767936ff-ae06-4b8a-86c6-211f8f69d603 tempest-VolumeRetypeWithoutMigrationTest-1784221946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:36:22 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-767936ff-ae06-4b8a-86c6-211f8f69d603 tempest-VolumeRetypeWithoutMigrationTest-1784221946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:36:22 devstack sudo[102470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:36:22 devstack sudo[102470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:36:22 devstack sudo[102470]: pam_unix(sudo:session): session closed for user root
Nov 03 18:36:22 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-767936ff-ae06-4b8a-86c6-211f8f69d603 tempest-VolumeRetypeWithoutMigrationTest-1784221946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.295s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:36:22 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-767936ff-ae06-4b8a-86c6-211f8f69d603 tempest-VolumeRetypeWithoutMigrationTest-1784221946 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:36:22 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-767936ff-ae06-4b8a-86c6-211f8f69d603 tempest-VolumeRetypeWithoutMigrationTest-1784221946 None] Retype volume completed successfully.
Nov 03 18:36:24 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-ed835289-1fd8-4b83-bb7b-3f4b53c38f56 tempest-VolumeRetypeWithoutMigrationTest-1784221946 None] Acquiring lock "cinder-34b66a8b-3bcd-4f3a-92d9-d16462f85f68-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:36:24 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-ed835289-1fd8-4b83-bb7b-3f4b53c38f56 tempest-VolumeRetypeWithoutMigrationTest-1784221946 None] Lock "cinder-34b66a8b-3bcd-4f3a-92d9-d16462f85f68-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:36:24 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-ed835289-1fd8-4b83-bb7b-3f4b53c38f56 tempest-VolumeRetypeWithoutMigrationTest-1784221946 None] Acquiring lock "cinder-quobyte-34b66a8b-3bcd-4f3a-92d9-d16462f85f68" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:36:24 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-ed835289-1fd8-4b83-bb7b-3f4b53c38f56 tempest-VolumeRetypeWithoutMigrationTest-1784221946 None] Lock "cinder-quobyte-34b66a8b-3bcd-4f3a-92d9-d16462f85f68" acquired by "delete_volume" :: waited 0.015s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:36:24 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[a45a777f-bf58-4d81-8d1b-a5b937ef60f8]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:36:24 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-ed835289-1fd8-4b83-bb7b-3f4b53c38f56 tempest-VolumeRetypeWithoutMigrationTest-1784221946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-34b66a8b-3bcd-4f3a-92d9-d16462f85f68 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:36:24 devstack sudo[102474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-34b66a8b-3bcd-4f3a-92d9-d16462f85f68
Nov 03 18:36:24 devstack sudo[102474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:36:24 devstack sudo[102474]: pam_unix(sudo:session): session closed for user root
Nov 03 18:36:24 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-ed835289-1fd8-4b83-bb7b-3f4b53c38f56 tempest-VolumeRetypeWithoutMigrationTest-1784221946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-34b66a8b-3bcd-4f3a-92d9-d16462f85f68" returned: 0 in 0.394s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:36:24 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-ed835289-1fd8-4b83-bb7b-3f4b53c38f56 tempest-VolumeRetypeWithoutMigrationTest-1784221946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-34b66a8b-3bcd-4f3a-92d9-d16462f85f68 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:36:24 devstack sudo[102479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-34b66a8b-3bcd-4f3a-92d9-d16462f85f68
Nov 03 18:36:24 devstack sudo[102479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:36:24 devstack sudo[102479]: pam_unix(sudo:session): session closed for user root
Nov 03 18:36:24 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-ed835289-1fd8-4b83-bb7b-3f4b53c38f56 tempest-VolumeRetypeWithoutMigrationTest-1784221946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-34b66a8b-3bcd-4f3a-92d9-d16462f85f68" returned: 0 in 0.269s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:36:24 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-ed835289-1fd8-4b83-bb7b-3f4b53c38f56 tempest-VolumeRetypeWithoutMigrationTest-1784221946 None] Lock "cinder-quobyte-34b66a8b-3bcd-4f3a-92d9-d16462f85f68" released by "delete_volume" :: held 0.710s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:36:24 devstack cinder-volume[86120]: WARNING cinder.quota [None req-ed835289-1fd8-4b83-bb7b-3f4b53c38f56 tempest-VolumeRetypeWithoutMigrationTest-1784221946 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Nov 03 18:36:24 devstack cinder-volume[86120]: WARNING cinder.quota [None req-ed835289-1fd8-4b83-bb7b-3f4b53c38f56 tempest-VolumeRetypeWithoutMigrationTest-1784221946 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Nov 03 18:36:24 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-ed835289-1fd8-4b83-bb7b-3f4b53c38f56 tempest-VolumeRetypeWithoutMigrationTest-1784221946 None] Created reservations ['0ef586ad-5a8a-4986-9306-bda0752c8f12', '00119af2-9679-4c81-97f4-3c3053b16bc0', '7aa16f87-e921-41b0-8830-7c3f9845c0a4', '9b03d5c2-7f3e-454e-891d-2fd15d06a42b'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:36:24 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-ed835289-1fd8-4b83-bb7b-3f4b53c38f56 tempest-VolumeRetypeWithoutMigrationTest-1784221946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:36:24 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-ed835289-1fd8-4b83-bb7b-3f4b53c38f56 tempest-VolumeRetypeWithoutMigrationTest-1784221946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:36:24 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-ed835289-1fd8-4b83-bb7b-3f4b53c38f56 tempest-VolumeRetypeWithoutMigrationTest-1784221946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:36:24 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-ed835289-1fd8-4b83-bb7b-3f4b53c38f56 tempest-VolumeRetypeWithoutMigrationTest-1784221946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:36:24 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-ed835289-1fd8-4b83-bb7b-3f4b53c38f56 tempest-VolumeRetypeWithoutMigrationTest-1784221946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:36:24 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-ed835289-1fd8-4b83-bb7b-3f4b53c38f56 tempest-VolumeRetypeWithoutMigrationTest-1784221946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:36:25 devstack sudo[102482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:36:25 devstack sudo[102482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:36:25 devstack sudo[102482]: pam_unix(sudo:session): session closed for user root
Nov 03 18:36:25 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-ed835289-1fd8-4b83-bb7b-3f4b53c38f56 tempest-VolumeRetypeWithoutMigrationTest-1784221946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.272s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:36:25 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-ed835289-1fd8-4b83-bb7b-3f4b53c38f56 tempest-VolumeRetypeWithoutMigrationTest-1784221946 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:36:25 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-ed835289-1fd8-4b83-bb7b-3f4b53c38f56 tempest-VolumeRetypeWithoutMigrationTest-1784221946 None] Deleted volume successfully.
Nov 03 18:36:25 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-ed835289-1fd8-4b83-bb7b-3f4b53c38f56 tempest-VolumeRetypeWithoutMigrationTest-1784221946 None] Lock "cinder-34b66a8b-3bcd-4f3a-92d9-d16462f85f68-delete_volume" released by "delete_volume" :: held 1.218s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:36:34 devstack cinder-volume[86120]: DEBUG dbcounter [-] [86120] Writing DB stats cinder:SELECT=26,cinder:UPDATE=45,cinder:INSERT=6,cinder:DELETE=2 {{(pid=86120) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 18:36:35 devstack cinder-volume[86120]: DEBUG dbcounter [-] [86120] Writing DB stats cinder:SELECT=31,cinder:INSERT=9,cinder:UPDATE=30,cinder:DELETE=4 {{(pid=86120) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 18:36:43 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-75f39793-982f-4593-8da5-e281922f4715 tempest-SnapshotMetadataTestJSON-1495645847 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:36:43 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-75f39793-982f-4593-8da5-e281922f4715 tempest-SnapshotMetadataTestJSON-1495645847 None] Flow 'volume_create_manager' (4009c579-9053-49f9-882e-287f02d392c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:36:43 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-75f39793-982f-4593-8da5-e281922f4715 tempest-SnapshotMetadataTestJSON-1495645847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (981bd8d1-69fe-4eae-bbd2-a7aa9bdf1d6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:36:43 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-75f39793-982f-4593-8da5-e281922f4715 tempest-SnapshotMetadataTestJSON-1495645847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (981bd8d1-69fe-4eae-bbd2-a7aa9bdf1d6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:36:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-865172225',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f207332-825c-43d2-8956-276e386de84f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59c4322293234accb7f8fcecb2503040',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:36:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:36:44Z,use_quota=True,user_id='914d1fa148484c969d91a2dac366b551',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:36:43 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-75f39793-982f-4593-8da5-e281922f4715 tempest-SnapshotMetadataTestJSON-1495645847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2be95a05-5b4d-42e9-9822-06ccfa1f8004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:36:43 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-75f39793-982f-4593-8da5-e281922f4715 tempest-SnapshotMetadataTestJSON-1495645847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2be95a05-5b4d-42e9-9822-06ccfa1f8004) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:36:43 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-75f39793-982f-4593-8da5-e281922f4715 tempest-SnapshotMetadataTestJSON-1495645847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f14f147b-57af-4b17-bef6-aa60f246b149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:36:43 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-75f39793-982f-4593-8da5-e281922f4715 tempest-SnapshotMetadataTestJSON-1495645847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f14f147b-57af-4b17-bef6-aa60f246b149) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f207332-825c-43d2-8956-276e386de84f', 'volume_name': 'volume-5f207332-825c-43d2-8956-276e386de84f', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:36:43 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-75f39793-982f-4593-8da5-e281922f4715 tempest-SnapshotMetadataTestJSON-1495645847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4c2bf9d-56c4-47b8-bb68-5043e9b6766f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:36:43 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-75f39793-982f-4593-8da5-e281922f4715 tempest-SnapshotMetadataTestJSON-1495645847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4c2bf9d-56c4-47b8-bb68-5043e9b6766f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:36:43 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-75f39793-982f-4593-8da5-e281922f4715 tempest-SnapshotMetadataTestJSON-1495645847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b42b5525-aab8-433f-bda8-4a3d5a96dc3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:36:43 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-75f39793-982f-4593-8da5-e281922f4715 tempest-SnapshotMetadataTestJSON-1495645847 None] Volume 5f207332-825c-43d2-8956-276e386de84f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f207332-825c-43d2-8956-276e386de84f', 'volume_size': 1}
Nov 03 18:36:43 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-75f39793-982f-4593-8da5-e281922f4715 tempest-SnapshotMetadataTestJSON-1495645847 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:36:43 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-75f39793-982f-4593-8da5-e281922f4715 tempest-SnapshotMetadataTestJSON-1495645847 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:36:43 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-75f39793-982f-4593-8da5-e281922f4715 tempest-SnapshotMetadataTestJSON-1495645847 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:36:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-865172225',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f207332-825c-43d2-8956-276e386de84f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59c4322293234accb7f8fcecb2503040',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:36:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:36:44Z,use_quota=True,user_id='914d1fa148484c969d91a2dac366b551',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:36:43 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-75f39793-982f-4593-8da5-e281922f4715 tempest-SnapshotMetadataTestJSON-1495645847 None] Creating volume 5f207332-825c-43d2-8956-276e386de84f {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:36:43 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-75f39793-982f-4593-8da5-e281922f4715 tempest-SnapshotMetadataTestJSON-1495645847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:36:43 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-75f39793-982f-4593-8da5-e281922f4715 tempest-SnapshotMetadataTestJSON-1495645847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:36:43 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-75f39793-982f-4593-8da5-e281922f4715 tempest-SnapshotMetadataTestJSON-1495645847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:36:43 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-75f39793-982f-4593-8da5-e281922f4715 tempest-SnapshotMetadataTestJSON-1495645847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:36:43 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-75f39793-982f-4593-8da5-e281922f4715 tempest-SnapshotMetadataTestJSON-1495645847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:36:43 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-75f39793-982f-4593-8da5-e281922f4715 tempest-SnapshotMetadataTestJSON-1495645847 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:36:43 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-75f39793-982f-4593-8da5-e281922f4715 tempest-SnapshotMetadataTestJSON-1495645847 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:36:43 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-75f39793-982f-4593-8da5-e281922f4715 tempest-SnapshotMetadataTestJSON-1495645847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-5f207332-825c-43d2-8956-276e386de84f 1073741824 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:36:43 devstack sudo[102615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-5f207332-825c-43d2-8956-276e386de84f 1073741824
Nov 03 18:36:43 devstack sudo[102615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:36:44 devstack sudo[102615]: pam_unix(sudo:session): session closed for user root
Nov 03 18:36:44 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-75f39793-982f-4593-8da5-e281922f4715 tempest-SnapshotMetadataTestJSON-1495645847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-5f207332-825c-43d2-8956-276e386de84f 1073741824" returned: 0 in 0.499s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:36:44 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-75f39793-982f-4593-8da5-e281922f4715 tempest-SnapshotMetadataTestJSON-1495645847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-5f207332-825c-43d2-8956-276e386de84f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:36:44 devstack sudo[102621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-5f207332-825c-43d2-8956-276e386de84f
Nov 03 18:36:44 devstack sudo[102621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:36:44 devstack sudo[102621]: pam_unix(sudo:session): session closed for user root
Nov 03 18:36:44 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-75f39793-982f-4593-8da5-e281922f4715 tempest-SnapshotMetadataTestJSON-1495645847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-5f207332-825c-43d2-8956-276e386de84f" returned: 0 in 0.324s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:36:44 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-75f39793-982f-4593-8da5-e281922f4715 tempest-SnapshotMetadataTestJSON-1495645847 None] <== create_volume: return (877ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:36:44 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-75f39793-982f-4593-8da5-e281922f4715 tempest-SnapshotMetadataTestJSON-1495645847 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.882s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:36:44 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-75f39793-982f-4593-8da5-e281922f4715 tempest-SnapshotMetadataTestJSON-1495645847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b42b5525-aab8-433f-bda8-4a3d5a96dc3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f207332-825c-43d2-8956-276e386de84f', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:36:44 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-75f39793-982f-4593-8da5-e281922f4715 tempest-SnapshotMetadataTestJSON-1495645847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eab2c172-e1ed-46b4-b75f-27daf8e3f7f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:36:44 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-75f39793-982f-4593-8da5-e281922f4715 tempest-SnapshotMetadataTestJSON-1495645847 None] Volume volume-5f207332-825c-43d2-8956-276e386de84f (5f207332-825c-43d2-8956-276e386de84f): created successfully
Nov 03 18:36:44 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-75f39793-982f-4593-8da5-e281922f4715 tempest-SnapshotMetadataTestJSON-1495645847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eab2c172-e1ed-46b4-b75f-27daf8e3f7f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:36:44 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-75f39793-982f-4593-8da5-e281922f4715 tempest-SnapshotMetadataTestJSON-1495645847 None] Flow 'volume_create_manager' (4009c579-9053-49f9-882e-287f02d392c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:36:44 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-75f39793-982f-4593-8da5-e281922f4715 tempest-SnapshotMetadataTestJSON-1495645847 None] Created volume successfully.
Nov 03 18:36:45 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-603db797-6e3c-4c5c-b641-24d74a97c0ba tempest-SnapshotMetadataTestJSON-1495645847 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:36:45 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-603db797-6e3c-4c5c-b641-24d74a97c0ba tempest-SnapshotMetadataTestJSON-1495645847 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:36:46 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-603db797-6e3c-4c5c-b641-24d74a97c0ba tempest-SnapshotMetadataTestJSON-1495645847 None] Creating offline snapshot 816655d9-76e3-4d1f-b9e4-b74ddb2a8c5f of volume 5f207332-825c-43d2-8956-276e386de84f {{(pid=86120) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 18:36:46 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3ea29e9-f7b5-4df3-8afb-8d7c2fc5f5b2]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:36:46 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-603db797-6e3c-4c5c-b641-24d74a97c0ba tempest-SnapshotMetadataTestJSON-1495645847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-5f207332-825c-43d2-8956-276e386de84f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:36:46 devstack sudo[102627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-5f207332-825c-43d2-8956-276e386de84f
Nov 03 18:36:46 devstack sudo[102627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:36:46 devstack sudo[102627]: pam_unix(sudo:session): session closed for user root
Nov 03 18:36:46 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-603db797-6e3c-4c5c-b641-24d74a97c0ba tempest-SnapshotMetadataTestJSON-1495645847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-5f207332-825c-43d2-8956-276e386de84f" returned: 0 in 0.367s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:36:46 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-603db797-6e3c-4c5c-b641-24d74a97c0ba tempest-SnapshotMetadataTestJSON-1495645847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-5f207332-825c-43d2-8956-276e386de84f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-5f207332-825c-43d2-8956-276e386de84f.816655d9-76e3-4d1f-b9e4-b74ddb2a8c5f 1G {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:36:46 devstack sudo[102632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-5f207332-825c-43d2-8956-276e386de84f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-5f207332-825c-43d2-8956-276e386de84f.816655d9-76e3-4d1f-b9e4-b74ddb2a8c5f 1G
Nov 03 18:36:46 devstack sudo[102632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:36:46 devstack sudo[102632]: pam_unix(sudo:session): session closed for user root
Nov 03 18:36:46 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-603db797-6e3c-4c5c-b641-24d74a97c0ba tempest-SnapshotMetadataTestJSON-1495645847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-5f207332-825c-43d2-8956-276e386de84f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-5f207332-825c-43d2-8956-276e386de84f.816655d9-76e3-4d1f-b9e4-b74ddb2a8c5f 1G" returned: 0 in 0.445s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:36:46 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-603db797-6e3c-4c5c-b641-24d74a97c0ba tempest-SnapshotMetadataTestJSON-1495645847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f207332-825c-43d2-8956-276e386de84f -F qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-5f207332-825c-43d2-8956-276e386de84f.816655d9-76e3-4d1f-b9e4-b74ddb2a8c5f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:36:46 devstack sudo[102637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f207332-825c-43d2-8956-276e386de84f -F qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-5f207332-825c-43d2-8956-276e386de84f.816655d9-76e3-4d1f-b9e4-b74ddb2a8c5f
Nov 03 18:36:46 devstack sudo[102637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:36:47 devstack sudo[102637]: pam_unix(sudo:session): session closed for user root
Nov 03 18:36:47 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-603db797-6e3c-4c5c-b641-24d74a97c0ba tempest-SnapshotMetadataTestJSON-1495645847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f207332-825c-43d2-8956-276e386de84f -F qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-5f207332-825c-43d2-8956-276e386de84f.816655d9-76e3-4d1f-b9e4-b74ddb2a8c5f" returned: 0 in 0.307s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:36:47 devstack cinder-volume[86120]: WARNING cinder.volume.drivers.remotefs [None req-603db797-6e3c-4c5c-b641-24d74a97c0ba tempest-SnapshotMetadataTestJSON-1495645847 None] /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-5f207332-825c-43d2-8956-276e386de84f.816655d9-76e3-4d1f-b9e4-b74ddb2a8c5f is being set with open permissions: ugo+rw
Nov 03 18:36:47 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-603db797-6e3c-4c5c-b641-24d74a97c0ba tempest-SnapshotMetadataTestJSON-1495645847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-5f207332-825c-43d2-8956-276e386de84f.816655d9-76e3-4d1f-b9e4-b74ddb2a8c5f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:36:47 devstack sudo[102642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-5f207332-825c-43d2-8956-276e386de84f.816655d9-76e3-4d1f-b9e4-b74ddb2a8c5f
Nov 03 18:36:47 devstack sudo[102642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:36:47 devstack sudo[102642]: pam_unix(sudo:session): session closed for user root
Nov 03 18:36:47 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-603db797-6e3c-4c5c-b641-24d74a97c0ba tempest-SnapshotMetadataTestJSON-1495645847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-5f207332-825c-43d2-8956-276e386de84f.816655d9-76e3-4d1f-b9e4-b74ddb2a8c5f" returned: 0 in 0.245s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:36:47 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-603db797-6e3c-4c5c-b641-24d74a97c0ba tempest-SnapshotMetadataTestJSON-1495645847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-5f207332-825c-43d2-8956-276e386de84f.info {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:36:47 devstack sudo[102645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-5f207332-825c-43d2-8956-276e386de84f.info
Nov 03 18:36:47 devstack sudo[102645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:36:47 devstack sudo[102645]: pam_unix(sudo:session): session closed for user root
Nov 03 18:36:47 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-603db797-6e3c-4c5c-b641-24d74a97c0ba tempest-SnapshotMetadataTestJSON-1495645847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-5f207332-825c-43d2-8956-276e386de84f.info" returned: 0 in 0.264s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:36:47 devstack cinder-volume[86120]: WARNING cinder.volume.drivers.remotefs [None req-603db797-6e3c-4c5c-b641-24d74a97c0ba tempest-SnapshotMetadataTestJSON-1495645847 None] /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-5f207332-825c-43d2-8956-276e386de84f.info is being set with open permissions: ugo+rw
Nov 03 18:36:47 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-603db797-6e3c-4c5c-b641-24d74a97c0ba tempest-SnapshotMetadataTestJSON-1495645847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-5f207332-825c-43d2-8956-276e386de84f.info {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:36:47 devstack sudo[102648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-5f207332-825c-43d2-8956-276e386de84f.info
Nov 03 18:36:47 devstack sudo[102648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:36:47 devstack sudo[102648]: pam_unix(sudo:session): session closed for user root
Nov 03 18:36:47 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-603db797-6e3c-4c5c-b641-24d74a97c0ba tempest-SnapshotMetadataTestJSON-1495645847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-5f207332-825c-43d2-8956-276e386de84f.info" returned: 0 in 0.255s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:36:47 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-603db797-6e3c-4c5c-b641-24d74a97c0ba tempest-SnapshotMetadataTestJSON-1495645847 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.973s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:36:48 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-603db797-6e3c-4c5c-b641-24d74a97c0ba tempest-SnapshotMetadataTestJSON-1495645847 None] Create snapshot completed successfully
Nov 03 18:36:48 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-40ffc572-27a9-437d-8e53-861842fff56f tempest-SnapshotMetadataTestJSON-1495645847 None] Acquiring lock "cinder-816655d9-76e3-4d1f-b9e4-b74ddb2a8c5f-delete_snapshot" by "delete_snapshot" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:36:48 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-40ffc572-27a9-437d-8e53-861842fff56f tempest-SnapshotMetadataTestJSON-1495645847 None] Lock "cinder-816655d9-76e3-4d1f-b9e4-b74ddb2a8c5f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:36:48 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-40ffc572-27a9-437d-8e53-861842fff56f tempest-SnapshotMetadataTestJSON-1495645847 None] Acquiring lock "cinder-quobyte-5f207332-825c-43d2-8956-276e386de84f" by "delete_snapshot" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:36:48 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-40ffc572-27a9-437d-8e53-861842fff56f tempest-SnapshotMetadataTestJSON-1495645847 None] Lock "cinder-quobyte-5f207332-825c-43d2-8956-276e386de84f" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:36:48 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-40ffc572-27a9-437d-8e53-861842fff56f tempest-SnapshotMetadataTestJSON-1495645847 None] Acquiring lock "cinder-quobyte-816655d9-76e3-4d1f-b9e4-b74ddb2a8c5f" by "_delete_snapshot" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:36:48 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-40ffc572-27a9-437d-8e53-861842fff56f tempest-SnapshotMetadataTestJSON-1495645847 None] Lock "cinder-quobyte-816655d9-76e3-4d1f-b9e4-b74ddb2a8c5f" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:36:49 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-40ffc572-27a9-437d-8e53-861842fff56f tempest-SnapshotMetadataTestJSON-1495645847 None] Deleting offline snapshot 816655d9-76e3-4d1f-b9e4-b74ddb2a8c5f of volume 5f207332-825c-43d2-8956-276e386de84f {{(pid=86120) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 18:36:49 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-40ffc572-27a9-437d-8e53-861842fff56f tempest-SnapshotMetadataTestJSON-1495645847 None] snapshot_file for this snap is: volume-5f207332-825c-43d2-8956-276e386de84f.816655d9-76e3-4d1f-b9e4-b74ddb2a8c5f {{(pid=86120) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 18:36:49 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[f77b14bc-26d5-433a-9c70-63870f0c2fd4]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:36:49 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-40ffc572-27a9-437d-8e53-861842fff56f tempest-SnapshotMetadataTestJSON-1495645847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-5f207332-825c-43d2-8956-276e386de84f.816655d9-76e3-4d1f-b9e4-b74ddb2a8c5f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:36:49 devstack sudo[102651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-5f207332-825c-43d2-8956-276e386de84f.816655d9-76e3-4d1f-b9e4-b74ddb2a8c5f
Nov 03 18:36:49 devstack sudo[102651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:36:49 devstack sudo[102651]: pam_unix(sudo:session): session closed for user root
Nov 03 18:36:49 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-40ffc572-27a9-437d-8e53-861842fff56f tempest-SnapshotMetadataTestJSON-1495645847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-5f207332-825c-43d2-8956-276e386de84f.816655d9-76e3-4d1f-b9e4-b74ddb2a8c5f" returned: 0 in 0.386s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:36:49 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-40ffc572-27a9-437d-8e53-861842fff56f tempest-SnapshotMetadataTestJSON-1495645847 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5f207332-825c-43d2-8956-276e386de84f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86120) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 18:36:49 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[9145e991-5f44-45ec-9d2b-7c1ea08a18db]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:36:49 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-40ffc572-27a9-437d-8e53-861842fff56f tempest-SnapshotMetadataTestJSON-1495645847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-5f207332-825c-43d2-8956-276e386de84f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:36:49 devstack sudo[102657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-5f207332-825c-43d2-8956-276e386de84f
Nov 03 18:36:49 devstack sudo[102657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:36:49 devstack sudo[102657]: pam_unix(sudo:session): session closed for user root
Nov 03 18:36:49 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-40ffc572-27a9-437d-8e53-861842fff56f tempest-SnapshotMetadataTestJSON-1495645847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-5f207332-825c-43d2-8956-276e386de84f" returned: 0 in 0.373s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:36:49 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-40ffc572-27a9-437d-8e53-861842fff56f tempest-SnapshotMetadataTestJSON-1495645847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-5f207332-825c-43d2-8956-276e386de84f.816655d9-76e3-4d1f-b9e4-b74ddb2a8c5f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:36:49 devstack sudo[102662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-5f207332-825c-43d2-8956-276e386de84f.816655d9-76e3-4d1f-b9e4-b74ddb2a8c5f
Nov 03 18:36:49 devstack sudo[102662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:36:50 devstack sudo[102662]: pam_unix(sudo:session): session closed for user root
Nov 03 18:36:50 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-40ffc572-27a9-437d-8e53-861842fff56f tempest-SnapshotMetadataTestJSON-1495645847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-5f207332-825c-43d2-8956-276e386de84f.816655d9-76e3-4d1f-b9e4-b74ddb2a8c5f" returned: 0 in 0.336s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:36:50 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-40ffc572-27a9-437d-8e53-861842fff56f tempest-SnapshotMetadataTestJSON-1495645847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-5f207332-825c-43d2-8956-276e386de84f.816655d9-76e3-4d1f-b9e4-b74ddb2a8c5f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:36:50 devstack sudo[102667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-5f207332-825c-43d2-8956-276e386de84f.816655d9-76e3-4d1f-b9e4-b74ddb2a8c5f
Nov 03 18:36:50 devstack sudo[102667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:36:50 devstack sudo[102667]: pam_unix(sudo:session): session closed for user root
Nov 03 18:36:50 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-40ffc572-27a9-437d-8e53-861842fff56f tempest-SnapshotMetadataTestJSON-1495645847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-5f207332-825c-43d2-8956-276e386de84f.816655d9-76e3-4d1f-b9e4-b74ddb2a8c5f" returned: 0 in 0.251s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:36:50 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-40ffc572-27a9-437d-8e53-861842fff56f tempest-SnapshotMetadataTestJSON-1495645847 None] Lock "cinder-quobyte-816655d9-76e3-4d1f-b9e4-b74ddb2a8c5f" released by "_delete_snapshot" :: held 1.445s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:36:50 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-40ffc572-27a9-437d-8e53-861842fff56f tempest-SnapshotMetadataTestJSON-1495645847 None] Lock "cinder-quobyte-5f207332-825c-43d2-8956-276e386de84f" released by "delete_snapshot" :: held 1.465s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:36:50 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-40ffc572-27a9-437d-8e53-861842fff56f tempest-SnapshotMetadataTestJSON-1495645847 None] Created reservations ['5d281315-1ded-460e-a64f-9daad70b3864', '2cae6f5e-a5c4-4177-8a0c-9405a83bec58', 'ef48a344-0c5b-452e-af89-36b7ffc3b5ca', '2779128f-be9b-42c4-ac31-b78f1bc5357c'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:36:50 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-40ffc572-27a9-437d-8e53-861842fff56f tempest-SnapshotMetadataTestJSON-1495645847 None] Delete snapshot completed successfully.
Nov 03 18:36:50 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-40ffc572-27a9-437d-8e53-861842fff56f tempest-SnapshotMetadataTestJSON-1495645847 None] Lock "cinder-816655d9-76e3-4d1f-b9e4-b74ddb2a8c5f-delete_snapshot" released by "delete_snapshot" :: held 1.599s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:36:51 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-9935ae7c-b75a-48cc-89fb-649c71638d74 tempest-SnapshotMetadataTestJSON-1495645847 None] Acquiring lock "cinder-5f207332-825c-43d2-8956-276e386de84f-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:36:51 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-9935ae7c-b75a-48cc-89fb-649c71638d74 tempest-SnapshotMetadataTestJSON-1495645847 None] Lock "cinder-5f207332-825c-43d2-8956-276e386de84f-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:36:51 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-9935ae7c-b75a-48cc-89fb-649c71638d74 tempest-SnapshotMetadataTestJSON-1495645847 None] Acquiring lock "cinder-quobyte-5f207332-825c-43d2-8956-276e386de84f" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:36:51 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-9935ae7c-b75a-48cc-89fb-649c71638d74 tempest-SnapshotMetadataTestJSON-1495645847 None] Lock "cinder-quobyte-5f207332-825c-43d2-8956-276e386de84f" acquired by "delete_volume" :: waited 0.025s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:36:51 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[e60a5dfa-f1e9-4ea8-a498-6cd7e7a22865]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:36:51 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-9935ae7c-b75a-48cc-89fb-649c71638d74 tempest-SnapshotMetadataTestJSON-1495645847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-5f207332-825c-43d2-8956-276e386de84f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:36:51 devstack sudo[102670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-5f207332-825c-43d2-8956-276e386de84f
Nov 03 18:36:51 devstack sudo[102670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:36:51 devstack sudo[102670]: pam_unix(sudo:session): session closed for user root
Nov 03 18:36:51 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-9935ae7c-b75a-48cc-89fb-649c71638d74 tempest-SnapshotMetadataTestJSON-1495645847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-5f207332-825c-43d2-8956-276e386de84f" returned: 0 in 0.371s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:36:51 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-9935ae7c-b75a-48cc-89fb-649c71638d74 tempest-SnapshotMetadataTestJSON-1495645847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-5f207332-825c-43d2-8956-276e386de84f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:36:51 devstack sudo[102675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-5f207332-825c-43d2-8956-276e386de84f
Nov 03 18:36:51 devstack sudo[102675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:36:51 devstack sudo[102675]: pam_unix(sudo:session): session closed for user root
Nov 03 18:36:51 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-9935ae7c-b75a-48cc-89fb-649c71638d74 tempest-SnapshotMetadataTestJSON-1495645847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-5f207332-825c-43d2-8956-276e386de84f" returned: 0 in 0.244s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:36:51 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-9935ae7c-b75a-48cc-89fb-649c71638d74 tempest-SnapshotMetadataTestJSON-1495645847 None] Lock "cinder-quobyte-5f207332-825c-43d2-8956-276e386de84f" released by "delete_volume" :: held 0.673s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:36:51 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-9935ae7c-b75a-48cc-89fb-649c71638d74 tempest-SnapshotMetadataTestJSON-1495645847 None] Created reservations ['25b09cfb-1f73-4e5c-b3ab-aaef7aeb930e', 'a216806b-f4bb-43a6-af3b-c5ff76123c47', '7b7721a6-6cc5-4360-b461-4c5680839684', '26ce99fa-eb4d-4ff4-b81d-5f5eb806b271'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:36:52 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-9935ae7c-b75a-48cc-89fb-649c71638d74 tempest-SnapshotMetadataTestJSON-1495645847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:36:52 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-9935ae7c-b75a-48cc-89fb-649c71638d74 tempest-SnapshotMetadataTestJSON-1495645847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:36:52 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-9935ae7c-b75a-48cc-89fb-649c71638d74 tempest-SnapshotMetadataTestJSON-1495645847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:36:52 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-9935ae7c-b75a-48cc-89fb-649c71638d74 tempest-SnapshotMetadataTestJSON-1495645847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:36:52 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-9935ae7c-b75a-48cc-89fb-649c71638d74 tempest-SnapshotMetadataTestJSON-1495645847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:36:52 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-9935ae7c-b75a-48cc-89fb-649c71638d74 tempest-SnapshotMetadataTestJSON-1495645847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:36:52 devstack sudo[102678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:36:52 devstack sudo[102678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:36:52 devstack sudo[102678]: pam_unix(sudo:session): session closed for user root
Nov 03 18:36:52 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-9935ae7c-b75a-48cc-89fb-649c71638d74 tempest-SnapshotMetadataTestJSON-1495645847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.278s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:36:52 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-9935ae7c-b75a-48cc-89fb-649c71638d74 tempest-SnapshotMetadataTestJSON-1495645847 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:36:52 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-9935ae7c-b75a-48cc-89fb-649c71638d74 tempest-SnapshotMetadataTestJSON-1495645847 None] Deleted volume successfully.
Nov 03 18:36:52 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-9935ae7c-b75a-48cc-89fb-649c71638d74 tempest-SnapshotMetadataTestJSON-1495645847 None] Lock "cinder-5f207332-825c-43d2-8956-276e386de84f-delete_volume" released by "delete_volume" :: held 1.177s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:36:57 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-b71f716d-a9b0-4849-b5fd-d7c073ade8d5 tempest-VolumesTransfersTest-1649074776 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:36:57 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-b71f716d-a9b0-4849-b5fd-d7c073ade8d5 tempest-VolumesTransfersTest-1649074776 None] Flow 'volume_create_manager' (29f84430-7834-4866-820d-c9f477685bb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:36:57 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-b71f716d-a9b0-4849-b5fd-d7c073ade8d5 tempest-VolumesTransfersTest-1649074776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b31f52c7-4581-46ef-89ae-80c4c776c3d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:36:57 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-b71f716d-a9b0-4849-b5fd-d7c073ade8d5 tempest-VolumesTransfersTest-1649074776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b31f52c7-4581-46ef-89ae-80c4c776c3d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:36:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-977007975',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f8f9d58-1b52-4772-9824-7b35c0825df5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0720d26343664923acb5a9621022399c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:36:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:36:57Z,use_quota=True,user_id='6a45120e6d9746178c70737af3643360',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:36:57 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-b71f716d-a9b0-4849-b5fd-d7c073ade8d5 tempest-VolumesTransfersTest-1649074776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d84cb8fe-870a-488c-9baa-d4899ed9c001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:36:57 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-b71f716d-a9b0-4849-b5fd-d7c073ade8d5 tempest-VolumesTransfersTest-1649074776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d84cb8fe-870a-488c-9baa-d4899ed9c001) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:36:57 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-b71f716d-a9b0-4849-b5fd-d7c073ade8d5 tempest-VolumesTransfersTest-1649074776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e15d27f4-2acc-46d3-b208-64997f4f6188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:36:57 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-b71f716d-a9b0-4849-b5fd-d7c073ade8d5 tempest-VolumesTransfersTest-1649074776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e15d27f4-2acc-46d3-b208-64997f4f6188) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f8f9d58-1b52-4772-9824-7b35c0825df5', 'volume_name': 'volume-8f8f9d58-1b52-4772-9824-7b35c0825df5', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:36:57 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-b71f716d-a9b0-4849-b5fd-d7c073ade8d5 tempest-VolumesTransfersTest-1649074776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8694aaf-7ab7-456a-a4be-e44ec8f10850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:36:57 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-b71f716d-a9b0-4849-b5fd-d7c073ade8d5 tempest-VolumesTransfersTest-1649074776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8694aaf-7ab7-456a-a4be-e44ec8f10850) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:36:57 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-b71f716d-a9b0-4849-b5fd-d7c073ade8d5 tempest-VolumesTransfersTest-1649074776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (727ad117-b412-48e8-9087-883ea272f16a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:36:57 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-b71f716d-a9b0-4849-b5fd-d7c073ade8d5 tempest-VolumesTransfersTest-1649074776 None] Volume 8f8f9d58-1b52-4772-9824-7b35c0825df5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f8f9d58-1b52-4772-9824-7b35c0825df5', 'volume_size': 1}
Nov 03 18:36:57 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-b71f716d-a9b0-4849-b5fd-d7c073ade8d5 tempest-VolumesTransfersTest-1649074776 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:36:57 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-b71f716d-a9b0-4849-b5fd-d7c073ade8d5 tempest-VolumesTransfersTest-1649074776 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:36:57 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-b71f716d-a9b0-4849-b5fd-d7c073ade8d5 tempest-VolumesTransfersTest-1649074776 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:36:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-977007975',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f8f9d58-1b52-4772-9824-7b35c0825df5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0720d26343664923acb5a9621022399c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:36:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:36:57Z,use_quota=True,user_id='6a45120e6d9746178c70737af3643360',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:36:57 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-b71f716d-a9b0-4849-b5fd-d7c073ade8d5 tempest-VolumesTransfersTest-1649074776 None] Creating volume 8f8f9d58-1b52-4772-9824-7b35c0825df5 {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:36:57 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-b71f716d-a9b0-4849-b5fd-d7c073ade8d5 tempest-VolumesTransfersTest-1649074776 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:36:57 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-b71f716d-a9b0-4849-b5fd-d7c073ade8d5 tempest-VolumesTransfersTest-1649074776 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:36:57 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-b71f716d-a9b0-4849-b5fd-d7c073ade8d5 tempest-VolumesTransfersTest-1649074776 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:36:57 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-b71f716d-a9b0-4849-b5fd-d7c073ade8d5 tempest-VolumesTransfersTest-1649074776 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:36:57 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-b71f716d-a9b0-4849-b5fd-d7c073ade8d5 tempest-VolumesTransfersTest-1649074776 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:36:57 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-b71f716d-a9b0-4849-b5fd-d7c073ade8d5 tempest-VolumesTransfersTest-1649074776 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:36:57 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-b71f716d-a9b0-4849-b5fd-d7c073ade8d5 tempest-VolumesTransfersTest-1649074776 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:36:57 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b71f716d-a9b0-4849-b5fd-d7c073ade8d5 tempest-VolumesTransfersTest-1649074776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8f8f9d58-1b52-4772-9824-7b35c0825df5 1073741824 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:36:57 devstack sudo[102700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8f8f9d58-1b52-4772-9824-7b35c0825df5 1073741824
Nov 03 18:36:57 devstack sudo[102700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:36:58 devstack sudo[102700]: pam_unix(sudo:session): session closed for user root
Nov 03 18:36:58 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b71f716d-a9b0-4849-b5fd-d7c073ade8d5 tempest-VolumesTransfersTest-1649074776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8f8f9d58-1b52-4772-9824-7b35c0825df5 1073741824" returned: 0 in 0.460s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:36:58 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b71f716d-a9b0-4849-b5fd-d7c073ade8d5 tempest-VolumesTransfersTest-1649074776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8f8f9d58-1b52-4772-9824-7b35c0825df5 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:36:58 devstack sudo[102712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8f8f9d58-1b52-4772-9824-7b35c0825df5
Nov 03 18:36:58 devstack sudo[102712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:36:58 devstack sudo[102712]: pam_unix(sudo:session): session closed for user root
Nov 03 18:36:58 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b71f716d-a9b0-4849-b5fd-d7c073ade8d5 tempest-VolumesTransfersTest-1649074776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8f8f9d58-1b52-4772-9824-7b35c0825df5" returned: 0 in 0.253s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:36:58 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-b71f716d-a9b0-4849-b5fd-d7c073ade8d5 tempest-VolumesTransfersTest-1649074776 None] <== create_volume: return (765ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:36:58 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-b71f716d-a9b0-4849-b5fd-d7c073ade8d5 tempest-VolumesTransfersTest-1649074776 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.767s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:36:58 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-b71f716d-a9b0-4849-b5fd-d7c073ade8d5 tempest-VolumesTransfersTest-1649074776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (727ad117-b412-48e8-9087-883ea272f16a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f8f9d58-1b52-4772-9824-7b35c0825df5', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:36:58 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-b71f716d-a9b0-4849-b5fd-d7c073ade8d5 tempest-VolumesTransfersTest-1649074776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06dbb284-40e5-44b7-966a-9e72d8143b4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:36:58 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-b71f716d-a9b0-4849-b5fd-d7c073ade8d5 tempest-VolumesTransfersTest-1649074776 None] Volume volume-8f8f9d58-1b52-4772-9824-7b35c0825df5 (8f8f9d58-1b52-4772-9824-7b35c0825df5): created successfully
Nov 03 18:36:58 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-b71f716d-a9b0-4849-b5fd-d7c073ade8d5 tempest-VolumesTransfersTest-1649074776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06dbb284-40e5-44b7-966a-9e72d8143b4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:36:58 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-b71f716d-a9b0-4849-b5fd-d7c073ade8d5 tempest-VolumesTransfersTest-1649074776 None] Flow 'volume_create_manager' (29f84430-7834-4866-820d-c9f477685bb4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:36:58 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-b71f716d-a9b0-4849-b5fd-d7c073ade8d5 tempest-VolumesTransfersTest-1649074776 None] Created volume successfully.
Nov 03 18:36:59 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-3a3a5d35-7152-4e1f-b9eb-f8a72a85974d tempest-VolumesTransfersTest-308750451 None] Transfer volume completed successfully.
Nov 03 18:36:59 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-1f2ee10a-b8df-4b57-96f8-be00d1a9f9d8 tempest-VolumesTransfersTest-1596065341 None] Acquiring lock "cinder-8f8f9d58-1b52-4772-9824-7b35c0825df5-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:36:59 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-1f2ee10a-b8df-4b57-96f8-be00d1a9f9d8 tempest-VolumesTransfersTest-1596065341 None] Lock "cinder-8f8f9d58-1b52-4772-9824-7b35c0825df5-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:36:59 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-1f2ee10a-b8df-4b57-96f8-be00d1a9f9d8 tempest-VolumesTransfersTest-1596065341 None] Acquiring lock "cinder-quobyte-8f8f9d58-1b52-4772-9824-7b35c0825df5" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:36:59 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-1f2ee10a-b8df-4b57-96f8-be00d1a9f9d8 tempest-VolumesTransfersTest-1596065341 None] Lock "cinder-quobyte-8f8f9d58-1b52-4772-9824-7b35c0825df5" acquired by "delete_volume" :: waited 0.018s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:36:59 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1efc764-8742-4ef3-9363-242fc798ea13]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:36:59 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-1f2ee10a-b8df-4b57-96f8-be00d1a9f9d8 tempest-VolumesTransfersTest-1596065341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8f8f9d58-1b52-4772-9824-7b35c0825df5 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:36:59 devstack sudo[102716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8f8f9d58-1b52-4772-9824-7b35c0825df5
Nov 03 18:36:59 devstack sudo[102716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:37:00 devstack sudo[102716]: pam_unix(sudo:session): session closed for user root
Nov 03 18:37:00 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-1f2ee10a-b8df-4b57-96f8-be00d1a9f9d8 tempest-VolumesTransfersTest-1596065341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8f8f9d58-1b52-4772-9824-7b35c0825df5" returned: 0 in 0.341s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:37:00 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-1f2ee10a-b8df-4b57-96f8-be00d1a9f9d8 tempest-VolumesTransfersTest-1596065341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8f8f9d58-1b52-4772-9824-7b35c0825df5 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:37:00 devstack sudo[102721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8f8f9d58-1b52-4772-9824-7b35c0825df5
Nov 03 18:37:00 devstack sudo[102721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:37:00 devstack sudo[102721]: pam_unix(sudo:session): session closed for user root
Nov 03 18:37:00 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-1f2ee10a-b8df-4b57-96f8-be00d1a9f9d8 tempest-VolumesTransfersTest-1596065341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8f8f9d58-1b52-4772-9824-7b35c0825df5" returned: 0 in 0.258s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:37:00 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-1f2ee10a-b8df-4b57-96f8-be00d1a9f9d8 tempest-VolumesTransfersTest-1596065341 None] Lock "cinder-quobyte-8f8f9d58-1b52-4772-9824-7b35c0825df5" released by "delete_volume" :: held 0.646s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:37:00 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-1f2ee10a-b8df-4b57-96f8-be00d1a9f9d8 tempest-VolumesTransfersTest-1596065341 None] Created reservations ['6414e571-629d-40fa-a4b8-c2824e1bc90c', 'c687d552-ea67-4f19-ac8f-73b167b8e061', 'cc619be0-02c0-4283-bb11-60de6767dff1', '51d9bdb2-ff15-4675-afa9-365a71d09a3b'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:37:00 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-1f2ee10a-b8df-4b57-96f8-be00d1a9f9d8 tempest-VolumesTransfersTest-1596065341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:37:00 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-1f2ee10a-b8df-4b57-96f8-be00d1a9f9d8 tempest-VolumesTransfersTest-1596065341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:37:00 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-1f2ee10a-b8df-4b57-96f8-be00d1a9f9d8 tempest-VolumesTransfersTest-1596065341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:37:00 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-1f2ee10a-b8df-4b57-96f8-be00d1a9f9d8 tempest-VolumesTransfersTest-1596065341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:37:00 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-1f2ee10a-b8df-4b57-96f8-be00d1a9f9d8 tempest-VolumesTransfersTest-1596065341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:37:00 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-1f2ee10a-b8df-4b57-96f8-be00d1a9f9d8 tempest-VolumesTransfersTest-1596065341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:37:00 devstack sudo[102724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:37:00 devstack sudo[102724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:37:00 devstack sudo[102724]: pam_unix(sudo:session): session closed for user root
Nov 03 18:37:00 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-1f2ee10a-b8df-4b57-96f8-be00d1a9f9d8 tempest-VolumesTransfersTest-1596065341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.237s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:37:00 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-1f2ee10a-b8df-4b57-96f8-be00d1a9f9d8 tempest-VolumesTransfersTest-1596065341 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:37:00 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-1f2ee10a-b8df-4b57-96f8-be00d1a9f9d8 tempest-VolumesTransfersTest-1596065341 None] Deleted volume successfully.
Nov 03 18:37:00 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-1f2ee10a-b8df-4b57-96f8-be00d1a9f9d8 tempest-VolumesTransfersTest-1596065341 None] Lock "cinder-8f8f9d58-1b52-4772-9824-7b35c0825df5-delete_volume" released by "delete_volume" :: held 1.079s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:37:01 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-17559d1d-d2b6-4010-9b0d-0fd5f552af3e tempest-VolumesTransfersTest-1649074776 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:37:01 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-17559d1d-d2b6-4010-9b0d-0fd5f552af3e tempest-VolumesTransfersTest-1649074776 None] Flow 'volume_create_manager' (625e768f-393d-4271-b78d-4c690a594982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:37:01 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-17559d1d-d2b6-4010-9b0d-0fd5f552af3e tempest-VolumesTransfersTest-1649074776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcda4998-9162-4323-9da6-10cd88ece3be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:37:01 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-17559d1d-d2b6-4010-9b0d-0fd5f552af3e tempest-VolumesTransfersTest-1649074776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcda4998-9162-4323-9da6-10cd88ece3be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:37:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1066134068',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abbd3a02-afdd-4e2e-98b8-eccaf2f72e17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0720d26343664923acb5a9621022399c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:37:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:37:01Z,use_quota=True,user_id='6a45120e6d9746178c70737af3643360',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:37:01 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-17559d1d-d2b6-4010-9b0d-0fd5f552af3e tempest-VolumesTransfersTest-1649074776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a434d63c-7f1e-4d01-994f-15711a3a7289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:37:01 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-17559d1d-d2b6-4010-9b0d-0fd5f552af3e tempest-VolumesTransfersTest-1649074776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a434d63c-7f1e-4d01-994f-15711a3a7289) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:37:01 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-17559d1d-d2b6-4010-9b0d-0fd5f552af3e tempest-VolumesTransfersTest-1649074776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56007fbf-4b05-43a2-b702-52857ef3f173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:37:01 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-17559d1d-d2b6-4010-9b0d-0fd5f552af3e tempest-VolumesTransfersTest-1649074776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56007fbf-4b05-43a2-b702-52857ef3f173) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'abbd3a02-afdd-4e2e-98b8-eccaf2f72e17', 'volume_name': 'volume-abbd3a02-afdd-4e2e-98b8-eccaf2f72e17', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:37:01 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-17559d1d-d2b6-4010-9b0d-0fd5f552af3e tempest-VolumesTransfersTest-1649074776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29a64dbf-1700-48c7-8361-da2dc0fce624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:37:01 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-17559d1d-d2b6-4010-9b0d-0fd5f552af3e tempest-VolumesTransfersTest-1649074776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29a64dbf-1700-48c7-8361-da2dc0fce624) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:37:01 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-17559d1d-d2b6-4010-9b0d-0fd5f552af3e tempest-VolumesTransfersTest-1649074776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f353ef8-35c1-4bc2-a7c1-7c17d9a81475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:37:01 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-17559d1d-d2b6-4010-9b0d-0fd5f552af3e tempest-VolumesTransfersTest-1649074776 None] Volume abbd3a02-afdd-4e2e-98b8-eccaf2f72e17: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-abbd3a02-afdd-4e2e-98b8-eccaf2f72e17', 'volume_size': 1}
Nov 03 18:37:01 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-17559d1d-d2b6-4010-9b0d-0fd5f552af3e tempest-VolumesTransfersTest-1649074776 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:37:01 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-17559d1d-d2b6-4010-9b0d-0fd5f552af3e tempest-VolumesTransfersTest-1649074776 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:37:01 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-17559d1d-d2b6-4010-9b0d-0fd5f552af3e tempest-VolumesTransfersTest-1649074776 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:37:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1066134068',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abbd3a02-afdd-4e2e-98b8-eccaf2f72e17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0720d26343664923acb5a9621022399c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:37:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:37:01Z,use_quota=True,user_id='6a45120e6d9746178c70737af3643360',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:37:01 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-17559d1d-d2b6-4010-9b0d-0fd5f552af3e tempest-VolumesTransfersTest-1649074776 None] Creating volume abbd3a02-afdd-4e2e-98b8-eccaf2f72e17 {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:37:01 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-17559d1d-d2b6-4010-9b0d-0fd5f552af3e tempest-VolumesTransfersTest-1649074776 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:37:01 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-17559d1d-d2b6-4010-9b0d-0fd5f552af3e tempest-VolumesTransfersTest-1649074776 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:37:01 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-17559d1d-d2b6-4010-9b0d-0fd5f552af3e tempest-VolumesTransfersTest-1649074776 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:37:01 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-17559d1d-d2b6-4010-9b0d-0fd5f552af3e tempest-VolumesTransfersTest-1649074776 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:37:01 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-17559d1d-d2b6-4010-9b0d-0fd5f552af3e tempest-VolumesTransfersTest-1649074776 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:37:01 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-17559d1d-d2b6-4010-9b0d-0fd5f552af3e tempest-VolumesTransfersTest-1649074776 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:37:01 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-17559d1d-d2b6-4010-9b0d-0fd5f552af3e tempest-VolumesTransfersTest-1649074776 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:37:01 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-17559d1d-d2b6-4010-9b0d-0fd5f552af3e tempest-VolumesTransfersTest-1649074776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-abbd3a02-afdd-4e2e-98b8-eccaf2f72e17 1073741824 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:37:01 devstack sudo[102727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-abbd3a02-afdd-4e2e-98b8-eccaf2f72e17 1073741824
Nov 03 18:37:01 devstack sudo[102727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:37:01 devstack sudo[102727]: pam_unix(sudo:session): session closed for user root
Nov 03 18:37:01 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-17559d1d-d2b6-4010-9b0d-0fd5f552af3e tempest-VolumesTransfersTest-1649074776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-abbd3a02-afdd-4e2e-98b8-eccaf2f72e17 1073741824" returned: 0 in 0.444s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:37:01 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-17559d1d-d2b6-4010-9b0d-0fd5f552af3e tempest-VolumesTransfersTest-1649074776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-abbd3a02-afdd-4e2e-98b8-eccaf2f72e17 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:37:01 devstack sudo[102733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-abbd3a02-afdd-4e2e-98b8-eccaf2f72e17
Nov 03 18:37:01 devstack sudo[102733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:37:02 devstack sudo[102733]: pam_unix(sudo:session): session closed for user root
Nov 03 18:37:02 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-17559d1d-d2b6-4010-9b0d-0fd5f552af3e tempest-VolumesTransfersTest-1649074776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-abbd3a02-afdd-4e2e-98b8-eccaf2f72e17" returned: 0 in 0.274s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:37:02 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-17559d1d-d2b6-4010-9b0d-0fd5f552af3e tempest-VolumesTransfersTest-1649074776 None] <== create_volume: return (760ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:37:02 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-17559d1d-d2b6-4010-9b0d-0fd5f552af3e tempest-VolumesTransfersTest-1649074776 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.762s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:37:02 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-17559d1d-d2b6-4010-9b0d-0fd5f552af3e tempest-VolumesTransfersTest-1649074776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f353ef8-35c1-4bc2-a7c1-7c17d9a81475) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-abbd3a02-afdd-4e2e-98b8-eccaf2f72e17', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:37:02 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-17559d1d-d2b6-4010-9b0d-0fd5f552af3e tempest-VolumesTransfersTest-1649074776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43415bec-7045-457e-9ce0-7e6762ae9416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:37:02 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-17559d1d-d2b6-4010-9b0d-0fd5f552af3e tempest-VolumesTransfersTest-1649074776 None] Volume volume-abbd3a02-afdd-4e2e-98b8-eccaf2f72e17 (abbd3a02-afdd-4e2e-98b8-eccaf2f72e17): created successfully
Nov 03 18:37:02 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-17559d1d-d2b6-4010-9b0d-0fd5f552af3e tempest-VolumesTransfersTest-1649074776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43415bec-7045-457e-9ce0-7e6762ae9416) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:37:02 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-17559d1d-d2b6-4010-9b0d-0fd5f552af3e tempest-VolumesTransfersTest-1649074776 None] Flow 'volume_create_manager' (625e768f-393d-4271-b78d-4c690a594982) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:37:02 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-17559d1d-d2b6-4010-9b0d-0fd5f552af3e tempest-VolumesTransfersTest-1649074776 None] Created volume successfully.
Nov 03 18:37:02 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-4329dacd-5636-4af8-8afd-695db5a99067 tempest-VolumesTransfersTest-1596065341 None] Acquiring lock "cinder-abbd3a02-afdd-4e2e-98b8-eccaf2f72e17-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:37:02 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-4329dacd-5636-4af8-8afd-695db5a99067 tempest-VolumesTransfersTest-1596065341 None] Lock "cinder-abbd3a02-afdd-4e2e-98b8-eccaf2f72e17-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:37:02 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-4329dacd-5636-4af8-8afd-695db5a99067 tempest-VolumesTransfersTest-1596065341 None] Acquiring lock "cinder-quobyte-abbd3a02-afdd-4e2e-98b8-eccaf2f72e17" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:37:02 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-4329dacd-5636-4af8-8afd-695db5a99067 tempest-VolumesTransfersTest-1596065341 None] Lock "cinder-quobyte-abbd3a02-afdd-4e2e-98b8-eccaf2f72e17" acquired by "delete_volume" :: waited 0.019s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:37:02 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1945fbb-9744-47a6-a371-99933e1665e9]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:37:02 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-4329dacd-5636-4af8-8afd-695db5a99067 tempest-VolumesTransfersTest-1596065341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-abbd3a02-afdd-4e2e-98b8-eccaf2f72e17 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:37:02 devstack sudo[102736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-abbd3a02-afdd-4e2e-98b8-eccaf2f72e17
Nov 03 18:37:02 devstack sudo[102736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:37:02 devstack sudo[102736]: pam_unix(sudo:session): session closed for user root
Nov 03 18:37:02 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-4329dacd-5636-4af8-8afd-695db5a99067 tempest-VolumesTransfersTest-1596065341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-abbd3a02-afdd-4e2e-98b8-eccaf2f72e17" returned: 0 in 0.379s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:37:02 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-4329dacd-5636-4af8-8afd-695db5a99067 tempest-VolumesTransfersTest-1596065341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-abbd3a02-afdd-4e2e-98b8-eccaf2f72e17 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:37:03 devstack sudo[102741]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-abbd3a02-afdd-4e2e-98b8-eccaf2f72e17
Nov 03 18:37:03 devstack sudo[102741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:37:03 devstack sudo[102741]: pam_unix(sudo:session): session closed for user root
Nov 03 18:37:03 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-4329dacd-5636-4af8-8afd-695db5a99067 tempest-VolumesTransfersTest-1596065341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-abbd3a02-afdd-4e2e-98b8-eccaf2f72e17" returned: 0 in 0.272s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:37:03 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-4329dacd-5636-4af8-8afd-695db5a99067 tempest-VolumesTransfersTest-1596065341 None] Lock "cinder-quobyte-abbd3a02-afdd-4e2e-98b8-eccaf2f72e17" released by "delete_volume" :: held 0.704s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:37:03 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-4329dacd-5636-4af8-8afd-695db5a99067 tempest-VolumesTransfersTest-1596065341 None] Created reservations ['9f0d646a-0ac2-4ff1-ad9b-15cae7de1512', 'ff6d0553-3080-4834-aa69-1800712faf02', '90f6626b-9209-4edd-99a9-f007ceea87ea', 'df0789ce-aac9-4c6a-b582-61b0f7702d20'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:37:03 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-4329dacd-5636-4af8-8afd-695db5a99067 tempest-VolumesTransfersTest-1596065341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:37:03 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-4329dacd-5636-4af8-8afd-695db5a99067 tempest-VolumesTransfersTest-1596065341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:37:03 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-4329dacd-5636-4af8-8afd-695db5a99067 tempest-VolumesTransfersTest-1596065341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:37:03 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-4329dacd-5636-4af8-8afd-695db5a99067 tempest-VolumesTransfersTest-1596065341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:37:03 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-4329dacd-5636-4af8-8afd-695db5a99067 tempest-VolumesTransfersTest-1596065341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:37:03 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-4329dacd-5636-4af8-8afd-695db5a99067 tempest-VolumesTransfersTest-1596065341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:37:03 devstack sudo[102744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:37:03 devstack sudo[102744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:37:03 devstack sudo[102744]: pam_unix(sudo:session): session closed for user root
Nov 03 18:37:03 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-4329dacd-5636-4af8-8afd-695db5a99067 tempest-VolumesTransfersTest-1596065341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.284s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:37:03 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-4329dacd-5636-4af8-8afd-695db5a99067 tempest-VolumesTransfersTest-1596065341 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:37:03 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-4329dacd-5636-4af8-8afd-695db5a99067 tempest-VolumesTransfersTest-1596065341 None] Deleted volume successfully.
Nov 03 18:37:03 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-4329dacd-5636-4af8-8afd-695db5a99067 tempest-VolumesTransfersTest-1596065341 None] Lock "cinder-abbd3a02-afdd-4e2e-98b8-eccaf2f72e17-delete_volume" released by "delete_volume" :: held 1.196s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:37:06 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-c18db075-dd3e-46f8-8d1d-1f58af1753b2 tempest-TestServerVolumeAttachScenarioOldVersion-1377087450 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:37:06 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-c18db075-dd3e-46f8-8d1d-1f58af1753b2 tempest-TestServerVolumeAttachScenarioOldVersion-1377087450 None] Flow 'volume_create_manager' (3df90936-881e-4ee8-8987-174533db93ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:37:06 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-c18db075-dd3e-46f8-8d1d-1f58af1753b2 tempest-TestServerVolumeAttachScenarioOldVersion-1377087450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03e4f729-2381-4b3d-bc4c-9e1da6325a2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:37:06 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-c18db075-dd3e-46f8-8d1d-1f58af1753b2 tempest-TestServerVolumeAttachScenarioOldVersion-1377087450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03e4f729-2381-4b3d-bc4c-9e1da6325a2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:37:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-2079855833',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=020bcbc2-4e49-474f-8c0b-5de4fc5a8a40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c40be9d538c45f8b06b16b8f81380fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:37:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:37:06Z,use_quota=True,user_id='81b4ab06e5244652a588e75f88ea061e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:37:06 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-c18db075-dd3e-46f8-8d1d-1f58af1753b2 tempest-TestServerVolumeAttachScenarioOldVersion-1377087450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bd7bce5-ccb5-4ff9-be78-2d67e5bb09af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:37:06 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-c18db075-dd3e-46f8-8d1d-1f58af1753b2 tempest-TestServerVolumeAttachScenarioOldVersion-1377087450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bd7bce5-ccb5-4ff9-be78-2d67e5bb09af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:37:06 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-c18db075-dd3e-46f8-8d1d-1f58af1753b2 tempest-TestServerVolumeAttachScenarioOldVersion-1377087450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7752ed6-2c40-4edf-9b9d-93a9c6d3eb24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:37:06 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-c18db075-dd3e-46f8-8d1d-1f58af1753b2 tempest-TestServerVolumeAttachScenarioOldVersion-1377087450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7752ed6-2c40-4edf-9b9d-93a9c6d3eb24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '020bcbc2-4e49-474f-8c0b-5de4fc5a8a40', 'volume_name': 'volume-020bcbc2-4e49-474f-8c0b-5de4fc5a8a40', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:37:06 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-c18db075-dd3e-46f8-8d1d-1f58af1753b2 tempest-TestServerVolumeAttachScenarioOldVersion-1377087450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa28b515-e03c-458b-9cdb-3cb1c126252e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:37:06 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-c18db075-dd3e-46f8-8d1d-1f58af1753b2 tempest-TestServerVolumeAttachScenarioOldVersion-1377087450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa28b515-e03c-458b-9cdb-3cb1c126252e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:37:06 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-c18db075-dd3e-46f8-8d1d-1f58af1753b2 tempest-TestServerVolumeAttachScenarioOldVersion-1377087450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ee9b9a2-9536-48e0-9a43-75f09eaf9bfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:37:06 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-c18db075-dd3e-46f8-8d1d-1f58af1753b2 tempest-TestServerVolumeAttachScenarioOldVersion-1377087450 None] Volume 020bcbc2-4e49-474f-8c0b-5de4fc5a8a40: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-020bcbc2-4e49-474f-8c0b-5de4fc5a8a40', 'volume_size': 1}
Nov 03 18:37:06 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-c18db075-dd3e-46f8-8d1d-1f58af1753b2 tempest-TestServerVolumeAttachScenarioOldVersion-1377087450 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:37:06 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-c18db075-dd3e-46f8-8d1d-1f58af1753b2 tempest-TestServerVolumeAttachScenarioOldVersion-1377087450 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:37:06 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-c18db075-dd3e-46f8-8d1d-1f58af1753b2 tempest-TestServerVolumeAttachScenarioOldVersion-1377087450 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:37:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-2079855833',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=020bcbc2-4e49-474f-8c0b-5de4fc5a8a40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c40be9d538c45f8b06b16b8f81380fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:37:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:37:06Z,use_quota=True,user_id='81b4ab06e5244652a588e75f88ea061e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:37:06 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-c18db075-dd3e-46f8-8d1d-1f58af1753b2 tempest-TestServerVolumeAttachScenarioOldVersion-1377087450 None] Creating volume 020bcbc2-4e49-474f-8c0b-5de4fc5a8a40 {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:37:06 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-c18db075-dd3e-46f8-8d1d-1f58af1753b2 tempest-TestServerVolumeAttachScenarioOldVersion-1377087450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:37:06 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-c18db075-dd3e-46f8-8d1d-1f58af1753b2 tempest-TestServerVolumeAttachScenarioOldVersion-1377087450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:37:06 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-c18db075-dd3e-46f8-8d1d-1f58af1753b2 tempest-TestServerVolumeAttachScenarioOldVersion-1377087450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:37:06 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-c18db075-dd3e-46f8-8d1d-1f58af1753b2 tempest-TestServerVolumeAttachScenarioOldVersion-1377087450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:37:06 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-c18db075-dd3e-46f8-8d1d-1f58af1753b2 tempest-TestServerVolumeAttachScenarioOldVersion-1377087450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:37:06 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-c18db075-dd3e-46f8-8d1d-1f58af1753b2 tempest-TestServerVolumeAttachScenarioOldVersion-1377087450 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:37:06 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-c18db075-dd3e-46f8-8d1d-1f58af1753b2 tempest-TestServerVolumeAttachScenarioOldVersion-1377087450 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:37:06 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-c18db075-dd3e-46f8-8d1d-1f58af1753b2 tempest-TestServerVolumeAttachScenarioOldVersion-1377087450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-020bcbc2-4e49-474f-8c0b-5de4fc5a8a40 1073741824 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:37:06 devstack sudo[102749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-020bcbc2-4e49-474f-8c0b-5de4fc5a8a40 1073741824
Nov 03 18:37:06 devstack sudo[102749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:37:06 devstack sudo[102749]: pam_unix(sudo:session): session closed for user root
Nov 03 18:37:06 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-c18db075-dd3e-46f8-8d1d-1f58af1753b2 tempest-TestServerVolumeAttachScenarioOldVersion-1377087450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-020bcbc2-4e49-474f-8c0b-5de4fc5a8a40 1073741824" returned: 0 in 0.467s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:37:06 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-c18db075-dd3e-46f8-8d1d-1f58af1753b2 tempest-TestServerVolumeAttachScenarioOldVersion-1377087450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-020bcbc2-4e49-474f-8c0b-5de4fc5a8a40 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:37:06 devstack sudo[102755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-020bcbc2-4e49-474f-8c0b-5de4fc5a8a40
Nov 03 18:37:06 devstack sudo[102755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:37:06 devstack sudo[102755]: pam_unix(sudo:session): session closed for user root
Nov 03 18:37:06 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-c18db075-dd3e-46f8-8d1d-1f58af1753b2 tempest-TestServerVolumeAttachScenarioOldVersion-1377087450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-020bcbc2-4e49-474f-8c0b-5de4fc5a8a40" returned: 0 in 0.241s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:37:06 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-c18db075-dd3e-46f8-8d1d-1f58af1753b2 tempest-TestServerVolumeAttachScenarioOldVersion-1377087450 None] <== create_volume: return (757ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:37:06 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-c18db075-dd3e-46f8-8d1d-1f58af1753b2 tempest-TestServerVolumeAttachScenarioOldVersion-1377087450 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.759s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:37:06 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-c18db075-dd3e-46f8-8d1d-1f58af1753b2 tempest-TestServerVolumeAttachScenarioOldVersion-1377087450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ee9b9a2-9536-48e0-9a43-75f09eaf9bfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-020bcbc2-4e49-474f-8c0b-5de4fc5a8a40', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:37:06 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-c18db075-dd3e-46f8-8d1d-1f58af1753b2 tempest-TestServerVolumeAttachScenarioOldVersion-1377087450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b403975-be9b-4ddd-8d1e-21cce0670431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:37:06 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-c18db075-dd3e-46f8-8d1d-1f58af1753b2 tempest-TestServerVolumeAttachScenarioOldVersion-1377087450 None] Volume volume-020bcbc2-4e49-474f-8c0b-5de4fc5a8a40 (020bcbc2-4e49-474f-8c0b-5de4fc5a8a40): created successfully
Nov 03 18:37:06 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-c18db075-dd3e-46f8-8d1d-1f58af1753b2 tempest-TestServerVolumeAttachScenarioOldVersion-1377087450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b403975-be9b-4ddd-8d1e-21cce0670431) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:37:06 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-c18db075-dd3e-46f8-8d1d-1f58af1753b2 tempest-TestServerVolumeAttachScenarioOldVersion-1377087450 None] Flow 'volume_create_manager' (3df90936-881e-4ee8-8987-174533db93ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:37:06 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-c18db075-dd3e-46f8-8d1d-1f58af1753b2 tempest-TestServerVolumeAttachScenarioOldVersion-1377087450 None] Created volume successfully.
Nov 03 18:37:07 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [req-e5568e1d-fbb7-4cbe-8611-93269e73cae2 req-e9238afc-e602-4c45-864f-dcd750115445 tempest-TestServerVolumeAttachScenarioOldVersion-1377087450 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:37:07 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [req-e5568e1d-fbb7-4cbe-8611-93269e73cae2 req-e9238afc-e602-4c45-864f-dcd750115445 tempest-TestServerVolumeAttachScenarioOldVersion-1377087450 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:37:07 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [req-e5568e1d-fbb7-4cbe-8611-93269e73cae2 req-e9238afc-e602-4c45-864f-dcd750115445 tempest-TestServerVolumeAttachScenarioOldVersion-1377087450 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:37:08 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [req-e5568e1d-fbb7-4cbe-8611-93269e73cae2 req-e9238afc-e602-4c45-864f-dcd750115445 tempest-TestServerVolumeAttachScenarioOldVersion-1377087450 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c', 'name': 'volume-020bcbc2-4e49-474f-8c0b-5de4fc5a8a40', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '322f7399-ac33-4cc3-b8d1-fb3521f0b3df', 'enforce_multipath': True} {{(pid=86120) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 03 18:37:08 devstack cinder-volume[86120]: INFO cinder.volume.manager [req-e5568e1d-fbb7-4cbe-8611-93269e73cae2 req-e9238afc-e602-4c45-864f-dcd750115445 tempest-TestServerVolumeAttachScenarioOldVersion-1377087450 None] attachment_update completed successfully.
Nov 03 18:37:09 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-38b2f682-8d1c-40b3-aed2-3ba9e84e7c49 tempest-VolumesCloneTest-1384325336 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:37:09 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-38b2f682-8d1c-40b3-aed2-3ba9e84e7c49 tempest-VolumesCloneTest-1384325336 None] Flow 'volume_create_manager' (dda0c745-db63-4a65-98e5-60fe0981bb48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:37:09 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-38b2f682-8d1c-40b3-aed2-3ba9e84e7c49 tempest-VolumesCloneTest-1384325336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7c05574-dee6-453a-9984-2e961122e90a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:37:09 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-38b2f682-8d1c-40b3-aed2-3ba9e84e7c49 tempest-VolumesCloneTest-1384325336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7c05574-dee6-453a-9984-2e961122e90a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:37:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1468981158',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7f3d747-b0ad-4b18-be47-f5e3cba78484,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a61db786bf9430fb19f9fbb82e6ff54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:37:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:37:10Z,use_quota=True,user_id='ec4d32d313384299b63a62f640a4cea7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:37:09 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-38b2f682-8d1c-40b3-aed2-3ba9e84e7c49 tempest-VolumesCloneTest-1384325336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (401b2e1d-edcd-467a-8b4b-48e575728c39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:37:10 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-38b2f682-8d1c-40b3-aed2-3ba9e84e7c49 tempest-VolumesCloneTest-1384325336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (401b2e1d-edcd-467a-8b4b-48e575728c39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:37:10 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-38b2f682-8d1c-40b3-aed2-3ba9e84e7c49 tempest-VolumesCloneTest-1384325336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (160b969e-ef83-43c9-a811-46fb56f5b753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:37:10 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-38b2f682-8d1c-40b3-aed2-3ba9e84e7c49 tempest-VolumesCloneTest-1384325336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (160b969e-ef83-43c9-a811-46fb56f5b753) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7f3d747-b0ad-4b18-be47-f5e3cba78484', 'volume_name': 'volume-c7f3d747-b0ad-4b18-be47-f5e3cba78484', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:37:10 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-38b2f682-8d1c-40b3-aed2-3ba9e84e7c49 tempest-VolumesCloneTest-1384325336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (619388d6-fcdc-42a9-ae6b-71f30f55a759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:37:10 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-38b2f682-8d1c-40b3-aed2-3ba9e84e7c49 tempest-VolumesCloneTest-1384325336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (619388d6-fcdc-42a9-ae6b-71f30f55a759) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:37:10 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-38b2f682-8d1c-40b3-aed2-3ba9e84e7c49 tempest-VolumesCloneTest-1384325336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (246631b2-24c5-4b40-845a-bcd1ef46ae38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:37:10 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-38b2f682-8d1c-40b3-aed2-3ba9e84e7c49 tempest-VolumesCloneTest-1384325336 None] Volume c7f3d747-b0ad-4b18-be47-f5e3cba78484: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7f3d747-b0ad-4b18-be47-f5e3cba78484', 'volume_size': 1}
Nov 03 18:37:10 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-38b2f682-8d1c-40b3-aed2-3ba9e84e7c49 tempest-VolumesCloneTest-1384325336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:37:10 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-38b2f682-8d1c-40b3-aed2-3ba9e84e7c49 tempest-VolumesCloneTest-1384325336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:37:10 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-38b2f682-8d1c-40b3-aed2-3ba9e84e7c49 tempest-VolumesCloneTest-1384325336 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:37:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1468981158',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7f3d747-b0ad-4b18-be47-f5e3cba78484,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a61db786bf9430fb19f9fbb82e6ff54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:37:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:37:10Z,use_quota=True,user_id='ec4d32d313384299b63a62f640a4cea7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:37:10 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-38b2f682-8d1c-40b3-aed2-3ba9e84e7c49 tempest-VolumesCloneTest-1384325336 None] Creating volume c7f3d747-b0ad-4b18-be47-f5e3cba78484 {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:37:10 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-38b2f682-8d1c-40b3-aed2-3ba9e84e7c49 tempest-VolumesCloneTest-1384325336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:37:10 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-38b2f682-8d1c-40b3-aed2-3ba9e84e7c49 tempest-VolumesCloneTest-1384325336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:37:10 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-38b2f682-8d1c-40b3-aed2-3ba9e84e7c49 tempest-VolumesCloneTest-1384325336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:37:10 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-38b2f682-8d1c-40b3-aed2-3ba9e84e7c49 tempest-VolumesCloneTest-1384325336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:37:10 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-38b2f682-8d1c-40b3-aed2-3ba9e84e7c49 tempest-VolumesCloneTest-1384325336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:37:10 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-38b2f682-8d1c-40b3-aed2-3ba9e84e7c49 tempest-VolumesCloneTest-1384325336 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:37:10 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-38b2f682-8d1c-40b3-aed2-3ba9e84e7c49 tempest-VolumesCloneTest-1384325336 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:37:10 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-38b2f682-8d1c-40b3-aed2-3ba9e84e7c49 tempest-VolumesCloneTest-1384325336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-c7f3d747-b0ad-4b18-be47-f5e3cba78484 1073741824 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:37:10 devstack sudo[103187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-c7f3d747-b0ad-4b18-be47-f5e3cba78484 1073741824
Nov 03 18:37:10 devstack sudo[103187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:37:10 devstack sudo[103187]: pam_unix(sudo:session): session closed for user root
Nov 03 18:37:10 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-38b2f682-8d1c-40b3-aed2-3ba9e84e7c49 tempest-VolumesCloneTest-1384325336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-c7f3d747-b0ad-4b18-be47-f5e3cba78484 1073741824" returned: 0 in 0.459s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:37:10 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-38b2f682-8d1c-40b3-aed2-3ba9e84e7c49 tempest-VolumesCloneTest-1384325336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-c7f3d747-b0ad-4b18-be47-f5e3cba78484 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:37:10 devstack sudo[103193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-c7f3d747-b0ad-4b18-be47-f5e3cba78484
Nov 03 18:37:10 devstack sudo[103193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:37:10 devstack sudo[103193]: pam_unix(sudo:session): session closed for user root
Nov 03 18:37:10 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-38b2f682-8d1c-40b3-aed2-3ba9e84e7c49 tempest-VolumesCloneTest-1384325336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-c7f3d747-b0ad-4b18-be47-f5e3cba78484" returned: 0 in 0.254s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:37:10 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-38b2f682-8d1c-40b3-aed2-3ba9e84e7c49 tempest-VolumesCloneTest-1384325336 None] <== create_volume: return (757ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:37:10 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-38b2f682-8d1c-40b3-aed2-3ba9e84e7c49 tempest-VolumesCloneTest-1384325336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.759s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:37:10 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-38b2f682-8d1c-40b3-aed2-3ba9e84e7c49 tempest-VolumesCloneTest-1384325336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (246631b2-24c5-4b40-845a-bcd1ef46ae38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7f3d747-b0ad-4b18-be47-f5e3cba78484', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:37:10 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-38b2f682-8d1c-40b3-aed2-3ba9e84e7c49 tempest-VolumesCloneTest-1384325336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f24097f-2a4a-4854-8631-05a0d2659ad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:37:10 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-38b2f682-8d1c-40b3-aed2-3ba9e84e7c49 tempest-VolumesCloneTest-1384325336 None] Volume volume-c7f3d747-b0ad-4b18-be47-f5e3cba78484 (c7f3d747-b0ad-4b18-be47-f5e3cba78484): created successfully
Nov 03 18:37:10 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-38b2f682-8d1c-40b3-aed2-3ba9e84e7c49 tempest-VolumesCloneTest-1384325336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f24097f-2a4a-4854-8631-05a0d2659ad9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:37:10 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-38b2f682-8d1c-40b3-aed2-3ba9e84e7c49 tempest-VolumesCloneTest-1384325336 None] Flow 'volume_create_manager' (dda0c745-db63-4a65-98e5-60fe0981bb48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:37:10 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-38b2f682-8d1c-40b3-aed2-3ba9e84e7c49 tempest-VolumesCloneTest-1384325336 None] Created volume successfully.
Nov 03 18:37:11 devstack cinder-volume[86120]: INFO cinder.volume.manager [req-718d40a4-9212-4a5a-ae2f-11cb68242d37 req-3522a650-3099-40c8-af2f-4a8af0c57c00 tempest-TestServerVolumeAttachScenarioOldVersion-1377087450 None] Terminate volume connection completed successfully.
Nov 03 18:37:11 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [req-718d40a4-9212-4a5a-ae2f-11cb68242d37 req-3522a650-3099-40c8-af2f-4a8af0c57c00 tempest-TestServerVolumeAttachScenarioOldVersion-1377087450 None] Deleting attachment 322f7399-ac33-4cc3-b8d1-fb3521f0b3df. {{(pid=86120) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 03 18:37:11 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f5c66af-37f3-4593-b078-8f205231a5fc tempest-VolumesCloneTest-1384325336 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:37:11 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-5f5c66af-37f3-4593-b078-8f205231a5fc tempest-VolumesCloneTest-1384325336 None] Flow 'volume_create_manager' (b2118275-f3df-4a4d-80e5-f48fdacbcd99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:37:11 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-5f5c66af-37f3-4593-b078-8f205231a5fc tempest-VolumesCloneTest-1384325336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87cd1337-8c4f-4a8a-a3a8-478f7828edc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:37:11 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-5f5c66af-37f3-4593-b078-8f205231a5fc tempest-VolumesCloneTest-1384325336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87cd1337-8c4f-4a8a-a3a8-478f7828edc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:37:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-2146099900',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=813402a7-c32e-49e3-ac1c-a64107c834f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a61db786bf9430fb19f9fbb82e6ff54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:37:12Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=c7f3d747-b0ad-4b18-be47-f5e3cba78484,status='creating',terminated_at=None,updated_at=2026-11-03T17:37:12Z,use_quota=True,user_id='ec4d32d313384299b63a62f640a4cea7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:37:11 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-5f5c66af-37f3-4593-b078-8f205231a5fc tempest-VolumesCloneTest-1384325336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (954502f1-a281-4f7a-8914-b46467319b80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:37:11 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-5f5c66af-37f3-4593-b078-8f205231a5fc tempest-VolumesCloneTest-1384325336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (954502f1-a281-4f7a-8914-b46467319b80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:37:11 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-5f5c66af-37f3-4593-b078-8f205231a5fc tempest-VolumesCloneTest-1384325336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ce68812-e7ca-436c-9879-c445f47b6391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:37:11 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-5f5c66af-37f3-4593-b078-8f205231a5fc tempest-VolumesCloneTest-1384325336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ce68812-e7ca-436c-9879-c445f47b6391) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '813402a7-c32e-49e3-ac1c-a64107c834f3', 'volume_name': 'volume-813402a7-c32e-49e3-ac1c-a64107c834f3', 'volume_size': 2, 'source_volid': 'c7f3d747-b0ad-4b18-be47-f5e3cba78484', 'source_volstatus': 'available'}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:37:11 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-5f5c66af-37f3-4593-b078-8f205231a5fc tempest-VolumesCloneTest-1384325336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6723985-dc9e-46bb-8d65-538e7ab83765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:37:11 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-5f5c66af-37f3-4593-b078-8f205231a5fc tempest-VolumesCloneTest-1384325336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6723985-dc9e-46bb-8d65-538e7ab83765) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:37:11 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-5f5c66af-37f3-4593-b078-8f205231a5fc tempest-VolumesCloneTest-1384325336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e743ba6-cd91-4add-9e94-eb796218bf9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:37:11 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-5f5c66af-37f3-4593-b078-8f205231a5fc tempest-VolumesCloneTest-1384325336 None] Volume 813402a7-c32e-49e3-ac1c-a64107c834f3: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-813402a7-c32e-49e3-ac1c-a64107c834f3', 'volume_size': 2, 'source_volid': 'c7f3d747-b0ad-4b18-be47-f5e3cba78484', 'source_volstatus': 'available'}
Nov 03 18:37:11 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-5f5c66af-37f3-4593-b078-8f205231a5fc tempest-VolumesCloneTest-1384325336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:37:11 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-5f5c66af-37f3-4593-b078-8f205231a5fc tempest-VolumesCloneTest-1384325336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:37:11 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-5f5c66af-37f3-4593-b078-8f205231a5fc tempest-VolumesCloneTest-1384325336 None] Cloning volume c7f3d747-b0ad-4b18-be47-f5e3cba78484 to volume 813402a7-c32e-49e3-ac1c-a64107c834f3
Nov 03 18:37:11 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-5f5c66af-37f3-4593-b078-8f205231a5fc tempest-VolumesCloneTest-1384325336 None] Creating offline snapshot 9d7d8141-2a12-4266-9dce-233ceb7e90e4 of volume c7f3d747-b0ad-4b18-be47-f5e3cba78484 {{(pid=86120) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 18:37:11 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b2d1d09-a8ed-4de0-bf75-c393842c4657]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:37:11 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-5f5c66af-37f3-4593-b078-8f205231a5fc tempest-VolumesCloneTest-1384325336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-c7f3d747-b0ad-4b18-be47-f5e3cba78484 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:37:11 devstack sudo[103224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-c7f3d747-b0ad-4b18-be47-f5e3cba78484
Nov 03 18:37:11 devstack sudo[103224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:37:12 devstack sudo[103224]: pam_unix(sudo:session): session closed for user root
Nov 03 18:37:12 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-5f5c66af-37f3-4593-b078-8f205231a5fc tempest-VolumesCloneTest-1384325336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-c7f3d747-b0ad-4b18-be47-f5e3cba78484" returned: 0 in 0.375s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:37:12 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-5f5c66af-37f3-4593-b078-8f205231a5fc tempest-VolumesCloneTest-1384325336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-c7f3d747-b0ad-4b18-be47-f5e3cba78484,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-c7f3d747-b0ad-4b18-be47-f5e3cba78484.9d7d8141-2a12-4266-9dce-233ceb7e90e4 1G {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:37:12 devstack sudo[103229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-c7f3d747-b0ad-4b18-be47-f5e3cba78484,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-c7f3d747-b0ad-4b18-be47-f5e3cba78484.9d7d8141-2a12-4266-9dce-233ceb7e90e4 1G
Nov 03 18:37:12 devstack sudo[103229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:37:12 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-bb1c40f6-34a3-47b1-a4a2-75e7b344b887 tempest-TestServerVolumeAttachScenarioOldVersion-1377087450 None] Acquiring lock "cinder-020bcbc2-4e49-474f-8c0b-5de4fc5a8a40-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:37:12 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-bb1c40f6-34a3-47b1-a4a2-75e7b344b887 tempest-TestServerVolumeAttachScenarioOldVersion-1377087450 None] Lock "cinder-020bcbc2-4e49-474f-8c0b-5de4fc5a8a40-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:37:12 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-bb1c40f6-34a3-47b1-a4a2-75e7b344b887 tempest-TestServerVolumeAttachScenarioOldVersion-1377087450 None] Acquiring lock "cinder-quobyte-020bcbc2-4e49-474f-8c0b-5de4fc5a8a40" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:37:12 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-bb1c40f6-34a3-47b1-a4a2-75e7b344b887 tempest-TestServerVolumeAttachScenarioOldVersion-1377087450 None] Lock "cinder-quobyte-020bcbc2-4e49-474f-8c0b-5de4fc5a8a40" acquired by "delete_volume" :: waited 0.016s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:37:12 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[37cd352c-d663-4f6a-908c-9d55fd886354]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:37:12 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-bb1c40f6-34a3-47b1-a4a2-75e7b344b887 tempest-TestServerVolumeAttachScenarioOldVersion-1377087450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-020bcbc2-4e49-474f-8c0b-5de4fc5a8a40 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:37:12 devstack sudo[103234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-020bcbc2-4e49-474f-8c0b-5de4fc5a8a40
Nov 03 18:37:12 devstack sudo[103234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:37:12 devstack sudo[103229]: pam_unix(sudo:session): session closed for user root
Nov 03 18:37:12 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-5f5c66af-37f3-4593-b078-8f205231a5fc tempest-VolumesCloneTest-1384325336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-c7f3d747-b0ad-4b18-be47-f5e3cba78484,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-c7f3d747-b0ad-4b18-be47-f5e3cba78484.9d7d8141-2a12-4266-9dce-233ceb7e90e4 1G" returned: 0 in 0.445s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:37:12 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-5f5c66af-37f3-4593-b078-8f205231a5fc tempest-VolumesCloneTest-1384325336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7f3d747-b0ad-4b18-be47-f5e3cba78484 -F qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-c7f3d747-b0ad-4b18-be47-f5e3cba78484.9d7d8141-2a12-4266-9dce-233ceb7e90e4 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:37:12 devstack sudo[103238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7f3d747-b0ad-4b18-be47-f5e3cba78484 -F qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-c7f3d747-b0ad-4b18-be47-f5e3cba78484.9d7d8141-2a12-4266-9dce-233ceb7e90e4
Nov 03 18:37:12 devstack sudo[103238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:37:12 devstack sudo[103234]: pam_unix(sudo:session): session closed for user root
Nov 03 18:37:12 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-bb1c40f6-34a3-47b1-a4a2-75e7b344b887 tempest-TestServerVolumeAttachScenarioOldVersion-1377087450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-020bcbc2-4e49-474f-8c0b-5de4fc5a8a40" returned: 0 in 0.386s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:37:12 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-bb1c40f6-34a3-47b1-a4a2-75e7b344b887 tempest-TestServerVolumeAttachScenarioOldVersion-1377087450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-020bcbc2-4e49-474f-8c0b-5de4fc5a8a40 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:37:12 devstack sudo[103245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-020bcbc2-4e49-474f-8c0b-5de4fc5a8a40
Nov 03 18:37:12 devstack sudo[103245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:37:12 devstack sudo[103238]: pam_unix(sudo:session): session closed for user root
Nov 03 18:37:12 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-5f5c66af-37f3-4593-b078-8f205231a5fc tempest-VolumesCloneTest-1384325336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7f3d747-b0ad-4b18-be47-f5e3cba78484 -F qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-c7f3d747-b0ad-4b18-be47-f5e3cba78484.9d7d8141-2a12-4266-9dce-233ceb7e90e4" returned: 0 in 0.314s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:37:12 devstack cinder-volume[86120]: WARNING cinder.volume.drivers.remotefs [None req-5f5c66af-37f3-4593-b078-8f205231a5fc tempest-VolumesCloneTest-1384325336 None] /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-c7f3d747-b0ad-4b18-be47-f5e3cba78484.9d7d8141-2a12-4266-9dce-233ceb7e90e4 is being set with open permissions: ugo+rw
Nov 03 18:37:12 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-5f5c66af-37f3-4593-b078-8f205231a5fc tempest-VolumesCloneTest-1384325336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-c7f3d747-b0ad-4b18-be47-f5e3cba78484.9d7d8141-2a12-4266-9dce-233ceb7e90e4 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:37:12 devstack sudo[103248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-c7f3d747-b0ad-4b18-be47-f5e3cba78484.9d7d8141-2a12-4266-9dce-233ceb7e90e4
Nov 03 18:37:12 devstack sudo[103248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:37:13 devstack sudo[103245]: pam_unix(sudo:session): session closed for user root
Nov 03 18:37:13 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-bb1c40f6-34a3-47b1-a4a2-75e7b344b887 tempest-TestServerVolumeAttachScenarioOldVersion-1377087450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-020bcbc2-4e49-474f-8c0b-5de4fc5a8a40" returned: 0 in 0.244s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:37:13 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-bb1c40f6-34a3-47b1-a4a2-75e7b344b887 tempest-TestServerVolumeAttachScenarioOldVersion-1377087450 None] Lock "cinder-quobyte-020bcbc2-4e49-474f-8c0b-5de4fc5a8a40" released by "delete_volume" :: held 0.679s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:37:13 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-bb1c40f6-34a3-47b1-a4a2-75e7b344b887 tempest-TestServerVolumeAttachScenarioOldVersion-1377087450 None] Created reservations ['5a2d102c-3700-4522-a3c6-8d6a5ce4930d', 'd09b345a-1cfd-47b3-9dd8-cfccba5c4f2f', '8b7e7362-a5f3-4142-8f9b-4a61abb265c5', 'eb26e0da-01fa-4d85-8659-1612486a8f52'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:37:13 devstack sudo[103248]: pam_unix(sudo:session): session closed for user root
Nov 03 18:37:13 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-5f5c66af-37f3-4593-b078-8f205231a5fc tempest-VolumesCloneTest-1384325336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-c7f3d747-b0ad-4b18-be47-f5e3cba78484.9d7d8141-2a12-4266-9dce-233ceb7e90e4" returned: 0 in 0.270s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:37:13 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-bb1c40f6-34a3-47b1-a4a2-75e7b344b887 tempest-TestServerVolumeAttachScenarioOldVersion-1377087450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:37:13 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-bb1c40f6-34a3-47b1-a4a2-75e7b344b887 tempest-TestServerVolumeAttachScenarioOldVersion-1377087450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:37:13 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-bb1c40f6-34a3-47b1-a4a2-75e7b344b887 tempest-TestServerVolumeAttachScenarioOldVersion-1377087450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:37:13 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-bb1c40f6-34a3-47b1-a4a2-75e7b344b887 tempest-TestServerVolumeAttachScenarioOldVersion-1377087450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:37:13 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-bb1c40f6-34a3-47b1-a4a2-75e7b344b887 tempest-TestServerVolumeAttachScenarioOldVersion-1377087450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:37:13 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-bb1c40f6-34a3-47b1-a4a2-75e7b344b887 tempest-TestServerVolumeAttachScenarioOldVersion-1377087450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:37:13 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-5f5c66af-37f3-4593-b078-8f205231a5fc tempest-VolumesCloneTest-1384325336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-c7f3d747-b0ad-4b18-be47-f5e3cba78484.info {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:37:13 devstack sudo[103252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:37:13 devstack sudo[103252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:37:13 devstack sudo[103254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-c7f3d747-b0ad-4b18-be47-f5e3cba78484.info
Nov 03 18:37:13 devstack sudo[103254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:37:13 devstack sudo[103252]: pam_unix(sudo:session): session closed for user root
Nov 03 18:37:13 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-bb1c40f6-34a3-47b1-a4a2-75e7b344b887 tempest-TestServerVolumeAttachScenarioOldVersion-1377087450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.268s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:37:13 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-bb1c40f6-34a3-47b1-a4a2-75e7b344b887 tempest-TestServerVolumeAttachScenarioOldVersion-1377087450 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:37:13 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-bb1c40f6-34a3-47b1-a4a2-75e7b344b887 tempest-TestServerVolumeAttachScenarioOldVersion-1377087450 None] Deleted volume successfully.
Nov 03 18:37:13 devstack sudo[103254]: pam_unix(sudo:session): session closed for user root
Nov 03 18:37:13 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-bb1c40f6-34a3-47b1-a4a2-75e7b344b887 tempest-TestServerVolumeAttachScenarioOldVersion-1377087450 None] Lock "cinder-020bcbc2-4e49-474f-8c0b-5de4fc5a8a40-delete_volume" released by "delete_volume" :: held 1.173s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:37:13 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-5f5c66af-37f3-4593-b078-8f205231a5fc tempest-VolumesCloneTest-1384325336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-c7f3d747-b0ad-4b18-be47-f5e3cba78484.info" returned: 0 in 0.292s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:37:13 devstack cinder-volume[86120]: WARNING cinder.volume.drivers.remotefs [None req-5f5c66af-37f3-4593-b078-8f205231a5fc tempest-VolumesCloneTest-1384325336 None] /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-c7f3d747-b0ad-4b18-be47-f5e3cba78484.info is being set with open permissions: ugo+rw
Nov 03 18:37:13 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-5f5c66af-37f3-4593-b078-8f205231a5fc tempest-VolumesCloneTest-1384325336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-c7f3d747-b0ad-4b18-be47-f5e3cba78484.info {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:37:13 devstack sudo[103258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-c7f3d747-b0ad-4b18-be47-f5e3cba78484.info
Nov 03 18:37:13 devstack sudo[103258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:37:13 devstack sudo[103258]: pam_unix(sudo:session): session closed for user root
Nov 03 18:37:13 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-5f5c66af-37f3-4593-b078-8f205231a5fc tempest-VolumesCloneTest-1384325336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-c7f3d747-b0ad-4b18-be47-f5e3cba78484.info" returned: 0 in 0.268s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:37:13 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-5f5c66af-37f3-4593-b078-8f205231a5fc tempest-VolumesCloneTest-1384325336 None] Acquiring lock "cinder-quobyte-813402a7-c32e-49e3-ac1c-a64107c834f3" by "_copy_volume_from_snapshot" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:37:13 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-5f5c66af-37f3-4593-b078-8f205231a5fc tempest-VolumesCloneTest-1384325336 None] Lock "cinder-quobyte-813402a7-c32e-49e3-ac1c-a64107c834f3" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:37:13 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-5f5c66af-37f3-4593-b078-8f205231a5fc tempest-VolumesCloneTest-1384325336 None] snapshot: 9d7d8141-2a12-4266-9dce-233ceb7e90e4, volume: 813402a7-c32e-49e3-ac1c-a64107c834f3,  {{(pid=86120) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 03 18:37:13 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-5f5c66af-37f3-4593-b078-8f205231a5fc tempest-VolumesCloneTest-1384325336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:37:13 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-5f5c66af-37f3-4593-b078-8f205231a5fc tempest-VolumesCloneTest-1384325336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:37:13 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-5f5c66af-37f3-4593-b078-8f205231a5fc tempest-VolumesCloneTest-1384325336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:37:13 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-5f5c66af-37f3-4593-b078-8f205231a5fc tempest-VolumesCloneTest-1384325336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:37:13 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-5f5c66af-37f3-4593-b078-8f205231a5fc tempest-VolumesCloneTest-1384325336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:37:13 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[05b031f7-05a7-4e94-8218-ced1b1cdb3d8]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:37:13 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-5f5c66af-37f3-4593-b078-8f205231a5fc tempest-VolumesCloneTest-1384325336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-c7f3d747-b0ad-4b18-be47-f5e3cba78484.9d7d8141-2a12-4266-9dce-233ceb7e90e4 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:37:13 devstack sudo[103261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-c7f3d747-b0ad-4b18-be47-f5e3cba78484.9d7d8141-2a12-4266-9dce-233ceb7e90e4
Nov 03 18:37:13 devstack sudo[103261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:37:14 devstack sudo[103261]: pam_unix(sudo:session): session closed for user root
Nov 03 18:37:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-5f5c66af-37f3-4593-b078-8f205231a5fc tempest-VolumesCloneTest-1384325336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-c7f3d747-b0ad-4b18-be47-f5e3cba78484.9d7d8141-2a12-4266-9dce-233ceb7e90e4" returned: 0 in 0.468s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:37:14 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-5f5c66af-37f3-4593-b078-8f205231a5fc tempest-VolumesCloneTest-1384325336 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c7f3d747-b0ad-4b18-be47-f5e3cba78484(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86120) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 18:37:14 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[77429c00-f08a-4e8a-803a-fbe2aff28918]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:37:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-5f5c66af-37f3-4593-b078-8f205231a5fc tempest-VolumesCloneTest-1384325336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-c7f3d747-b0ad-4b18-be47-f5e3cba78484 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:37:14 devstack sudo[103289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-c7f3d747-b0ad-4b18-be47-f5e3cba78484
Nov 03 18:37:14 devstack sudo[103289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:37:14 devstack sudo[103289]: pam_unix(sudo:session): session closed for user root
Nov 03 18:37:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-5f5c66af-37f3-4593-b078-8f205231a5fc tempest-VolumesCloneTest-1384325336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-c7f3d747-b0ad-4b18-be47-f5e3cba78484" returned: 0 in 0.433s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:37:14 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-5f5c66af-37f3-4593-b078-8f205231a5fc tempest-VolumesCloneTest-1384325336 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-c7f3d747-b0ad-4b18-be47-f5e3cba78484 {{(pid=86120) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 03 18:37:14 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-5f5c66af-37f3-4593-b078-8f205231a5fc tempest-VolumesCloneTest-1384325336 None] Creating direct copy from snapshot {{(pid=86120) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 03 18:37:14 devstack cinder-volume[86120]: DEBUG cinder.utils [None req-5f5c66af-37f3-4593-b078-8f205231a5fc tempest-VolumesCloneTest-1384325336 None] Path /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-813402a7-c32e-49e3-ac1c-a64107c834f3 not found in is_blk_device check {{(pid=86120) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 03 18:37:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-5f5c66af-37f3-4593-b078-8f205231a5fc tempest-VolumesCloneTest-1384325336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-c7f3d747-b0ad-4b18-be47-f5e3cba78484 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-813402a7-c32e-49e3-ac1c-a64107c834f3 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:37:14 devstack sudo[103299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-c7f3d747-b0ad-4b18-be47-f5e3cba78484 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-813402a7-c32e-49e3-ac1c-a64107c834f3
Nov 03 18:37:14 devstack sudo[103299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:37:14 devstack cinder-volume[86120]: DEBUG oslo_service.periodic_task [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86120) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 18:37:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:37:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:37:14 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:37:14 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:37:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:37:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:37:14 devstack sudo[103302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:37:14 devstack sudo[103302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:37:15 devstack sudo[103302]: pam_unix(sudo:session): session closed for user root
Nov 03 18:37:15 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.373s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:37:15 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:37:15 devstack cinder-volume[86120]: DEBUG oslo_service.periodic_task [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Running periodic task VolumeManager._thread_info {{(pid=86120) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 18:37:15 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] thread count: 28 {{(pid=86120) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 03 18:37:15 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] thread info: [<_MainThread(MainThread, started 134747145822336)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134747033686336)>, <Thread(Thread-3 (stat_writer), started daemon 134747030828736)>, <Thread(Rabbit-heartbeat, started daemon 134747035433408)>, <Thread(Thread-5 (_runner), started daemon 134747029587392)>, <Thread(Thread-7 (_runner), started daemon 134747029784256)>, <Thread(fd_logger, started daemon 134747027909120)>, <Thread(privsep_reader, started daemon 134747027006592)>, <Thread(tpool_thread_0, started daemon 134747018950336)>, <Thread(tpool_thread_1, started daemon 134747010541248)>, <Thread(tpool_thread_2, started daemon 134747002132160)>, <Thread(tpool_thread_3, started daemon 134746993723072)>, <Thread(tpool_thread_4, started daemon 134746985313984)>, <Thread(tpool_thread_5, started daemon 134746976904896)>, <Thread(tpool_thread_6, started daemon 134746968495808)>, <Thread(tpool_thread_7, started daemon 134746960086720)>, <Thread(tpool_thread_8, started daemon 134746951677632)>, <Thread(tpool_thread_9, started daemon 134746943268544)>, <Thread(tpool_thread_10, started daemon 134746934859456)>, <Thread(tpool_thread_11, started daemon 134746926450368)>, <Thread(tpool_thread_12, started daemon 134746918041280)>, <Thread(tpool_thread_13, started daemon 134746909632192)>, <Thread(tpool_thread_14, started daemon 134746901223104)>, <Thread(tpool_thread_15, started daemon 134746892814016)>, <Thread(tpool_thread_16, started daemon 134746884404928)>, <Thread(tpool_thread_17, started daemon 134746875995840)>, <Thread(tpool_thread_18, started daemon 134746867586752)>, <Thread(tpool_thread_19, started daemon 134746859177664)>] {{(pid=86120) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 03 18:37:22 devstack sudo[103299]: pam_unix(sudo:session): session closed for user root
Nov 03 18:37:22 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-5f5c66af-37f3-4593-b078-8f205231a5fc tempest-VolumesCloneTest-1384325336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-c7f3d747-b0ad-4b18-be47-f5e3cba78484 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-813402a7-c32e-49e3-ac1c-a64107c834f3" returned: 0 in 7.214s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:37:22 devstack cinder-volume[86120]: DEBUG cinder.image.image_utils [None req-5f5c66af-37f3-4593-b078-8f205231a5fc tempest-VolumesCloneTest-1384325336 None] Image conversion details: src /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-c7f3d747-b0ad-4b18-be47-f5e3cba78484, size 1024.00 MB, duration 7.22 sec, destination /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-813402a7-c32e-49e3-ac1c-a64107c834f3 {{(pid=86120) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 03 18:37:22 devstack cinder-volume[86120]: INFO cinder.image.image_utils [None req-5f5c66af-37f3-4593-b078-8f205231a5fc tempest-VolumesCloneTest-1384325336 None] Converted 1024.00 MB image at 141.92 MB/s
Nov 03 18:37:22 devstack cinder-volume[86120]: WARNING cinder.volume.drivers.remotefs [None req-5f5c66af-37f3-4593-b078-8f205231a5fc tempest-VolumesCloneTest-1384325336 None] /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-813402a7-c32e-49e3-ac1c-a64107c834f3 is being set with open permissions: ugo+rw
Nov 03 18:37:22 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-5f5c66af-37f3-4593-b078-8f205231a5fc tempest-VolumesCloneTest-1384325336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-813402a7-c32e-49e3-ac1c-a64107c834f3 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:37:22 devstack sudo[103319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-813402a7-c32e-49e3-ac1c-a64107c834f3
Nov 03 18:37:22 devstack sudo[103319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:37:22 devstack sudo[103319]: pam_unix(sudo:session): session closed for user root
Nov 03 18:37:22 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-5f5c66af-37f3-4593-b078-8f205231a5fc tempest-VolumesCloneTest-1384325336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-813402a7-c32e-49e3-ac1c-a64107c834f3" returned: 0 in 0.264s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:37:22 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-5f5c66af-37f3-4593-b078-8f205231a5fc tempest-VolumesCloneTest-1384325336 None] Lock "cinder-quobyte-813402a7-c32e-49e3-ac1c-a64107c834f3" released by "_copy_volume_from_snapshot" :: held 8.480s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:37:22 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-5f5c66af-37f3-4593-b078-8f205231a5fc tempest-VolumesCloneTest-1384325336 None] Acquiring lock "cinder-quobyte-9d7d8141-2a12-4266-9dce-233ceb7e90e4" by "_delete_snapshot" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:37:22 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-5f5c66af-37f3-4593-b078-8f205231a5fc tempest-VolumesCloneTest-1384325336 None] Lock "cinder-quobyte-9d7d8141-2a12-4266-9dce-233ceb7e90e4" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:37:22 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-5f5c66af-37f3-4593-b078-8f205231a5fc tempest-VolumesCloneTest-1384325336 None] Deleting offline snapshot 9d7d8141-2a12-4266-9dce-233ceb7e90e4 of volume c7f3d747-b0ad-4b18-be47-f5e3cba78484 {{(pid=86120) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 18:37:22 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-5f5c66af-37f3-4593-b078-8f205231a5fc tempest-VolumesCloneTest-1384325336 None] snapshot_file for this snap is: volume-c7f3d747-b0ad-4b18-be47-f5e3cba78484.9d7d8141-2a12-4266-9dce-233ceb7e90e4 {{(pid=86120) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 18:37:22 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d22983c-720f-4a86-967a-6a64d267eed8]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:37:22 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-5f5c66af-37f3-4593-b078-8f205231a5fc tempest-VolumesCloneTest-1384325336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-c7f3d747-b0ad-4b18-be47-f5e3cba78484.9d7d8141-2a12-4266-9dce-233ceb7e90e4 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:37:22 devstack sudo[103322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-c7f3d747-b0ad-4b18-be47-f5e3cba78484.9d7d8141-2a12-4266-9dce-233ceb7e90e4
Nov 03 18:37:22 devstack sudo[103322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:37:22 devstack sudo[103322]: pam_unix(sudo:session): session closed for user root
Nov 03 18:37:22 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-5f5c66af-37f3-4593-b078-8f205231a5fc tempest-VolumesCloneTest-1384325336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-c7f3d747-b0ad-4b18-be47-f5e3cba78484.9d7d8141-2a12-4266-9dce-233ceb7e90e4" returned: 0 in 0.354s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:37:22 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-5f5c66af-37f3-4593-b078-8f205231a5fc tempest-VolumesCloneTest-1384325336 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c7f3d747-b0ad-4b18-be47-f5e3cba78484(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86120) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 18:37:22 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[61429983-4335-4751-b1fa-2d720cd9e237]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:37:22 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-5f5c66af-37f3-4593-b078-8f205231a5fc tempest-VolumesCloneTest-1384325336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-c7f3d747-b0ad-4b18-be47-f5e3cba78484 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:37:22 devstack sudo[103327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-c7f3d747-b0ad-4b18-be47-f5e3cba78484
Nov 03 18:37:22 devstack sudo[103327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:37:23 devstack sudo[103327]: pam_unix(sudo:session): session closed for user root
Nov 03 18:37:23 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-5f5c66af-37f3-4593-b078-8f205231a5fc tempest-VolumesCloneTest-1384325336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-c7f3d747-b0ad-4b18-be47-f5e3cba78484" returned: 0 in 0.551s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:37:23 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-5f5c66af-37f3-4593-b078-8f205231a5fc tempest-VolumesCloneTest-1384325336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-c7f3d747-b0ad-4b18-be47-f5e3cba78484.9d7d8141-2a12-4266-9dce-233ceb7e90e4 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:37:23 devstack sudo[103333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-c7f3d747-b0ad-4b18-be47-f5e3cba78484.9d7d8141-2a12-4266-9dce-233ceb7e90e4
Nov 03 18:37:23 devstack sudo[103333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:37:23 devstack cinder-volume[86120]: DEBUG dbcounter [-] [86120] Writing DB stats cinder:SELECT=57,cinder:INSERT=17,cinder:UPDATE=57,cinder:DELETE=5 {{(pid=86120) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 18:37:23 devstack sudo[103333]: pam_unix(sudo:session): session closed for user root
Nov 03 18:37:23 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-5f5c66af-37f3-4593-b078-8f205231a5fc tempest-VolumesCloneTest-1384325336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-c7f3d747-b0ad-4b18-be47-f5e3cba78484.9d7d8141-2a12-4266-9dce-233ceb7e90e4" returned: 0 in 0.334s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:37:23 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-5f5c66af-37f3-4593-b078-8f205231a5fc tempest-VolumesCloneTest-1384325336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-c7f3d747-b0ad-4b18-be47-f5e3cba78484.9d7d8141-2a12-4266-9dce-233ceb7e90e4 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:37:23 devstack sudo[103339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-c7f3d747-b0ad-4b18-be47-f5e3cba78484.9d7d8141-2a12-4266-9dce-233ceb7e90e4
Nov 03 18:37:23 devstack sudo[103339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:37:23 devstack sudo[103339]: pam_unix(sudo:session): session closed for user root
Nov 03 18:37:23 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-5f5c66af-37f3-4593-b078-8f205231a5fc tempest-VolumesCloneTest-1384325336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-c7f3d747-b0ad-4b18-be47-f5e3cba78484.9d7d8141-2a12-4266-9dce-233ceb7e90e4" returned: 0 in 0.260s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:37:23 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-5f5c66af-37f3-4593-b078-8f205231a5fc tempest-VolumesCloneTest-1384325336 None] Lock "cinder-quobyte-9d7d8141-2a12-4266-9dce-233ceb7e90e4" released by "_delete_snapshot" :: held 1.602s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:37:23 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-5f5c66af-37f3-4593-b078-8f205231a5fc tempest-VolumesCloneTest-1384325336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.246s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:37:23 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-5f5c66af-37f3-4593-b078-8f205231a5fc tempest-VolumesCloneTest-1384325336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e743ba6-cd91-4add-9e94-eb796218bf9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-813402a7-c32e-49e3-ac1c-a64107c834f3', 'volume_size': 2, 'source_volid': 'c7f3d747-b0ad-4b18-be47-f5e3cba78484', 'source_volstatus': 'available'}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:37:24 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-5f5c66af-37f3-4593-b078-8f205231a5fc tempest-VolumesCloneTest-1384325336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e93c788-2edc-4fa5-a841-e3a3621582ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:37:24 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-5f5c66af-37f3-4593-b078-8f205231a5fc tempest-VolumesCloneTest-1384325336 None] Volume volume-813402a7-c32e-49e3-ac1c-a64107c834f3 (813402a7-c32e-49e3-ac1c-a64107c834f3): created successfully
Nov 03 18:37:24 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-5f5c66af-37f3-4593-b078-8f205231a5fc tempest-VolumesCloneTest-1384325336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e93c788-2edc-4fa5-a841-e3a3621582ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:37:24 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-5f5c66af-37f3-4593-b078-8f205231a5fc tempest-VolumesCloneTest-1384325336 None] Flow 'volume_create_manager' (b2118275-f3df-4a4d-80e5-f48fdacbcd99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:37:24 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-5f5c66af-37f3-4593-b078-8f205231a5fc tempest-VolumesCloneTest-1384325336 None] Created volume successfully.
Nov 03 18:37:24 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-a5344dc6-c0d2-48b4-af6b-b21d777cecec tempest-VolumesCloneTest-1384325336 None] Acquiring lock "cinder-813402a7-c32e-49e3-ac1c-a64107c834f3-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:37:24 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-a5344dc6-c0d2-48b4-af6b-b21d777cecec tempest-VolumesCloneTest-1384325336 None] Lock "cinder-813402a7-c32e-49e3-ac1c-a64107c834f3-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:37:24 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-a5344dc6-c0d2-48b4-af6b-b21d777cecec tempest-VolumesCloneTest-1384325336 None] Acquiring lock "cinder-quobyte-813402a7-c32e-49e3-ac1c-a64107c834f3" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:37:24 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-a5344dc6-c0d2-48b4-af6b-b21d777cecec tempest-VolumesCloneTest-1384325336 None] Lock "cinder-quobyte-813402a7-c32e-49e3-ac1c-a64107c834f3" acquired by "delete_volume" :: waited 0.017s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:37:24 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2e8931c-f79b-4af7-9741-8419a0a20357]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:37:24 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-a5344dc6-c0d2-48b4-af6b-b21d777cecec tempest-VolumesCloneTest-1384325336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-813402a7-c32e-49e3-ac1c-a64107c834f3 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:37:24 devstack sudo[103344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-813402a7-c32e-49e3-ac1c-a64107c834f3
Nov 03 18:37:24 devstack sudo[103344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:37:25 devstack sudo[103344]: pam_unix(sudo:session): session closed for user root
Nov 03 18:37:25 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-a5344dc6-c0d2-48b4-af6b-b21d777cecec tempest-VolumesCloneTest-1384325336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-813402a7-c32e-49e3-ac1c-a64107c834f3" returned: 0 in 0.366s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:37:25 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-a5344dc6-c0d2-48b4-af6b-b21d777cecec tempest-VolumesCloneTest-1384325336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-813402a7-c32e-49e3-ac1c-a64107c834f3 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:37:25 devstack sudo[103349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-813402a7-c32e-49e3-ac1c-a64107c834f3
Nov 03 18:37:25 devstack sudo[103349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:37:25 devstack sudo[103349]: pam_unix(sudo:session): session closed for user root
Nov 03 18:37:25 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-a5344dc6-c0d2-48b4-af6b-b21d777cecec tempest-VolumesCloneTest-1384325336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-813402a7-c32e-49e3-ac1c-a64107c834f3" returned: 0 in 0.264s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:37:25 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-a5344dc6-c0d2-48b4-af6b-b21d777cecec tempest-VolumesCloneTest-1384325336 None] Lock "cinder-quobyte-813402a7-c32e-49e3-ac1c-a64107c834f3" released by "delete_volume" :: held 0.673s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:37:25 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-a5344dc6-c0d2-48b4-af6b-b21d777cecec tempest-VolumesCloneTest-1384325336 None] Created reservations ['a009ade1-69ed-41d6-9b86-5b11d86ec375', '14d3cf4a-cffa-4f9d-8e75-e4dc221342f4', 'cc14280e-9ca1-4db8-9743-2f233dd2d591', 'afa0330f-33ae-4526-a728-b18b73ce298b'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:37:25 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-a5344dc6-c0d2-48b4-af6b-b21d777cecec tempest-VolumesCloneTest-1384325336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:37:25 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-a5344dc6-c0d2-48b4-af6b-b21d777cecec tempest-VolumesCloneTest-1384325336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:37:25 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-a5344dc6-c0d2-48b4-af6b-b21d777cecec tempest-VolumesCloneTest-1384325336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:37:25 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-a5344dc6-c0d2-48b4-af6b-b21d777cecec tempest-VolumesCloneTest-1384325336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:37:25 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-a5344dc6-c0d2-48b4-af6b-b21d777cecec tempest-VolumesCloneTest-1384325336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:37:25 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-a5344dc6-c0d2-48b4-af6b-b21d777cecec tempest-VolumesCloneTest-1384325336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:37:25 devstack sudo[103352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:37:25 devstack sudo[103352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:37:25 devstack sudo[103352]: pam_unix(sudo:session): session closed for user root
Nov 03 18:37:25 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-a5344dc6-c0d2-48b4-af6b-b21d777cecec tempest-VolumesCloneTest-1384325336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.260s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:37:25 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-a5344dc6-c0d2-48b4-af6b-b21d777cecec tempest-VolumesCloneTest-1384325336 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:37:25 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-a5344dc6-c0d2-48b4-af6b-b21d777cecec tempest-VolumesCloneTest-1384325336 None] Deleted volume successfully.
Nov 03 18:37:25 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-a5344dc6-c0d2-48b4-af6b-b21d777cecec tempest-VolumesCloneTest-1384325336 None] Lock "cinder-813402a7-c32e-49e3-ac1c-a64107c834f3-delete_volume" released by "delete_volume" :: held 1.146s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:37:25 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-7dea94ff-61f9-4afd-9e52-462a07b07038 tempest-VolumesCloneTest-1384325336 None] Acquiring lock "cinder-c7f3d747-b0ad-4b18-be47-f5e3cba78484-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:37:25 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-7dea94ff-61f9-4afd-9e52-462a07b07038 tempest-VolumesCloneTest-1384325336 None] Lock "cinder-c7f3d747-b0ad-4b18-be47-f5e3cba78484-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:37:26 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-7dea94ff-61f9-4afd-9e52-462a07b07038 tempest-VolumesCloneTest-1384325336 None] Acquiring lock "cinder-quobyte-c7f3d747-b0ad-4b18-be47-f5e3cba78484" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:37:26 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-7dea94ff-61f9-4afd-9e52-462a07b07038 tempest-VolumesCloneTest-1384325336 None] Lock "cinder-quobyte-c7f3d747-b0ad-4b18-be47-f5e3cba78484" acquired by "delete_volume" :: waited 0.016s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:37:26 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f10a3db-0ec8-4302-ab10-722a976ab117]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:37:26 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-7dea94ff-61f9-4afd-9e52-462a07b07038 tempest-VolumesCloneTest-1384325336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-c7f3d747-b0ad-4b18-be47-f5e3cba78484 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:37:26 devstack sudo[103355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-c7f3d747-b0ad-4b18-be47-f5e3cba78484
Nov 03 18:37:26 devstack sudo[103355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:37:26 devstack sudo[103355]: pam_unix(sudo:session): session closed for user root
Nov 03 18:37:26 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-7dea94ff-61f9-4afd-9e52-462a07b07038 tempest-VolumesCloneTest-1384325336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-c7f3d747-b0ad-4b18-be47-f5e3cba78484" returned: 0 in 0.418s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:37:26 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-7dea94ff-61f9-4afd-9e52-462a07b07038 tempest-VolumesCloneTest-1384325336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-c7f3d747-b0ad-4b18-be47-f5e3cba78484 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:37:26 devstack sudo[103360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-c7f3d747-b0ad-4b18-be47-f5e3cba78484
Nov 03 18:37:26 devstack sudo[103360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:37:26 devstack sudo[103360]: pam_unix(sudo:session): session closed for user root
Nov 03 18:37:26 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-7dea94ff-61f9-4afd-9e52-462a07b07038 tempest-VolumesCloneTest-1384325336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-c7f3d747-b0ad-4b18-be47-f5e3cba78484" returned: 0 in 0.244s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:37:26 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-7dea94ff-61f9-4afd-9e52-462a07b07038 tempest-VolumesCloneTest-1384325336 None] Lock "cinder-quobyte-c7f3d747-b0ad-4b18-be47-f5e3cba78484" released by "delete_volume" :: held 0.734s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:37:26 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-7dea94ff-61f9-4afd-9e52-462a07b07038 tempest-VolumesCloneTest-1384325336 None] Created reservations ['a54d68b6-0288-47fa-83fa-1298534a75cd', 'c158bfbd-94b8-44f1-99ca-8b2923416cf7', '8b96c1cf-7177-45d3-b208-d64b62e8834a', 'e4983d91-d344-4f39-9c57-6c823e5abe63'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:37:26 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-7dea94ff-61f9-4afd-9e52-462a07b07038 tempest-VolumesCloneTest-1384325336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:37:26 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-7dea94ff-61f9-4afd-9e52-462a07b07038 tempest-VolumesCloneTest-1384325336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:37:26 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-7dea94ff-61f9-4afd-9e52-462a07b07038 tempest-VolumesCloneTest-1384325336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:37:26 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-7dea94ff-61f9-4afd-9e52-462a07b07038 tempest-VolumesCloneTest-1384325336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:37:26 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-7dea94ff-61f9-4afd-9e52-462a07b07038 tempest-VolumesCloneTest-1384325336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:37:26 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-7dea94ff-61f9-4afd-9e52-462a07b07038 tempest-VolumesCloneTest-1384325336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:37:26 devstack sudo[103363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:37:26 devstack sudo[103363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:37:27 devstack sudo[103363]: pam_unix(sudo:session): session closed for user root
Nov 03 18:37:27 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-7dea94ff-61f9-4afd-9e52-462a07b07038 tempest-VolumesCloneTest-1384325336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.325s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:37:27 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-7dea94ff-61f9-4afd-9e52-462a07b07038 tempest-VolumesCloneTest-1384325336 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:37:27 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-7dea94ff-61f9-4afd-9e52-462a07b07038 tempest-VolumesCloneTest-1384325336 None] Deleted volume successfully.
Nov 03 18:37:27 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-7dea94ff-61f9-4afd-9e52-462a07b07038 tempest-VolumesCloneTest-1384325336 None] Lock "cinder-c7f3d747-b0ad-4b18-be47-f5e3cba78484-delete_volume" released by "delete_volume" :: held 1.269s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:37:31 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-f86d3a9a-f293-44f9-b911-faa012af782a tempest-VolumesCloneNegativeTest-1788564915 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:37:31 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-f86d3a9a-f293-44f9-b911-faa012af782a tempest-VolumesCloneNegativeTest-1788564915 None] Flow 'volume_create_manager' (70c5ec6f-a0ba-4350-9985-6dc7b4a7122f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:37:31 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-f86d3a9a-f293-44f9-b911-faa012af782a tempest-VolumesCloneNegativeTest-1788564915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (704bc93e-a382-468f-926b-e165c5ee5b49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:37:31 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-f86d3a9a-f293-44f9-b911-faa012af782a tempest-VolumesCloneNegativeTest-1788564915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (704bc93e-a382-468f-926b-e165c5ee5b49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:37:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-32234515',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2fc0b2c-0d02-42a9-a7da-cb5a996b782e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='217b3e5024b5440dbfa45da01d86145f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:37:31Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:37:31Z,use_quota=True,user_id='352d82a51d7d407897c47f44d440abf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:37:31 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-f86d3a9a-f293-44f9-b911-faa012af782a tempest-VolumesCloneNegativeTest-1788564915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7986b7cc-953c-4fd0-a352-6bd7b0f7a3b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:37:31 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-f86d3a9a-f293-44f9-b911-faa012af782a tempest-VolumesCloneNegativeTest-1788564915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7986b7cc-953c-4fd0-a352-6bd7b0f7a3b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:37:31 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-f86d3a9a-f293-44f9-b911-faa012af782a tempest-VolumesCloneNegativeTest-1788564915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac132ec8-0f71-4acd-8ebd-b1ad5f899224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:37:31 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-f86d3a9a-f293-44f9-b911-faa012af782a tempest-VolumesCloneNegativeTest-1788564915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac132ec8-0f71-4acd-8ebd-b1ad5f899224) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2fc0b2c-0d02-42a9-a7da-cb5a996b782e', 'volume_name': 'volume-c2fc0b2c-0d02-42a9-a7da-cb5a996b782e', 'volume_size': 2}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:37:31 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-f86d3a9a-f293-44f9-b911-faa012af782a tempest-VolumesCloneNegativeTest-1788564915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20023440-b186-43b2-a14d-c40fab07947d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:37:31 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-f86d3a9a-f293-44f9-b911-faa012af782a tempest-VolumesCloneNegativeTest-1788564915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20023440-b186-43b2-a14d-c40fab07947d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:37:31 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-f86d3a9a-f293-44f9-b911-faa012af782a tempest-VolumesCloneNegativeTest-1788564915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (681994f5-5338-4ec4-b109-13b992680504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:37:31 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-f86d3a9a-f293-44f9-b911-faa012af782a tempest-VolumesCloneNegativeTest-1788564915 None] Volume c2fc0b2c-0d02-42a9-a7da-cb5a996b782e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2fc0b2c-0d02-42a9-a7da-cb5a996b782e', 'volume_size': 2}
Nov 03 18:37:31 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-f86d3a9a-f293-44f9-b911-faa012af782a tempest-VolumesCloneNegativeTest-1788564915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:37:31 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-f86d3a9a-f293-44f9-b911-faa012af782a tempest-VolumesCloneNegativeTest-1788564915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:37:31 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-f86d3a9a-f293-44f9-b911-faa012af782a tempest-VolumesCloneNegativeTest-1788564915 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:37:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-32234515',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2fc0b2c-0d02-42a9-a7da-cb5a996b782e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='217b3e5024b5440dbfa45da01d86145f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:37:31Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:37:31Z,use_quota=True,user_id='352d82a51d7d407897c47f44d440abf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:37:31 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-f86d3a9a-f293-44f9-b911-faa012af782a tempest-VolumesCloneNegativeTest-1788564915 None] Creating volume c2fc0b2c-0d02-42a9-a7da-cb5a996b782e {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:37:31 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-f86d3a9a-f293-44f9-b911-faa012af782a tempest-VolumesCloneNegativeTest-1788564915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:37:31 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-f86d3a9a-f293-44f9-b911-faa012af782a tempest-VolumesCloneNegativeTest-1788564915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:37:31 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-f86d3a9a-f293-44f9-b911-faa012af782a tempest-VolumesCloneNegativeTest-1788564915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:37:31 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-f86d3a9a-f293-44f9-b911-faa012af782a tempest-VolumesCloneNegativeTest-1788564915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:37:31 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-f86d3a9a-f293-44f9-b911-faa012af782a tempest-VolumesCloneNegativeTest-1788564915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:37:31 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-f86d3a9a-f293-44f9-b911-faa012af782a tempest-VolumesCloneNegativeTest-1788564915 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:37:31 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-f86d3a9a-f293-44f9-b911-faa012af782a tempest-VolumesCloneNegativeTest-1788564915 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:37:31 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-f86d3a9a-f293-44f9-b911-faa012af782a tempest-VolumesCloneNegativeTest-1788564915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-c2fc0b2c-0d02-42a9-a7da-cb5a996b782e 2147483648 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:37:31 devstack sudo[103368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-c2fc0b2c-0d02-42a9-a7da-cb5a996b782e 2147483648
Nov 03 18:37:31 devstack sudo[103368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:37:31 devstack sudo[103368]: pam_unix(sudo:session): session closed for user root
Nov 03 18:37:31 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-f86d3a9a-f293-44f9-b911-faa012af782a tempest-VolumesCloneNegativeTest-1788564915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-c2fc0b2c-0d02-42a9-a7da-cb5a996b782e 2147483648" returned: 0 in 0.488s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:37:31 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-f86d3a9a-f293-44f9-b911-faa012af782a tempest-VolumesCloneNegativeTest-1788564915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-c2fc0b2c-0d02-42a9-a7da-cb5a996b782e {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:37:31 devstack sudo[103374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-c2fc0b2c-0d02-42a9-a7da-cb5a996b782e
Nov 03 18:37:31 devstack sudo[103374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:37:32 devstack sudo[103374]: pam_unix(sudo:session): session closed for user root
Nov 03 18:37:32 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-f86d3a9a-f293-44f9-b911-faa012af782a tempest-VolumesCloneNegativeTest-1788564915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-c2fc0b2c-0d02-42a9-a7da-cb5a996b782e" returned: 0 in 0.277s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:37:32 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-f86d3a9a-f293-44f9-b911-faa012af782a tempest-VolumesCloneNegativeTest-1788564915 None] <== create_volume: return (809ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:37:32 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-f86d3a9a-f293-44f9-b911-faa012af782a tempest-VolumesCloneNegativeTest-1788564915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.813s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:37:32 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-f86d3a9a-f293-44f9-b911-faa012af782a tempest-VolumesCloneNegativeTest-1788564915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (681994f5-5338-4ec4-b109-13b992680504) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2fc0b2c-0d02-42a9-a7da-cb5a996b782e', 'volume_size': 2}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:37:32 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-f86d3a9a-f293-44f9-b911-faa012af782a tempest-VolumesCloneNegativeTest-1788564915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92e95370-e0ee-4c94-be45-246e50ad2c38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:37:32 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-f86d3a9a-f293-44f9-b911-faa012af782a tempest-VolumesCloneNegativeTest-1788564915 None] Volume volume-c2fc0b2c-0d02-42a9-a7da-cb5a996b782e (c2fc0b2c-0d02-42a9-a7da-cb5a996b782e): created successfully
Nov 03 18:37:32 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-f86d3a9a-f293-44f9-b911-faa012af782a tempest-VolumesCloneNegativeTest-1788564915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92e95370-e0ee-4c94-be45-246e50ad2c38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:37:32 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-f86d3a9a-f293-44f9-b911-faa012af782a tempest-VolumesCloneNegativeTest-1788564915 None] Flow 'volume_create_manager' (70c5ec6f-a0ba-4350-9985-6dc7b4a7122f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:37:32 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-f86d3a9a-f293-44f9-b911-faa012af782a tempest-VolumesCloneNegativeTest-1788564915 None] Created volume successfully.
Nov 03 18:37:33 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-0e486e6e-7f97-440d-a806-b3b2efa76a0f tempest-VolumesCloneNegativeTest-1788564915 None] Acquiring lock "cinder-c2fc0b2c-0d02-42a9-a7da-cb5a996b782e-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:37:33 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-0e486e6e-7f97-440d-a806-b3b2efa76a0f tempest-VolumesCloneNegativeTest-1788564915 None] Lock "cinder-c2fc0b2c-0d02-42a9-a7da-cb5a996b782e-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:37:33 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-0e486e6e-7f97-440d-a806-b3b2efa76a0f tempest-VolumesCloneNegativeTest-1788564915 None] Acquiring lock "cinder-quobyte-c2fc0b2c-0d02-42a9-a7da-cb5a996b782e" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:37:33 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-0e486e6e-7f97-440d-a806-b3b2efa76a0f tempest-VolumesCloneNegativeTest-1788564915 None] Lock "cinder-quobyte-c2fc0b2c-0d02-42a9-a7da-cb5a996b782e" acquired by "delete_volume" :: waited 0.015s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:37:33 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[967d4db1-f58b-42e0-b4a4-9e22fa704c1f]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:37:33 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-0e486e6e-7f97-440d-a806-b3b2efa76a0f tempest-VolumesCloneNegativeTest-1788564915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-c2fc0b2c-0d02-42a9-a7da-cb5a996b782e {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:37:33 devstack sudo[103413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-c2fc0b2c-0d02-42a9-a7da-cb5a996b782e
Nov 03 18:37:33 devstack sudo[103413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:37:34 devstack sudo[103413]: pam_unix(sudo:session): session closed for user root
Nov 03 18:37:34 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-0e486e6e-7f97-440d-a806-b3b2efa76a0f tempest-VolumesCloneNegativeTest-1788564915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-c2fc0b2c-0d02-42a9-a7da-cb5a996b782e" returned: 0 in 0.385s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:37:34 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-0e486e6e-7f97-440d-a806-b3b2efa76a0f tempest-VolumesCloneNegativeTest-1788564915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-c2fc0b2c-0d02-42a9-a7da-cb5a996b782e {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:37:34 devstack sudo[103418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-c2fc0b2c-0d02-42a9-a7da-cb5a996b782e
Nov 03 18:37:34 devstack sudo[103418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:37:34 devstack sudo[103418]: pam_unix(sudo:session): session closed for user root
Nov 03 18:37:34 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-0e486e6e-7f97-440d-a806-b3b2efa76a0f tempest-VolumesCloneNegativeTest-1788564915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-c2fc0b2c-0d02-42a9-a7da-cb5a996b782e" returned: 0 in 0.273s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:37:34 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-0e486e6e-7f97-440d-a806-b3b2efa76a0f tempest-VolumesCloneNegativeTest-1788564915 None] Lock "cinder-quobyte-c2fc0b2c-0d02-42a9-a7da-cb5a996b782e" released by "delete_volume" :: held 0.740s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:37:34 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-0e486e6e-7f97-440d-a806-b3b2efa76a0f tempest-VolumesCloneNegativeTest-1788564915 None] Created reservations ['68b99e60-1f8c-4606-a648-8fcf8c0c40f6', 'a76fe340-7862-4abb-8f2d-da94f398abeb', '4dfbc033-0533-4f2b-9e23-4fcd4eca6e23', 'aeffc3e5-d79d-4f27-a3ad-081199b65fa3'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:37:34 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-0e486e6e-7f97-440d-a806-b3b2efa76a0f tempest-VolumesCloneNegativeTest-1788564915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:37:34 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-0e486e6e-7f97-440d-a806-b3b2efa76a0f tempest-VolumesCloneNegativeTest-1788564915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:37:34 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-0e486e6e-7f97-440d-a806-b3b2efa76a0f tempest-VolumesCloneNegativeTest-1788564915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:37:34 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-0e486e6e-7f97-440d-a806-b3b2efa76a0f tempest-VolumesCloneNegativeTest-1788564915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:37:34 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-0e486e6e-7f97-440d-a806-b3b2efa76a0f tempest-VolumesCloneNegativeTest-1788564915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:37:34 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-0e486e6e-7f97-440d-a806-b3b2efa76a0f tempest-VolumesCloneNegativeTest-1788564915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:37:34 devstack sudo[103421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:37:34 devstack sudo[103421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:37:34 devstack sudo[103421]: pam_unix(sudo:session): session closed for user root
Nov 03 18:37:34 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-0e486e6e-7f97-440d-a806-b3b2efa76a0f tempest-VolumesCloneNegativeTest-1788564915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.310s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:37:34 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-0e486e6e-7f97-440d-a806-b3b2efa76a0f tempest-VolumesCloneNegativeTest-1788564915 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:37:34 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-0e486e6e-7f97-440d-a806-b3b2efa76a0f tempest-VolumesCloneNegativeTest-1788564915 None] Deleted volume successfully.
Nov 03 18:37:34 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-0e486e6e-7f97-440d-a806-b3b2efa76a0f tempest-VolumesCloneNegativeTest-1788564915 None] Lock "cinder-c2fc0b2c-0d02-42a9-a7da-cb5a996b782e-delete_volume" released by "delete_volume" :: held 1.305s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:37:38 devstack cinder-volume[86120]: DEBUG dbcounter [-] [86120] Writing DB stats cinder:UPDATE=86,cinder:SELECT=62,cinder:DELETE=8,cinder:INSERT=21 {{(pid=86120) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 18:37:38 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-22c731c4-0df6-4fc2-a94d-72e6c7c6756c tempest-VolumesExtendTest-361984405 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:37:38 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-22c731c4-0df6-4fc2-a94d-72e6c7c6756c tempest-VolumesExtendTest-361984405 None] Flow 'volume_create_manager' (8df4de22-7fcc-41f7-a933-6e018e8af155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:37:38 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-22c731c4-0df6-4fc2-a94d-72e6c7c6756c tempest-VolumesExtendTest-361984405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9feba45f-bacc-4139-97e8-a9edb5948577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:37:38 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-22c731c4-0df6-4fc2-a94d-72e6c7c6756c tempest-VolumesExtendTest-361984405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9feba45f-bacc-4139-97e8-a9edb5948577) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:37:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1242791941',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d9c03d6-7873-493e-8e3d-1da36b8bb64b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='faafa3af28ca405caeb8d8322c7abf8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:37:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:37:39Z,use_quota=True,user_id='499fb3bc8d744d9b8128ac8c25c43ae2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:37:38 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-22c731c4-0df6-4fc2-a94d-72e6c7c6756c tempest-VolumesExtendTest-361984405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7eff5af-2366-40d1-855f-33ab8ca89573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:37:38 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-22c731c4-0df6-4fc2-a94d-72e6c7c6756c tempest-VolumesExtendTest-361984405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7eff5af-2366-40d1-855f-33ab8ca89573) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:37:38 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-22c731c4-0df6-4fc2-a94d-72e6c7c6756c tempest-VolumesExtendTest-361984405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c5bb358-d769-46d8-9630-d55569476993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:37:38 devstack cinder-volume[86120]: DEBUG cinder.image.glance [None req-22c731c4-0df6-4fc2-a94d-72e6c7c6756c tempest-VolumesExtendTest-361984405 None] Creating Keystone auth plugin from conf {{(pid=86120) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 03 18:37:39 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-22c731c4-0df6-4fc2-a94d-72e6c7c6756c tempest-VolumesExtendTest-361984405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c5bb358-d769-46d8-9630-d55569476993) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3d9c03d6-7873-493e-8e3d-1da36b8bb64b', 'volume_name': 'volume-3d9c03d6-7873-493e-8e3d-1da36b8bb64b', 'volume_size': 1, 'image_id': '83b28d58-14b6-4404-8354-5cfe237c5c95', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/83b28d58-14b6-4404-8354-5cfe237c5c95', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4b0f900e807a4827ba1f8686981981d9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '83b28d58-14b6-4404-8354-5cfe237c5c95', 'created_at': datetime.datetime(2026, 11, 3, 17, 17, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 17, 17, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/83b28d58-14b6-4404-8354-5cfe237c5c95/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7a8d3ce494f0>}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:37:39 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-22c731c4-0df6-4fc2-a94d-72e6c7c6756c tempest-VolumesExtendTest-361984405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (776ad2c0-f323-4007-a930-fdca446e9332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:37:39 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-22c731c4-0df6-4fc2-a94d-72e6c7c6756c tempest-VolumesExtendTest-361984405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (776ad2c0-f323-4007-a930-fdca446e9332) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:37:39 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-22c731c4-0df6-4fc2-a94d-72e6c7c6756c tempest-VolumesExtendTest-361984405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ebc78cb-156f-4cb8-afc5-5adea069d5be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:37:39 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-22c731c4-0df6-4fc2-a94d-72e6c7c6756c tempest-VolumesExtendTest-361984405 None] Volume 3d9c03d6-7873-493e-8e3d-1da36b8bb64b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3d9c03d6-7873-493e-8e3d-1da36b8bb64b', 'volume_size': 1, 'image_id': '83b28d58-14b6-4404-8354-5cfe237c5c95', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/83b28d58-14b6-4404-8354-5cfe237c5c95', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4b0f900e807a4827ba1f8686981981d9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '83b28d58-14b6-4404-8354-5cfe237c5c95', 'created_at': datetime.datetime(2026, 11, 3, 17, 17, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 17, 17, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/83b28d58-14b6-4404-8354-5cfe237c5c95/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7a8d3ce494f0>}
Nov 03 18:37:39 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-22c731c4-0df6-4fc2-a94d-72e6c7c6756c tempest-VolumesExtendTest-361984405 None] Trying to clone 3d9c03d6-7873-493e-8e3d-1da36b8bb64b from image 83b28d58-14b6-4404-8354-5cfe237c5c95 at location (None, [{'url': 'file:///opt/stack/data/glance/images/83b28d58-14b6-4404-8354-5cfe237c5c95', 'metadata': {}}]). {{(pid=86120) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 03 18:37:39 devstack cinder-volume[86120]: DEBUG cinder.image.image_utils [None req-22c731c4-0df6-4fc2-a94d-72e6c7c6756c tempest-VolumesExtendTest-361984405 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_83b28d58-14b6-4404-8354-5cfe237c5c95_35zeg7mydevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86120) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 03 18:37:39 devstack cinder-volume[86120]: INFO cinder.image.image_utils [None req-22c731c4-0df6-4fc2-a94d-72e6c7c6756c tempest-VolumesExtendTest-361984405 None] Image download 20.69 MB at 20.69 MB/s
Nov 03 18:37:39 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[f49e7c5b-5401-4d7f-8ce8-87e94cc87e33]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:37:39 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-22c731c4-0df6-4fc2-a94d-72e6c7c6756c tempest-VolumesExtendTest-361984405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_83b28d58-14b6-4404-8354-5cfe237c5c95_35zeg7mydevstack@QuobyteHD {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:37:39 devstack sudo[103427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_83b28d58-14b6-4404-8354-5cfe237c5c95_35zeg7mydevstack@QuobyteHD
Nov 03 18:37:39 devstack sudo[103427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:37:39 devstack sudo[103427]: pam_unix(sudo:session): session closed for user root
Nov 03 18:37:39 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-22c731c4-0df6-4fc2-a94d-72e6c7c6756c tempest-VolumesExtendTest-361984405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_83b28d58-14b6-4404-8354-5cfe237c5c95_35zeg7mydevstack@QuobyteHD" returned: 0 in 0.383s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:37:39 devstack cinder-volume[86120]: DEBUG cinder.image.image_utils [None req-22c731c4-0df6-4fc2-a94d-72e6c7c6756c tempest-VolumesExtendTest-361984405 None] Temporary image 83b28d58-14b6-4404-8354-5cfe237c5c95 is fetched for user 499fb3bc8d744d9b8128ac8c25c43ae2. {{(pid=86120) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 03 18:37:40 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb01cee0-90cf-4150-8be2-e77c8bf52388]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:37:40 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-22c731c4-0df6-4fc2-a94d-72e6c7c6756c tempest-VolumesExtendTest-361984405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_83b28d58-14b6-4404-8354-5cfe237c5c95_35zeg7mydevstack@QuobyteHD {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:37:40 devstack sudo[103432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_83b28d58-14b6-4404-8354-5cfe237c5c95_35zeg7mydevstack@QuobyteHD
Nov 03 18:37:40 devstack sudo[103432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:37:40 devstack sudo[103432]: pam_unix(sudo:session): session closed for user root
Nov 03 18:37:40 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-22c731c4-0df6-4fc2-a94d-72e6c7c6756c tempest-VolumesExtendTest-361984405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_83b28d58-14b6-4404-8354-5cfe237c5c95_35zeg7mydevstack@QuobyteHD" returned: 0 in 0.330s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:37:40 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-22c731c4-0df6-4fc2-a94d-72e6c7c6756c tempest-VolumesExtendTest-361984405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:37:40 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-22c731c4-0df6-4fc2-a94d-72e6c7c6756c tempest-VolumesExtendTest-361984405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:37:40 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-22c731c4-0df6-4fc2-a94d-72e6c7c6756c tempest-VolumesExtendTest-361984405 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:37:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1242791941',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d9c03d6-7873-493e-8e3d-1da36b8bb64b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='faafa3af28ca405caeb8d8322c7abf8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:37:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:37:39Z,use_quota=True,user_id='499fb3bc8d744d9b8128ac8c25c43ae2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:37:40 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-22c731c4-0df6-4fc2-a94d-72e6c7c6756c tempest-VolumesExtendTest-361984405 None] Creating volume 3d9c03d6-7873-493e-8e3d-1da36b8bb64b {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:37:40 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-22c731c4-0df6-4fc2-a94d-72e6c7c6756c tempest-VolumesExtendTest-361984405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:37:40 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-22c731c4-0df6-4fc2-a94d-72e6c7c6756c tempest-VolumesExtendTest-361984405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:37:40 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-22c731c4-0df6-4fc2-a94d-72e6c7c6756c tempest-VolumesExtendTest-361984405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:37:40 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-22c731c4-0df6-4fc2-a94d-72e6c7c6756c tempest-VolumesExtendTest-361984405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:37:40 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-22c731c4-0df6-4fc2-a94d-72e6c7c6756c tempest-VolumesExtendTest-361984405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:37:40 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-22c731c4-0df6-4fc2-a94d-72e6c7c6756c tempest-VolumesExtendTest-361984405 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:37:40 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-22c731c4-0df6-4fc2-a94d-72e6c7c6756c tempest-VolumesExtendTest-361984405 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:37:40 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-22c731c4-0df6-4fc2-a94d-72e6c7c6756c tempest-VolumesExtendTest-361984405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3d9c03d6-7873-493e-8e3d-1da36b8bb64b 1073741824 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:37:40 devstack sudo[103437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3d9c03d6-7873-493e-8e3d-1da36b8bb64b 1073741824
Nov 03 18:37:40 devstack sudo[103437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:37:40 devstack sudo[103437]: pam_unix(sudo:session): session closed for user root
Nov 03 18:37:40 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-22c731c4-0df6-4fc2-a94d-72e6c7c6756c tempest-VolumesExtendTest-361984405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3d9c03d6-7873-493e-8e3d-1da36b8bb64b 1073741824" returned: 0 in 0.452s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:37:40 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-22c731c4-0df6-4fc2-a94d-72e6c7c6756c tempest-VolumesExtendTest-361984405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3d9c03d6-7873-493e-8e3d-1da36b8bb64b {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:37:40 devstack sudo[103443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3d9c03d6-7873-493e-8e3d-1da36b8bb64b
Nov 03 18:37:40 devstack sudo[103443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:37:41 devstack sudo[103443]: pam_unix(sudo:session): session closed for user root
Nov 03 18:37:41 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-22c731c4-0df6-4fc2-a94d-72e6c7c6756c tempest-VolumesExtendTest-361984405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3d9c03d6-7873-493e-8e3d-1da36b8bb64b" returned: 0 in 0.267s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:37:41 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-22c731c4-0df6-4fc2-a94d-72e6c7c6756c tempest-VolumesExtendTest-361984405 None] <== create_volume: return (759ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:37:41 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-22c731c4-0df6-4fc2-a94d-72e6c7c6756c tempest-VolumesExtendTest-361984405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.763s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:37:41 devstack cinder-volume[86120]: DEBUG cinder.volume.volume_utils [None req-22c731c4-0df6-4fc2-a94d-72e6c7c6756c tempest-VolumesExtendTest-361984405 None] Attempting download of 83b28d58-14b6-4404-8354-5cfe237c5c95 ((None, [{'url': 'file:///opt/stack/data/glance/images/83b28d58-14b6-4404-8354-5cfe237c5c95', 'metadata': {}}])) to volume 3d9c03d6-7873-493e-8e3d-1da36b8bb64b. {{(pid=86120) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 03 18:37:41 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc61e103-0419-49b3-80db-d986adc06691]: (4, 'raw') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:37:41 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-22c731c4-0df6-4fc2-a94d-72e6c7c6756c tempest-VolumesExtendTest-361984405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_83b28d58-14b6-4404-8354-5cfe237c5c95_kdr35fp0 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:37:41 devstack sudo[103446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_83b28d58-14b6-4404-8354-5cfe237c5c95_kdr35fp0
Nov 03 18:37:41 devstack sudo[103446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:37:41 devstack sudo[103446]: pam_unix(sudo:session): session closed for user root
Nov 03 18:37:41 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-22c731c4-0df6-4fc2-a94d-72e6c7c6756c tempest-VolumesExtendTest-361984405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_83b28d58-14b6-4404-8354-5cfe237c5c95_kdr35fp0" returned: 0 in 0.333s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:37:41 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-22c731c4-0df6-4fc2-a94d-72e6c7c6756c tempest-VolumesExtendTest-361984405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_83b28d58-14b6-4404-8354-5cfe237c5c95_kdr35fp0 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:37:41 devstack sudo[103452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_83b28d58-14b6-4404-8354-5cfe237c5c95_kdr35fp0
Nov 03 18:37:41 devstack sudo[103452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:37:41 devstack sudo[103452]: pam_unix(sudo:session): session closed for user root
Nov 03 18:37:41 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-22c731c4-0df6-4fc2-a94d-72e6c7c6756c tempest-VolumesExtendTest-361984405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_83b28d58-14b6-4404-8354-5cfe237c5c95_kdr35fp0" returned: 1 in 0.329s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:37:41 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-22c731c4-0df6-4fc2-a94d-72e6c7c6756c tempest-VolumesExtendTest-361984405 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_83b28d58-14b6-4404-8354-5cfe237c5c95_kdr35fp0' failed. Not Retrying. {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 03 18:37:41 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[27961591-c7de-44bc-97f6-6fb0b3c4c233]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:37:41 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-22c731c4-0df6-4fc2-a94d-72e6c7c6756c tempest-VolumesExtendTest-361984405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_83b28d58-14b6-4404-8354-5cfe237c5c95_35zeg7mydevstack@QuobyteHD {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:37:41 devstack sudo[103456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_83b28d58-14b6-4404-8354-5cfe237c5c95_35zeg7mydevstack@QuobyteHD
Nov 03 18:37:41 devstack sudo[103456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:37:42 devstack sudo[103456]: pam_unix(sudo:session): session closed for user root
Nov 03 18:37:42 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-22c731c4-0df6-4fc2-a94d-72e6c7c6756c tempest-VolumesExtendTest-361984405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_83b28d58-14b6-4404-8354-5cfe237c5c95_35zeg7mydevstack@QuobyteHD" returned: 0 in 0.326s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:37:42 devstack cinder-volume[86120]: DEBUG cinder.image.image_utils [None req-22c731c4-0df6-4fc2-a94d-72e6c7c6756c tempest-VolumesExtendTest-361984405 None] 83b28d58-14b6-4404-8354-5cfe237c5c95 was qcow2, converting to qcow2 {{(pid=86120) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 03 18:37:42 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-22c731c4-0df6-4fc2-a94d-72e6c7c6756c tempest-VolumesExtendTest-361984405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_83b28d58-14b6-4404-8354-5cfe237c5c95_35zeg7mydevstack@QuobyteHD /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3d9c03d6-7873-493e-8e3d-1da36b8bb64b {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:37:42 devstack sudo[103461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_83b28d58-14b6-4404-8354-5cfe237c5c95_35zeg7mydevstack@QuobyteHD /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3d9c03d6-7873-493e-8e3d-1da36b8bb64b
Nov 03 18:37:42 devstack sudo[103461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:37:44 devstack sudo[103461]: pam_unix(sudo:session): session closed for user root
Nov 03 18:37:44 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-22c731c4-0df6-4fc2-a94d-72e6c7c6756c tempest-VolumesExtendTest-361984405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_83b28d58-14b6-4404-8354-5cfe237c5c95_35zeg7mydevstack@QuobyteHD /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3d9c03d6-7873-493e-8e3d-1da36b8bb64b" returned: 0 in 1.957s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:37:44 devstack cinder-volume[86120]: DEBUG cinder.image.image_utils [None req-22c731c4-0df6-4fc2-a94d-72e6c7c6756c tempest-VolumesExtendTest-361984405 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_83b28d58-14b6-4404-8354-5cfe237c5c95_35zeg7mydevstack@QuobyteHD, size 112.00 MB, duration 1.96 sec, destination /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3d9c03d6-7873-493e-8e3d-1da36b8bb64b {{(pid=86120) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 03 18:37:44 devstack cinder-volume[86120]: INFO cinder.image.image_utils [None req-22c731c4-0df6-4fc2-a94d-72e6c7c6756c tempest-VolumesExtendTest-361984405 None] Converted 112.00 MB image at 57.18 MB/s
Nov 03 18:37:44 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-22c731c4-0df6-4fc2-a94d-72e6c7c6756c tempest-VolumesExtendTest-361984405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3d9c03d6-7873-493e-8e3d-1da36b8bb64b 1G {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:37:44 devstack sudo[103476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3d9c03d6-7873-493e-8e3d-1da36b8bb64b 1G
Nov 03 18:37:44 devstack sudo[103476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:37:44 devstack sudo[103476]: pam_unix(sudo:session): session closed for user root
Nov 03 18:37:44 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-22c731c4-0df6-4fc2-a94d-72e6c7c6756c tempest-VolumesExtendTest-361984405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3d9c03d6-7873-493e-8e3d-1da36b8bb64b 1G" returned: 0 in 0.311s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:37:44 devstack cinder-volume[86120]: DEBUG cinder.volume.volume_utils [None req-22c731c4-0df6-4fc2-a94d-72e6c7c6756c tempest-VolumesExtendTest-361984405 None] Downloaded image 83b28d58-14b6-4404-8354-5cfe237c5c95 ((None, [{'url': 'file:///opt/stack/data/glance/images/83b28d58-14b6-4404-8354-5cfe237c5c95', 'metadata': {}}])) to volume 3d9c03d6-7873-493e-8e3d-1da36b8bb64b successfully. {{(pid=86120) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 03 18:37:44 devstack cinder-volume[86120]: DEBUG cinder.image.image_utils [None req-22c731c4-0df6-4fc2-a94d-72e6c7c6756c tempest-VolumesExtendTest-361984405 None] Temporary image 83b28d58-14b6-4404-8354-5cfe237c5c95 for user 499fb3bc8d744d9b8128ac8c25c43ae2 is deleted. {{(pid=86120) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 03 18:37:44 devstack cinder-volume[86120]: DEBUG cinder.volume.volume_utils [None req-22c731c4-0df6-4fc2-a94d-72e6c7c6756c tempest-VolumesExtendTest-361984405 None] Marking volume 3d9c03d6-7873-493e-8e3d-1da36b8bb64b as bootable. {{(pid=86120) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 03 18:37:44 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-22c731c4-0df6-4fc2-a94d-72e6c7c6756c tempest-VolumesExtendTest-361984405 None] Copying metadata from image 83b28d58-14b6-4404-8354-5cfe237c5c95 to 3d9c03d6-7873-493e-8e3d-1da36b8bb64b. {{(pid=86120) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 03 18:37:44 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-22c731c4-0df6-4fc2-a94d-72e6c7c6756c tempest-VolumesExtendTest-361984405 None] Creating volume glance metadata for volume 3d9c03d6-7873-493e-8e3d-1da36b8bb64b backed by image 83b28d58-14b6-4404-8354-5cfe237c5c95 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '83b28d58-14b6-4404-8354-5cfe237c5c95', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86120) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 03 18:37:44 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-22c731c4-0df6-4fc2-a94d-72e6c7c6756c tempest-VolumesExtendTest-361984405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ebc78cb-156f-4cb8-afc5-5adea069d5be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d9c03d6-7873-493e-8e3d-1da36b8bb64b', 'volume_size': 1, 'image_id': '83b28d58-14b6-4404-8354-5cfe237c5c95', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/83b28d58-14b6-4404-8354-5cfe237c5c95', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4b0f900e807a4827ba1f8686981981d9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '83b28d58-14b6-4404-8354-5cfe237c5c95', 'created_at': datetime.datetime(2026, 11, 3, 17, 17, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 17, 17, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/83b28d58-14b6-4404-8354-5cfe237c5c95/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7a8d3ce494f0>}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:37:44 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-22c731c4-0df6-4fc2-a94d-72e6c7c6756c tempest-VolumesExtendTest-361984405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e51f0540-e582-4f6d-bceb-f1c0cb432d2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:37:44 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-22c731c4-0df6-4fc2-a94d-72e6c7c6756c tempest-VolumesExtendTest-361984405 None] Volume volume-3d9c03d6-7873-493e-8e3d-1da36b8bb64b (3d9c03d6-7873-493e-8e3d-1da36b8bb64b): created successfully
Nov 03 18:37:44 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-22c731c4-0df6-4fc2-a94d-72e6c7c6756c tempest-VolumesExtendTest-361984405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e51f0540-e582-4f6d-bceb-f1c0cb432d2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:37:44 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-22c731c4-0df6-4fc2-a94d-72e6c7c6756c tempest-VolumesExtendTest-361984405 None] Flow 'volume_create_manager' (8df4de22-7fcc-41f7-a933-6e018e8af155) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:37:44 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-22c731c4-0df6-4fc2-a94d-72e6c7c6756c tempest-VolumesExtendTest-361984405 None] Created volume successfully.
Nov 03 18:37:45 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-3e9c81af-eb2e-4db0-ac0b-bb228faa219f tempest-VolumesExtendTest-361984405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:37:45 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-3e9c81af-eb2e-4db0-ac0b-bb228faa219f tempest-VolumesExtendTest-361984405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:37:45 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[b78671e1-dc8e-488b-996f-9672bcbbc9ce]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:37:45 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-3e9c81af-eb2e-4db0-ac0b-bb228faa219f tempest-VolumesExtendTest-361984405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3d9c03d6-7873-493e-8e3d-1da36b8bb64b {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:37:45 devstack sudo[103481]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3d9c03d6-7873-493e-8e3d-1da36b8bb64b
Nov 03 18:37:45 devstack sudo[103481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:37:45 devstack sudo[103481]: pam_unix(sudo:session): session closed for user root
Nov 03 18:37:45 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-3e9c81af-eb2e-4db0-ac0b-bb228faa219f tempest-VolumesExtendTest-361984405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3d9c03d6-7873-493e-8e3d-1da36b8bb64b" returned: 0 in 0.394s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:37:45 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-3e9c81af-eb2e-4db0-ac0b-bb228faa219f tempest-VolumesExtendTest-361984405 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3d9c03d6-7873-493e-8e3d-1da36b8bb64b 2G {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:37:45 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-3e9c81af-eb2e-4db0-ac0b-bb228faa219f tempest-VolumesExtendTest-361984405 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3d9c03d6-7873-493e-8e3d-1da36b8bb64b 2G" returned: 0 in 0.104s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:37:45 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-3e9c81af-eb2e-4db0-ac0b-bb228faa219f tempest-VolumesExtendTest-361984405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.531s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:37:45 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-3e9c81af-eb2e-4db0-ac0b-bb228faa219f tempest-VolumesExtendTest-361984405 None] Extend volume completed successfully.
Nov 03 18:37:46 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-f146b63b-7413-4376-a759-e2fec8953a3a tempest-VolumesExtendTest-361984405 None] Acquiring lock "cinder-3d9c03d6-7873-493e-8e3d-1da36b8bb64b-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:37:46 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-f146b63b-7413-4376-a759-e2fec8953a3a tempest-VolumesExtendTest-361984405 None] Lock "cinder-3d9c03d6-7873-493e-8e3d-1da36b8bb64b-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:37:46 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-f146b63b-7413-4376-a759-e2fec8953a3a tempest-VolumesExtendTest-361984405 None] Acquiring lock "cinder-quobyte-3d9c03d6-7873-493e-8e3d-1da36b8bb64b" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:37:46 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-f146b63b-7413-4376-a759-e2fec8953a3a tempest-VolumesExtendTest-361984405 None] Lock "cinder-quobyte-3d9c03d6-7873-493e-8e3d-1da36b8bb64b" acquired by "delete_volume" :: waited 0.016s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:37:46 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebd9aaa6-69cf-47e4-aad0-ae46ba1409b2]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:37:46 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-f146b63b-7413-4376-a759-e2fec8953a3a tempest-VolumesExtendTest-361984405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3d9c03d6-7873-493e-8e3d-1da36b8bb64b {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:37:47 devstack sudo[103490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3d9c03d6-7873-493e-8e3d-1da36b8bb64b
Nov 03 18:37:47 devstack sudo[103490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:37:47 devstack sudo[103490]: pam_unix(sudo:session): session closed for user root
Nov 03 18:37:47 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-f146b63b-7413-4376-a759-e2fec8953a3a tempest-VolumesExtendTest-361984405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3d9c03d6-7873-493e-8e3d-1da36b8bb64b" returned: 0 in 0.386s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:37:47 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-f146b63b-7413-4376-a759-e2fec8953a3a tempest-VolumesExtendTest-361984405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3d9c03d6-7873-493e-8e3d-1da36b8bb64b {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:37:47 devstack sudo[103495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3d9c03d6-7873-493e-8e3d-1da36b8bb64b
Nov 03 18:37:47 devstack sudo[103495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:37:47 devstack sudo[103495]: pam_unix(sudo:session): session closed for user root
Nov 03 18:37:47 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-f146b63b-7413-4376-a759-e2fec8953a3a tempest-VolumesExtendTest-361984405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3d9c03d6-7873-493e-8e3d-1da36b8bb64b" returned: 0 in 0.276s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:37:47 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-f146b63b-7413-4376-a759-e2fec8953a3a tempest-VolumesExtendTest-361984405 None] Lock "cinder-quobyte-3d9c03d6-7873-493e-8e3d-1da36b8bb64b" released by "delete_volume" :: held 0.704s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:37:47 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-f146b63b-7413-4376-a759-e2fec8953a3a tempest-VolumesExtendTest-361984405 None] Created reservations ['6a9966f9-b5e4-475a-bfa0-8b375ddde52b', '8e0518e7-1d58-40dd-af52-17f395d44117', '19292145-8d0e-40d0-a6b9-bd00f3e652d0', 'c728e327-6bf7-49f3-879f-c02c6808a134'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:37:47 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-f146b63b-7413-4376-a759-e2fec8953a3a tempest-VolumesExtendTest-361984405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:37:47 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-f146b63b-7413-4376-a759-e2fec8953a3a tempest-VolumesExtendTest-361984405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:37:47 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-f146b63b-7413-4376-a759-e2fec8953a3a tempest-VolumesExtendTest-361984405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:37:47 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-f146b63b-7413-4376-a759-e2fec8953a3a tempest-VolumesExtendTest-361984405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:37:47 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-f146b63b-7413-4376-a759-e2fec8953a3a tempest-VolumesExtendTest-361984405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:37:47 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-f146b63b-7413-4376-a759-e2fec8953a3a tempest-VolumesExtendTest-361984405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:37:47 devstack sudo[103498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:37:47 devstack sudo[103498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:37:48 devstack sudo[103498]: pam_unix(sudo:session): session closed for user root
Nov 03 18:37:48 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-f146b63b-7413-4376-a759-e2fec8953a3a tempest-VolumesExtendTest-361984405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.260s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:37:48 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-f146b63b-7413-4376-a759-e2fec8953a3a tempest-VolumesExtendTest-361984405 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:37:48 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-f146b63b-7413-4376-a759-e2fec8953a3a tempest-VolumesExtendTest-361984405 None] Deleted volume successfully.
Nov 03 18:37:48 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-f146b63b-7413-4376-a759-e2fec8953a3a tempest-VolumesExtendTest-361984405 None] Lock "cinder-3d9c03d6-7873-493e-8e3d-1da36b8bb64b-delete_volume" released by "delete_volume" :: held 1.210s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:37:48 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f56859b-4a1c-4b0c-afc6-915b5c4a89e2 tempest-VolumesExtendTest-361984405 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:37:48 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-8f56859b-4a1c-4b0c-afc6-915b5c4a89e2 tempest-VolumesExtendTest-361984405 None] Flow 'volume_create_manager' (6a05a0ab-c1f5-4d75-a9e0-42b903c4d449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:37:48 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-8f56859b-4a1c-4b0c-afc6-915b5c4a89e2 tempest-VolumesExtendTest-361984405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8faad6f-3fa9-4140-a46e-40ef6ac5e3ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:37:48 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-8f56859b-4a1c-4b0c-afc6-915b5c4a89e2 tempest-VolumesExtendTest-361984405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8faad6f-3fa9-4140-a46e-40ef6ac5e3ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:37:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1196120504',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=045120e8-afe7-4417-bac2-be06c7053feb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='faafa3af28ca405caeb8d8322c7abf8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:37:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:37:48Z,use_quota=True,user_id='499fb3bc8d744d9b8128ac8c25c43ae2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:37:48 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-8f56859b-4a1c-4b0c-afc6-915b5c4a89e2 tempest-VolumesExtendTest-361984405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25593609-24b8-4ec4-91df-383053650c1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:37:48 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-8f56859b-4a1c-4b0c-afc6-915b5c4a89e2 tempest-VolumesExtendTest-361984405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25593609-24b8-4ec4-91df-383053650c1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:37:48 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-8f56859b-4a1c-4b0c-afc6-915b5c4a89e2 tempest-VolumesExtendTest-361984405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69ee9e3f-1446-44aa-b1cd-2dfb92105b6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:37:48 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-8f56859b-4a1c-4b0c-afc6-915b5c4a89e2 tempest-VolumesExtendTest-361984405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69ee9e3f-1446-44aa-b1cd-2dfb92105b6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '045120e8-afe7-4417-bac2-be06c7053feb', 'volume_name': 'volume-045120e8-afe7-4417-bac2-be06c7053feb', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:37:48 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-8f56859b-4a1c-4b0c-afc6-915b5c4a89e2 tempest-VolumesExtendTest-361984405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af326d8e-cf40-4641-ac4f-67eaf1da5f4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:37:48 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-8f56859b-4a1c-4b0c-afc6-915b5c4a89e2 tempest-VolumesExtendTest-361984405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af326d8e-cf40-4641-ac4f-67eaf1da5f4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:37:48 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-8f56859b-4a1c-4b0c-afc6-915b5c4a89e2 tempest-VolumesExtendTest-361984405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcb6f3c3-6acc-44d9-9788-2e7ba0b9b22d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:37:48 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-8f56859b-4a1c-4b0c-afc6-915b5c4a89e2 tempest-VolumesExtendTest-361984405 None] Volume 045120e8-afe7-4417-bac2-be06c7053feb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-045120e8-afe7-4417-bac2-be06c7053feb', 'volume_size': 1}
Nov 03 18:37:48 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-8f56859b-4a1c-4b0c-afc6-915b5c4a89e2 tempest-VolumesExtendTest-361984405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:37:48 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-8f56859b-4a1c-4b0c-afc6-915b5c4a89e2 tempest-VolumesExtendTest-361984405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:37:48 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-8f56859b-4a1c-4b0c-afc6-915b5c4a89e2 tempest-VolumesExtendTest-361984405 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:37:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1196120504',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=045120e8-afe7-4417-bac2-be06c7053feb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='faafa3af28ca405caeb8d8322c7abf8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:37:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:37:48Z,use_quota=True,user_id='499fb3bc8d744d9b8128ac8c25c43ae2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:37:48 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-8f56859b-4a1c-4b0c-afc6-915b5c4a89e2 tempest-VolumesExtendTest-361984405 None] Creating volume 045120e8-afe7-4417-bac2-be06c7053feb {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:37:48 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-8f56859b-4a1c-4b0c-afc6-915b5c4a89e2 tempest-VolumesExtendTest-361984405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:37:48 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-8f56859b-4a1c-4b0c-afc6-915b5c4a89e2 tempest-VolumesExtendTest-361984405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:37:48 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-8f56859b-4a1c-4b0c-afc6-915b5c4a89e2 tempest-VolumesExtendTest-361984405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:37:48 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-8f56859b-4a1c-4b0c-afc6-915b5c4a89e2 tempest-VolumesExtendTest-361984405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:37:48 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-8f56859b-4a1c-4b0c-afc6-915b5c4a89e2 tempest-VolumesExtendTest-361984405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:37:48 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-8f56859b-4a1c-4b0c-afc6-915b5c4a89e2 tempest-VolumesExtendTest-361984405 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:37:48 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-8f56859b-4a1c-4b0c-afc6-915b5c4a89e2 tempest-VolumesExtendTest-361984405 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:37:48 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-8f56859b-4a1c-4b0c-afc6-915b5c4a89e2 tempest-VolumesExtendTest-361984405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-045120e8-afe7-4417-bac2-be06c7053feb 1073741824 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:37:48 devstack sudo[103501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-045120e8-afe7-4417-bac2-be06c7053feb 1073741824
Nov 03 18:37:48 devstack sudo[103501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:37:49 devstack sudo[103501]: pam_unix(sudo:session): session closed for user root
Nov 03 18:37:49 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-8f56859b-4a1c-4b0c-afc6-915b5c4a89e2 tempest-VolumesExtendTest-361984405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-045120e8-afe7-4417-bac2-be06c7053feb 1073741824" returned: 0 in 0.467s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:37:49 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-8f56859b-4a1c-4b0c-afc6-915b5c4a89e2 tempest-VolumesExtendTest-361984405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-045120e8-afe7-4417-bac2-be06c7053feb {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:37:49 devstack sudo[103507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-045120e8-afe7-4417-bac2-be06c7053feb
Nov 03 18:37:49 devstack sudo[103507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:37:49 devstack sudo[103507]: pam_unix(sudo:session): session closed for user root
Nov 03 18:37:49 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-8f56859b-4a1c-4b0c-afc6-915b5c4a89e2 tempest-VolumesExtendTest-361984405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-045120e8-afe7-4417-bac2-be06c7053feb" returned: 0 in 0.239s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:37:49 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-8f56859b-4a1c-4b0c-afc6-915b5c4a89e2 tempest-VolumesExtendTest-361984405 None] <== create_volume: return (749ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:37:49 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-8f56859b-4a1c-4b0c-afc6-915b5c4a89e2 tempest-VolumesExtendTest-361984405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.751s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:37:49 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-8f56859b-4a1c-4b0c-afc6-915b5c4a89e2 tempest-VolumesExtendTest-361984405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcb6f3c3-6acc-44d9-9788-2e7ba0b9b22d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-045120e8-afe7-4417-bac2-be06c7053feb', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:37:49 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-8f56859b-4a1c-4b0c-afc6-915b5c4a89e2 tempest-VolumesExtendTest-361984405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4281cef2-39db-4bca-a446-37c7ee511b9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:37:49 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-8f56859b-4a1c-4b0c-afc6-915b5c4a89e2 tempest-VolumesExtendTest-361984405 None] Volume volume-045120e8-afe7-4417-bac2-be06c7053feb (045120e8-afe7-4417-bac2-be06c7053feb): created successfully
Nov 03 18:37:49 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-8f56859b-4a1c-4b0c-afc6-915b5c4a89e2 tempest-VolumesExtendTest-361984405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4281cef2-39db-4bca-a446-37c7ee511b9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:37:49 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-8f56859b-4a1c-4b0c-afc6-915b5c4a89e2 tempest-VolumesExtendTest-361984405 None] Flow 'volume_create_manager' (6a05a0ab-c1f5-4d75-a9e0-42b903c4d449) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:37:49 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-8f56859b-4a1c-4b0c-afc6-915b5c4a89e2 tempest-VolumesExtendTest-361984405 None] Created volume successfully.
Nov 03 18:37:49 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-a75a4f74-db09-490f-93c7-299513bfdba3 tempest-VolumesExtendTest-361984405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:37:49 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-a75a4f74-db09-490f-93c7-299513bfdba3 tempest-VolumesExtendTest-361984405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:37:49 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-a75a4f74-db09-490f-93c7-299513bfdba3 tempest-VolumesExtendTest-361984405 None] Creating offline snapshot 86bf5148-c2a2-4564-bcce-882f26e135a2 of volume 045120e8-afe7-4417-bac2-be06c7053feb {{(pid=86120) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 18:37:49 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[f31664ab-62e3-4bfd-a5dc-a91b6d72f398]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:37:49 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-a75a4f74-db09-490f-93c7-299513bfdba3 tempest-VolumesExtendTest-361984405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-045120e8-afe7-4417-bac2-be06c7053feb {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:37:49 devstack sudo[103511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-045120e8-afe7-4417-bac2-be06c7053feb
Nov 03 18:37:49 devstack sudo[103511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:37:50 devstack sudo[103511]: pam_unix(sudo:session): session closed for user root
Nov 03 18:37:50 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-a75a4f74-db09-490f-93c7-299513bfdba3 tempest-VolumesExtendTest-361984405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-045120e8-afe7-4417-bac2-be06c7053feb" returned: 0 in 0.382s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:37:50 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-a75a4f74-db09-490f-93c7-299513bfdba3 tempest-VolumesExtendTest-361984405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-045120e8-afe7-4417-bac2-be06c7053feb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-045120e8-afe7-4417-bac2-be06c7053feb.86bf5148-c2a2-4564-bcce-882f26e135a2 1G {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:37:50 devstack sudo[103516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-045120e8-afe7-4417-bac2-be06c7053feb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-045120e8-afe7-4417-bac2-be06c7053feb.86bf5148-c2a2-4564-bcce-882f26e135a2 1G
Nov 03 18:37:50 devstack sudo[103516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:37:50 devstack sudo[103516]: pam_unix(sudo:session): session closed for user root
Nov 03 18:37:50 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-a75a4f74-db09-490f-93c7-299513bfdba3 tempest-VolumesExtendTest-361984405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-045120e8-afe7-4417-bac2-be06c7053feb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-045120e8-afe7-4417-bac2-be06c7053feb.86bf5148-c2a2-4564-bcce-882f26e135a2 1G" returned: 0 in 0.423s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:37:50 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-a75a4f74-db09-490f-93c7-299513bfdba3 tempest-VolumesExtendTest-361984405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-045120e8-afe7-4417-bac2-be06c7053feb -F qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-045120e8-afe7-4417-bac2-be06c7053feb.86bf5148-c2a2-4564-bcce-882f26e135a2 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:37:50 devstack sudo[103522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-045120e8-afe7-4417-bac2-be06c7053feb -F qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-045120e8-afe7-4417-bac2-be06c7053feb.86bf5148-c2a2-4564-bcce-882f26e135a2
Nov 03 18:37:50 devstack sudo[103522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:37:50 devstack sudo[103522]: pam_unix(sudo:session): session closed for user root
Nov 03 18:37:50 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-a75a4f74-db09-490f-93c7-299513bfdba3 tempest-VolumesExtendTest-361984405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-045120e8-afe7-4417-bac2-be06c7053feb -F qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-045120e8-afe7-4417-bac2-be06c7053feb.86bf5148-c2a2-4564-bcce-882f26e135a2" returned: 0 in 0.305s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:37:50 devstack cinder-volume[86120]: WARNING cinder.volume.drivers.remotefs [None req-a75a4f74-db09-490f-93c7-299513bfdba3 tempest-VolumesExtendTest-361984405 None] /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-045120e8-afe7-4417-bac2-be06c7053feb.86bf5148-c2a2-4564-bcce-882f26e135a2 is being set with open permissions: ugo+rw
Nov 03 18:37:50 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-a75a4f74-db09-490f-93c7-299513bfdba3 tempest-VolumesExtendTest-361984405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-045120e8-afe7-4417-bac2-be06c7053feb.86bf5148-c2a2-4564-bcce-882f26e135a2 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:37:50 devstack sudo[103527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-045120e8-afe7-4417-bac2-be06c7053feb.86bf5148-c2a2-4564-bcce-882f26e135a2
Nov 03 18:37:50 devstack sudo[103527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:37:51 devstack sudo[103527]: pam_unix(sudo:session): session closed for user root
Nov 03 18:37:51 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-a75a4f74-db09-490f-93c7-299513bfdba3 tempest-VolumesExtendTest-361984405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-045120e8-afe7-4417-bac2-be06c7053feb.86bf5148-c2a2-4564-bcce-882f26e135a2" returned: 0 in 0.290s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:37:51 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-a75a4f74-db09-490f-93c7-299513bfdba3 tempest-VolumesExtendTest-361984405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-045120e8-afe7-4417-bac2-be06c7053feb.info {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:37:51 devstack sudo[103530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-045120e8-afe7-4417-bac2-be06c7053feb.info
Nov 03 18:37:51 devstack sudo[103530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:37:51 devstack sudo[103530]: pam_unix(sudo:session): session closed for user root
Nov 03 18:37:51 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-a75a4f74-db09-490f-93c7-299513bfdba3 tempest-VolumesExtendTest-361984405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-045120e8-afe7-4417-bac2-be06c7053feb.info" returned: 0 in 0.283s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:37:51 devstack cinder-volume[86120]: WARNING cinder.volume.drivers.remotefs [None req-a75a4f74-db09-490f-93c7-299513bfdba3 tempest-VolumesExtendTest-361984405 None] /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-045120e8-afe7-4417-bac2-be06c7053feb.info is being set with open permissions: ugo+rw
Nov 03 18:37:51 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-a75a4f74-db09-490f-93c7-299513bfdba3 tempest-VolumesExtendTest-361984405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-045120e8-afe7-4417-bac2-be06c7053feb.info {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:37:51 devstack sudo[103533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-045120e8-afe7-4417-bac2-be06c7053feb.info
Nov 03 18:37:51 devstack sudo[103533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:37:51 devstack sudo[103533]: pam_unix(sudo:session): session closed for user root
Nov 03 18:37:51 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-a75a4f74-db09-490f-93c7-299513bfdba3 tempest-VolumesExtendTest-361984405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-045120e8-afe7-4417-bac2-be06c7053feb.info" returned: 0 in 0.310s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:37:51 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-a75a4f74-db09-490f-93c7-299513bfdba3 tempest-VolumesExtendTest-361984405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.114s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:37:51 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-a75a4f74-db09-490f-93c7-299513bfdba3 tempest-VolumesExtendTest-361984405 None] Create snapshot completed successfully
Nov 03 18:37:52 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4dd6f0d-ebda-4056-b5ee-a9244d0ff546 tempest-TestImageHashVerification-1613625104 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:37:52 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-b4dd6f0d-ebda-4056-b5ee-a9244d0ff546 tempest-TestImageHashVerification-1613625104 None] Flow 'volume_create_manager' (dae964e6-010f-4d30-8122-e4a4ded8e393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:37:52 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-b4dd6f0d-ebda-4056-b5ee-a9244d0ff546 tempest-TestImageHashVerification-1613625104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acf7a7ef-a7e4-4cc0-a658-43e9a64bda32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:37:52 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-b4dd6f0d-ebda-4056-b5ee-a9244d0ff546 tempest-TestImageHashVerification-1613625104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acf7a7ef-a7e4-4cc0-a658-43e9a64bda32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:37:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1641242738',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e84b6e4-f964-4bae-a107-4dfbfefd41c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a31d2e0be1a42909c8721d5a815e3d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:37:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:37:52Z,use_quota=True,user_id='d0188e460ecd4c14bc033bfe59b1c077',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:37:52 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-b4dd6f0d-ebda-4056-b5ee-a9244d0ff546 tempest-TestImageHashVerification-1613625104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (135672d1-29f9-4f54-940c-3aa80aae6555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:37:52 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-b4dd6f0d-ebda-4056-b5ee-a9244d0ff546 tempest-TestImageHashVerification-1613625104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (135672d1-29f9-4f54-940c-3aa80aae6555) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:37:52 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-b4dd6f0d-ebda-4056-b5ee-a9244d0ff546 tempest-TestImageHashVerification-1613625104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4f2f92c-0776-4b00-885a-7443651a8a63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:37:52 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-b4dd6f0d-ebda-4056-b5ee-a9244d0ff546 tempest-TestImageHashVerification-1613625104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4f2f92c-0776-4b00-885a-7443651a8a63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e84b6e4-f964-4bae-a107-4dfbfefd41c0', 'volume_name': 'volume-6e84b6e4-f964-4bae-a107-4dfbfefd41c0', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:37:52 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-b4dd6f0d-ebda-4056-b5ee-a9244d0ff546 tempest-TestImageHashVerification-1613625104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1fe6896-1e51-4a44-b6ef-e653dea0da11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:37:52 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-b4dd6f0d-ebda-4056-b5ee-a9244d0ff546 tempest-TestImageHashVerification-1613625104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1fe6896-1e51-4a44-b6ef-e653dea0da11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:37:52 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-b4dd6f0d-ebda-4056-b5ee-a9244d0ff546 tempest-TestImageHashVerification-1613625104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (068fea31-2ef6-47f0-82ff-2038dfebb572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:37:52 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-b4dd6f0d-ebda-4056-b5ee-a9244d0ff546 tempest-TestImageHashVerification-1613625104 None] Volume 6e84b6e4-f964-4bae-a107-4dfbfefd41c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e84b6e4-f964-4bae-a107-4dfbfefd41c0', 'volume_size': 1}
Nov 03 18:37:52 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-b4dd6f0d-ebda-4056-b5ee-a9244d0ff546 tempest-TestImageHashVerification-1613625104 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:37:52 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-b4dd6f0d-ebda-4056-b5ee-a9244d0ff546 tempest-TestImageHashVerification-1613625104 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:37:52 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-b4dd6f0d-ebda-4056-b5ee-a9244d0ff546 tempest-TestImageHashVerification-1613625104 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:37:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1641242738',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e84b6e4-f964-4bae-a107-4dfbfefd41c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a31d2e0be1a42909c8721d5a815e3d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:37:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:37:52Z,use_quota=True,user_id='d0188e460ecd4c14bc033bfe59b1c077',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:37:52 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-b4dd6f0d-ebda-4056-b5ee-a9244d0ff546 tempest-TestImageHashVerification-1613625104 None] Creating volume 6e84b6e4-f964-4bae-a107-4dfbfefd41c0 {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:37:52 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-b4dd6f0d-ebda-4056-b5ee-a9244d0ff546 tempest-TestImageHashVerification-1613625104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:37:52 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-b4dd6f0d-ebda-4056-b5ee-a9244d0ff546 tempest-TestImageHashVerification-1613625104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:37:52 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-b4dd6f0d-ebda-4056-b5ee-a9244d0ff546 tempest-TestImageHashVerification-1613625104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:37:52 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-b4dd6f0d-ebda-4056-b5ee-a9244d0ff546 tempest-TestImageHashVerification-1613625104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:37:52 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-b4dd6f0d-ebda-4056-b5ee-a9244d0ff546 tempest-TestImageHashVerification-1613625104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:37:52 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-b4dd6f0d-ebda-4056-b5ee-a9244d0ff546 tempest-TestImageHashVerification-1613625104 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:37:52 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-b4dd6f0d-ebda-4056-b5ee-a9244d0ff546 tempest-TestImageHashVerification-1613625104 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:37:52 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b4dd6f0d-ebda-4056-b5ee-a9244d0ff546 tempest-TestImageHashVerification-1613625104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6e84b6e4-f964-4bae-a107-4dfbfefd41c0 1073741824 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:37:52 devstack sudo[103536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6e84b6e4-f964-4bae-a107-4dfbfefd41c0 1073741824
Nov 03 18:37:52 devstack sudo[103536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:37:52 devstack sudo[103536]: pam_unix(sudo:session): session closed for user root
Nov 03 18:37:52 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b4dd6f0d-ebda-4056-b5ee-a9244d0ff546 tempest-TestImageHashVerification-1613625104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6e84b6e4-f964-4bae-a107-4dfbfefd41c0 1073741824" returned: 0 in 0.405s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:37:52 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b4dd6f0d-ebda-4056-b5ee-a9244d0ff546 tempest-TestImageHashVerification-1613625104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6e84b6e4-f964-4bae-a107-4dfbfefd41c0 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:37:52 devstack sudo[103542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6e84b6e4-f964-4bae-a107-4dfbfefd41c0
Nov 03 18:37:52 devstack sudo[103542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:37:52 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-38c46aa7-8f3f-4265-8a2d-a5d63ad8ad13 tempest-VolumesExtendTest-361984405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:37:53 devstack sudo[103542]: pam_unix(sudo:session): session closed for user root
Nov 03 18:37:53 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b4dd6f0d-ebda-4056-b5ee-a9244d0ff546 tempest-TestImageHashVerification-1613625104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6e84b6e4-f964-4bae-a107-4dfbfefd41c0" returned: 0 in 0.241s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:37:53 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-b4dd6f0d-ebda-4056-b5ee-a9244d0ff546 tempest-TestImageHashVerification-1613625104 None] <== create_volume: return (686ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:37:53 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-b4dd6f0d-ebda-4056-b5ee-a9244d0ff546 tempest-TestImageHashVerification-1613625104 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.689s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:37:53 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-38c46aa7-8f3f-4265-8a2d-a5d63ad8ad13 tempest-VolumesExtendTest-361984405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.161s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:37:53 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-b4dd6f0d-ebda-4056-b5ee-a9244d0ff546 tempest-TestImageHashVerification-1613625104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (068fea31-2ef6-47f0-82ff-2038dfebb572) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e84b6e4-f964-4bae-a107-4dfbfefd41c0', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:37:53 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-b4dd6f0d-ebda-4056-b5ee-a9244d0ff546 tempest-TestImageHashVerification-1613625104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5568d3d8-b90a-4641-be0b-6fdb2b9c8157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:37:53 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[416e2294-50c1-4665-9e8a-296302dde73c]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:37:53 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-38c46aa7-8f3f-4265-8a2d-a5d63ad8ad13 tempest-VolumesExtendTest-361984405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-045120e8-afe7-4417-bac2-be06c7053feb {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:37:53 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-b4dd6f0d-ebda-4056-b5ee-a9244d0ff546 tempest-TestImageHashVerification-1613625104 None] Volume volume-6e84b6e4-f964-4bae-a107-4dfbfefd41c0 (6e84b6e4-f964-4bae-a107-4dfbfefd41c0): created successfully
Nov 03 18:37:53 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-b4dd6f0d-ebda-4056-b5ee-a9244d0ff546 tempest-TestImageHashVerification-1613625104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5568d3d8-b90a-4641-be0b-6fdb2b9c8157) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:37:53 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-b4dd6f0d-ebda-4056-b5ee-a9244d0ff546 tempest-TestImageHashVerification-1613625104 None] Flow 'volume_create_manager' (dae964e6-010f-4d30-8122-e4a4ded8e393) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:37:53 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-b4dd6f0d-ebda-4056-b5ee-a9244d0ff546 tempest-TestImageHashVerification-1613625104 None] Created volume successfully.
Nov 03 18:37:53 devstack sudo[103545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-045120e8-afe7-4417-bac2-be06c7053feb
Nov 03 18:37:53 devstack sudo[103545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:37:53 devstack sudo[103545]: pam_unix(sudo:session): session closed for user root
Nov 03 18:37:53 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-38c46aa7-8f3f-4265-8a2d-a5d63ad8ad13 tempest-VolumesExtendTest-361984405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-045120e8-afe7-4417-bac2-be06c7053feb" returned: 0 in 0.361s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:37:53 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-38c46aa7-8f3f-4265-8a2d-a5d63ad8ad13 tempest-VolumesExtendTest-361984405 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-045120e8-afe7-4417-bac2-be06c7053feb.86bf5148-c2a2-4564-bcce-882f26e135a2 2G {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:37:53 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-38c46aa7-8f3f-4265-8a2d-a5d63ad8ad13 tempest-VolumesExtendTest-361984405 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-045120e8-afe7-4417-bac2-be06c7053feb.86bf5148-c2a2-4564-bcce-882f26e135a2 2G" returned: 0 in 0.145s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:37:53 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-38c46aa7-8f3f-4265-8a2d-a5d63ad8ad13 tempest-VolumesExtendTest-361984405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.569s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:37:53 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-38c46aa7-8f3f-4265-8a2d-a5d63ad8ad13 tempest-VolumesExtendTest-361984405 None] Extend volume completed successfully.
Nov 03 18:37:54 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-70ce4652-c612-40e4-a672-38220a5215b8 tempest-TestImageHashVerification-1613625104 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:37:54 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-70ce4652-c612-40e4-a672-38220a5215b8 tempest-TestImageHashVerification-1613625104 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:37:54 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[e721807e-3ff2-4ccd-a925-7e3dcda6c6b1]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:37:54 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-70ce4652-c612-40e4-a672-38220a5215b8 tempest-TestImageHashVerification-1613625104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6e84b6e4-f964-4bae-a107-4dfbfefd41c0 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:37:54 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-afa139f9-f566-426e-8811-256bbe6e1a43 tempest-VolumesExtendTest-361984405 None] Acquiring lock "cinder-86bf5148-c2a2-4564-bcce-882f26e135a2-delete_snapshot" by "delete_snapshot" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:37:54 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-afa139f9-f566-426e-8811-256bbe6e1a43 tempest-VolumesExtendTest-361984405 None] Lock "cinder-86bf5148-c2a2-4564-bcce-882f26e135a2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:37:54 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-afa139f9-f566-426e-8811-256bbe6e1a43 tempest-VolumesExtendTest-361984405 None] Acquiring lock "cinder-quobyte-045120e8-afe7-4417-bac2-be06c7053feb" by "delete_snapshot" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:37:54 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-afa139f9-f566-426e-8811-256bbe6e1a43 tempest-VolumesExtendTest-361984405 None] Lock "cinder-quobyte-045120e8-afe7-4417-bac2-be06c7053feb" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:37:54 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-afa139f9-f566-426e-8811-256bbe6e1a43 tempest-VolumesExtendTest-361984405 None] Acquiring lock "cinder-quobyte-86bf5148-c2a2-4564-bcce-882f26e135a2" by "_delete_snapshot" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:37:54 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-afa139f9-f566-426e-8811-256bbe6e1a43 tempest-VolumesExtendTest-361984405 None] Lock "cinder-quobyte-86bf5148-c2a2-4564-bcce-882f26e135a2" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:37:54 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-afa139f9-f566-426e-8811-256bbe6e1a43 tempest-VolumesExtendTest-361984405 None] Deleting offline snapshot 86bf5148-c2a2-4564-bcce-882f26e135a2 of volume 045120e8-afe7-4417-bac2-be06c7053feb {{(pid=86120) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 18:37:54 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-afa139f9-f566-426e-8811-256bbe6e1a43 tempest-VolumesExtendTest-361984405 None] snapshot_file for this snap is: volume-045120e8-afe7-4417-bac2-be06c7053feb.86bf5148-c2a2-4564-bcce-882f26e135a2 {{(pid=86120) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 18:37:54 devstack sudo[103554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6e84b6e4-f964-4bae-a107-4dfbfefd41c0
Nov 03 18:37:54 devstack sudo[103554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:37:54 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[53ab516b-5153-4dda-a020-dbc3fda29b78]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:37:54 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-afa139f9-f566-426e-8811-256bbe6e1a43 tempest-VolumesExtendTest-361984405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-045120e8-afe7-4417-bac2-be06c7053feb.86bf5148-c2a2-4564-bcce-882f26e135a2 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:37:54 devstack sudo[103556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-045120e8-afe7-4417-bac2-be06c7053feb.86bf5148-c2a2-4564-bcce-882f26e135a2
Nov 03 18:37:54 devstack sudo[103556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:37:54 devstack sudo[103554]: pam_unix(sudo:session): session closed for user root
Nov 03 18:37:54 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-70ce4652-c612-40e4-a672-38220a5215b8 tempest-TestImageHashVerification-1613625104 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6e84b6e4-f964-4bae-a107-4dfbfefd41c0" returned: 0 in 0.361s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:37:54 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ed4ae3e-dc80-4a11-b7a0-1119cc00675e]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:37:54 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-70ce4652-c612-40e4-a672-38220a5215b8 tempest-TestImageHashVerification-1613625104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6e84b6e4-f964-4bae-a107-4dfbfefd41c0 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:37:54 devstack sudo[103556]: pam_unix(sudo:session): session closed for user root
Nov 03 18:37:54 devstack sudo[103561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6e84b6e4-f964-4bae-a107-4dfbfefd41c0
Nov 03 18:37:54 devstack sudo[103561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:37:54 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-afa139f9-f566-426e-8811-256bbe6e1a43 tempest-VolumesExtendTest-361984405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-045120e8-afe7-4417-bac2-be06c7053feb.86bf5148-c2a2-4564-bcce-882f26e135a2" returned: 0 in 0.377s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:37:54 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-afa139f9-f566-426e-8811-256bbe6e1a43 tempest-VolumesExtendTest-361984405 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-045120e8-afe7-4417-bac2-be06c7053feb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86120) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 18:37:54 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[35ab1b09-7c5e-47c4-924f-89a66cce8565]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:37:54 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-afa139f9-f566-426e-8811-256bbe6e1a43 tempest-VolumesExtendTest-361984405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-045120e8-afe7-4417-bac2-be06c7053feb {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:37:54 devstack sudo[103566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-045120e8-afe7-4417-bac2-be06c7053feb
Nov 03 18:37:54 devstack sudo[103566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:37:54 devstack sudo[103561]: pam_unix(sudo:session): session closed for user root
Nov 03 18:37:54 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-70ce4652-c612-40e4-a672-38220a5215b8 tempest-TestImageHashVerification-1613625104 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6e84b6e4-f964-4bae-a107-4dfbfefd41c0" returned: 0 in 0.369s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:37:54 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-70ce4652-c612-40e4-a672-38220a5215b8 tempest-TestImageHashVerification-1613625104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6e84b6e4-f964-4bae-a107-4dfbfefd41c0 /opt/stack/data/cinder/conversion/6e84b6e4-f964-4bae-a107-4dfbfefd41c0.temp_image.d56bb3fb-c407-4c4d-ba7e-8fbce967d93d5hs_m1vs.img {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:37:54 devstack sudo[103571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6e84b6e4-f964-4bae-a107-4dfbfefd41c0 /opt/stack/data/cinder/conversion/6e84b6e4-f964-4bae-a107-4dfbfefd41c0.temp_image.d56bb3fb-c407-4c4d-ba7e-8fbce967d93d5hs_m1vs.img
Nov 03 18:37:54 devstack sudo[103571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:37:55 devstack sudo[103566]: pam_unix(sudo:session): session closed for user root
Nov 03 18:37:55 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-afa139f9-f566-426e-8811-256bbe6e1a43 tempest-VolumesExtendTest-361984405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-045120e8-afe7-4417-bac2-be06c7053feb" returned: 0 in 0.344s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:37:55 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-afa139f9-f566-426e-8811-256bbe6e1a43 tempest-VolumesExtendTest-361984405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-045120e8-afe7-4417-bac2-be06c7053feb.86bf5148-c2a2-4564-bcce-882f26e135a2 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:37:55 devstack sudo[103576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-045120e8-afe7-4417-bac2-be06c7053feb.86bf5148-c2a2-4564-bcce-882f26e135a2
Nov 03 18:37:55 devstack sudo[103576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:37:55 devstack sudo[103576]: pam_unix(sudo:session): session closed for user root
Nov 03 18:37:55 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-afa139f9-f566-426e-8811-256bbe6e1a43 tempest-VolumesExtendTest-361984405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-045120e8-afe7-4417-bac2-be06c7053feb.86bf5148-c2a2-4564-bcce-882f26e135a2" returned: 0 in 0.680s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:37:55 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-afa139f9-f566-426e-8811-256bbe6e1a43 tempest-VolumesExtendTest-361984405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-045120e8-afe7-4417-bac2-be06c7053feb.86bf5148-c2a2-4564-bcce-882f26e135a2 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:37:55 devstack sudo[103592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-045120e8-afe7-4417-bac2-be06c7053feb.86bf5148-c2a2-4564-bcce-882f26e135a2
Nov 03 18:37:55 devstack sudo[103592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:37:56 devstack sudo[103592]: pam_unix(sudo:session): session closed for user root
Nov 03 18:37:56 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-afa139f9-f566-426e-8811-256bbe6e1a43 tempest-VolumesExtendTest-361984405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-045120e8-afe7-4417-bac2-be06c7053feb.86bf5148-c2a2-4564-bcce-882f26e135a2" returned: 0 in 0.358s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:37:56 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-afa139f9-f566-426e-8811-256bbe6e1a43 tempest-VolumesExtendTest-361984405 None] Lock "cinder-quobyte-86bf5148-c2a2-4564-bcce-882f26e135a2" released by "_delete_snapshot" :: held 1.930s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:37:56 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-afa139f9-f566-426e-8811-256bbe6e1a43 tempest-VolumesExtendTest-361984405 None] Lock "cinder-quobyte-045120e8-afe7-4417-bac2-be06c7053feb" released by "delete_snapshot" :: held 1.956s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:37:56 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-afa139f9-f566-426e-8811-256bbe6e1a43 tempest-VolumesExtendTest-361984405 None] Created reservations ['67d24e5e-ca9a-4d21-9c9f-6f05d024b410', '8254f8db-b651-447f-9bc0-fb4a01d4ed26', 'f4b30eed-0c64-459a-98f7-85d8a1ad3bd2', 'a11ca3d0-7c97-4540-a770-cea67bd5dfb5'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:37:56 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-afa139f9-f566-426e-8811-256bbe6e1a43 tempest-VolumesExtendTest-361984405 None] Delete snapshot completed successfully.
Nov 03 18:37:56 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-afa139f9-f566-426e-8811-256bbe6e1a43 tempest-VolumesExtendTest-361984405 None] Lock "cinder-86bf5148-c2a2-4564-bcce-882f26e135a2-delete_snapshot" released by "delete_snapshot" :: held 2.196s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:37:56 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-bf93af3f-ec2b-4b4e-873e-13611d579130 tempest-VolumesExtendTest-361984405 None] Acquiring lock "cinder-045120e8-afe7-4417-bac2-be06c7053feb-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:37:56 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-bf93af3f-ec2b-4b4e-873e-13611d579130 tempest-VolumesExtendTest-361984405 None] Lock "cinder-045120e8-afe7-4417-bac2-be06c7053feb-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:37:56 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-bf93af3f-ec2b-4b4e-873e-13611d579130 tempest-VolumesExtendTest-361984405 None] Acquiring lock "cinder-quobyte-045120e8-afe7-4417-bac2-be06c7053feb" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:37:56 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-bf93af3f-ec2b-4b4e-873e-13611d579130 tempest-VolumesExtendTest-361984405 None] Lock "cinder-quobyte-045120e8-afe7-4417-bac2-be06c7053feb" acquired by "delete_volume" :: waited 0.037s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:37:56 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[db598681-ff4c-4792-b059-46a7d82b488f]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:37:56 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-bf93af3f-ec2b-4b4e-873e-13611d579130 tempest-VolumesExtendTest-361984405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-045120e8-afe7-4417-bac2-be06c7053feb {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:37:57 devstack sudo[103595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-045120e8-afe7-4417-bac2-be06c7053feb
Nov 03 18:37:57 devstack sudo[103595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:37:57 devstack sudo[103595]: pam_unix(sudo:session): session closed for user root
Nov 03 18:37:57 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-bf93af3f-ec2b-4b4e-873e-13611d579130 tempest-VolumesExtendTest-361984405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-045120e8-afe7-4417-bac2-be06c7053feb" returned: 0 in 0.584s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:37:57 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-bf93af3f-ec2b-4b4e-873e-13611d579130 tempest-VolumesExtendTest-361984405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-045120e8-afe7-4417-bac2-be06c7053feb {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:37:57 devstack sudo[103600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-045120e8-afe7-4417-bac2-be06c7053feb
Nov 03 18:37:57 devstack sudo[103600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:37:57 devstack sudo[103600]: pam_unix(sudo:session): session closed for user root
Nov 03 18:37:57 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-bf93af3f-ec2b-4b4e-873e-13611d579130 tempest-VolumesExtendTest-361984405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-045120e8-afe7-4417-bac2-be06c7053feb" returned: 0 in 0.451s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:37:57 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-bf93af3f-ec2b-4b4e-873e-13611d579130 tempest-VolumesExtendTest-361984405 None] Lock "cinder-quobyte-045120e8-afe7-4417-bac2-be06c7053feb" released by "delete_volume" :: held 1.185s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:37:58 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-bf93af3f-ec2b-4b4e-873e-13611d579130 tempest-VolumesExtendTest-361984405 None] Created reservations ['85d7639b-39b7-4a52-9d6e-532cc8d9708e', '26fff992-d827-4159-b5d5-c325a780ab54', '70ee4723-1356-4682-9ef9-bd47d261bce5', 'd16f1254-bf19-462a-a0e0-8e1cbb47139d'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:37:58 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-bf93af3f-ec2b-4b4e-873e-13611d579130 tempest-VolumesExtendTest-361984405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:37:58 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-bf93af3f-ec2b-4b4e-873e-13611d579130 tempest-VolumesExtendTest-361984405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:37:58 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-bf93af3f-ec2b-4b4e-873e-13611d579130 tempest-VolumesExtendTest-361984405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:37:58 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-bf93af3f-ec2b-4b4e-873e-13611d579130 tempest-VolumesExtendTest-361984405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:37:58 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-bf93af3f-ec2b-4b4e-873e-13611d579130 tempest-VolumesExtendTest-361984405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:37:58 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-bf93af3f-ec2b-4b4e-873e-13611d579130 tempest-VolumesExtendTest-361984405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:37:58 devstack sudo[103605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:37:58 devstack sudo[103605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:37:58 devstack sudo[103605]: pam_unix(sudo:session): session closed for user root
Nov 03 18:37:58 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-bf93af3f-ec2b-4b4e-873e-13611d579130 tempest-VolumesExtendTest-361984405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.414s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:37:58 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-bf93af3f-ec2b-4b4e-873e-13611d579130 tempest-VolumesExtendTest-361984405 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:37:58 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-bf93af3f-ec2b-4b4e-873e-13611d579130 tempest-VolumesExtendTest-361984405 None] Deleted volume successfully.
Nov 03 18:37:58 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-bf93af3f-ec2b-4b4e-873e-13611d579130 tempest-VolumesExtendTest-361984405 None] Lock "cinder-045120e8-afe7-4417-bac2-be06c7053feb-delete_volume" released by "delete_volume" :: held 2.055s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:38:01 devstack sudo[103571]: pam_unix(sudo:session): session closed for user root
Nov 03 18:38:01 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-70ce4652-c612-40e4-a672-38220a5215b8 tempest-TestImageHashVerification-1613625104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6e84b6e4-f964-4bae-a107-4dfbfefd41c0 /opt/stack/data/cinder/conversion/6e84b6e4-f964-4bae-a107-4dfbfefd41c0.temp_image.d56bb3fb-c407-4c4d-ba7e-8fbce967d93d5hs_m1vs.img" returned: 0 in 6.773s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:38:01 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[85c0dd5d-e675-4e07-af50-592c41419937]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:38:01 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-70ce4652-c612-40e4-a672-38220a5215b8 tempest-TestImageHashVerification-1613625104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6e84b6e4-f964-4bae-a107-4dfbfefd41c0 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:38:01 devstack sudo[103609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6e84b6e4-f964-4bae-a107-4dfbfefd41c0
Nov 03 18:38:01 devstack sudo[103609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:38:02 devstack sudo[103609]: pam_unix(sudo:session): session closed for user root
Nov 03 18:38:02 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-70ce4652-c612-40e4-a672-38220a5215b8 tempest-TestImageHashVerification-1613625104 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6e84b6e4-f964-4bae-a107-4dfbfefd41c0" returned: 0 in 0.580s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:38:02 devstack cinder-volume[86120]: DEBUG cinder.image.image_utils [None req-70ce4652-c612-40e4-a672-38220a5215b8 tempest-TestImageHashVerification-1613625104 None] Image conversion details: src /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6e84b6e4-f964-4bae-a107-4dfbfefd41c0, size 1024.00 MB, duration 6.77 sec, destination /opt/stack/data/cinder/conversion/6e84b6e4-f964-4bae-a107-4dfbfefd41c0.temp_image.d56bb3fb-c407-4c4d-ba7e-8fbce967d93d5hs_m1vs.img {{(pid=86120) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 03 18:38:02 devstack cinder-volume[86120]: INFO cinder.image.image_utils [None req-70ce4652-c612-40e4-a672-38220a5215b8 tempest-TestImageHashVerification-1613625104 None] Converted 1024.00 MB image at 151.16 MB/s
Nov 03 18:38:02 devstack cinder-volume[86120]: DEBUG cinder.image.image_utils [None req-70ce4652-c612-40e4-a672-38220a5215b8 tempest-TestImageHashVerification-1613625104 None] d56bb3fb-c407-4c4d-ba7e-8fbce967d93d was raw, no need to convert to raw {{(pid=86120) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}}
Nov 03 18:38:12 devstack cinder-volume[86120]: DEBUG dbcounter [-] [86120] Writing DB stats cinder:SELECT=43,cinder:UPDATE=36,cinder:INSERT=10,cinder:DELETE=4 {{(pid=86120) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 18:38:12 devstack cinder-volume[86120]: DEBUG dbcounter [-] [86120] Writing DB stats cinder:UPDATE=73,cinder:SELECT=51,cinder:INSERT=23,cinder:DELETE=4 {{(pid=86120) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 18:38:14 devstack cinder-volume[86120]: DEBUG oslo_service.periodic_task [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86120) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 18:38:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:38:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:38:14 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:38:14 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:38:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:38:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:38:15 devstack sudo[103622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:38:15 devstack sudo[103622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:38:15 devstack sudo[103622]: pam_unix(sudo:session): session closed for user root
Nov 03 18:38:15 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.292s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:38:15 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:38:15 devstack cinder-volume[86120]: DEBUG oslo_service.periodic_task [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Running periodic task VolumeManager._thread_info {{(pid=86120) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 18:38:15 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] thread count: 28 {{(pid=86120) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 03 18:38:15 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] thread info: [<_MainThread(MainThread, started 134747145822336)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134747033686336)>, <Thread(Thread-3 (stat_writer), started daemon 134747030828736)>, <Thread(Rabbit-heartbeat, started daemon 134747035433408)>, <Thread(Thread-5 (_runner), started daemon 134747029587392)>, <Thread(Thread-7 (_runner), started daemon 134747029784256)>, <Thread(fd_logger, started daemon 134747027909120)>, <Thread(privsep_reader, started daemon 134747027006592)>, <Thread(tpool_thread_0, started daemon 134747018950336)>, <Thread(tpool_thread_1, started daemon 134747010541248)>, <Thread(tpool_thread_2, started daemon 134747002132160)>, <Thread(tpool_thread_3, started daemon 134746993723072)>, <Thread(tpool_thread_4, started daemon 134746985313984)>, <Thread(tpool_thread_5, started daemon 134746976904896)>, <Thread(tpool_thread_6, started daemon 134746968495808)>, <Thread(tpool_thread_7, started daemon 134746960086720)>, <Thread(tpool_thread_8, started daemon 134746951677632)>, <Thread(tpool_thread_9, started daemon 134746943268544)>, <Thread(tpool_thread_10, started daemon 134746934859456)>, <Thread(tpool_thread_11, started daemon 134746926450368)>, <Thread(tpool_thread_12, started daemon 134746918041280)>, <Thread(tpool_thread_13, started daemon 134746909632192)>, <Thread(tpool_thread_14, started daemon 134746901223104)>, <Thread(tpool_thread_15, started daemon 134746892814016)>, <Thread(tpool_thread_16, started daemon 134746884404928)>, <Thread(tpool_thread_17, started daemon 134746875995840)>, <Thread(tpool_thread_18, started daemon 134746867586752)>, <Thread(tpool_thread_19, started daemon 134746859177664)>] {{(pid=86120) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 03 18:38:23 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-70ce4652-c612-40e4-a672-38220a5215b8 tempest-TestImageHashVerification-1613625104 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 29.575s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:38:23 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-70ce4652-c612-40e4-a672-38220a5215b8 tempest-TestImageHashVerification-1613625104 None] Uploaded volume to glance image-id: d56bb3fb-c407-4c4d-ba7e-8fbce967d93d. {{(pid=86120) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Nov 03 18:38:23 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-70ce4652-c612-40e4-a672-38220a5215b8 tempest-TestImageHashVerification-1613625104 None] Copy volume to image completed successfully.
Nov 03 18:38:25 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-6d6acdd4-6a95-4f1a-9612-4537174c0611 tempest-TestImageHashVerification-1613625104 None] Acquiring lock "cinder-6e84b6e4-f964-4bae-a107-4dfbfefd41c0-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:38:25 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-6d6acdd4-6a95-4f1a-9612-4537174c0611 tempest-TestImageHashVerification-1613625104 None] Lock "cinder-6e84b6e4-f964-4bae-a107-4dfbfefd41c0-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:38:25 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-6d6acdd4-6a95-4f1a-9612-4537174c0611 tempest-TestImageHashVerification-1613625104 None] Acquiring lock "cinder-quobyte-6e84b6e4-f964-4bae-a107-4dfbfefd41c0" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:38:25 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-6d6acdd4-6a95-4f1a-9612-4537174c0611 tempest-TestImageHashVerification-1613625104 None] Lock "cinder-quobyte-6e84b6e4-f964-4bae-a107-4dfbfefd41c0" acquired by "delete_volume" :: waited 0.018s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:38:25 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1c87296-2077-4fef-b378-a4f757fec77f]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:38:25 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-6d6acdd4-6a95-4f1a-9612-4537174c0611 tempest-TestImageHashVerification-1613625104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6e84b6e4-f964-4bae-a107-4dfbfefd41c0 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:38:25 devstack sudo[103626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6e84b6e4-f964-4bae-a107-4dfbfefd41c0
Nov 03 18:38:25 devstack sudo[103626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:38:25 devstack sudo[103626]: pam_unix(sudo:session): session closed for user root
Nov 03 18:38:25 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-6d6acdd4-6a95-4f1a-9612-4537174c0611 tempest-TestImageHashVerification-1613625104 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6e84b6e4-f964-4bae-a107-4dfbfefd41c0" returned: 0 in 0.372s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:38:25 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-6d6acdd4-6a95-4f1a-9612-4537174c0611 tempest-TestImageHashVerification-1613625104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6e84b6e4-f964-4bae-a107-4dfbfefd41c0 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:38:25 devstack sudo[103631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6e84b6e4-f964-4bae-a107-4dfbfefd41c0
Nov 03 18:38:25 devstack sudo[103631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:38:25 devstack sudo[103631]: pam_unix(sudo:session): session closed for user root
Nov 03 18:38:25 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-6d6acdd4-6a95-4f1a-9612-4537174c0611 tempest-TestImageHashVerification-1613625104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6e84b6e4-f964-4bae-a107-4dfbfefd41c0" returned: 0 in 0.256s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:38:25 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-6d6acdd4-6a95-4f1a-9612-4537174c0611 tempest-TestImageHashVerification-1613625104 None] Lock "cinder-quobyte-6e84b6e4-f964-4bae-a107-4dfbfefd41c0" released by "delete_volume" :: held 0.673s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:38:25 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-6d6acdd4-6a95-4f1a-9612-4537174c0611 tempest-TestImageHashVerification-1613625104 None] Created reservations ['aadc7b3b-dd85-4676-ba90-62f2f8fa5083', '183c1ff9-c778-412b-9b31-9a42d9922aa3', '60dfec64-6372-4335-b40a-35d362c88409', 'a84662a5-7efa-4453-8a1a-f2f082371b89'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:38:26 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-6d6acdd4-6a95-4f1a-9612-4537174c0611 tempest-TestImageHashVerification-1613625104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:38:26 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-6d6acdd4-6a95-4f1a-9612-4537174c0611 tempest-TestImageHashVerification-1613625104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:38:26 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-6d6acdd4-6a95-4f1a-9612-4537174c0611 tempest-TestImageHashVerification-1613625104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:38:26 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-6d6acdd4-6a95-4f1a-9612-4537174c0611 tempest-TestImageHashVerification-1613625104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:38:26 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-6d6acdd4-6a95-4f1a-9612-4537174c0611 tempest-TestImageHashVerification-1613625104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:38:26 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-6d6acdd4-6a95-4f1a-9612-4537174c0611 tempest-TestImageHashVerification-1613625104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:38:26 devstack sudo[103634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:38:26 devstack sudo[103634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:38:26 devstack sudo[103634]: pam_unix(sudo:session): session closed for user root
Nov 03 18:38:26 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-6d6acdd4-6a95-4f1a-9612-4537174c0611 tempest-TestImageHashVerification-1613625104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.279s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:38:26 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-6d6acdd4-6a95-4f1a-9612-4537174c0611 tempest-TestImageHashVerification-1613625104 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:38:26 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-6d6acdd4-6a95-4f1a-9612-4537174c0611 tempest-TestImageHashVerification-1613625104 None] Deleted volume successfully.
Nov 03 18:38:26 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-6d6acdd4-6a95-4f1a-9612-4537174c0611 tempest-TestImageHashVerification-1613625104 None] Lock "cinder-6e84b6e4-f964-4bae-a107-4dfbfefd41c0-delete_volume" released by "delete_volume" :: held 1.182s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:38:27 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc764adf-e48c-4fb3-ae1c-01e02886edbb tempest-TestInstancesWithCinderVolumes-517437558 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:38:27 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-fc764adf-e48c-4fb3-ae1c-01e02886edbb tempest-TestInstancesWithCinderVolumes-517437558 None] Flow 'volume_create_manager' (6904d1d7-f3ad-4d86-91d1-181bc55cc3ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:38:27 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-fc764adf-e48c-4fb3-ae1c-01e02886edbb tempest-TestInstancesWithCinderVolumes-517437558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18cd7933-4b1c-434e-aa7c-19208ff5d930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:38:27 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-fc764adf-e48c-4fb3-ae1c-01e02886edbb tempest-TestInstancesWithCinderVolumes-517437558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18cd7933-4b1c-434e-aa7c-19208ff5d930) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:38:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-377140095',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=089e798d-b533-47c1-9822-a516a4fe0ba1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44f77a2498ce4fc3ab9de4604159b3e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:38:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:38:27Z,use_quota=True,user_id='701160c19bbf4530a9fb66c045233148',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(704e49ce-7e5b-4054-b397-cf9a917b2295),volume_type_id=704e49ce-7e5b-4054-b397-cf9a917b2295)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:38:27 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-fc764adf-e48c-4fb3-ae1c-01e02886edbb tempest-TestInstancesWithCinderVolumes-517437558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23913759-05ae-4296-a043-18fb777df75d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:38:27 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-fc764adf-e48c-4fb3-ae1c-01e02886edbb tempest-TestInstancesWithCinderVolumes-517437558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23913759-05ae-4296-a043-18fb777df75d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:38:27 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-fc764adf-e48c-4fb3-ae1c-01e02886edbb tempest-TestInstancesWithCinderVolumes-517437558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c12ac34a-bdaa-4453-9b3a-32715343075a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:38:27 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-fc764adf-e48c-4fb3-ae1c-01e02886edbb tempest-TestInstancesWithCinderVolumes-517437558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c12ac34a-bdaa-4453-9b3a-32715343075a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '089e798d-b533-47c1-9822-a516a4fe0ba1', 'volume_name': 'volume-089e798d-b533-47c1-9822-a516a4fe0ba1', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:38:27 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-fc764adf-e48c-4fb3-ae1c-01e02886edbb tempest-TestInstancesWithCinderVolumes-517437558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20a905a4-b7a2-4e23-93f8-282e33c54f19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:38:27 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-fc764adf-e48c-4fb3-ae1c-01e02886edbb tempest-TestInstancesWithCinderVolumes-517437558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20a905a4-b7a2-4e23-93f8-282e33c54f19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:38:27 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-fc764adf-e48c-4fb3-ae1c-01e02886edbb tempest-TestInstancesWithCinderVolumes-517437558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04770a62-11b9-4969-9262-c780cc81495e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:38:27 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-fc764adf-e48c-4fb3-ae1c-01e02886edbb tempest-TestInstancesWithCinderVolumes-517437558 None] Volume 089e798d-b533-47c1-9822-a516a4fe0ba1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-089e798d-b533-47c1-9822-a516a4fe0ba1', 'volume_size': 1}
Nov 03 18:38:27 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-fc764adf-e48c-4fb3-ae1c-01e02886edbb tempest-TestInstancesWithCinderVolumes-517437558 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:38:27 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-fc764adf-e48c-4fb3-ae1c-01e02886edbb tempest-TestInstancesWithCinderVolumes-517437558 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:38:27 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-fc764adf-e48c-4fb3-ae1c-01e02886edbb tempest-TestInstancesWithCinderVolumes-517437558 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:38:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-377140095',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=089e798d-b533-47c1-9822-a516a4fe0ba1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44f77a2498ce4fc3ab9de4604159b3e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:38:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:38:27Z,use_quota=True,user_id='701160c19bbf4530a9fb66c045233148',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(704e49ce-7e5b-4054-b397-cf9a917b2295),volume_type_id=704e49ce-7e5b-4054-b397-cf9a917b2295)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:38:27 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-fc764adf-e48c-4fb3-ae1c-01e02886edbb tempest-TestInstancesWithCinderVolumes-517437558 None] Creating volume 089e798d-b533-47c1-9822-a516a4fe0ba1 {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:38:27 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-fc764adf-e48c-4fb3-ae1c-01e02886edbb tempest-TestInstancesWithCinderVolumes-517437558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:38:27 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-fc764adf-e48c-4fb3-ae1c-01e02886edbb tempest-TestInstancesWithCinderVolumes-517437558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:38:27 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-fc764adf-e48c-4fb3-ae1c-01e02886edbb tempest-TestInstancesWithCinderVolumes-517437558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:38:27 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-fc764adf-e48c-4fb3-ae1c-01e02886edbb tempest-TestInstancesWithCinderVolumes-517437558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:38:27 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-fc764adf-e48c-4fb3-ae1c-01e02886edbb tempest-TestInstancesWithCinderVolumes-517437558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:38:27 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-fc764adf-e48c-4fb3-ae1c-01e02886edbb tempest-TestInstancesWithCinderVolumes-517437558 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:38:27 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-fc764adf-e48c-4fb3-ae1c-01e02886edbb tempest-TestInstancesWithCinderVolumes-517437558 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:38:27 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-fc764adf-e48c-4fb3-ae1c-01e02886edbb tempest-TestInstancesWithCinderVolumes-517437558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-089e798d-b533-47c1-9822-a516a4fe0ba1 1073741824 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:38:27 devstack sudo[103638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-089e798d-b533-47c1-9822-a516a4fe0ba1 1073741824
Nov 03 18:38:27 devstack sudo[103638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:38:27 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ed8a317-0672-4ed5-b7f1-5e52f877b490 tempest-TestInstancesWithCinderVolumes-517437558 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:38:27 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-0ed8a317-0672-4ed5-b7f1-5e52f877b490 tempest-TestInstancesWithCinderVolumes-517437558 None] Flow 'volume_create_manager' (31096317-220d-43d0-952d-1f8f20af91c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:38:27 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-0ed8a317-0672-4ed5-b7f1-5e52f877b490 tempest-TestInstancesWithCinderVolumes-517437558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a96f32c1-f76e-4caf-af8f-85bd75eda7b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:38:27 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-0ed8a317-0672-4ed5-b7f1-5e52f877b490 tempest-TestInstancesWithCinderVolumes-517437558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a96f32c1-f76e-4caf-af8f-85bd75eda7b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:38:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-823743229',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53141f35-9fdc-4822-b70f-df3a1469c321,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44f77a2498ce4fc3ab9de4604159b3e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:38:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:38:28Z,use_quota=True,user_id='701160c19bbf4530a9fb66c045233148',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef3d0fe6-3b9a-4bb4-ae3d-25ddead012f2),volume_type_id=ef3d0fe6-3b9a-4bb4-ae3d-25ddead012f2)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:38:27 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-0ed8a317-0672-4ed5-b7f1-5e52f877b490 tempest-TestInstancesWithCinderVolumes-517437558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27e0a8b9-9a99-4a9f-96ee-5a7d78be29a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:38:27 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-0ed8a317-0672-4ed5-b7f1-5e52f877b490 tempest-TestInstancesWithCinderVolumes-517437558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27e0a8b9-9a99-4a9f-96ee-5a7d78be29a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:38:27 devstack sudo[103638]: pam_unix(sudo:session): session closed for user root
Nov 03 18:38:27 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-0ed8a317-0672-4ed5-b7f1-5e52f877b490 tempest-TestInstancesWithCinderVolumes-517437558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31fc0684-3096-46c8-aa37-82c49c7edaa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:38:27 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-0ed8a317-0672-4ed5-b7f1-5e52f877b490 tempest-TestInstancesWithCinderVolumes-517437558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31fc0684-3096-46c8-aa37-82c49c7edaa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53141f35-9fdc-4822-b70f-df3a1469c321', 'volume_name': 'volume-53141f35-9fdc-4822-b70f-df3a1469c321', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:38:27 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-0ed8a317-0672-4ed5-b7f1-5e52f877b490 tempest-TestInstancesWithCinderVolumes-517437558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bdc3d9e-fe4d-4d73-a4c1-44f3ec980990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:38:27 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-0ed8a317-0672-4ed5-b7f1-5e52f877b490 tempest-TestInstancesWithCinderVolumes-517437558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bdc3d9e-fe4d-4d73-a4c1-44f3ec980990) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:38:27 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-0ed8a317-0672-4ed5-b7f1-5e52f877b490 tempest-TestInstancesWithCinderVolumes-517437558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a87626bc-0c8d-49f0-adba-9b5aeed3c53c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:38:27 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-0ed8a317-0672-4ed5-b7f1-5e52f877b490 tempest-TestInstancesWithCinderVolumes-517437558 None] Volume 53141f35-9fdc-4822-b70f-df3a1469c321: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53141f35-9fdc-4822-b70f-df3a1469c321', 'volume_size': 1}
Nov 03 18:38:27 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-0ed8a317-0672-4ed5-b7f1-5e52f877b490 tempest-TestInstancesWithCinderVolumes-517437558 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:38:27 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-fc764adf-e48c-4fb3-ae1c-01e02886edbb tempest-TestInstancesWithCinderVolumes-517437558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-089e798d-b533-47c1-9822-a516a4fe0ba1 1073741824" returned: 0 in 0.606s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:38:28 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-fc764adf-e48c-4fb3-ae1c-01e02886edbb tempest-TestInstancesWithCinderVolumes-517437558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-089e798d-b533-47c1-9822-a516a4fe0ba1 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:38:28 devstack sudo[103644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-089e798d-b533-47c1-9822-a516a4fe0ba1
Nov 03 18:38:28 devstack sudo[103644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:38:28 devstack sudo[103644]: pam_unix(sudo:session): session closed for user root
Nov 03 18:38:28 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-fc764adf-e48c-4fb3-ae1c-01e02886edbb tempest-TestInstancesWithCinderVolumes-517437558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-089e798d-b533-47c1-9822-a516a4fe0ba1" returned: 0 in 0.315s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:38:28 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-fc764adf-e48c-4fb3-ae1c-01e02886edbb tempest-TestInstancesWithCinderVolumes-517437558 None] <== create_volume: return (961ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:38:28 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-fc764adf-e48c-4fb3-ae1c-01e02886edbb tempest-TestInstancesWithCinderVolumes-517437558 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.964s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:38:28 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-0ed8a317-0672-4ed5-b7f1-5e52f877b490 tempest-TestInstancesWithCinderVolumes-517437558 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.356s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:38:28 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-0ed8a317-0672-4ed5-b7f1-5e52f877b490 tempest-TestInstancesWithCinderVolumes-517437558 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:38:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-823743229',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53141f35-9fdc-4822-b70f-df3a1469c321,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44f77a2498ce4fc3ab9de4604159b3e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:38:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:38:28Z,use_quota=True,user_id='701160c19bbf4530a9fb66c045233148',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef3d0fe6-3b9a-4bb4-ae3d-25ddead012f2),volume_type_id=ef3d0fe6-3b9a-4bb4-ae3d-25ddead012f2)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:38:28 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-0ed8a317-0672-4ed5-b7f1-5e52f877b490 tempest-TestInstancesWithCinderVolumes-517437558 None] Creating volume 53141f35-9fdc-4822-b70f-df3a1469c321 {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:38:28 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-0ed8a317-0672-4ed5-b7f1-5e52f877b490 tempest-TestInstancesWithCinderVolumes-517437558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:38:28 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-0ed8a317-0672-4ed5-b7f1-5e52f877b490 tempest-TestInstancesWithCinderVolumes-517437558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:38:28 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-0ed8a317-0672-4ed5-b7f1-5e52f877b490 tempest-TestInstancesWithCinderVolumes-517437558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:38:28 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-0ed8a317-0672-4ed5-b7f1-5e52f877b490 tempest-TestInstancesWithCinderVolumes-517437558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:38:28 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-0ed8a317-0672-4ed5-b7f1-5e52f877b490 tempest-TestInstancesWithCinderVolumes-517437558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:38:28 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-0ed8a317-0672-4ed5-b7f1-5e52f877b490 tempest-TestInstancesWithCinderVolumes-517437558 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:38:28 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-0ed8a317-0672-4ed5-b7f1-5e52f877b490 tempest-TestInstancesWithCinderVolumes-517437558 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:38:28 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-0ed8a317-0672-4ed5-b7f1-5e52f877b490 tempest-TestInstancesWithCinderVolumes-517437558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-53141f35-9fdc-4822-b70f-df3a1469c321 1073741824 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:38:28 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-fc764adf-e48c-4fb3-ae1c-01e02886edbb tempest-TestInstancesWithCinderVolumes-517437558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04770a62-11b9-4969-9262-c780cc81495e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-089e798d-b533-47c1-9822-a516a4fe0ba1', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:38:28 devstack sudo[103647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-53141f35-9fdc-4822-b70f-df3a1469c321 1073741824
Nov 03 18:38:28 devstack sudo[103647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:38:28 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-fc764adf-e48c-4fb3-ae1c-01e02886edbb tempest-TestInstancesWithCinderVolumes-517437558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (877e399e-80ce-44d8-bfb6-95ec497329a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:38:28 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-4694f8f8-7e4c-4d24-827d-796084b94803 tempest-TestInstancesWithCinderVolumes-517437558 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:38:28 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-4694f8f8-7e4c-4d24-827d-796084b94803 tempest-TestInstancesWithCinderVolumes-517437558 None] Flow 'volume_create_manager' (1041f9c7-6044-4f15-a7c5-1f28b47f17fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:38:28 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-4694f8f8-7e4c-4d24-827d-796084b94803 tempest-TestInstancesWithCinderVolumes-517437558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63501d7d-fa4c-4d34-99db-f2ce5983ca0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:38:28 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-fc764adf-e48c-4fb3-ae1c-01e02886edbb tempest-TestInstancesWithCinderVolumes-517437558 None] Volume volume-089e798d-b533-47c1-9822-a516a4fe0ba1 (089e798d-b533-47c1-9822-a516a4fe0ba1): created successfully
Nov 03 18:38:28 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-fc764adf-e48c-4fb3-ae1c-01e02886edbb tempest-TestInstancesWithCinderVolumes-517437558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (877e399e-80ce-44d8-bfb6-95ec497329a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:38:28 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-fc764adf-e48c-4fb3-ae1c-01e02886edbb tempest-TestInstancesWithCinderVolumes-517437558 None] Flow 'volume_create_manager' (6904d1d7-f3ad-4d86-91d1-181bc55cc3ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:38:28 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-4694f8f8-7e4c-4d24-827d-796084b94803 tempest-TestInstancesWithCinderVolumes-517437558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63501d7d-fa4c-4d34-99db-f2ce5983ca0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:38:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1961334187',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d4d6c32-7256-40dc-a782-bc8a4f37c541,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44f77a2498ce4fc3ab9de4604159b3e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:38:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:38:28Z,use_quota=True,user_id='701160c19bbf4530a9fb66c045233148',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9566e37f-e772-447a-b507-45a79a2a1d67),volume_type_id=9566e37f-e772-447a-b507-45a79a2a1d67)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:38:28 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-4694f8f8-7e4c-4d24-827d-796084b94803 tempest-TestInstancesWithCinderVolumes-517437558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc9ff0bf-51fd-4f9a-be21-0f4b447cfaa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:38:28 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-4694f8f8-7e4c-4d24-827d-796084b94803 tempest-TestInstancesWithCinderVolumes-517437558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc9ff0bf-51fd-4f9a-be21-0f4b447cfaa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:38:28 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-4694f8f8-7e4c-4d24-827d-796084b94803 tempest-TestInstancesWithCinderVolumes-517437558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9cea048-18c7-40eb-b13b-420af0867ff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:38:28 devstack cinder-volume[86120]: DEBUG cinder.image.glance [None req-4694f8f8-7e4c-4d24-827d-796084b94803 tempest-TestInstancesWithCinderVolumes-517437558 None] Creating Keystone auth plugin from conf {{(pid=86120) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 03 18:38:28 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-fc764adf-e48c-4fb3-ae1c-01e02886edbb tempest-TestInstancesWithCinderVolumes-517437558 None] Created volume successfully.
Nov 03 18:38:28 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-4694f8f8-7e4c-4d24-827d-796084b94803 tempest-TestInstancesWithCinderVolumes-517437558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9cea048-18c7-40eb-b13b-420af0867ff7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6d4d6c32-7256-40dc-a782-bc8a4f37c541', 'volume_name': 'volume-6d4d6c32-7256-40dc-a782-bc8a4f37c541', 'volume_size': 1, 'image_id': 'd50f4da1-2d30-435b-a046-699f9961b2ff', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d50f4da1-2d30-435b-a046-699f9961b2ff', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--2029572019', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '44f77a2498ce4fc3ab9de4604159b3e5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd50f4da1-2d30-435b-a046-699f9961b2ff', 'created_at': datetime.datetime(2026, 11, 3, 17, 38, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 17, 38, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d50f4da1-2d30-435b-a046-699f9961b2ff/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7a8d3cd9d010>}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:38:28 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-4694f8f8-7e4c-4d24-827d-796084b94803 tempest-TestInstancesWithCinderVolumes-517437558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e570b4a9-7f76-479b-abdd-2379549487bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:38:28 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-4694f8f8-7e4c-4d24-827d-796084b94803 tempest-TestInstancesWithCinderVolumes-517437558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e570b4a9-7f76-479b-abdd-2379549487bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:38:28 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-4694f8f8-7e4c-4d24-827d-796084b94803 tempest-TestInstancesWithCinderVolumes-517437558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4dd08c39-8fad-4467-8da3-39a45c66f711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:38:28 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-4694f8f8-7e4c-4d24-827d-796084b94803 tempest-TestInstancesWithCinderVolumes-517437558 None] Volume 6d4d6c32-7256-40dc-a782-bc8a4f37c541: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6d4d6c32-7256-40dc-a782-bc8a4f37c541', 'volume_size': 1, 'image_id': 'd50f4da1-2d30-435b-a046-699f9961b2ff', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d50f4da1-2d30-435b-a046-699f9961b2ff', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--2029572019', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '44f77a2498ce4fc3ab9de4604159b3e5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd50f4da1-2d30-435b-a046-699f9961b2ff', 'created_at': datetime.datetime(2026, 11, 3, 17, 38, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 17, 38, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d50f4da1-2d30-435b-a046-699f9961b2ff/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7a8d3cd9d010>}
Nov 03 18:38:28 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-4694f8f8-7e4c-4d24-827d-796084b94803 tempest-TestInstancesWithCinderVolumes-517437558 None] Trying to clone 6d4d6c32-7256-40dc-a782-bc8a4f37c541 from image d50f4da1-2d30-435b-a046-699f9961b2ff at location (None, [{'url': 'file:///opt/stack/data/glance/images/d50f4da1-2d30-435b-a046-699f9961b2ff', 'metadata': {}}]). {{(pid=86120) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 03 18:38:28 devstack sudo[103647]: pam_unix(sudo:session): session closed for user root
Nov 03 18:38:28 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-0ed8a317-0672-4ed5-b7f1-5e52f877b490 tempest-TestInstancesWithCinderVolumes-517437558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-53141f35-9fdc-4822-b70f-df3a1469c321 1073741824" returned: 0 in 0.567s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:38:28 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-0ed8a317-0672-4ed5-b7f1-5e52f877b490 tempest-TestInstancesWithCinderVolumes-517437558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-53141f35-9fdc-4822-b70f-df3a1469c321 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:38:28 devstack sudo[103654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-53141f35-9fdc-4822-b70f-df3a1469c321
Nov 03 18:38:28 devstack sudo[103654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:38:29 devstack sudo[103654]: pam_unix(sudo:session): session closed for user root
Nov 03 18:38:29 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-0ed8a317-0672-4ed5-b7f1-5e52f877b490 tempest-TestInstancesWithCinderVolumes-517437558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-53141f35-9fdc-4822-b70f-df3a1469c321" returned: 0 in 0.290s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:38:29 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-0ed8a317-0672-4ed5-b7f1-5e52f877b490 tempest-TestInstancesWithCinderVolumes-517437558 None] <== create_volume: return (909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:38:29 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-0ed8a317-0672-4ed5-b7f1-5e52f877b490 tempest-TestInstancesWithCinderVolumes-517437558 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.913s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:38:29 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-0ed8a317-0672-4ed5-b7f1-5e52f877b490 tempest-TestInstancesWithCinderVolumes-517437558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a87626bc-0c8d-49f0-adba-9b5aeed3c53c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53141f35-9fdc-4822-b70f-df3a1469c321', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:38:29 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-0ed8a317-0672-4ed5-b7f1-5e52f877b490 tempest-TestInstancesWithCinderVolumes-517437558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (894af537-e801-455f-a1a8-229d69754bce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:38:29 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-0ed8a317-0672-4ed5-b7f1-5e52f877b490 tempest-TestInstancesWithCinderVolumes-517437558 None] Volume volume-53141f35-9fdc-4822-b70f-df3a1469c321 (53141f35-9fdc-4822-b70f-df3a1469c321): created successfully
Nov 03 18:38:29 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-0ed8a317-0672-4ed5-b7f1-5e52f877b490 tempest-TestInstancesWithCinderVolumes-517437558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (894af537-e801-455f-a1a8-229d69754bce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:38:29 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-0ed8a317-0672-4ed5-b7f1-5e52f877b490 tempest-TestInstancesWithCinderVolumes-517437558 None] Flow 'volume_create_manager' (31096317-220d-43d0-952d-1f8f20af91c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:38:29 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-0ed8a317-0672-4ed5-b7f1-5e52f877b490 tempest-TestInstancesWithCinderVolumes-517437558 None] Created volume successfully.
Nov 03 18:38:32 devstack cinder-volume[86120]: DEBUG cinder.image.image_utils [None req-4694f8f8-7e4c-4d24-827d-796084b94803 tempest-TestInstancesWithCinderVolumes-517437558 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d50f4da1-2d30-435b-a046-699f9961b2ff_8n8xse8qdevstack@QuobyteHD, size 20.69 MB, duration 3.39 sec {{(pid=86120) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 03 18:38:32 devstack cinder-volume[86120]: INFO cinder.image.image_utils [None req-4694f8f8-7e4c-4d24-827d-796084b94803 tempest-TestInstancesWithCinderVolumes-517437558 None] Image download 20.69 MB at 6.09 MB/s
Nov 03 18:38:32 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab0582b2-a4fc-49fb-b8af-8897169eaca3]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:38:32 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-4694f8f8-7e4c-4d24-827d-796084b94803 tempest-TestInstancesWithCinderVolumes-517437558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d50f4da1-2d30-435b-a046-699f9961b2ff_8n8xse8qdevstack@QuobyteHD {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:38:32 devstack sudo[103659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d50f4da1-2d30-435b-a046-699f9961b2ff_8n8xse8qdevstack@QuobyteHD
Nov 03 18:38:32 devstack sudo[103659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:38:32 devstack sudo[103659]: pam_unix(sudo:session): session closed for user root
Nov 03 18:38:32 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-4694f8f8-7e4c-4d24-827d-796084b94803 tempest-TestInstancesWithCinderVolumes-517437558 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d50f4da1-2d30-435b-a046-699f9961b2ff_8n8xse8qdevstack@QuobyteHD" returned: 0 in 0.340s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:38:32 devstack cinder-volume[86120]: DEBUG cinder.image.image_utils [None req-4694f8f8-7e4c-4d24-827d-796084b94803 tempest-TestInstancesWithCinderVolumes-517437558 None] Temporary image d50f4da1-2d30-435b-a046-699f9961b2ff is fetched for user 701160c19bbf4530a9fb66c045233148. {{(pid=86120) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 03 18:38:32 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[768ec6bc-5d94-49af-ba3a-605c00a7c663]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:38:32 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-4694f8f8-7e4c-4d24-827d-796084b94803 tempest-TestInstancesWithCinderVolumes-517437558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d50f4da1-2d30-435b-a046-699f9961b2ff_8n8xse8qdevstack@QuobyteHD {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:38:32 devstack sudo[103664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d50f4da1-2d30-435b-a046-699f9961b2ff_8n8xse8qdevstack@QuobyteHD
Nov 03 18:38:32 devstack sudo[103664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:38:33 devstack sudo[103664]: pam_unix(sudo:session): session closed for user root
Nov 03 18:38:33 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-4694f8f8-7e4c-4d24-827d-796084b94803 tempest-TestInstancesWithCinderVolumes-517437558 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d50f4da1-2d30-435b-a046-699f9961b2ff_8n8xse8qdevstack@QuobyteHD" returned: 0 in 0.340s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:38:33 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-4694f8f8-7e4c-4d24-827d-796084b94803 tempest-TestInstancesWithCinderVolumes-517437558 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:38:33 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-4694f8f8-7e4c-4d24-827d-796084b94803 tempest-TestInstancesWithCinderVolumes-517437558 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:38:33 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-4694f8f8-7e4c-4d24-827d-796084b94803 tempest-TestInstancesWithCinderVolumes-517437558 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:38:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1961334187',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d4d6c32-7256-40dc-a782-bc8a4f37c541,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44f77a2498ce4fc3ab9de4604159b3e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:38:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:38:28Z,use_quota=True,user_id='701160c19bbf4530a9fb66c045233148',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9566e37f-e772-447a-b507-45a79a2a1d67),volume_type_id=9566e37f-e772-447a-b507-45a79a2a1d67)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:38:33 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-4694f8f8-7e4c-4d24-827d-796084b94803 tempest-TestInstancesWithCinderVolumes-517437558 None] Creating volume 6d4d6c32-7256-40dc-a782-bc8a4f37c541 {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:38:33 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-4694f8f8-7e4c-4d24-827d-796084b94803 tempest-TestInstancesWithCinderVolumes-517437558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:38:33 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-4694f8f8-7e4c-4d24-827d-796084b94803 tempest-TestInstancesWithCinderVolumes-517437558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:38:33 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-4694f8f8-7e4c-4d24-827d-796084b94803 tempest-TestInstancesWithCinderVolumes-517437558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:38:33 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-4694f8f8-7e4c-4d24-827d-796084b94803 tempest-TestInstancesWithCinderVolumes-517437558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:38:33 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-4694f8f8-7e4c-4d24-827d-796084b94803 tempest-TestInstancesWithCinderVolumes-517437558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:38:33 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-4694f8f8-7e4c-4d24-827d-796084b94803 tempest-TestInstancesWithCinderVolumes-517437558 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:38:33 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-4694f8f8-7e4c-4d24-827d-796084b94803 tempest-TestInstancesWithCinderVolumes-517437558 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:38:33 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-4694f8f8-7e4c-4d24-827d-796084b94803 tempest-TestInstancesWithCinderVolumes-517437558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6d4d6c32-7256-40dc-a782-bc8a4f37c541 1073741824 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:38:33 devstack sudo[103670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6d4d6c32-7256-40dc-a782-bc8a4f37c541 1073741824
Nov 03 18:38:33 devstack sudo[103670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:38:33 devstack sudo[103670]: pam_unix(sudo:session): session closed for user root
Nov 03 18:38:33 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-4694f8f8-7e4c-4d24-827d-796084b94803 tempest-TestInstancesWithCinderVolumes-517437558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6d4d6c32-7256-40dc-a782-bc8a4f37c541 1073741824" returned: 0 in 0.427s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:38:33 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-4694f8f8-7e4c-4d24-827d-796084b94803 tempest-TestInstancesWithCinderVolumes-517437558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6d4d6c32-7256-40dc-a782-bc8a4f37c541 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:38:33 devstack sudo[103676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6d4d6c32-7256-40dc-a782-bc8a4f37c541
Nov 03 18:38:33 devstack sudo[103676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:38:33 devstack sudo[103676]: pam_unix(sudo:session): session closed for user root
Nov 03 18:38:33 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-4694f8f8-7e4c-4d24-827d-796084b94803 tempest-TestInstancesWithCinderVolumes-517437558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6d4d6c32-7256-40dc-a782-bc8a4f37c541" returned: 0 in 0.248s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:38:33 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-4694f8f8-7e4c-4d24-827d-796084b94803 tempest-TestInstancesWithCinderVolumes-517437558 None] <== create_volume: return (723ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:38:33 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-4694f8f8-7e4c-4d24-827d-796084b94803 tempest-TestInstancesWithCinderVolumes-517437558 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.733s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:38:33 devstack cinder-volume[86120]: DEBUG cinder.volume.volume_utils [None req-4694f8f8-7e4c-4d24-827d-796084b94803 tempest-TestInstancesWithCinderVolumes-517437558 None] Attempting download of d50f4da1-2d30-435b-a046-699f9961b2ff ((None, [{'url': 'file:///opt/stack/data/glance/images/d50f4da1-2d30-435b-a046-699f9961b2ff', 'metadata': {}}])) to volume 6d4d6c32-7256-40dc-a782-bc8a4f37c541. {{(pid=86120) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 03 18:38:33 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[89af404b-f363-485b-bd62-410ada66796d]: (4, 'raw') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:38:33 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-4694f8f8-7e4c-4d24-827d-796084b94803 tempest-TestInstancesWithCinderVolumes-517437558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d50f4da1-2d30-435b-a046-699f9961b2ff_ae5fuqq3 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:38:33 devstack sudo[103693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d50f4da1-2d30-435b-a046-699f9961b2ff_ae5fuqq3
Nov 03 18:38:33 devstack sudo[103693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:38:34 devstack sudo[103693]: pam_unix(sudo:session): session closed for user root
Nov 03 18:38:34 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-4694f8f8-7e4c-4d24-827d-796084b94803 tempest-TestInstancesWithCinderVolumes-517437558 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d50f4da1-2d30-435b-a046-699f9961b2ff_ae5fuqq3" returned: 0 in 0.366s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:38:34 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-4694f8f8-7e4c-4d24-827d-796084b94803 tempest-TestInstancesWithCinderVolumes-517437558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d50f4da1-2d30-435b-a046-699f9961b2ff_ae5fuqq3 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:38:34 devstack sudo[103719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d50f4da1-2d30-435b-a046-699f9961b2ff_ae5fuqq3
Nov 03 18:38:34 devstack sudo[103719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:38:34 devstack sudo[103719]: pam_unix(sudo:session): session closed for user root
Nov 03 18:38:34 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-4694f8f8-7e4c-4d24-827d-796084b94803 tempest-TestInstancesWithCinderVolumes-517437558 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d50f4da1-2d30-435b-a046-699f9961b2ff_ae5fuqq3" returned: 1 in 0.319s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:38:34 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-4694f8f8-7e4c-4d24-827d-796084b94803 tempest-TestInstancesWithCinderVolumes-517437558 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d50f4da1-2d30-435b-a046-699f9961b2ff_ae5fuqq3' failed. Not Retrying. {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 03 18:38:34 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc06ec87-3d44-4966-abaa-f810b6fa5872]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:38:34 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-4694f8f8-7e4c-4d24-827d-796084b94803 tempest-TestInstancesWithCinderVolumes-517437558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d50f4da1-2d30-435b-a046-699f9961b2ff_8n8xse8qdevstack@QuobyteHD {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:38:34 devstack sudo[103723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d50f4da1-2d30-435b-a046-699f9961b2ff_8n8xse8qdevstack@QuobyteHD
Nov 03 18:38:34 devstack sudo[103723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:38:34 devstack sudo[103723]: pam_unix(sudo:session): session closed for user root
Nov 03 18:38:34 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-4694f8f8-7e4c-4d24-827d-796084b94803 tempest-TestInstancesWithCinderVolumes-517437558 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d50f4da1-2d30-435b-a046-699f9961b2ff_8n8xse8qdevstack@QuobyteHD" returned: 0 in 0.314s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:38:34 devstack cinder-volume[86120]: DEBUG cinder.image.image_utils [None req-4694f8f8-7e4c-4d24-827d-796084b94803 tempest-TestInstancesWithCinderVolumes-517437558 None] d50f4da1-2d30-435b-a046-699f9961b2ff was qcow2, converting to qcow2 {{(pid=86120) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 03 18:38:34 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-4694f8f8-7e4c-4d24-827d-796084b94803 tempest-TestInstancesWithCinderVolumes-517437558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d50f4da1-2d30-435b-a046-699f9961b2ff_8n8xse8qdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6d4d6c32-7256-40dc-a782-bc8a4f37c541 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:38:34 devstack sudo[103728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d50f4da1-2d30-435b-a046-699f9961b2ff_8n8xse8qdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6d4d6c32-7256-40dc-a782-bc8a4f37c541
Nov 03 18:38:34 devstack sudo[103728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:38:36 devstack sudo[103728]: pam_unix(sudo:session): session closed for user root
Nov 03 18:38:36 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-4694f8f8-7e4c-4d24-827d-796084b94803 tempest-TestInstancesWithCinderVolumes-517437558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d50f4da1-2d30-435b-a046-699f9961b2ff_8n8xse8qdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6d4d6c32-7256-40dc-a782-bc8a4f37c541" returned: 0 in 1.951s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:38:36 devstack cinder-volume[86120]: DEBUG cinder.image.image_utils [None req-4694f8f8-7e4c-4d24-827d-796084b94803 tempest-TestInstancesWithCinderVolumes-517437558 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d50f4da1-2d30-435b-a046-699f9961b2ff_8n8xse8qdevstack@QuobyteHD, size 112.00 MB, duration 1.95 sec, destination /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6d4d6c32-7256-40dc-a782-bc8a4f37c541 {{(pid=86120) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 03 18:38:36 devstack cinder-volume[86120]: INFO cinder.image.image_utils [None req-4694f8f8-7e4c-4d24-827d-796084b94803 tempest-TestInstancesWithCinderVolumes-517437558 None] Converted 112.00 MB image at 57.38 MB/s
Nov 03 18:38:36 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-4694f8f8-7e4c-4d24-827d-796084b94803 tempest-TestInstancesWithCinderVolumes-517437558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6d4d6c32-7256-40dc-a782-bc8a4f37c541 1G {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:38:36 devstack sudo[103737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6d4d6c32-7256-40dc-a782-bc8a4f37c541 1G
Nov 03 18:38:36 devstack sudo[103737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:38:37 devstack sudo[103737]: pam_unix(sudo:session): session closed for user root
Nov 03 18:38:37 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-4694f8f8-7e4c-4d24-827d-796084b94803 tempest-TestInstancesWithCinderVolumes-517437558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6d4d6c32-7256-40dc-a782-bc8a4f37c541 1G" returned: 0 in 0.337s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:38:37 devstack cinder-volume[86120]: DEBUG cinder.volume.volume_utils [None req-4694f8f8-7e4c-4d24-827d-796084b94803 tempest-TestInstancesWithCinderVolumes-517437558 None] Downloaded image d50f4da1-2d30-435b-a046-699f9961b2ff ((None, [{'url': 'file:///opt/stack/data/glance/images/d50f4da1-2d30-435b-a046-699f9961b2ff', 'metadata': {}}])) to volume 6d4d6c32-7256-40dc-a782-bc8a4f37c541 successfully. {{(pid=86120) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 03 18:38:37 devstack cinder-volume[86120]: DEBUG cinder.image.image_utils [None req-4694f8f8-7e4c-4d24-827d-796084b94803 tempest-TestInstancesWithCinderVolumes-517437558 None] Temporary image d50f4da1-2d30-435b-a046-699f9961b2ff for user 701160c19bbf4530a9fb66c045233148 is deleted. {{(pid=86120) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 03 18:38:37 devstack cinder-volume[86120]: DEBUG cinder.volume.volume_utils [None req-4694f8f8-7e4c-4d24-827d-796084b94803 tempest-TestInstancesWithCinderVolumes-517437558 None] Marking volume 6d4d6c32-7256-40dc-a782-bc8a4f37c541 as bootable. {{(pid=86120) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 03 18:38:37 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-4694f8f8-7e4c-4d24-827d-796084b94803 tempest-TestInstancesWithCinderVolumes-517437558 None] Copying metadata from image d50f4da1-2d30-435b-a046-699f9961b2ff to 6d4d6c32-7256-40dc-a782-bc8a4f37c541. {{(pid=86120) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 03 18:38:37 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-4694f8f8-7e4c-4d24-827d-796084b94803 tempest-TestInstancesWithCinderVolumes-517437558 None] Creating volume glance metadata for volume 6d4d6c32-7256-40dc-a782-bc8a4f37c541 backed by image d50f4da1-2d30-435b-a046-699f9961b2ff with: {'image_id': 'd50f4da1-2d30-435b-a046-699f9961b2ff', 'image_name': 'tempest-scenario-img--2029572019', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86120) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 03 18:38:37 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-4694f8f8-7e4c-4d24-827d-796084b94803 tempest-TestInstancesWithCinderVolumes-517437558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4dd08c39-8fad-4467-8da3-39a45c66f711) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d4d6c32-7256-40dc-a782-bc8a4f37c541', 'volume_size': 1, 'image_id': 'd50f4da1-2d30-435b-a046-699f9961b2ff', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d50f4da1-2d30-435b-a046-699f9961b2ff', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--2029572019', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '44f77a2498ce4fc3ab9de4604159b3e5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd50f4da1-2d30-435b-a046-699f9961b2ff', 'created_at': datetime.datetime(2026, 11, 3, 17, 38, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 17, 38, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d50f4da1-2d30-435b-a046-699f9961b2ff/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7a8d3cd9d010>}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:38:37 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-4694f8f8-7e4c-4d24-827d-796084b94803 tempest-TestInstancesWithCinderVolumes-517437558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5eef2536-dbc8-46cf-a7be-caca081826a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:38:37 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-4694f8f8-7e4c-4d24-827d-796084b94803 tempest-TestInstancesWithCinderVolumes-517437558 None] Volume volume-6d4d6c32-7256-40dc-a782-bc8a4f37c541 (6d4d6c32-7256-40dc-a782-bc8a4f37c541): created successfully
Nov 03 18:38:37 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-4694f8f8-7e4c-4d24-827d-796084b94803 tempest-TestInstancesWithCinderVolumes-517437558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5eef2536-dbc8-46cf-a7be-caca081826a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:38:37 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-4694f8f8-7e4c-4d24-827d-796084b94803 tempest-TestInstancesWithCinderVolumes-517437558 None] Flow 'volume_create_manager' (1041f9c7-6044-4f15-a7c5-1f28b47f17fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:38:37 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-4694f8f8-7e4c-4d24-827d-796084b94803 tempest-TestInstancesWithCinderVolumes-517437558 None] Created volume successfully.
Nov 03 18:38:39 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e98e5ab-19d8-41e7-979e-7b9518752a12 tempest-CreateVolumesFromSnapshotTest-661250879 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:38:39 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-2e98e5ab-19d8-41e7-979e-7b9518752a12 tempest-CreateVolumesFromSnapshotTest-661250879 None] Flow 'volume_create_manager' (d5146447-317b-41d5-ba89-6de3169c8878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:38:39 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-2e98e5ab-19d8-41e7-979e-7b9518752a12 tempest-CreateVolumesFromSnapshotTest-661250879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (950e2c59-b000-4e14-b6d8-a9afefa712bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:38:39 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-2e98e5ab-19d8-41e7-979e-7b9518752a12 tempest-CreateVolumesFromSnapshotTest-661250879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (950e2c59-b000-4e14-b6d8-a9afefa712bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:38:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-565461637',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=783ac3cf-e6fa-4dc2-85fd-253b5be69667,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9c6fb58b4164d528c7804d55c5e6497',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:38:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:38:39Z,use_quota=True,user_id='d480cd51911c4cafb0f379cd6153fdd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:38:39 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-2e98e5ab-19d8-41e7-979e-7b9518752a12 tempest-CreateVolumesFromSnapshotTest-661250879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3992474b-7fa1-46b8-b649-0c6e7916131a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:38:39 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-2e98e5ab-19d8-41e7-979e-7b9518752a12 tempest-CreateVolumesFromSnapshotTest-661250879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3992474b-7fa1-46b8-b649-0c6e7916131a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:38:39 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-2e98e5ab-19d8-41e7-979e-7b9518752a12 tempest-CreateVolumesFromSnapshotTest-661250879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a73dcf2-1a35-42a7-b65b-765833deb620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:38:39 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-2e98e5ab-19d8-41e7-979e-7b9518752a12 tempest-CreateVolumesFromSnapshotTest-661250879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a73dcf2-1a35-42a7-b65b-765833deb620) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '783ac3cf-e6fa-4dc2-85fd-253b5be69667', 'volume_name': 'volume-783ac3cf-e6fa-4dc2-85fd-253b5be69667', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:38:39 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-2e98e5ab-19d8-41e7-979e-7b9518752a12 tempest-CreateVolumesFromSnapshotTest-661250879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37bf87d9-dde6-41dc-a38f-4dd114ae3b2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:38:39 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-2e98e5ab-19d8-41e7-979e-7b9518752a12 tempest-CreateVolumesFromSnapshotTest-661250879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37bf87d9-dde6-41dc-a38f-4dd114ae3b2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:38:39 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-2e98e5ab-19d8-41e7-979e-7b9518752a12 tempest-CreateVolumesFromSnapshotTest-661250879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f45ec746-b0d1-4bd8-8fde-b61ec8b6a10e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:38:39 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-2e98e5ab-19d8-41e7-979e-7b9518752a12 tempest-CreateVolumesFromSnapshotTest-661250879 None] Volume 783ac3cf-e6fa-4dc2-85fd-253b5be69667: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-783ac3cf-e6fa-4dc2-85fd-253b5be69667', 'volume_size': 1}
Nov 03 18:38:39 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-2e98e5ab-19d8-41e7-979e-7b9518752a12 tempest-CreateVolumesFromSnapshotTest-661250879 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:38:39 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-2e98e5ab-19d8-41e7-979e-7b9518752a12 tempest-CreateVolumesFromSnapshotTest-661250879 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:38:39 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-2e98e5ab-19d8-41e7-979e-7b9518752a12 tempest-CreateVolumesFromSnapshotTest-661250879 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:38:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-565461637',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=783ac3cf-e6fa-4dc2-85fd-253b5be69667,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9c6fb58b4164d528c7804d55c5e6497',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:38:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:38:39Z,use_quota=True,user_id='d480cd51911c4cafb0f379cd6153fdd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:38:39 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-2e98e5ab-19d8-41e7-979e-7b9518752a12 tempest-CreateVolumesFromSnapshotTest-661250879 None] Creating volume 783ac3cf-e6fa-4dc2-85fd-253b5be69667 {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:38:39 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-2e98e5ab-19d8-41e7-979e-7b9518752a12 tempest-CreateVolumesFromSnapshotTest-661250879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:38:39 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-2e98e5ab-19d8-41e7-979e-7b9518752a12 tempest-CreateVolumesFromSnapshotTest-661250879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:38:39 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-2e98e5ab-19d8-41e7-979e-7b9518752a12 tempest-CreateVolumesFromSnapshotTest-661250879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:38:39 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-2e98e5ab-19d8-41e7-979e-7b9518752a12 tempest-CreateVolumesFromSnapshotTest-661250879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:38:39 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-2e98e5ab-19d8-41e7-979e-7b9518752a12 tempest-CreateVolumesFromSnapshotTest-661250879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:38:39 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-2e98e5ab-19d8-41e7-979e-7b9518752a12 tempest-CreateVolumesFromSnapshotTest-661250879 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:38:39 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-2e98e5ab-19d8-41e7-979e-7b9518752a12 tempest-CreateVolumesFromSnapshotTest-661250879 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:38:39 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-2e98e5ab-19d8-41e7-979e-7b9518752a12 tempest-CreateVolumesFromSnapshotTest-661250879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-783ac3cf-e6fa-4dc2-85fd-253b5be69667 1073741824 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:38:39 devstack sudo[103748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-783ac3cf-e6fa-4dc2-85fd-253b5be69667 1073741824
Nov 03 18:38:39 devstack sudo[103748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:38:39 devstack sudo[103748]: pam_unix(sudo:session): session closed for user root
Nov 03 18:38:39 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-2e98e5ab-19d8-41e7-979e-7b9518752a12 tempest-CreateVolumesFromSnapshotTest-661250879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-783ac3cf-e6fa-4dc2-85fd-253b5be69667 1073741824" returned: 0 in 0.472s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:38:39 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-2e98e5ab-19d8-41e7-979e-7b9518752a12 tempest-CreateVolumesFromSnapshotTest-661250879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-783ac3cf-e6fa-4dc2-85fd-253b5be69667 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:38:39 devstack sudo[103754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-783ac3cf-e6fa-4dc2-85fd-253b5be69667
Nov 03 18:38:39 devstack sudo[103754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:38:40 devstack sudo[103754]: pam_unix(sudo:session): session closed for user root
Nov 03 18:38:40 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-2e98e5ab-19d8-41e7-979e-7b9518752a12 tempest-CreateVolumesFromSnapshotTest-661250879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-783ac3cf-e6fa-4dc2-85fd-253b5be69667" returned: 0 in 0.263s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:38:40 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-2e98e5ab-19d8-41e7-979e-7b9518752a12 tempest-CreateVolumesFromSnapshotTest-661250879 None] <== create_volume: return (784ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:38:40 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-2e98e5ab-19d8-41e7-979e-7b9518752a12 tempest-CreateVolumesFromSnapshotTest-661250879 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.787s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:38:40 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-2e98e5ab-19d8-41e7-979e-7b9518752a12 tempest-CreateVolumesFromSnapshotTest-661250879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f45ec746-b0d1-4bd8-8fde-b61ec8b6a10e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-783ac3cf-e6fa-4dc2-85fd-253b5be69667', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:38:40 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-2e98e5ab-19d8-41e7-979e-7b9518752a12 tempest-CreateVolumesFromSnapshotTest-661250879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8965b1c-e270-4a67-9431-29a27b19ee84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:38:40 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-2e98e5ab-19d8-41e7-979e-7b9518752a12 tempest-CreateVolumesFromSnapshotTest-661250879 None] Volume volume-783ac3cf-e6fa-4dc2-85fd-253b5be69667 (783ac3cf-e6fa-4dc2-85fd-253b5be69667): created successfully
Nov 03 18:38:40 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-2e98e5ab-19d8-41e7-979e-7b9518752a12 tempest-CreateVolumesFromSnapshotTest-661250879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8965b1c-e270-4a67-9431-29a27b19ee84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:38:40 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-2e98e5ab-19d8-41e7-979e-7b9518752a12 tempest-CreateVolumesFromSnapshotTest-661250879 None] Flow 'volume_create_manager' (d5146447-317b-41d5-ba89-6de3169c8878) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:38:40 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-2e98e5ab-19d8-41e7-979e-7b9518752a12 tempest-CreateVolumesFromSnapshotTest-661250879 None] Created volume successfully.
Nov 03 18:38:40 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [req-2c79a32d-9425-4f55-b243-e53a55e58f18 req-d0ce126a-6bcd-4fd1-8b1f-7cc501822e1f tempest-TestInstancesWithCinderVolumes-517437558 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:38:40 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [req-2c79a32d-9425-4f55-b243-e53a55e58f18 req-d0ce126a-6bcd-4fd1-8b1f-7cc501822e1f tempest-TestInstancesWithCinderVolumes-517437558 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:38:40 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [req-2c79a32d-9425-4f55-b243-e53a55e58f18 req-d0ce126a-6bcd-4fd1-8b1f-7cc501822e1f tempest-TestInstancesWithCinderVolumes-517437558 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:38:40 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [req-2c79a32d-9425-4f55-b243-e53a55e58f18 req-d0ce126a-6bcd-4fd1-8b1f-7cc501822e1f tempest-TestInstancesWithCinderVolumes-517437558 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c', 'name': 'volume-6d4d6c32-7256-40dc-a782-bc8a4f37c541', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4a9cb274-1503-4477-bef1-d0a97acdcf27', 'enforce_multipath': True} {{(pid=86120) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 03 18:38:40 devstack cinder-volume[86120]: INFO cinder.volume.manager [req-2c79a32d-9425-4f55-b243-e53a55e58f18 req-d0ce126a-6bcd-4fd1-8b1f-7cc501822e1f tempest-TestInstancesWithCinderVolumes-517437558 None] attachment_update completed successfully.
Nov 03 18:38:41 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-e2ef5ffd-b7f2-4a00-8605-f35d3c638cf8 tempest-CreateVolumesFromSnapshotTest-661250879 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:38:41 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-e2ef5ffd-b7f2-4a00-8605-f35d3c638cf8 tempest-CreateVolumesFromSnapshotTest-661250879 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:38:41 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-e2ef5ffd-b7f2-4a00-8605-f35d3c638cf8 tempest-CreateVolumesFromSnapshotTest-661250879 None] Creating offline snapshot c2fb653c-7a3f-4d5e-bed2-a8f179fef05f of volume 783ac3cf-e6fa-4dc2-85fd-253b5be69667 {{(pid=86120) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 18:38:41 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5a5263f-d244-4ee7-b3e6-df5ef6f53ba3]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:38:41 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-e2ef5ffd-b7f2-4a00-8605-f35d3c638cf8 tempest-CreateVolumesFromSnapshotTest-661250879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-783ac3cf-e6fa-4dc2-85fd-253b5be69667 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:38:41 devstack sudo[103768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-783ac3cf-e6fa-4dc2-85fd-253b5be69667
Nov 03 18:38:41 devstack sudo[103768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:38:41 devstack sudo[103768]: pam_unix(sudo:session): session closed for user root
Nov 03 18:38:41 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-e2ef5ffd-b7f2-4a00-8605-f35d3c638cf8 tempest-CreateVolumesFromSnapshotTest-661250879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-783ac3cf-e6fa-4dc2-85fd-253b5be69667" returned: 0 in 0.399s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:38:41 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-e2ef5ffd-b7f2-4a00-8605-f35d3c638cf8 tempest-CreateVolumesFromSnapshotTest-661250879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-783ac3cf-e6fa-4dc2-85fd-253b5be69667,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-783ac3cf-e6fa-4dc2-85fd-253b5be69667.c2fb653c-7a3f-4d5e-bed2-a8f179fef05f 1G {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:38:41 devstack sudo[103773]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-783ac3cf-e6fa-4dc2-85fd-253b5be69667,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-783ac3cf-e6fa-4dc2-85fd-253b5be69667.c2fb653c-7a3f-4d5e-bed2-a8f179fef05f 1G
Nov 03 18:38:41 devstack sudo[103773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:38:42 devstack sudo[103773]: pam_unix(sudo:session): session closed for user root
Nov 03 18:38:42 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-e2ef5ffd-b7f2-4a00-8605-f35d3c638cf8 tempest-CreateVolumesFromSnapshotTest-661250879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-783ac3cf-e6fa-4dc2-85fd-253b5be69667,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-783ac3cf-e6fa-4dc2-85fd-253b5be69667.c2fb653c-7a3f-4d5e-bed2-a8f179fef05f 1G" returned: 0 in 0.421s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:38:42 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-e2ef5ffd-b7f2-4a00-8605-f35d3c638cf8 tempest-CreateVolumesFromSnapshotTest-661250879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-783ac3cf-e6fa-4dc2-85fd-253b5be69667 -F qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-783ac3cf-e6fa-4dc2-85fd-253b5be69667.c2fb653c-7a3f-4d5e-bed2-a8f179fef05f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:38:42 devstack sudo[103779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-783ac3cf-e6fa-4dc2-85fd-253b5be69667 -F qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-783ac3cf-e6fa-4dc2-85fd-253b5be69667.c2fb653c-7a3f-4d5e-bed2-a8f179fef05f
Nov 03 18:38:42 devstack sudo[103779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:38:42 devstack sudo[103779]: pam_unix(sudo:session): session closed for user root
Nov 03 18:38:42 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-e2ef5ffd-b7f2-4a00-8605-f35d3c638cf8 tempest-CreateVolumesFromSnapshotTest-661250879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-783ac3cf-e6fa-4dc2-85fd-253b5be69667 -F qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-783ac3cf-e6fa-4dc2-85fd-253b5be69667.c2fb653c-7a3f-4d5e-bed2-a8f179fef05f" returned: 0 in 0.317s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:38:42 devstack cinder-volume[86120]: WARNING cinder.volume.drivers.remotefs [None req-e2ef5ffd-b7f2-4a00-8605-f35d3c638cf8 tempest-CreateVolumesFromSnapshotTest-661250879 None] /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-783ac3cf-e6fa-4dc2-85fd-253b5be69667.c2fb653c-7a3f-4d5e-bed2-a8f179fef05f is being set with open permissions: ugo+rw
Nov 03 18:38:42 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-e2ef5ffd-b7f2-4a00-8605-f35d3c638cf8 tempest-CreateVolumesFromSnapshotTest-661250879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-783ac3cf-e6fa-4dc2-85fd-253b5be69667.c2fb653c-7a3f-4d5e-bed2-a8f179fef05f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:38:42 devstack sudo[103785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-783ac3cf-e6fa-4dc2-85fd-253b5be69667.c2fb653c-7a3f-4d5e-bed2-a8f179fef05f
Nov 03 18:38:42 devstack sudo[103785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:38:42 devstack sudo[103785]: pam_unix(sudo:session): session closed for user root
Nov 03 18:38:42 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-e2ef5ffd-b7f2-4a00-8605-f35d3c638cf8 tempest-CreateVolumesFromSnapshotTest-661250879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-783ac3cf-e6fa-4dc2-85fd-253b5be69667.c2fb653c-7a3f-4d5e-bed2-a8f179fef05f" returned: 0 in 0.266s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:38:43 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-e2ef5ffd-b7f2-4a00-8605-f35d3c638cf8 tempest-CreateVolumesFromSnapshotTest-661250879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-783ac3cf-e6fa-4dc2-85fd-253b5be69667.info {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:38:43 devstack sudo[103813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-783ac3cf-e6fa-4dc2-85fd-253b5be69667.info
Nov 03 18:38:43 devstack sudo[103813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:38:43 devstack sudo[103813]: pam_unix(sudo:session): session closed for user root
Nov 03 18:38:43 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-e2ef5ffd-b7f2-4a00-8605-f35d3c638cf8 tempest-CreateVolumesFromSnapshotTest-661250879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-783ac3cf-e6fa-4dc2-85fd-253b5be69667.info" returned: 0 in 0.436s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:38:43 devstack cinder-volume[86120]: WARNING cinder.volume.drivers.remotefs [None req-e2ef5ffd-b7f2-4a00-8605-f35d3c638cf8 tempest-CreateVolumesFromSnapshotTest-661250879 None] /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-783ac3cf-e6fa-4dc2-85fd-253b5be69667.info is being set with open permissions: ugo+rw
Nov 03 18:38:43 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-e2ef5ffd-b7f2-4a00-8605-f35d3c638cf8 tempest-CreateVolumesFromSnapshotTest-661250879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-783ac3cf-e6fa-4dc2-85fd-253b5be69667.info {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:38:43 devstack sudo[103904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-783ac3cf-e6fa-4dc2-85fd-253b5be69667.info
Nov 03 18:38:43 devstack sudo[103904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:38:43 devstack sudo[103904]: pam_unix(sudo:session): session closed for user root
Nov 03 18:38:43 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-e2ef5ffd-b7f2-4a00-8605-f35d3c638cf8 tempest-CreateVolumesFromSnapshotTest-661250879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-783ac3cf-e6fa-4dc2-85fd-253b5be69667.info" returned: 0 in 0.386s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:38:43 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-e2ef5ffd-b7f2-4a00-8605-f35d3c638cf8 tempest-CreateVolumesFromSnapshotTest-661250879 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.340s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:38:43 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-e2ef5ffd-b7f2-4a00-8605-f35d3c638cf8 tempest-CreateVolumesFromSnapshotTest-661250879 None] Create snapshot completed successfully
Nov 03 18:38:45 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e385c22-9d7f-488c-a3c6-7d4b42a98b38 tempest-CreateVolumesFromSnapshotTest-661250879 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:38:45 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-8e385c22-9d7f-488c-a3c6-7d4b42a98b38 tempest-CreateVolumesFromSnapshotTest-661250879 None] Flow 'volume_create_manager' (618f48d9-6aea-47aa-a20e-88848a2a69b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:38:45 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-8e385c22-9d7f-488c-a3c6-7d4b42a98b38 tempest-CreateVolumesFromSnapshotTest-661250879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e0262c2-99eb-4483-ae03-84c3792f8984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:38:45 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-8e385c22-9d7f-488c-a3c6-7d4b42a98b38 tempest-CreateVolumesFromSnapshotTest-661250879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e0262c2-99eb-4483-ae03-84c3792f8984) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:38:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-104220910',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eef08c37-91f7-4332-896f-5aea61a7d3c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9c6fb58b4164d528c7804d55c5e6497',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:38:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:38:45Z,use_quota=True,user_id='d480cd51911c4cafb0f379cd6153fdd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:38:45 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-8e385c22-9d7f-488c-a3c6-7d4b42a98b38 tempest-CreateVolumesFromSnapshotTest-661250879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0afa4303-1c7a-4083-b48b-7cc6e1ac6bc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:38:45 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-8e385c22-9d7f-488c-a3c6-7d4b42a98b38 tempest-CreateVolumesFromSnapshotTest-661250879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0afa4303-1c7a-4083-b48b-7cc6e1ac6bc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:38:45 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-8e385c22-9d7f-488c-a3c6-7d4b42a98b38 tempest-CreateVolumesFromSnapshotTest-661250879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a64d820-d0d4-45db-adb8-f84a28d1ded3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:38:45 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-8e385c22-9d7f-488c-a3c6-7d4b42a98b38 tempest-CreateVolumesFromSnapshotTest-661250879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a64d820-d0d4-45db-adb8-f84a28d1ded3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eef08c37-91f7-4332-896f-5aea61a7d3c4', 'volume_name': 'volume-eef08c37-91f7-4332-896f-5aea61a7d3c4', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:38:45 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-8e385c22-9d7f-488c-a3c6-7d4b42a98b38 tempest-CreateVolumesFromSnapshotTest-661250879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e864aff0-4e0d-4b1d-b517-f17e432a54e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:38:45 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-8e385c22-9d7f-488c-a3c6-7d4b42a98b38 tempest-CreateVolumesFromSnapshotTest-661250879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e864aff0-4e0d-4b1d-b517-f17e432a54e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:38:45 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-8e385c22-9d7f-488c-a3c6-7d4b42a98b38 tempest-CreateVolumesFromSnapshotTest-661250879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c73f716-250d-4f78-baf9-d5ef702191d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:38:45 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-8e385c22-9d7f-488c-a3c6-7d4b42a98b38 tempest-CreateVolumesFromSnapshotTest-661250879 None] Volume eef08c37-91f7-4332-896f-5aea61a7d3c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eef08c37-91f7-4332-896f-5aea61a7d3c4', 'volume_size': 1}
Nov 03 18:38:45 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-8e385c22-9d7f-488c-a3c6-7d4b42a98b38 tempest-CreateVolumesFromSnapshotTest-661250879 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:38:45 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-8e385c22-9d7f-488c-a3c6-7d4b42a98b38 tempest-CreateVolumesFromSnapshotTest-661250879 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:38:45 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-8e385c22-9d7f-488c-a3c6-7d4b42a98b38 tempest-CreateVolumesFromSnapshotTest-661250879 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:38:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-104220910',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eef08c37-91f7-4332-896f-5aea61a7d3c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9c6fb58b4164d528c7804d55c5e6497',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:38:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:38:45Z,use_quota=True,user_id='d480cd51911c4cafb0f379cd6153fdd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:38:45 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-8e385c22-9d7f-488c-a3c6-7d4b42a98b38 tempest-CreateVolumesFromSnapshotTest-661250879 None] Creating volume eef08c37-91f7-4332-896f-5aea61a7d3c4 {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:38:45 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-8e385c22-9d7f-488c-a3c6-7d4b42a98b38 tempest-CreateVolumesFromSnapshotTest-661250879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:38:45 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-8e385c22-9d7f-488c-a3c6-7d4b42a98b38 tempest-CreateVolumesFromSnapshotTest-661250879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:38:45 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-8e385c22-9d7f-488c-a3c6-7d4b42a98b38 tempest-CreateVolumesFromSnapshotTest-661250879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:38:45 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-8e385c22-9d7f-488c-a3c6-7d4b42a98b38 tempest-CreateVolumesFromSnapshotTest-661250879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:38:45 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-8e385c22-9d7f-488c-a3c6-7d4b42a98b38 tempest-CreateVolumesFromSnapshotTest-661250879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:38:45 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-8e385c22-9d7f-488c-a3c6-7d4b42a98b38 tempest-CreateVolumesFromSnapshotTest-661250879 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:38:45 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-8e385c22-9d7f-488c-a3c6-7d4b42a98b38 tempest-CreateVolumesFromSnapshotTest-661250879 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:38:45 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-8e385c22-9d7f-488c-a3c6-7d4b42a98b38 tempest-CreateVolumesFromSnapshotTest-661250879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-eef08c37-91f7-4332-896f-5aea61a7d3c4 1073741824 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:38:45 devstack sudo[104273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-eef08c37-91f7-4332-896f-5aea61a7d3c4 1073741824
Nov 03 18:38:45 devstack sudo[104273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:38:45 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-7742c40c-ba5c-488d-b852-e40738291565 tempest-CreateVolumesFromSnapshotTest-661250879 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:38:45 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-7742c40c-ba5c-488d-b852-e40738291565 tempest-CreateVolumesFromSnapshotTest-661250879 None] Flow 'volume_create_manager' (e5138ff1-04b8-4f5a-a97a-c7b6abebe876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:38:45 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-7742c40c-ba5c-488d-b852-e40738291565 tempest-CreateVolumesFromSnapshotTest-661250879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44ded4f1-31b1-4e0a-9c53-e3fdd6f83241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:38:45 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-7742c40c-ba5c-488d-b852-e40738291565 tempest-CreateVolumesFromSnapshotTest-661250879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44ded4f1-31b1-4e0a-9c53-e3fdd6f83241) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:38:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1528391443',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed2a9a2e-edda-4f87-8eb3-e6ca6dad20b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9c6fb58b4164d528c7804d55c5e6497',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:38:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:38:46Z,use_quota=True,user_id='d480cd51911c4cafb0f379cd6153fdd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:38:45 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-7742c40c-ba5c-488d-b852-e40738291565 tempest-CreateVolumesFromSnapshotTest-661250879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23fc03ac-c255-4497-ba08-21da6181aaa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:38:45 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-7742c40c-ba5c-488d-b852-e40738291565 tempest-CreateVolumesFromSnapshotTest-661250879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23fc03ac-c255-4497-ba08-21da6181aaa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:38:45 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-7742c40c-ba5c-488d-b852-e40738291565 tempest-CreateVolumesFromSnapshotTest-661250879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0370a773-8d0e-4f5f-a354-4c80aa68d151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:38:46 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-7742c40c-ba5c-488d-b852-e40738291565 tempest-CreateVolumesFromSnapshotTest-661250879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0370a773-8d0e-4f5f-a354-4c80aa68d151) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed2a9a2e-edda-4f87-8eb3-e6ca6dad20b5', 'volume_name': 'volume-ed2a9a2e-edda-4f87-8eb3-e6ca6dad20b5', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:38:46 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-7742c40c-ba5c-488d-b852-e40738291565 tempest-CreateVolumesFromSnapshotTest-661250879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd505464-a8d5-4858-aa78-351c17d60151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:38:46 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-7742c40c-ba5c-488d-b852-e40738291565 tempest-CreateVolumesFromSnapshotTest-661250879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd505464-a8d5-4858-aa78-351c17d60151) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:38:46 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-7742c40c-ba5c-488d-b852-e40738291565 tempest-CreateVolumesFromSnapshotTest-661250879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aeaf02ff-e017-4cd8-9dc9-7114bb108b62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:38:46 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-7742c40c-ba5c-488d-b852-e40738291565 tempest-CreateVolumesFromSnapshotTest-661250879 None] Volume ed2a9a2e-edda-4f87-8eb3-e6ca6dad20b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed2a9a2e-edda-4f87-8eb3-e6ca6dad20b5', 'volume_size': 1}
Nov 03 18:38:46 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-7742c40c-ba5c-488d-b852-e40738291565 tempest-CreateVolumesFromSnapshotTest-661250879 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:38:46 devstack sudo[104273]: pam_unix(sudo:session): session closed for user root
Nov 03 18:38:46 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-8e385c22-9d7f-488c-a3c6-7d4b42a98b38 tempest-CreateVolumesFromSnapshotTest-661250879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-eef08c37-91f7-4332-896f-5aea61a7d3c4 1073741824" returned: 0 in 0.853s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:38:46 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-8e385c22-9d7f-488c-a3c6-7d4b42a98b38 tempest-CreateVolumesFromSnapshotTest-661250879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-eef08c37-91f7-4332-896f-5aea61a7d3c4 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:38:46 devstack sudo[104279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-eef08c37-91f7-4332-896f-5aea61a7d3c4
Nov 03 18:38:46 devstack sudo[104279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:38:46 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b39c9d9-1648-4cf5-9dee-de7df7d647a8 tempest-CreateVolumesFromSnapshotTest-661250879 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:38:46 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-6b39c9d9-1648-4cf5-9dee-de7df7d647a8 tempest-CreateVolumesFromSnapshotTest-661250879 None] Flow 'volume_create_manager' (1e593cbf-4be4-4a52-9dde-501240e9d8d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:38:46 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-6b39c9d9-1648-4cf5-9dee-de7df7d647a8 tempest-CreateVolumesFromSnapshotTest-661250879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e127fae7-0601-417f-b61f-7e2e04464804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:38:46 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-6b39c9d9-1648-4cf5-9dee-de7df7d647a8 tempest-CreateVolumesFromSnapshotTest-661250879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e127fae7-0601-417f-b61f-7e2e04464804) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:38:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-346240908',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca103916-de8f-4fcd-b364-476608099383,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9c6fb58b4164d528c7804d55c5e6497',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:38:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:38:46Z,use_quota=True,user_id='d480cd51911c4cafb0f379cd6153fdd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:38:46 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-6b39c9d9-1648-4cf5-9dee-de7df7d647a8 tempest-CreateVolumesFromSnapshotTest-661250879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4db0c23-cb98-4215-b593-7d0fe785090b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:38:46 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-6b39c9d9-1648-4cf5-9dee-de7df7d647a8 tempest-CreateVolumesFromSnapshotTest-661250879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4db0c23-cb98-4215-b593-7d0fe785090b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:38:46 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-6b39c9d9-1648-4cf5-9dee-de7df7d647a8 tempest-CreateVolumesFromSnapshotTest-661250879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0dbadb19-5313-4c1c-8f01-bee8de849ffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:38:46 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-6b39c9d9-1648-4cf5-9dee-de7df7d647a8 tempest-CreateVolumesFromSnapshotTest-661250879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0dbadb19-5313-4c1c-8f01-bee8de849ffb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca103916-de8f-4fcd-b364-476608099383', 'volume_name': 'volume-ca103916-de8f-4fcd-b364-476608099383', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:38:46 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-6b39c9d9-1648-4cf5-9dee-de7df7d647a8 tempest-CreateVolumesFromSnapshotTest-661250879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c741b82e-0b58-4479-b905-86b715be8434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:38:46 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-6b39c9d9-1648-4cf5-9dee-de7df7d647a8 tempest-CreateVolumesFromSnapshotTest-661250879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c741b82e-0b58-4479-b905-86b715be8434) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:38:46 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-6b39c9d9-1648-4cf5-9dee-de7df7d647a8 tempest-CreateVolumesFromSnapshotTest-661250879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fbb0d07-e7fb-410d-87af-fa4139a9c69d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:38:46 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-6b39c9d9-1648-4cf5-9dee-de7df7d647a8 tempest-CreateVolumesFromSnapshotTest-661250879 None] Volume ca103916-de8f-4fcd-b364-476608099383: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca103916-de8f-4fcd-b364-476608099383', 'volume_size': 1}
Nov 03 18:38:46 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-6b39c9d9-1648-4cf5-9dee-de7df7d647a8 tempest-CreateVolumesFromSnapshotTest-661250879 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:38:46 devstack sudo[104279]: pam_unix(sudo:session): session closed for user root
Nov 03 18:38:46 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-8e385c22-9d7f-488c-a3c6-7d4b42a98b38 tempest-CreateVolumesFromSnapshotTest-661250879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-eef08c37-91f7-4332-896f-5aea61a7d3c4" returned: 0 in 0.533s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:38:46 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-8e385c22-9d7f-488c-a3c6-7d4b42a98b38 tempest-CreateVolumesFromSnapshotTest-661250879 None] <== create_volume: return (1492ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:38:46 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-8e385c22-9d7f-488c-a3c6-7d4b42a98b38 tempest-CreateVolumesFromSnapshotTest-661250879 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.494s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:38:46 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-7742c40c-ba5c-488d-b852-e40738291565 tempest-CreateVolumesFromSnapshotTest-661250879 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.878s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:38:46 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-7742c40c-ba5c-488d-b852-e40738291565 tempest-CreateVolumesFromSnapshotTest-661250879 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:38:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1528391443',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed2a9a2e-edda-4f87-8eb3-e6ca6dad20b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9c6fb58b4164d528c7804d55c5e6497',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:38:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:38:46Z,use_quota=True,user_id='d480cd51911c4cafb0f379cd6153fdd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:38:46 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-7742c40c-ba5c-488d-b852-e40738291565 tempest-CreateVolumesFromSnapshotTest-661250879 None] Creating volume ed2a9a2e-edda-4f87-8eb3-e6ca6dad20b5 {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:38:46 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-7742c40c-ba5c-488d-b852-e40738291565 tempest-CreateVolumesFromSnapshotTest-661250879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:38:46 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-7742c40c-ba5c-488d-b852-e40738291565 tempest-CreateVolumesFromSnapshotTest-661250879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:38:46 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-7742c40c-ba5c-488d-b852-e40738291565 tempest-CreateVolumesFromSnapshotTest-661250879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:38:46 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-7742c40c-ba5c-488d-b852-e40738291565 tempest-CreateVolumesFromSnapshotTest-661250879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:38:46 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-7742c40c-ba5c-488d-b852-e40738291565 tempest-CreateVolumesFromSnapshotTest-661250879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:38:46 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-7742c40c-ba5c-488d-b852-e40738291565 tempest-CreateVolumesFromSnapshotTest-661250879 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:38:46 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-7742c40c-ba5c-488d-b852-e40738291565 tempest-CreateVolumesFromSnapshotTest-661250879 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:38:46 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-7742c40c-ba5c-488d-b852-e40738291565 tempest-CreateVolumesFromSnapshotTest-661250879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ed2a9a2e-edda-4f87-8eb3-e6ca6dad20b5 1073741824 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:38:46 devstack sudo[104282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ed2a9a2e-edda-4f87-8eb3-e6ca6dad20b5 1073741824
Nov 03 18:38:46 devstack sudo[104282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:38:47 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-8e385c22-9d7f-488c-a3c6-7d4b42a98b38 tempest-CreateVolumesFromSnapshotTest-661250879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c73f716-250d-4f78-baf9-d5ef702191d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eef08c37-91f7-4332-896f-5aea61a7d3c4', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:38:47 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-8e385c22-9d7f-488c-a3c6-7d4b42a98b38 tempest-CreateVolumesFromSnapshotTest-661250879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be505a3d-ea2c-4260-9242-082da061850d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:38:47 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-8e385c22-9d7f-488c-a3c6-7d4b42a98b38 tempest-CreateVolumesFromSnapshotTest-661250879 None] Volume volume-eef08c37-91f7-4332-896f-5aea61a7d3c4 (eef08c37-91f7-4332-896f-5aea61a7d3c4): created successfully
Nov 03 18:38:47 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-8e385c22-9d7f-488c-a3c6-7d4b42a98b38 tempest-CreateVolumesFromSnapshotTest-661250879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be505a3d-ea2c-4260-9242-082da061850d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:38:47 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-8e385c22-9d7f-488c-a3c6-7d4b42a98b38 tempest-CreateVolumesFromSnapshotTest-661250879 None] Flow 'volume_create_manager' (618f48d9-6aea-47aa-a20e-88848a2a69b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:38:47 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-8e385c22-9d7f-488c-a3c6-7d4b42a98b38 tempest-CreateVolumesFromSnapshotTest-661250879 None] Created volume successfully.
Nov 03 18:38:47 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-eca2fdd3-0723-4d68-97c3-ccdf45d30037 tempest-CreateVolumesFromSnapshotTest-661250879 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:38:47 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-eca2fdd3-0723-4d68-97c3-ccdf45d30037 tempest-CreateVolumesFromSnapshotTest-661250879 None] Flow 'volume_create_manager' (7811a33a-c5bf-473f-9915-c171f6459289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:38:47 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-eca2fdd3-0723-4d68-97c3-ccdf45d30037 tempest-CreateVolumesFromSnapshotTest-661250879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d84353c-9948-42bf-be2d-161adb866a01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:38:47 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-eca2fdd3-0723-4d68-97c3-ccdf45d30037 tempest-CreateVolumesFromSnapshotTest-661250879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d84353c-9948-42bf-be2d-161adb866a01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:38:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-923792476',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0ba53fd-6535-4742-9bfa-3cb58fe2edcd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9c6fb58b4164d528c7804d55c5e6497',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:38:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:38:47Z,use_quota=True,user_id='d480cd51911c4cafb0f379cd6153fdd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:38:47 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-eca2fdd3-0723-4d68-97c3-ccdf45d30037 tempest-CreateVolumesFromSnapshotTest-661250879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6763da56-cdb9-4fbf-a655-0425cbd2d893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:38:47 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-eca2fdd3-0723-4d68-97c3-ccdf45d30037 tempest-CreateVolumesFromSnapshotTest-661250879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6763da56-cdb9-4fbf-a655-0425cbd2d893) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:38:47 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-eca2fdd3-0723-4d68-97c3-ccdf45d30037 tempest-CreateVolumesFromSnapshotTest-661250879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c7bfe2a-9f68-4e51-ab0e-049dbe73bfa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:38:47 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-eca2fdd3-0723-4d68-97c3-ccdf45d30037 tempest-CreateVolumesFromSnapshotTest-661250879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c7bfe2a-9f68-4e51-ab0e-049dbe73bfa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0ba53fd-6535-4742-9bfa-3cb58fe2edcd', 'volume_name': 'volume-d0ba53fd-6535-4742-9bfa-3cb58fe2edcd', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:38:47 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-eca2fdd3-0723-4d68-97c3-ccdf45d30037 tempest-CreateVolumesFromSnapshotTest-661250879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2be01f5c-691d-4e1b-90c9-fba92b4afbf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:38:47 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-eca2fdd3-0723-4d68-97c3-ccdf45d30037 tempest-CreateVolumesFromSnapshotTest-661250879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2be01f5c-691d-4e1b-90c9-fba92b4afbf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:38:47 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-eca2fdd3-0723-4d68-97c3-ccdf45d30037 tempest-CreateVolumesFromSnapshotTest-661250879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5472f3b-b667-45fa-90f5-70e2b59232f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:38:47 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-eca2fdd3-0723-4d68-97c3-ccdf45d30037 tempest-CreateVolumesFromSnapshotTest-661250879 None] Volume d0ba53fd-6535-4742-9bfa-3cb58fe2edcd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0ba53fd-6535-4742-9bfa-3cb58fe2edcd', 'volume_size': 1}
Nov 03 18:38:47 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-eca2fdd3-0723-4d68-97c3-ccdf45d30037 tempest-CreateVolumesFromSnapshotTest-661250879 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:38:47 devstack sudo[104282]: pam_unix(sudo:session): session closed for user root
Nov 03 18:38:47 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-7742c40c-ba5c-488d-b852-e40738291565 tempest-CreateVolumesFromSnapshotTest-661250879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ed2a9a2e-edda-4f87-8eb3-e6ca6dad20b5 1073741824" returned: 0 in 0.737s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:38:47 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-7742c40c-ba5c-488d-b852-e40738291565 tempest-CreateVolumesFromSnapshotTest-661250879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ed2a9a2e-edda-4f87-8eb3-e6ca6dad20b5 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:38:47 devstack sudo[104288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ed2a9a2e-edda-4f87-8eb3-e6ca6dad20b5
Nov 03 18:38:47 devstack sudo[104288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:38:47 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-6055fcb3-e937-4b34-8012-72b053a73ecb tempest-CreateVolumesFromSnapshotTest-661250879 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:38:47 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-6055fcb3-e937-4b34-8012-72b053a73ecb tempest-CreateVolumesFromSnapshotTest-661250879 None] Flow 'volume_create_manager' (198e8e2b-c525-4778-a50f-e07ea0045063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:38:47 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-6055fcb3-e937-4b34-8012-72b053a73ecb tempest-CreateVolumesFromSnapshotTest-661250879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8df6a03e-1efa-4d2a-90dd-23172af85add) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:38:47 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-6055fcb3-e937-4b34-8012-72b053a73ecb tempest-CreateVolumesFromSnapshotTest-661250879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8df6a03e-1efa-4d2a-90dd-23172af85add) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:38:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-305983182',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=743d23e0-70f0-4abd-86b1-8da814631765,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9c6fb58b4164d528c7804d55c5e6497',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:38:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:38:48Z,use_quota=True,user_id='d480cd51911c4cafb0f379cd6153fdd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:38:47 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-6055fcb3-e937-4b34-8012-72b053a73ecb tempest-CreateVolumesFromSnapshotTest-661250879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed4dd6db-c24e-4bd1-92d2-2a7b3a3b910d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:38:47 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-6055fcb3-e937-4b34-8012-72b053a73ecb tempest-CreateVolumesFromSnapshotTest-661250879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed4dd6db-c24e-4bd1-92d2-2a7b3a3b910d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:38:47 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-6055fcb3-e937-4b34-8012-72b053a73ecb tempest-CreateVolumesFromSnapshotTest-661250879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f872c62-7169-4e62-8837-a911c708509f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:38:47 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-6055fcb3-e937-4b34-8012-72b053a73ecb tempest-CreateVolumesFromSnapshotTest-661250879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f872c62-7169-4e62-8837-a911c708509f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '743d23e0-70f0-4abd-86b1-8da814631765', 'volume_name': 'volume-743d23e0-70f0-4abd-86b1-8da814631765', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:38:47 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-6055fcb3-e937-4b34-8012-72b053a73ecb tempest-CreateVolumesFromSnapshotTest-661250879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f3afa34-2040-422a-9a49-97f5ac0be3c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:38:47 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-6055fcb3-e937-4b34-8012-72b053a73ecb tempest-CreateVolumesFromSnapshotTest-661250879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f3afa34-2040-422a-9a49-97f5ac0be3c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:38:47 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-6055fcb3-e937-4b34-8012-72b053a73ecb tempest-CreateVolumesFromSnapshotTest-661250879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c54cdcb1-0c55-433a-bdc2-2a0f33145c52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:38:47 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-6055fcb3-e937-4b34-8012-72b053a73ecb tempest-CreateVolumesFromSnapshotTest-661250879 None] Volume 743d23e0-70f0-4abd-86b1-8da814631765: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-743d23e0-70f0-4abd-86b1-8da814631765', 'volume_size': 1}
Nov 03 18:38:47 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-6055fcb3-e937-4b34-8012-72b053a73ecb tempest-CreateVolumesFromSnapshotTest-661250879 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:38:48 devstack sudo[104288]: pam_unix(sudo:session): session closed for user root
Nov 03 18:38:48 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-7742c40c-ba5c-488d-b852-e40738291565 tempest-CreateVolumesFromSnapshotTest-661250879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ed2a9a2e-edda-4f87-8eb3-e6ca6dad20b5" returned: 0 in 0.355s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:38:48 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-7742c40c-ba5c-488d-b852-e40738291565 tempest-CreateVolumesFromSnapshotTest-661250879 None] <== create_volume: return (1173ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:38:48 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-7742c40c-ba5c-488d-b852-e40738291565 tempest-CreateVolumesFromSnapshotTest-661250879 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.176s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:38:48 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-6b39c9d9-1648-4cf5-9dee-de7df7d647a8 tempest-CreateVolumesFromSnapshotTest-661250879 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.514s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:38:48 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-6b39c9d9-1648-4cf5-9dee-de7df7d647a8 tempest-CreateVolumesFromSnapshotTest-661250879 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:38:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-346240908',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca103916-de8f-4fcd-b364-476608099383,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9c6fb58b4164d528c7804d55c5e6497',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:38:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:38:46Z,use_quota=True,user_id='d480cd51911c4cafb0f379cd6153fdd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:38:48 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-6b39c9d9-1648-4cf5-9dee-de7df7d647a8 tempest-CreateVolumesFromSnapshotTest-661250879 None] Creating volume ca103916-de8f-4fcd-b364-476608099383 {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:38:48 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-6b39c9d9-1648-4cf5-9dee-de7df7d647a8 tempest-CreateVolumesFromSnapshotTest-661250879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:38:48 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-6b39c9d9-1648-4cf5-9dee-de7df7d647a8 tempest-CreateVolumesFromSnapshotTest-661250879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:38:48 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-6b39c9d9-1648-4cf5-9dee-de7df7d647a8 tempest-CreateVolumesFromSnapshotTest-661250879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:38:48 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-6b39c9d9-1648-4cf5-9dee-de7df7d647a8 tempest-CreateVolumesFromSnapshotTest-661250879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:38:48 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-6b39c9d9-1648-4cf5-9dee-de7df7d647a8 tempest-CreateVolumesFromSnapshotTest-661250879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:38:48 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-6b39c9d9-1648-4cf5-9dee-de7df7d647a8 tempest-CreateVolumesFromSnapshotTest-661250879 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:38:48 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-6b39c9d9-1648-4cf5-9dee-de7df7d647a8 tempest-CreateVolumesFromSnapshotTest-661250879 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:38:48 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-6b39c9d9-1648-4cf5-9dee-de7df7d647a8 tempest-CreateVolumesFromSnapshotTest-661250879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ca103916-de8f-4fcd-b364-476608099383 1073741824 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:38:48 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-7742c40c-ba5c-488d-b852-e40738291565 tempest-CreateVolumesFromSnapshotTest-661250879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aeaf02ff-e017-4cd8-9dc9-7114bb108b62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed2a9a2e-edda-4f87-8eb3-e6ca6dad20b5', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:38:48 devstack sudo[104291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ca103916-de8f-4fcd-b364-476608099383 1073741824
Nov 03 18:38:48 devstack sudo[104291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:38:48 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-7742c40c-ba5c-488d-b852-e40738291565 tempest-CreateVolumesFromSnapshotTest-661250879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4688881-b1a9-4730-bd77-34def6fd6f0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:38:48 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-7742c40c-ba5c-488d-b852-e40738291565 tempest-CreateVolumesFromSnapshotTest-661250879 None] Volume volume-ed2a9a2e-edda-4f87-8eb3-e6ca6dad20b5 (ed2a9a2e-edda-4f87-8eb3-e6ca6dad20b5): created successfully
Nov 03 18:38:48 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-7742c40c-ba5c-488d-b852-e40738291565 tempest-CreateVolumesFromSnapshotTest-661250879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4688881-b1a9-4730-bd77-34def6fd6f0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:38:48 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-7742c40c-ba5c-488d-b852-e40738291565 tempest-CreateVolumesFromSnapshotTest-661250879 None] Flow 'volume_create_manager' (e5138ff1-04b8-4f5a-a97a-c7b6abebe876) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:38:48 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-7742c40c-ba5c-488d-b852-e40738291565 tempest-CreateVolumesFromSnapshotTest-661250879 None] Created volume successfully.
Nov 03 18:38:48 devstack sudo[104291]: pam_unix(sudo:session): session closed for user root
Nov 03 18:38:48 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-6b39c9d9-1648-4cf5-9dee-de7df7d647a8 tempest-CreateVolumesFromSnapshotTest-661250879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ca103916-de8f-4fcd-b364-476608099383 1073741824" returned: 0 in 0.555s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:38:48 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-6b39c9d9-1648-4cf5-9dee-de7df7d647a8 tempest-CreateVolumesFromSnapshotTest-661250879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ca103916-de8f-4fcd-b364-476608099383 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:38:48 devstack sudo[104297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ca103916-de8f-4fcd-b364-476608099383
Nov 03 18:38:48 devstack sudo[104297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:38:49 devstack sudo[104297]: pam_unix(sudo:session): session closed for user root
Nov 03 18:38:49 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-6b39c9d9-1648-4cf5-9dee-de7df7d647a8 tempest-CreateVolumesFromSnapshotTest-661250879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ca103916-de8f-4fcd-b364-476608099383" returned: 0 in 0.307s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:38:49 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-6b39c9d9-1648-4cf5-9dee-de7df7d647a8 tempest-CreateVolumesFromSnapshotTest-661250879 None] <== create_volume: return (927ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:38:49 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-6b39c9d9-1648-4cf5-9dee-de7df7d647a8 tempest-CreateVolumesFromSnapshotTest-661250879 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.930s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:38:49 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-eca2fdd3-0723-4d68-97c3-ccdf45d30037 tempest-CreateVolumesFromSnapshotTest-661250879 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.708s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:38:49 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-eca2fdd3-0723-4d68-97c3-ccdf45d30037 tempest-CreateVolumesFromSnapshotTest-661250879 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:38:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-923792476',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0ba53fd-6535-4742-9bfa-3cb58fe2edcd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9c6fb58b4164d528c7804d55c5e6497',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:38:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:38:47Z,use_quota=True,user_id='d480cd51911c4cafb0f379cd6153fdd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:38:49 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-eca2fdd3-0723-4d68-97c3-ccdf45d30037 tempest-CreateVolumesFromSnapshotTest-661250879 None] Creating volume d0ba53fd-6535-4742-9bfa-3cb58fe2edcd {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:38:49 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-eca2fdd3-0723-4d68-97c3-ccdf45d30037 tempest-CreateVolumesFromSnapshotTest-661250879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:38:49 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-eca2fdd3-0723-4d68-97c3-ccdf45d30037 tempest-CreateVolumesFromSnapshotTest-661250879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:38:49 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-eca2fdd3-0723-4d68-97c3-ccdf45d30037 tempest-CreateVolumesFromSnapshotTest-661250879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:38:49 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-eca2fdd3-0723-4d68-97c3-ccdf45d30037 tempest-CreateVolumesFromSnapshotTest-661250879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:38:49 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-eca2fdd3-0723-4d68-97c3-ccdf45d30037 tempest-CreateVolumesFromSnapshotTest-661250879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:38:49 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-eca2fdd3-0723-4d68-97c3-ccdf45d30037 tempest-CreateVolumesFromSnapshotTest-661250879 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:38:49 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-eca2fdd3-0723-4d68-97c3-ccdf45d30037 tempest-CreateVolumesFromSnapshotTest-661250879 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:38:49 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-eca2fdd3-0723-4d68-97c3-ccdf45d30037 tempest-CreateVolumesFromSnapshotTest-661250879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d0ba53fd-6535-4742-9bfa-3cb58fe2edcd 1073741824 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:38:49 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-6b39c9d9-1648-4cf5-9dee-de7df7d647a8 tempest-CreateVolumesFromSnapshotTest-661250879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fbb0d07-e7fb-410d-87af-fa4139a9c69d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca103916-de8f-4fcd-b364-476608099383', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:38:49 devstack sudo[104301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d0ba53fd-6535-4742-9bfa-3cb58fe2edcd 1073741824
Nov 03 18:38:49 devstack sudo[104301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:38:49 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-6b39c9d9-1648-4cf5-9dee-de7df7d647a8 tempest-CreateVolumesFromSnapshotTest-661250879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c624df37-fad2-402a-8a91-b784dcd7de08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:38:49 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-6b39c9d9-1648-4cf5-9dee-de7df7d647a8 tempest-CreateVolumesFromSnapshotTest-661250879 None] Volume volume-ca103916-de8f-4fcd-b364-476608099383 (ca103916-de8f-4fcd-b364-476608099383): created successfully
Nov 03 18:38:49 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-6b39c9d9-1648-4cf5-9dee-de7df7d647a8 tempest-CreateVolumesFromSnapshotTest-661250879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c624df37-fad2-402a-8a91-b784dcd7de08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:38:49 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-6b39c9d9-1648-4cf5-9dee-de7df7d647a8 tempest-CreateVolumesFromSnapshotTest-661250879 None] Flow 'volume_create_manager' (1e593cbf-4be4-4a52-9dde-501240e9d8d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:38:49 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-6b39c9d9-1648-4cf5-9dee-de7df7d647a8 tempest-CreateVolumesFromSnapshotTest-661250879 None] Created volume successfully.
Nov 03 18:38:49 devstack sudo[104301]: pam_unix(sudo:session): session closed for user root
Nov 03 18:38:49 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-eca2fdd3-0723-4d68-97c3-ccdf45d30037 tempest-CreateVolumesFromSnapshotTest-661250879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d0ba53fd-6535-4742-9bfa-3cb58fe2edcd 1073741824" returned: 0 in 0.699s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:38:49 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-eca2fdd3-0723-4d68-97c3-ccdf45d30037 tempest-CreateVolumesFromSnapshotTest-661250879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d0ba53fd-6535-4742-9bfa-3cb58fe2edcd {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:38:49 devstack sudo[104309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d0ba53fd-6535-4742-9bfa-3cb58fe2edcd
Nov 03 18:38:49 devstack sudo[104309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:38:50 devstack sudo[104309]: pam_unix(sudo:session): session closed for user root
Nov 03 18:38:50 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-eca2fdd3-0723-4d68-97c3-ccdf45d30037 tempest-CreateVolumesFromSnapshotTest-661250879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d0ba53fd-6535-4742-9bfa-3cb58fe2edcd" returned: 0 in 0.547s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:38:50 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-eca2fdd3-0723-4d68-97c3-ccdf45d30037 tempest-CreateVolumesFromSnapshotTest-661250879 None] <== create_volume: return (1303ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:38:50 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-eca2fdd3-0723-4d68-97c3-ccdf45d30037 tempest-CreateVolumesFromSnapshotTest-661250879 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.307s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:38:50 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-6055fcb3-e937-4b34-8012-72b053a73ecb tempest-CreateVolumesFromSnapshotTest-661250879 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.363s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:38:50 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-6055fcb3-e937-4b34-8012-72b053a73ecb tempest-CreateVolumesFromSnapshotTest-661250879 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:38:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-305983182',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=743d23e0-70f0-4abd-86b1-8da814631765,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9c6fb58b4164d528c7804d55c5e6497',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:38:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:38:48Z,use_quota=True,user_id='d480cd51911c4cafb0f379cd6153fdd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:38:50 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-6055fcb3-e937-4b34-8012-72b053a73ecb tempest-CreateVolumesFromSnapshotTest-661250879 None] Creating volume 743d23e0-70f0-4abd-86b1-8da814631765 {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:38:50 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-6055fcb3-e937-4b34-8012-72b053a73ecb tempest-CreateVolumesFromSnapshotTest-661250879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:38:50 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-6055fcb3-e937-4b34-8012-72b053a73ecb tempest-CreateVolumesFromSnapshotTest-661250879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:38:50 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-6055fcb3-e937-4b34-8012-72b053a73ecb tempest-CreateVolumesFromSnapshotTest-661250879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:38:50 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-6055fcb3-e937-4b34-8012-72b053a73ecb tempest-CreateVolumesFromSnapshotTest-661250879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:38:50 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-6055fcb3-e937-4b34-8012-72b053a73ecb tempest-CreateVolumesFromSnapshotTest-661250879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:38:50 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-6055fcb3-e937-4b34-8012-72b053a73ecb tempest-CreateVolumesFromSnapshotTest-661250879 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:38:50 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-6055fcb3-e937-4b34-8012-72b053a73ecb tempest-CreateVolumesFromSnapshotTest-661250879 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:38:50 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-6055fcb3-e937-4b34-8012-72b053a73ecb tempest-CreateVolumesFromSnapshotTest-661250879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-743d23e0-70f0-4abd-86b1-8da814631765 1073741824 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:38:50 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-eca2fdd3-0723-4d68-97c3-ccdf45d30037 tempest-CreateVolumesFromSnapshotTest-661250879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5472f3b-b667-45fa-90f5-70e2b59232f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0ba53fd-6535-4742-9bfa-3cb58fe2edcd', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:38:50 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-eca2fdd3-0723-4d68-97c3-ccdf45d30037 tempest-CreateVolumesFromSnapshotTest-661250879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4e46d10-aeae-45d8-9945-7dc1cd9fd526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:38:50 devstack sudo[104312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-743d23e0-70f0-4abd-86b1-8da814631765 1073741824
Nov 03 18:38:50 devstack sudo[104312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:38:50 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-eca2fdd3-0723-4d68-97c3-ccdf45d30037 tempest-CreateVolumesFromSnapshotTest-661250879 None] Volume volume-d0ba53fd-6535-4742-9bfa-3cb58fe2edcd (d0ba53fd-6535-4742-9bfa-3cb58fe2edcd): created successfully
Nov 03 18:38:50 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-eca2fdd3-0723-4d68-97c3-ccdf45d30037 tempest-CreateVolumesFromSnapshotTest-661250879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4e46d10-aeae-45d8-9945-7dc1cd9fd526) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:38:50 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-eca2fdd3-0723-4d68-97c3-ccdf45d30037 tempest-CreateVolumesFromSnapshotTest-661250879 None] Flow 'volume_create_manager' (7811a33a-c5bf-473f-9915-c171f6459289) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:38:50 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-eca2fdd3-0723-4d68-97c3-ccdf45d30037 tempest-CreateVolumesFromSnapshotTest-661250879 None] Created volume successfully.
Nov 03 18:38:51 devstack sudo[104312]: pam_unix(sudo:session): session closed for user root
Nov 03 18:38:51 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-6055fcb3-e937-4b34-8012-72b053a73ecb tempest-CreateVolumesFromSnapshotTest-661250879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-743d23e0-70f0-4abd-86b1-8da814631765 1073741824" returned: 0 in 0.629s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:38:51 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-6055fcb3-e937-4b34-8012-72b053a73ecb tempest-CreateVolumesFromSnapshotTest-661250879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-743d23e0-70f0-4abd-86b1-8da814631765 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:38:51 devstack sudo[104318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-743d23e0-70f0-4abd-86b1-8da814631765
Nov 03 18:38:51 devstack sudo[104318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:38:51 devstack sudo[104318]: pam_unix(sudo:session): session closed for user root
Nov 03 18:38:51 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-6055fcb3-e937-4b34-8012-72b053a73ecb tempest-CreateVolumesFromSnapshotTest-661250879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-743d23e0-70f0-4abd-86b1-8da814631765" returned: 0 in 0.297s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:38:51 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-6055fcb3-e937-4b34-8012-72b053a73ecb tempest-CreateVolumesFromSnapshotTest-661250879 None] <== create_volume: return (987ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:38:51 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-6055fcb3-e937-4b34-8012-72b053a73ecb tempest-CreateVolumesFromSnapshotTest-661250879 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.992s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:38:51 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-6055fcb3-e937-4b34-8012-72b053a73ecb tempest-CreateVolumesFromSnapshotTest-661250879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c54cdcb1-0c55-433a-bdc2-2a0f33145c52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-743d23e0-70f0-4abd-86b1-8da814631765', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:38:51 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-6055fcb3-e937-4b34-8012-72b053a73ecb tempest-CreateVolumesFromSnapshotTest-661250879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fe367e4-4a18-451d-9080-8701a4541860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:38:51 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-6055fcb3-e937-4b34-8012-72b053a73ecb tempest-CreateVolumesFromSnapshotTest-661250879 None] Volume volume-743d23e0-70f0-4abd-86b1-8da814631765 (743d23e0-70f0-4abd-86b1-8da814631765): created successfully
Nov 03 18:38:51 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-6055fcb3-e937-4b34-8012-72b053a73ecb tempest-CreateVolumesFromSnapshotTest-661250879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fe367e4-4a18-451d-9080-8701a4541860) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:38:51 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-6055fcb3-e937-4b34-8012-72b053a73ecb tempest-CreateVolumesFromSnapshotTest-661250879 None] Flow 'volume_create_manager' (198e8e2b-c525-4778-a50f-e07ea0045063) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:38:51 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-6055fcb3-e937-4b34-8012-72b053a73ecb tempest-CreateVolumesFromSnapshotTest-661250879 None] Created volume successfully.
Nov 03 18:38:52 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-b8577ecc-8b68-41be-ab78-2ce293db8b63 tempest-CreateVolumesFromSnapshotTest-661250879 None] Acquiring lock "cinder-743d23e0-70f0-4abd-86b1-8da814631765-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:38:52 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-b8577ecc-8b68-41be-ab78-2ce293db8b63 tempest-CreateVolumesFromSnapshotTest-661250879 None] Lock "cinder-743d23e0-70f0-4abd-86b1-8da814631765-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:38:52 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-b8577ecc-8b68-41be-ab78-2ce293db8b63 tempest-CreateVolumesFromSnapshotTest-661250879 None] Acquiring lock "cinder-quobyte-743d23e0-70f0-4abd-86b1-8da814631765" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:38:52 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-b8577ecc-8b68-41be-ab78-2ce293db8b63 tempest-CreateVolumesFromSnapshotTest-661250879 None] Lock "cinder-quobyte-743d23e0-70f0-4abd-86b1-8da814631765" acquired by "delete_volume" :: waited 0.019s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:38:52 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[15674615-3e1c-4995-8480-7f478b79cd1e]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:38:52 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b8577ecc-8b68-41be-ab78-2ce293db8b63 tempest-CreateVolumesFromSnapshotTest-661250879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-743d23e0-70f0-4abd-86b1-8da814631765 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:38:52 devstack sudo[104322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-743d23e0-70f0-4abd-86b1-8da814631765
Nov 03 18:38:52 devstack sudo[104322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:38:53 devstack sudo[104322]: pam_unix(sudo:session): session closed for user root
Nov 03 18:38:53 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b8577ecc-8b68-41be-ab78-2ce293db8b63 tempest-CreateVolumesFromSnapshotTest-661250879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-743d23e0-70f0-4abd-86b1-8da814631765" returned: 0 in 0.506s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:38:53 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b8577ecc-8b68-41be-ab78-2ce293db8b63 tempest-CreateVolumesFromSnapshotTest-661250879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-743d23e0-70f0-4abd-86b1-8da814631765 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:38:53 devstack sudo[104328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-743d23e0-70f0-4abd-86b1-8da814631765
Nov 03 18:38:53 devstack sudo[104328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:38:53 devstack sudo[104328]: pam_unix(sudo:session): session closed for user root
Nov 03 18:38:53 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b8577ecc-8b68-41be-ab78-2ce293db8b63 tempest-CreateVolumesFromSnapshotTest-661250879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-743d23e0-70f0-4abd-86b1-8da814631765" returned: 0 in 0.314s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:38:53 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-b8577ecc-8b68-41be-ab78-2ce293db8b63 tempest-CreateVolumesFromSnapshotTest-661250879 None] Lock "cinder-quobyte-743d23e0-70f0-4abd-86b1-8da814631765" released by "delete_volume" :: held 0.888s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:38:53 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-b8577ecc-8b68-41be-ab78-2ce293db8b63 tempest-CreateVolumesFromSnapshotTest-661250879 None] Created reservations ['3a54e8e6-f441-4bd2-a5e9-ae9f08e4a442', '897b85ab-6de9-4720-8e44-1a1d8c6827ea', '1e058ad6-21d7-4f10-b926-379ef79ef2ad', '70139503-bbc4-425c-bb5b-f2614df97dd7'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:38:53 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-b8577ecc-8b68-41be-ab78-2ce293db8b63 tempest-CreateVolumesFromSnapshotTest-661250879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:38:53 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-b8577ecc-8b68-41be-ab78-2ce293db8b63 tempest-CreateVolumesFromSnapshotTest-661250879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:38:53 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-b8577ecc-8b68-41be-ab78-2ce293db8b63 tempest-CreateVolumesFromSnapshotTest-661250879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:38:53 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-b8577ecc-8b68-41be-ab78-2ce293db8b63 tempest-CreateVolumesFromSnapshotTest-661250879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:38:53 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-b8577ecc-8b68-41be-ab78-2ce293db8b63 tempest-CreateVolumesFromSnapshotTest-661250879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:38:53 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b8577ecc-8b68-41be-ab78-2ce293db8b63 tempest-CreateVolumesFromSnapshotTest-661250879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:38:53 devstack sudo[104331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:38:53 devstack sudo[104331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:38:53 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-5deb4117-775c-4560-b638-2403d2b94fa4 tempest-CreateVolumesFromSnapshotTest-661250879 None] Acquiring lock "cinder-d0ba53fd-6535-4742-9bfa-3cb58fe2edcd-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:38:53 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-5deb4117-775c-4560-b638-2403d2b94fa4 tempest-CreateVolumesFromSnapshotTest-661250879 None] Lock "cinder-d0ba53fd-6535-4742-9bfa-3cb58fe2edcd-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:38:53 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-5deb4117-775c-4560-b638-2403d2b94fa4 tempest-CreateVolumesFromSnapshotTest-661250879 None] Acquiring lock "cinder-quobyte-d0ba53fd-6535-4742-9bfa-3cb58fe2edcd" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:38:53 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-5deb4117-775c-4560-b638-2403d2b94fa4 tempest-CreateVolumesFromSnapshotTest-661250879 None] Lock "cinder-quobyte-d0ba53fd-6535-4742-9bfa-3cb58fe2edcd" acquired by "delete_volume" :: waited 0.020s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:38:53 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[03c37e43-d0ec-45f9-9597-3079a7bbe5a7]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:38:53 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-5deb4117-775c-4560-b638-2403d2b94fa4 tempest-CreateVolumesFromSnapshotTest-661250879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d0ba53fd-6535-4742-9bfa-3cb58fe2edcd {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:38:54 devstack sudo[104333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d0ba53fd-6535-4742-9bfa-3cb58fe2edcd
Nov 03 18:38:54 devstack sudo[104333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:38:54 devstack sudo[104331]: pam_unix(sudo:session): session closed for user root
Nov 03 18:38:54 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b8577ecc-8b68-41be-ab78-2ce293db8b63 tempest-CreateVolumesFromSnapshotTest-661250879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.370s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:38:54 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-b8577ecc-8b68-41be-ab78-2ce293db8b63 tempest-CreateVolumesFromSnapshotTest-661250879 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:38:54 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-b8577ecc-8b68-41be-ab78-2ce293db8b63 tempest-CreateVolumesFromSnapshotTest-661250879 None] Deleted volume successfully.
Nov 03 18:38:54 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-b8577ecc-8b68-41be-ab78-2ce293db8b63 tempest-CreateVolumesFromSnapshotTest-661250879 None] Lock "cinder-743d23e0-70f0-4abd-86b1-8da814631765-delete_volume" released by "delete_volume" :: held 1.550s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:38:54 devstack sudo[104333]: pam_unix(sudo:session): session closed for user root
Nov 03 18:38:54 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-5deb4117-775c-4560-b638-2403d2b94fa4 tempest-CreateVolumesFromSnapshotTest-661250879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d0ba53fd-6535-4742-9bfa-3cb58fe2edcd" returned: 0 in 0.405s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:38:54 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-5deb4117-775c-4560-b638-2403d2b94fa4 tempest-CreateVolumesFromSnapshotTest-661250879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d0ba53fd-6535-4742-9bfa-3cb58fe2edcd {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:38:54 devstack sudo[104339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d0ba53fd-6535-4742-9bfa-3cb58fe2edcd
Nov 03 18:38:54 devstack sudo[104339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:38:54 devstack sudo[104339]: pam_unix(sudo:session): session closed for user root
Nov 03 18:38:54 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-5deb4117-775c-4560-b638-2403d2b94fa4 tempest-CreateVolumesFromSnapshotTest-661250879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d0ba53fd-6535-4742-9bfa-3cb58fe2edcd" returned: 0 in 0.260s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:38:54 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-5deb4117-775c-4560-b638-2403d2b94fa4 tempest-CreateVolumesFromSnapshotTest-661250879 None] Lock "cinder-quobyte-d0ba53fd-6535-4742-9bfa-3cb58fe2edcd" released by "delete_volume" :: held 0.720s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:38:54 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-5deb4117-775c-4560-b638-2403d2b94fa4 tempest-CreateVolumesFromSnapshotTest-661250879 None] Created reservations ['9b9f785d-642c-45ba-b94f-789401c3f771', '9d046bfb-4e99-40ac-8258-155002f14c93', 'fa449025-4ecd-4d9e-bd0b-360ebd4af373', '1b852032-c68f-43c5-8ec4-fe8c4d548768'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:38:54 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-5deb4117-775c-4560-b638-2403d2b94fa4 tempest-CreateVolumesFromSnapshotTest-661250879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:38:54 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-5deb4117-775c-4560-b638-2403d2b94fa4 tempest-CreateVolumesFromSnapshotTest-661250879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:38:54 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-5deb4117-775c-4560-b638-2403d2b94fa4 tempest-CreateVolumesFromSnapshotTest-661250879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:38:54 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-5deb4117-775c-4560-b638-2403d2b94fa4 tempest-CreateVolumesFromSnapshotTest-661250879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:38:54 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-5deb4117-775c-4560-b638-2403d2b94fa4 tempest-CreateVolumesFromSnapshotTest-661250879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:38:54 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-5deb4117-775c-4560-b638-2403d2b94fa4 tempest-CreateVolumesFromSnapshotTest-661250879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:38:54 devstack sudo[104342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:38:54 devstack sudo[104342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:38:54 devstack sudo[104342]: pam_unix(sudo:session): session closed for user root
Nov 03 18:38:54 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-5deb4117-775c-4560-b638-2403d2b94fa4 tempest-CreateVolumesFromSnapshotTest-661250879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.268s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:38:54 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-5deb4117-775c-4560-b638-2403d2b94fa4 tempest-CreateVolumesFromSnapshotTest-661250879 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:38:55 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-5deb4117-775c-4560-b638-2403d2b94fa4 tempest-CreateVolumesFromSnapshotTest-661250879 None] Deleted volume successfully.
Nov 03 18:38:55 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-a2a57763-c249-48ee-ad1b-f033c3bfbb43 tempest-CreateVolumesFromSnapshotTest-661250879 None] Acquiring lock "cinder-ca103916-de8f-4fcd-b364-476608099383-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:38:55 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-5deb4117-775c-4560-b638-2403d2b94fa4 tempest-CreateVolumesFromSnapshotTest-661250879 None] Lock "cinder-d0ba53fd-6535-4742-9bfa-3cb58fe2edcd-delete_volume" released by "delete_volume" :: held 1.252s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:38:55 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-a2a57763-c249-48ee-ad1b-f033c3bfbb43 tempest-CreateVolumesFromSnapshotTest-661250879 None] Lock "cinder-ca103916-de8f-4fcd-b364-476608099383-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:38:55 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-a2a57763-c249-48ee-ad1b-f033c3bfbb43 tempest-CreateVolumesFromSnapshotTest-661250879 None] Acquiring lock "cinder-quobyte-ca103916-de8f-4fcd-b364-476608099383" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:38:55 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-a2a57763-c249-48ee-ad1b-f033c3bfbb43 tempest-CreateVolumesFromSnapshotTest-661250879 None] Lock "cinder-quobyte-ca103916-de8f-4fcd-b364-476608099383" acquired by "delete_volume" :: waited 0.020s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:38:55 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[58435e82-f8c0-4f7c-b76e-5d44b29b6702]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:38:55 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-a2a57763-c249-48ee-ad1b-f033c3bfbb43 tempest-CreateVolumesFromSnapshotTest-661250879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ca103916-de8f-4fcd-b364-476608099383 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:38:55 devstack sudo[104345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ca103916-de8f-4fcd-b364-476608099383
Nov 03 18:38:55 devstack sudo[104345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:38:55 devstack sudo[104345]: pam_unix(sudo:session): session closed for user root
Nov 03 18:38:55 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-a2a57763-c249-48ee-ad1b-f033c3bfbb43 tempest-CreateVolumesFromSnapshotTest-661250879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ca103916-de8f-4fcd-b364-476608099383" returned: 0 in 0.374s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:38:55 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-a2a57763-c249-48ee-ad1b-f033c3bfbb43 tempest-CreateVolumesFromSnapshotTest-661250879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ca103916-de8f-4fcd-b364-476608099383 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:38:55 devstack sudo[104350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ca103916-de8f-4fcd-b364-476608099383
Nov 03 18:38:55 devstack sudo[104350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:38:55 devstack sudo[104350]: pam_unix(sudo:session): session closed for user root
Nov 03 18:38:55 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-a2a57763-c249-48ee-ad1b-f033c3bfbb43 tempest-CreateVolumesFromSnapshotTest-661250879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ca103916-de8f-4fcd-b364-476608099383" returned: 0 in 0.269s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:38:55 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-a2a57763-c249-48ee-ad1b-f033c3bfbb43 tempest-CreateVolumesFromSnapshotTest-661250879 None] Lock "cinder-quobyte-ca103916-de8f-4fcd-b364-476608099383" released by "delete_volume" :: held 0.685s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:38:55 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-a2a57763-c249-48ee-ad1b-f033c3bfbb43 tempest-CreateVolumesFromSnapshotTest-661250879 None] Created reservations ['72101e5c-8821-4834-8a13-864a13ed5789', 'a4cfc4b8-8de2-4526-a20d-d6e76b0a34dd', '49f0139a-969f-4bcc-b349-cce253a0dd08', 'cce0a5fe-e6fd-44a0-8947-ea1845819309'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:38:55 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-a2a57763-c249-48ee-ad1b-f033c3bfbb43 tempest-CreateVolumesFromSnapshotTest-661250879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:38:55 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-a2a57763-c249-48ee-ad1b-f033c3bfbb43 tempest-CreateVolumesFromSnapshotTest-661250879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:38:55 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-a2a57763-c249-48ee-ad1b-f033c3bfbb43 tempest-CreateVolumesFromSnapshotTest-661250879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:38:55 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-a2a57763-c249-48ee-ad1b-f033c3bfbb43 tempest-CreateVolumesFromSnapshotTest-661250879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:38:55 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-a2a57763-c249-48ee-ad1b-f033c3bfbb43 tempest-CreateVolumesFromSnapshotTest-661250879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:38:55 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-a2a57763-c249-48ee-ad1b-f033c3bfbb43 tempest-CreateVolumesFromSnapshotTest-661250879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:38:55 devstack sudo[104353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:38:55 devstack sudo[104353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:38:56 devstack sudo[104353]: pam_unix(sudo:session): session closed for user root
Nov 03 18:38:56 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-a2a57763-c249-48ee-ad1b-f033c3bfbb43 tempest-CreateVolumesFromSnapshotTest-661250879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.283s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:38:56 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-a2a57763-c249-48ee-ad1b-f033c3bfbb43 tempest-CreateVolumesFromSnapshotTest-661250879 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:38:56 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-fd874e4a-2b7a-4b51-9963-c4f5ec92b8dc tempest-CreateVolumesFromSnapshotTest-661250879 None] Acquiring lock "cinder-ed2a9a2e-edda-4f87-8eb3-e6ca6dad20b5-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:38:56 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-a2a57763-c249-48ee-ad1b-f033c3bfbb43 tempest-CreateVolumesFromSnapshotTest-661250879 None] Deleted volume successfully.
Nov 03 18:38:56 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-fd874e4a-2b7a-4b51-9963-c4f5ec92b8dc tempest-CreateVolumesFromSnapshotTest-661250879 None] Lock "cinder-ed2a9a2e-edda-4f87-8eb3-e6ca6dad20b5-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:38:56 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-a2a57763-c249-48ee-ad1b-f033c3bfbb43 tempest-CreateVolumesFromSnapshotTest-661250879 None] Lock "cinder-ca103916-de8f-4fcd-b364-476608099383-delete_volume" released by "delete_volume" :: held 1.213s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:38:56 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-fd874e4a-2b7a-4b51-9963-c4f5ec92b8dc tempest-CreateVolumesFromSnapshotTest-661250879 None] Acquiring lock "cinder-quobyte-ed2a9a2e-edda-4f87-8eb3-e6ca6dad20b5" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:38:56 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-fd874e4a-2b7a-4b51-9963-c4f5ec92b8dc tempest-CreateVolumesFromSnapshotTest-661250879 None] Lock "cinder-quobyte-ed2a9a2e-edda-4f87-8eb3-e6ca6dad20b5" acquired by "delete_volume" :: waited 0.018s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:38:56 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[b46eaa39-968e-4fba-b1a0-99fe094fd068]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:38:56 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-fd874e4a-2b7a-4b51-9963-c4f5ec92b8dc tempest-CreateVolumesFromSnapshotTest-661250879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ed2a9a2e-edda-4f87-8eb3-e6ca6dad20b5 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:38:56 devstack sudo[104356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ed2a9a2e-edda-4f87-8eb3-e6ca6dad20b5
Nov 03 18:38:56 devstack sudo[104356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:38:56 devstack sudo[104356]: pam_unix(sudo:session): session closed for user root
Nov 03 18:38:56 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-fd874e4a-2b7a-4b51-9963-c4f5ec92b8dc tempest-CreateVolumesFromSnapshotTest-661250879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ed2a9a2e-edda-4f87-8eb3-e6ca6dad20b5" returned: 0 in 0.376s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:38:56 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-fd874e4a-2b7a-4b51-9963-c4f5ec92b8dc tempest-CreateVolumesFromSnapshotTest-661250879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ed2a9a2e-edda-4f87-8eb3-e6ca6dad20b5 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:38:56 devstack sudo[104361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ed2a9a2e-edda-4f87-8eb3-e6ca6dad20b5
Nov 03 18:38:56 devstack sudo[104361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:38:56 devstack sudo[104361]: pam_unix(sudo:session): session closed for user root
Nov 03 18:38:56 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-fd874e4a-2b7a-4b51-9963-c4f5ec92b8dc tempest-CreateVolumesFromSnapshotTest-661250879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ed2a9a2e-edda-4f87-8eb3-e6ca6dad20b5" returned: 0 in 0.243s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:38:57 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-fd874e4a-2b7a-4b51-9963-c4f5ec92b8dc tempest-CreateVolumesFromSnapshotTest-661250879 None] Lock "cinder-quobyte-ed2a9a2e-edda-4f87-8eb3-e6ca6dad20b5" released by "delete_volume" :: held 0.666s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:38:57 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-fd874e4a-2b7a-4b51-9963-c4f5ec92b8dc tempest-CreateVolumesFromSnapshotTest-661250879 None] Created reservations ['9fec6677-a1d1-40aa-9245-4cfd11532939', '3bbfecc2-1d2e-41d7-aa30-62a2963ef0f7', 'dbbd5b27-b4f6-4323-af32-bdbe25b3b9c0', 'f71543d4-bfe0-4aa8-ad02-e1d337ac7215'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:38:57 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-fd874e4a-2b7a-4b51-9963-c4f5ec92b8dc tempest-CreateVolumesFromSnapshotTest-661250879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:38:57 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-fd874e4a-2b7a-4b51-9963-c4f5ec92b8dc tempest-CreateVolumesFromSnapshotTest-661250879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:38:57 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-fd874e4a-2b7a-4b51-9963-c4f5ec92b8dc tempest-CreateVolumesFromSnapshotTest-661250879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:38:57 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-fd874e4a-2b7a-4b51-9963-c4f5ec92b8dc tempest-CreateVolumesFromSnapshotTest-661250879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:38:57 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-fd874e4a-2b7a-4b51-9963-c4f5ec92b8dc tempest-CreateVolumesFromSnapshotTest-661250879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:38:57 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-fd874e4a-2b7a-4b51-9963-c4f5ec92b8dc tempest-CreateVolumesFromSnapshotTest-661250879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:38:57 devstack sudo[104364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:38:57 devstack sudo[104364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:38:57 devstack sudo[104364]: pam_unix(sudo:session): session closed for user root
Nov 03 18:38:57 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-fd874e4a-2b7a-4b51-9963-c4f5ec92b8dc tempest-CreateVolumesFromSnapshotTest-661250879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.255s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:38:57 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-fd874e4a-2b7a-4b51-9963-c4f5ec92b8dc tempest-CreateVolumesFromSnapshotTest-661250879 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:38:57 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-fd874e4a-2b7a-4b51-9963-c4f5ec92b8dc tempest-CreateVolumesFromSnapshotTest-661250879 None] Deleted volume successfully.
Nov 03 18:38:57 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-fd874e4a-2b7a-4b51-9963-c4f5ec92b8dc tempest-CreateVolumesFromSnapshotTest-661250879 None] Lock "cinder-ed2a9a2e-edda-4f87-8eb3-e6ca6dad20b5-delete_volume" released by "delete_volume" :: held 1.145s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:38:57 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-872d38be-9849-42c5-9781-ccfe6cdc0768 tempest-CreateVolumesFromSnapshotTest-661250879 None] Acquiring lock "cinder-eef08c37-91f7-4332-896f-5aea61a7d3c4-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:38:57 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-872d38be-9849-42c5-9781-ccfe6cdc0768 tempest-CreateVolumesFromSnapshotTest-661250879 None] Lock "cinder-eef08c37-91f7-4332-896f-5aea61a7d3c4-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:38:57 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-872d38be-9849-42c5-9781-ccfe6cdc0768 tempest-CreateVolumesFromSnapshotTest-661250879 None] Acquiring lock "cinder-quobyte-eef08c37-91f7-4332-896f-5aea61a7d3c4" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:38:57 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-872d38be-9849-42c5-9781-ccfe6cdc0768 tempest-CreateVolumesFromSnapshotTest-661250879 None] Lock "cinder-quobyte-eef08c37-91f7-4332-896f-5aea61a7d3c4" acquired by "delete_volume" :: waited 0.021s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:38:57 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d6704a5-dd6b-47b5-9bcd-0ef4fd55eb5d]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:38:57 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-872d38be-9849-42c5-9781-ccfe6cdc0768 tempest-CreateVolumesFromSnapshotTest-661250879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-eef08c37-91f7-4332-896f-5aea61a7d3c4 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:38:57 devstack sudo[104367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-eef08c37-91f7-4332-896f-5aea61a7d3c4
Nov 03 18:38:57 devstack sudo[104367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:38:57 devstack sudo[104367]: pam_unix(sudo:session): session closed for user root
Nov 03 18:38:57 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-872d38be-9849-42c5-9781-ccfe6cdc0768 tempest-CreateVolumesFromSnapshotTest-661250879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-eef08c37-91f7-4332-896f-5aea61a7d3c4" returned: 0 in 0.364s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:38:57 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-872d38be-9849-42c5-9781-ccfe6cdc0768 tempest-CreateVolumesFromSnapshotTest-661250879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-eef08c37-91f7-4332-896f-5aea61a7d3c4 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:38:57 devstack sudo[104372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-eef08c37-91f7-4332-896f-5aea61a7d3c4
Nov 03 18:38:57 devstack sudo[104372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:38:58 devstack sudo[104372]: pam_unix(sudo:session): session closed for user root
Nov 03 18:38:58 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-872d38be-9849-42c5-9781-ccfe6cdc0768 tempest-CreateVolumesFromSnapshotTest-661250879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-eef08c37-91f7-4332-896f-5aea61a7d3c4" returned: 0 in 0.262s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:38:58 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-872d38be-9849-42c5-9781-ccfe6cdc0768 tempest-CreateVolumesFromSnapshotTest-661250879 None] Lock "cinder-quobyte-eef08c37-91f7-4332-896f-5aea61a7d3c4" released by "delete_volume" :: held 0.672s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:38:58 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-872d38be-9849-42c5-9781-ccfe6cdc0768 tempest-CreateVolumesFromSnapshotTest-661250879 None] Created reservations ['078daf53-a6cd-4b4c-97a5-b8f4e6b9255e', '0f8d5206-8ec5-4a25-9126-62c553dc3e53', '47cc6684-a4fb-4295-840f-96c1c9d50f67', 'ef994717-da02-4814-b9fd-1753ac83159e'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:38:58 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-872d38be-9849-42c5-9781-ccfe6cdc0768 tempest-CreateVolumesFromSnapshotTest-661250879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:38:58 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-872d38be-9849-42c5-9781-ccfe6cdc0768 tempest-CreateVolumesFromSnapshotTest-661250879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:38:58 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-872d38be-9849-42c5-9781-ccfe6cdc0768 tempest-CreateVolumesFromSnapshotTest-661250879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:38:58 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-872d38be-9849-42c5-9781-ccfe6cdc0768 tempest-CreateVolumesFromSnapshotTest-661250879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:38:58 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-872d38be-9849-42c5-9781-ccfe6cdc0768 tempest-CreateVolumesFromSnapshotTest-661250879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:38:58 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-872d38be-9849-42c5-9781-ccfe6cdc0768 tempest-CreateVolumesFromSnapshotTest-661250879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:38:58 devstack sudo[104375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:38:58 devstack sudo[104375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:38:58 devstack sudo[104375]: pam_unix(sudo:session): session closed for user root
Nov 03 18:38:58 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-872d38be-9849-42c5-9781-ccfe6cdc0768 tempest-CreateVolumesFromSnapshotTest-661250879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.268s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:38:58 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-872d38be-9849-42c5-9781-ccfe6cdc0768 tempest-CreateVolumesFromSnapshotTest-661250879 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:38:58 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-872d38be-9849-42c5-9781-ccfe6cdc0768 tempest-CreateVolumesFromSnapshotTest-661250879 None] Deleted volume successfully.
Nov 03 18:38:58 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-5416facb-761c-4435-9876-28f868d1e5f0 tempest-CreateVolumesFromSnapshotTest-661250879 None] Acquiring lock "cinder-c2fb653c-7a3f-4d5e-bed2-a8f179fef05f-delete_snapshot" by "delete_snapshot" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:38:58 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-872d38be-9849-42c5-9781-ccfe6cdc0768 tempest-CreateVolumesFromSnapshotTest-661250879 None] Lock "cinder-eef08c37-91f7-4332-896f-5aea61a7d3c4-delete_volume" released by "delete_volume" :: held 1.197s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:38:58 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-5416facb-761c-4435-9876-28f868d1e5f0 tempest-CreateVolumesFromSnapshotTest-661250879 None] Lock "cinder-c2fb653c-7a3f-4d5e-bed2-a8f179fef05f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:38:58 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-5416facb-761c-4435-9876-28f868d1e5f0 tempest-CreateVolumesFromSnapshotTest-661250879 None] Acquiring lock "cinder-quobyte-783ac3cf-e6fa-4dc2-85fd-253b5be69667" by "delete_snapshot" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:38:58 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-5416facb-761c-4435-9876-28f868d1e5f0 tempest-CreateVolumesFromSnapshotTest-661250879 None] Lock "cinder-quobyte-783ac3cf-e6fa-4dc2-85fd-253b5be69667" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:38:58 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-5416facb-761c-4435-9876-28f868d1e5f0 tempest-CreateVolumesFromSnapshotTest-661250879 None] Acquiring lock "cinder-quobyte-c2fb653c-7a3f-4d5e-bed2-a8f179fef05f" by "_delete_snapshot" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:38:58 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-5416facb-761c-4435-9876-28f868d1e5f0 tempest-CreateVolumesFromSnapshotTest-661250879 None] Lock "cinder-quobyte-c2fb653c-7a3f-4d5e-bed2-a8f179fef05f" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:38:58 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-5416facb-761c-4435-9876-28f868d1e5f0 tempest-CreateVolumesFromSnapshotTest-661250879 None] Deleting offline snapshot c2fb653c-7a3f-4d5e-bed2-a8f179fef05f of volume 783ac3cf-e6fa-4dc2-85fd-253b5be69667 {{(pid=86120) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 18:38:58 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-5416facb-761c-4435-9876-28f868d1e5f0 tempest-CreateVolumesFromSnapshotTest-661250879 None] snapshot_file for this snap is: volume-783ac3cf-e6fa-4dc2-85fd-253b5be69667.c2fb653c-7a3f-4d5e-bed2-a8f179fef05f {{(pid=86120) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 18:38:58 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[edb2d4b8-f6af-404a-898b-281fbf9f2d1e]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:38:58 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-5416facb-761c-4435-9876-28f868d1e5f0 tempest-CreateVolumesFromSnapshotTest-661250879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-783ac3cf-e6fa-4dc2-85fd-253b5be69667.c2fb653c-7a3f-4d5e-bed2-a8f179fef05f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:38:58 devstack sudo[104378]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-783ac3cf-e6fa-4dc2-85fd-253b5be69667.c2fb653c-7a3f-4d5e-bed2-a8f179fef05f
Nov 03 18:38:58 devstack sudo[104378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:38:59 devstack sudo[104378]: pam_unix(sudo:session): session closed for user root
Nov 03 18:38:59 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-5416facb-761c-4435-9876-28f868d1e5f0 tempest-CreateVolumesFromSnapshotTest-661250879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-783ac3cf-e6fa-4dc2-85fd-253b5be69667.c2fb653c-7a3f-4d5e-bed2-a8f179fef05f" returned: 0 in 0.372s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:38:59 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-5416facb-761c-4435-9876-28f868d1e5f0 tempest-CreateVolumesFromSnapshotTest-661250879 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-783ac3cf-e6fa-4dc2-85fd-253b5be69667(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86120) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 18:38:59 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[54b9fc3f-ed98-4966-8b75-3e79316bcc83]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:38:59 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-5416facb-761c-4435-9876-28f868d1e5f0 tempest-CreateVolumesFromSnapshotTest-661250879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-783ac3cf-e6fa-4dc2-85fd-253b5be69667 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:38:59 devstack sudo[104383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-783ac3cf-e6fa-4dc2-85fd-253b5be69667
Nov 03 18:38:59 devstack sudo[104383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:38:59 devstack sudo[104383]: pam_unix(sudo:session): session closed for user root
Nov 03 18:38:59 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-5416facb-761c-4435-9876-28f868d1e5f0 tempest-CreateVolumesFromSnapshotTest-661250879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-783ac3cf-e6fa-4dc2-85fd-253b5be69667" returned: 0 in 0.376s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:38:59 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-5416facb-761c-4435-9876-28f868d1e5f0 tempest-CreateVolumesFromSnapshotTest-661250879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-783ac3cf-e6fa-4dc2-85fd-253b5be69667.c2fb653c-7a3f-4d5e-bed2-a8f179fef05f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:38:59 devstack sudo[104391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-783ac3cf-e6fa-4dc2-85fd-253b5be69667.c2fb653c-7a3f-4d5e-bed2-a8f179fef05f
Nov 03 18:38:59 devstack sudo[104391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:38:59 devstack sudo[104391]: pam_unix(sudo:session): session closed for user root
Nov 03 18:38:59 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-5416facb-761c-4435-9876-28f868d1e5f0 tempest-CreateVolumesFromSnapshotTest-661250879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-783ac3cf-e6fa-4dc2-85fd-253b5be69667.c2fb653c-7a3f-4d5e-bed2-a8f179fef05f" returned: 0 in 0.418s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:38:59 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-5416facb-761c-4435-9876-28f868d1e5f0 tempest-CreateVolumesFromSnapshotTest-661250879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-783ac3cf-e6fa-4dc2-85fd-253b5be69667.c2fb653c-7a3f-4d5e-bed2-a8f179fef05f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:38:59 devstack sudo[104398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-783ac3cf-e6fa-4dc2-85fd-253b5be69667.c2fb653c-7a3f-4d5e-bed2-a8f179fef05f
Nov 03 18:38:59 devstack sudo[104398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:39:00 devstack sudo[104398]: pam_unix(sudo:session): session closed for user root
Nov 03 18:39:00 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-5416facb-761c-4435-9876-28f868d1e5f0 tempest-CreateVolumesFromSnapshotTest-661250879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-783ac3cf-e6fa-4dc2-85fd-253b5be69667.c2fb653c-7a3f-4d5e-bed2-a8f179fef05f" returned: 0 in 0.271s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:39:00 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-5416facb-761c-4435-9876-28f868d1e5f0 tempest-CreateVolumesFromSnapshotTest-661250879 None] Lock "cinder-quobyte-c2fb653c-7a3f-4d5e-bed2-a8f179fef05f" released by "_delete_snapshot" :: held 1.544s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:39:00 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-5416facb-761c-4435-9876-28f868d1e5f0 tempest-CreateVolumesFromSnapshotTest-661250879 None] Lock "cinder-quobyte-783ac3cf-e6fa-4dc2-85fd-253b5be69667" released by "delete_snapshot" :: held 1.571s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:39:00 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-5416facb-761c-4435-9876-28f868d1e5f0 tempest-CreateVolumesFromSnapshotTest-661250879 None] Created reservations ['62492212-6c19-42c6-94c3-95c9ebe55040', '6e93d5ed-f04b-487e-8c9a-242a9672cc77', '904fab31-181c-4a7d-bd59-7a8e57ff7b79', '80988041-0e30-40b5-8f0d-1670ca86cdc2'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:39:00 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-5416facb-761c-4435-9876-28f868d1e5f0 tempest-CreateVolumesFromSnapshotTest-661250879 None] Delete snapshot completed successfully.
Nov 03 18:39:00 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-5416facb-761c-4435-9876-28f868d1e5f0 tempest-CreateVolumesFromSnapshotTest-661250879 None] Lock "cinder-c2fb653c-7a3f-4d5e-bed2-a8f179fef05f-delete_snapshot" released by "delete_snapshot" :: held 1.760s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:39:00 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-0f73c374-8547-4229-ace7-5a6883ff35dd tempest-CreateVolumesFromSnapshotTest-661250879 None] Acquiring lock "cinder-783ac3cf-e6fa-4dc2-85fd-253b5be69667-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:39:00 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-0f73c374-8547-4229-ace7-5a6883ff35dd tempest-CreateVolumesFromSnapshotTest-661250879 None] Lock "cinder-783ac3cf-e6fa-4dc2-85fd-253b5be69667-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:39:00 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-0f73c374-8547-4229-ace7-5a6883ff35dd tempest-CreateVolumesFromSnapshotTest-661250879 None] Acquiring lock "cinder-quobyte-783ac3cf-e6fa-4dc2-85fd-253b5be69667" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:39:00 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-0f73c374-8547-4229-ace7-5a6883ff35dd tempest-CreateVolumesFromSnapshotTest-661250879 None] Lock "cinder-quobyte-783ac3cf-e6fa-4dc2-85fd-253b5be69667" acquired by "delete_volume" :: waited 0.016s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:39:00 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e8613f3-c10d-4170-b63b-193b5c8325ac]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:39:00 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-0f73c374-8547-4229-ace7-5a6883ff35dd tempest-CreateVolumesFromSnapshotTest-661250879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-783ac3cf-e6fa-4dc2-85fd-253b5be69667 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:39:01 devstack sudo[104404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-783ac3cf-e6fa-4dc2-85fd-253b5be69667
Nov 03 18:39:01 devstack sudo[104404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:39:01 devstack sudo[104404]: pam_unix(sudo:session): session closed for user root
Nov 03 18:39:01 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-0f73c374-8547-4229-ace7-5a6883ff35dd tempest-CreateVolumesFromSnapshotTest-661250879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-783ac3cf-e6fa-4dc2-85fd-253b5be69667" returned: 0 in 0.476s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:39:01 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-0f73c374-8547-4229-ace7-5a6883ff35dd tempest-CreateVolumesFromSnapshotTest-661250879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-783ac3cf-e6fa-4dc2-85fd-253b5be69667 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:39:01 devstack sudo[104409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-783ac3cf-e6fa-4dc2-85fd-253b5be69667
Nov 03 18:39:01 devstack sudo[104409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:39:01 devstack sudo[104409]: pam_unix(sudo:session): session closed for user root
Nov 03 18:39:01 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-0f73c374-8547-4229-ace7-5a6883ff35dd tempest-CreateVolumesFromSnapshotTest-661250879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-783ac3cf-e6fa-4dc2-85fd-253b5be69667" returned: 0 in 0.304s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:39:01 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-0f73c374-8547-4229-ace7-5a6883ff35dd tempest-CreateVolumesFromSnapshotTest-661250879 None] Lock "cinder-quobyte-783ac3cf-e6fa-4dc2-85fd-253b5be69667" released by "delete_volume" :: held 0.860s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:39:01 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-0f73c374-8547-4229-ace7-5a6883ff35dd tempest-CreateVolumesFromSnapshotTest-661250879 None] Created reservations ['58c5e7a9-e63f-4ed4-8052-f9c70b014f9a', '96a5dd24-1a54-4d65-aee8-0c7fbf9ae24a', '3990fbcd-e2d3-4e9a-a2ec-3be92bccd59f', '07e9b6cb-1045-48ab-b56f-6441b8f36946'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:39:01 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-0f73c374-8547-4229-ace7-5a6883ff35dd tempest-CreateVolumesFromSnapshotTest-661250879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:39:01 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-0f73c374-8547-4229-ace7-5a6883ff35dd tempest-CreateVolumesFromSnapshotTest-661250879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:39:01 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-0f73c374-8547-4229-ace7-5a6883ff35dd tempest-CreateVolumesFromSnapshotTest-661250879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:39:01 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-0f73c374-8547-4229-ace7-5a6883ff35dd tempest-CreateVolumesFromSnapshotTest-661250879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:39:01 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-0f73c374-8547-4229-ace7-5a6883ff35dd tempest-CreateVolumesFromSnapshotTest-661250879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:39:01 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-0f73c374-8547-4229-ace7-5a6883ff35dd tempest-CreateVolumesFromSnapshotTest-661250879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:39:01 devstack sudo[104418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:39:01 devstack sudo[104418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:39:02 devstack sudo[104418]: pam_unix(sudo:session): session closed for user root
Nov 03 18:39:02 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-0f73c374-8547-4229-ace7-5a6883ff35dd tempest-CreateVolumesFromSnapshotTest-661250879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.272s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:39:02 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-0f73c374-8547-4229-ace7-5a6883ff35dd tempest-CreateVolumesFromSnapshotTest-661250879 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:39:02 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-0f73c374-8547-4229-ace7-5a6883ff35dd tempest-CreateVolumesFromSnapshotTest-661250879 None] Deleted volume successfully.
Nov 03 18:39:02 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-0f73c374-8547-4229-ace7-5a6883ff35dd tempest-CreateVolumesFromSnapshotTest-661250879 None] Lock "cinder-783ac3cf-e6fa-4dc2-85fd-253b5be69667-delete_volume" released by "delete_volume" :: held 1.350s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:39:04 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c3a5491-92e1-4dd5-b768-a9096bf336ea tempest-CinderUnicodeTest-1159000146 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:39:04 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-1c3a5491-92e1-4dd5-b768-a9096bf336ea tempest-CinderUnicodeTest-1159000146 None] Flow 'volume_create_manager' (9671b02a-a01e-4d78-86d1-c162716e4899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:39:04 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-1c3a5491-92e1-4dd5-b768-a9096bf336ea tempest-CinderUnicodeTest-1159000146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3992ea46-b833-4328-99f8-18547edd01f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:39:04 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-1c3a5491-92e1-4dd5-b768-a9096bf336ea tempest-CinderUnicodeTest-1159000146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3992ea46-b833-4328-99f8-18547edd01f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:39:05Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d74850d-f572-4bec-a3db-1e0036d9e2b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2e9c4cefe6e4d78b4a474a7ecb7f776',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:39:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:39:05Z,use_quota=True,user_id='3cff57ff24db4967bfae8e7a2e6d4849',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:39:04 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-1c3a5491-92e1-4dd5-b768-a9096bf336ea tempest-CinderUnicodeTest-1159000146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (564e4db1-9eb3-42bc-a960-d7877f0d2b7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:39:04 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-1c3a5491-92e1-4dd5-b768-a9096bf336ea tempest-CinderUnicodeTest-1159000146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (564e4db1-9eb3-42bc-a960-d7877f0d2b7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:39:04 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-1c3a5491-92e1-4dd5-b768-a9096bf336ea tempest-CinderUnicodeTest-1159000146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24fb66d7-653b-43b2-aa1d-d18aeb315e5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:39:04 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-1c3a5491-92e1-4dd5-b768-a9096bf336ea tempest-CinderUnicodeTest-1159000146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24fb66d7-653b-43b2-aa1d-d18aeb315e5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d74850d-f572-4bec-a3db-1e0036d9e2b1', 'volume_name': 'volume-5d74850d-f572-4bec-a3db-1e0036d9e2b1', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:39:04 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-1c3a5491-92e1-4dd5-b768-a9096bf336ea tempest-CinderUnicodeTest-1159000146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (954516f1-6e09-46cc-b06c-9a20b306f878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:39:04 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-1c3a5491-92e1-4dd5-b768-a9096bf336ea tempest-CinderUnicodeTest-1159000146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (954516f1-6e09-46cc-b06c-9a20b306f878) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:39:04 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-1c3a5491-92e1-4dd5-b768-a9096bf336ea tempest-CinderUnicodeTest-1159000146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (483b8d55-7e16-453b-adb6-8703576a86fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:39:04 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-1c3a5491-92e1-4dd5-b768-a9096bf336ea tempest-CinderUnicodeTest-1159000146 None] Volume 5d74850d-f572-4bec-a3db-1e0036d9e2b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d74850d-f572-4bec-a3db-1e0036d9e2b1', 'volume_size': 1}
Nov 03 18:39:04 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-1c3a5491-92e1-4dd5-b768-a9096bf336ea tempest-CinderUnicodeTest-1159000146 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:39:04 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-1c3a5491-92e1-4dd5-b768-a9096bf336ea tempest-CinderUnicodeTest-1159000146 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:39:04 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-1c3a5491-92e1-4dd5-b768-a9096bf336ea tempest-CinderUnicodeTest-1159000146 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:39:05Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d74850d-f572-4bec-a3db-1e0036d9e2b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2e9c4cefe6e4d78b4a474a7ecb7f776',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:39:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:39:05Z,use_quota=True,user_id='3cff57ff24db4967bfae8e7a2e6d4849',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:39:04 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-1c3a5491-92e1-4dd5-b768-a9096bf336ea tempest-CinderUnicodeTest-1159000146 None] Creating volume 5d74850d-f572-4bec-a3db-1e0036d9e2b1 {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:39:04 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-1c3a5491-92e1-4dd5-b768-a9096bf336ea tempest-CinderUnicodeTest-1159000146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:39:04 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-1c3a5491-92e1-4dd5-b768-a9096bf336ea tempest-CinderUnicodeTest-1159000146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:39:04 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-1c3a5491-92e1-4dd5-b768-a9096bf336ea tempest-CinderUnicodeTest-1159000146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:39:04 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-1c3a5491-92e1-4dd5-b768-a9096bf336ea tempest-CinderUnicodeTest-1159000146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:39:04 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-1c3a5491-92e1-4dd5-b768-a9096bf336ea tempest-CinderUnicodeTest-1159000146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:39:04 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-1c3a5491-92e1-4dd5-b768-a9096bf336ea tempest-CinderUnicodeTest-1159000146 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:39:04 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-1c3a5491-92e1-4dd5-b768-a9096bf336ea tempest-CinderUnicodeTest-1159000146 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:39:04 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-1c3a5491-92e1-4dd5-b768-a9096bf336ea tempest-CinderUnicodeTest-1159000146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-5d74850d-f572-4bec-a3db-1e0036d9e2b1 1073741824 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:39:04 devstack sudo[104445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-5d74850d-f572-4bec-a3db-1e0036d9e2b1 1073741824
Nov 03 18:39:04 devstack sudo[104445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:39:05 devstack sudo[104445]: pam_unix(sudo:session): session closed for user root
Nov 03 18:39:05 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-1c3a5491-92e1-4dd5-b768-a9096bf336ea tempest-CinderUnicodeTest-1159000146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-5d74850d-f572-4bec-a3db-1e0036d9e2b1 1073741824" returned: 0 in 0.425s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:39:05 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-1c3a5491-92e1-4dd5-b768-a9096bf336ea tempest-CinderUnicodeTest-1159000146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-5d74850d-f572-4bec-a3db-1e0036d9e2b1 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:39:05 devstack sudo[104450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-5d74850d-f572-4bec-a3db-1e0036d9e2b1
Nov 03 18:39:05 devstack sudo[104450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:39:05 devstack sudo[104450]: pam_unix(sudo:session): session closed for user root
Nov 03 18:39:05 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-1c3a5491-92e1-4dd5-b768-a9096bf336ea tempest-CinderUnicodeTest-1159000146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-5d74850d-f572-4bec-a3db-1e0036d9e2b1" returned: 0 in 0.250s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:39:05 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-1c3a5491-92e1-4dd5-b768-a9096bf336ea tempest-CinderUnicodeTest-1159000146 None] <== create_volume: return (716ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:39:05 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-1c3a5491-92e1-4dd5-b768-a9096bf336ea tempest-CinderUnicodeTest-1159000146 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.719s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:39:05 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-1c3a5491-92e1-4dd5-b768-a9096bf336ea tempest-CinderUnicodeTest-1159000146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (483b8d55-7e16-453b-adb6-8703576a86fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d74850d-f572-4bec-a3db-1e0036d9e2b1', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:39:05 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-1c3a5491-92e1-4dd5-b768-a9096bf336ea tempest-CinderUnicodeTest-1159000146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fab595b-fedf-414f-90ad-ed7804cf4934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:39:05 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-1c3a5491-92e1-4dd5-b768-a9096bf336ea tempest-CinderUnicodeTest-1159000146 None] Volume volume-5d74850d-f572-4bec-a3db-1e0036d9e2b1 (5d74850d-f572-4bec-a3db-1e0036d9e2b1): created successfully
Nov 03 18:39:05 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-1c3a5491-92e1-4dd5-b768-a9096bf336ea tempest-CinderUnicodeTest-1159000146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fab595b-fedf-414f-90ad-ed7804cf4934) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:39:05 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-1c3a5491-92e1-4dd5-b768-a9096bf336ea tempest-CinderUnicodeTest-1159000146 None] Flow 'volume_create_manager' (9671b02a-a01e-4d78-86d1-c162716e4899) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:39:05 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-1c3a5491-92e1-4dd5-b768-a9096bf336ea tempest-CinderUnicodeTest-1159000146 None] Created volume successfully.
Nov 03 18:39:06 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4b1abfe-4f15-4ee4-b728-3360f9fa325d tempest-CinderUnicodeTest-1159000146 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:39:06 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-b4b1abfe-4f15-4ee4-b728-3360f9fa325d tempest-CinderUnicodeTest-1159000146 None] Flow 'volume_create_manager' (809dbe02-9b92-4148-8818-4e58e4472c7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:39:06 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-b4b1abfe-4f15-4ee4-b728-3360f9fa325d tempest-CinderUnicodeTest-1159000146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a669134-5570-494b-aaac-a0518d9882b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:39:06 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-b4b1abfe-4f15-4ee4-b728-3360f9fa325d tempest-CinderUnicodeTest-1159000146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a669134-5570-494b-aaac-a0518d9882b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:39:06Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1467426534',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65be0852-a876-44ba-b654-ec49e2181965,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2e9c4cefe6e4d78b4a474a7ecb7f776',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:39:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:39:06Z,use_quota=True,user_id='3cff57ff24db4967bfae8e7a2e6d4849',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:39:06 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-b4b1abfe-4f15-4ee4-b728-3360f9fa325d tempest-CinderUnicodeTest-1159000146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1c7cae5-9f9d-4919-9df6-64c9642b02c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:39:06 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-b4b1abfe-4f15-4ee4-b728-3360f9fa325d tempest-CinderUnicodeTest-1159000146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1c7cae5-9f9d-4919-9df6-64c9642b02c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:39:06 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-b4b1abfe-4f15-4ee4-b728-3360f9fa325d tempest-CinderUnicodeTest-1159000146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e63f84c-9317-4ee3-8e39-78cbfa3ebad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:39:06 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-b4b1abfe-4f15-4ee4-b728-3360f9fa325d tempest-CinderUnicodeTest-1159000146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e63f84c-9317-4ee3-8e39-78cbfa3ebad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65be0852-a876-44ba-b654-ec49e2181965', 'volume_name': 'volume-65be0852-a876-44ba-b654-ec49e2181965', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:39:06 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-b4b1abfe-4f15-4ee4-b728-3360f9fa325d tempest-CinderUnicodeTest-1159000146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0149f89a-ccdd-41c3-89fa-13679ae4c6e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:39:06 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-b4b1abfe-4f15-4ee4-b728-3360f9fa325d tempest-CinderUnicodeTest-1159000146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0149f89a-ccdd-41c3-89fa-13679ae4c6e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:39:06 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-b4b1abfe-4f15-4ee4-b728-3360f9fa325d tempest-CinderUnicodeTest-1159000146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7c0449e-9cf4-4029-8192-8c29327f6157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:39:06 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-b4b1abfe-4f15-4ee4-b728-3360f9fa325d tempest-CinderUnicodeTest-1159000146 None] Volume 65be0852-a876-44ba-b654-ec49e2181965: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65be0852-a876-44ba-b654-ec49e2181965', 'volume_size': 1}
Nov 03 18:39:06 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-b4b1abfe-4f15-4ee4-b728-3360f9fa325d tempest-CinderUnicodeTest-1159000146 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:39:06 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-b4b1abfe-4f15-4ee4-b728-3360f9fa325d tempest-CinderUnicodeTest-1159000146 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:39:06 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-b4b1abfe-4f15-4ee4-b728-3360f9fa325d tempest-CinderUnicodeTest-1159000146 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:39:06Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1467426534',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65be0852-a876-44ba-b654-ec49e2181965,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2e9c4cefe6e4d78b4a474a7ecb7f776',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:39:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:39:06Z,use_quota=True,user_id='3cff57ff24db4967bfae8e7a2e6d4849',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:39:06 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-b4b1abfe-4f15-4ee4-b728-3360f9fa325d tempest-CinderUnicodeTest-1159000146 None] Creating volume 65be0852-a876-44ba-b654-ec49e2181965 {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:39:06 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-b4b1abfe-4f15-4ee4-b728-3360f9fa325d tempest-CinderUnicodeTest-1159000146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:39:06 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-b4b1abfe-4f15-4ee4-b728-3360f9fa325d tempest-CinderUnicodeTest-1159000146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:39:06 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-b4b1abfe-4f15-4ee4-b728-3360f9fa325d tempest-CinderUnicodeTest-1159000146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:39:06 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-b4b1abfe-4f15-4ee4-b728-3360f9fa325d tempest-CinderUnicodeTest-1159000146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:39:06 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-b4b1abfe-4f15-4ee4-b728-3360f9fa325d tempest-CinderUnicodeTest-1159000146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:39:06 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-b4b1abfe-4f15-4ee4-b728-3360f9fa325d tempest-CinderUnicodeTest-1159000146 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:39:06 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-b4b1abfe-4f15-4ee4-b728-3360f9fa325d tempest-CinderUnicodeTest-1159000146 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:39:06 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b4b1abfe-4f15-4ee4-b728-3360f9fa325d tempest-CinderUnicodeTest-1159000146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-65be0852-a876-44ba-b654-ec49e2181965 1073741824 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:39:06 devstack sudo[104453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-65be0852-a876-44ba-b654-ec49e2181965 1073741824
Nov 03 18:39:06 devstack sudo[104453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:39:06 devstack sudo[104453]: pam_unix(sudo:session): session closed for user root
Nov 03 18:39:06 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b4b1abfe-4f15-4ee4-b728-3360f9fa325d tempest-CinderUnicodeTest-1159000146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-65be0852-a876-44ba-b654-ec49e2181965 1073741824" returned: 0 in 0.425s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:39:06 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b4b1abfe-4f15-4ee4-b728-3360f9fa325d tempest-CinderUnicodeTest-1159000146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-65be0852-a876-44ba-b654-ec49e2181965 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:39:06 devstack sudo[104459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-65be0852-a876-44ba-b654-ec49e2181965
Nov 03 18:39:06 devstack sudo[104459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:39:07 devstack sudo[104459]: pam_unix(sudo:session): session closed for user root
Nov 03 18:39:07 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b4b1abfe-4f15-4ee4-b728-3360f9fa325d tempest-CinderUnicodeTest-1159000146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-65be0852-a876-44ba-b654-ec49e2181965" returned: 0 in 0.271s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:39:07 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-b4b1abfe-4f15-4ee4-b728-3360f9fa325d tempest-CinderUnicodeTest-1159000146 None] <== create_volume: return (735ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:39:07 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-b4b1abfe-4f15-4ee4-b728-3360f9fa325d tempest-CinderUnicodeTest-1159000146 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.738s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:39:07 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-b4b1abfe-4f15-4ee4-b728-3360f9fa325d tempest-CinderUnicodeTest-1159000146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7c0449e-9cf4-4029-8192-8c29327f6157) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65be0852-a876-44ba-b654-ec49e2181965', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:39:07 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-b4b1abfe-4f15-4ee4-b728-3360f9fa325d tempest-CinderUnicodeTest-1159000146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (251f9343-bfde-4589-b24d-5081b3977284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:39:07 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-b4b1abfe-4f15-4ee4-b728-3360f9fa325d tempest-CinderUnicodeTest-1159000146 None] Volume volume-65be0852-a876-44ba-b654-ec49e2181965 (65be0852-a876-44ba-b654-ec49e2181965): created successfully
Nov 03 18:39:07 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-b4b1abfe-4f15-4ee4-b728-3360f9fa325d tempest-CinderUnicodeTest-1159000146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (251f9343-bfde-4589-b24d-5081b3977284) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:39:07 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-b4b1abfe-4f15-4ee4-b728-3360f9fa325d tempest-CinderUnicodeTest-1159000146 None] Flow 'volume_create_manager' (809dbe02-9b92-4148-8818-4e58e4472c7f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:39:07 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-b4b1abfe-4f15-4ee4-b728-3360f9fa325d tempest-CinderUnicodeTest-1159000146 None] Created volume successfully.
Nov 03 18:39:07 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-b37d9d5a-95e5-40de-b16f-43d22c0ee7d6 tempest-CinderUnicodeTest-1159000146 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:39:07 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-b37d9d5a-95e5-40de-b16f-43d22c0ee7d6 tempest-CinderUnicodeTest-1159000146 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:39:07 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-b37d9d5a-95e5-40de-b16f-43d22c0ee7d6 tempest-CinderUnicodeTest-1159000146 None] Creating offline snapshot 1a8d80aa-c1f1-4ff4-be41-99b0c9e353c3 of volume 65be0852-a876-44ba-b654-ec49e2181965 {{(pid=86120) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 18:39:07 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[54742003-3b5b-4df0-a071-666508d6e09f]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:39:07 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b37d9d5a-95e5-40de-b16f-43d22c0ee7d6 tempest-CinderUnicodeTest-1159000146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-65be0852-a876-44ba-b654-ec49e2181965 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:39:07 devstack sudo[104462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-65be0852-a876-44ba-b654-ec49e2181965
Nov 03 18:39:07 devstack sudo[104462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:39:08 devstack sudo[104462]: pam_unix(sudo:session): session closed for user root
Nov 03 18:39:08 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b37d9d5a-95e5-40de-b16f-43d22c0ee7d6 tempest-CinderUnicodeTest-1159000146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-65be0852-a876-44ba-b654-ec49e2181965" returned: 0 in 0.393s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:39:08 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b37d9d5a-95e5-40de-b16f-43d22c0ee7d6 tempest-CinderUnicodeTest-1159000146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-65be0852-a876-44ba-b654-ec49e2181965,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-65be0852-a876-44ba-b654-ec49e2181965.1a8d80aa-c1f1-4ff4-be41-99b0c9e353c3 1G {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:39:08 devstack sudo[104467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-65be0852-a876-44ba-b654-ec49e2181965,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-65be0852-a876-44ba-b654-ec49e2181965.1a8d80aa-c1f1-4ff4-be41-99b0c9e353c3 1G
Nov 03 18:39:08 devstack sudo[104467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:39:08 devstack sudo[104467]: pam_unix(sudo:session): session closed for user root
Nov 03 18:39:08 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b37d9d5a-95e5-40de-b16f-43d22c0ee7d6 tempest-CinderUnicodeTest-1159000146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-65be0852-a876-44ba-b654-ec49e2181965,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-65be0852-a876-44ba-b654-ec49e2181965.1a8d80aa-c1f1-4ff4-be41-99b0c9e353c3 1G" returned: 0 in 0.425s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:39:08 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b37d9d5a-95e5-40de-b16f-43d22c0ee7d6 tempest-CinderUnicodeTest-1159000146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65be0852-a876-44ba-b654-ec49e2181965 -F qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-65be0852-a876-44ba-b654-ec49e2181965.1a8d80aa-c1f1-4ff4-be41-99b0c9e353c3 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:39:08 devstack sudo[104472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65be0852-a876-44ba-b654-ec49e2181965 -F qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-65be0852-a876-44ba-b654-ec49e2181965.1a8d80aa-c1f1-4ff4-be41-99b0c9e353c3
Nov 03 18:39:08 devstack sudo[104472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:39:08 devstack sudo[104472]: pam_unix(sudo:session): session closed for user root
Nov 03 18:39:08 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b37d9d5a-95e5-40de-b16f-43d22c0ee7d6 tempest-CinderUnicodeTest-1159000146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65be0852-a876-44ba-b654-ec49e2181965 -F qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-65be0852-a876-44ba-b654-ec49e2181965.1a8d80aa-c1f1-4ff4-be41-99b0c9e353c3" returned: 0 in 0.337s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:39:08 devstack cinder-volume[86120]: WARNING cinder.volume.drivers.remotefs [None req-b37d9d5a-95e5-40de-b16f-43d22c0ee7d6 tempest-CinderUnicodeTest-1159000146 None] /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-65be0852-a876-44ba-b654-ec49e2181965.1a8d80aa-c1f1-4ff4-be41-99b0c9e353c3 is being set with open permissions: ugo+rw
Nov 03 18:39:08 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b37d9d5a-95e5-40de-b16f-43d22c0ee7d6 tempest-CinderUnicodeTest-1159000146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-65be0852-a876-44ba-b654-ec49e2181965.1a8d80aa-c1f1-4ff4-be41-99b0c9e353c3 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:39:08 devstack sudo[104479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-65be0852-a876-44ba-b654-ec49e2181965.1a8d80aa-c1f1-4ff4-be41-99b0c9e353c3
Nov 03 18:39:08 devstack sudo[104479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:39:09 devstack sudo[104479]: pam_unix(sudo:session): session closed for user root
Nov 03 18:39:09 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b37d9d5a-95e5-40de-b16f-43d22c0ee7d6 tempest-CinderUnicodeTest-1159000146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-65be0852-a876-44ba-b654-ec49e2181965.1a8d80aa-c1f1-4ff4-be41-99b0c9e353c3" returned: 0 in 0.271s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:39:09 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b37d9d5a-95e5-40de-b16f-43d22c0ee7d6 tempest-CinderUnicodeTest-1159000146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-65be0852-a876-44ba-b654-ec49e2181965.info {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:39:09 devstack sudo[104482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-65be0852-a876-44ba-b654-ec49e2181965.info
Nov 03 18:39:09 devstack sudo[104482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:39:09 devstack sudo[104482]: pam_unix(sudo:session): session closed for user root
Nov 03 18:39:09 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b37d9d5a-95e5-40de-b16f-43d22c0ee7d6 tempest-CinderUnicodeTest-1159000146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-65be0852-a876-44ba-b654-ec49e2181965.info" returned: 0 in 0.283s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:39:09 devstack cinder-volume[86120]: WARNING cinder.volume.drivers.remotefs [None req-b37d9d5a-95e5-40de-b16f-43d22c0ee7d6 tempest-CinderUnicodeTest-1159000146 None] /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-65be0852-a876-44ba-b654-ec49e2181965.info is being set with open permissions: ugo+rw
Nov 03 18:39:09 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b37d9d5a-95e5-40de-b16f-43d22c0ee7d6 tempest-CinderUnicodeTest-1159000146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-65be0852-a876-44ba-b654-ec49e2181965.info {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:39:09 devstack sudo[104496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-65be0852-a876-44ba-b654-ec49e2181965.info
Nov 03 18:39:09 devstack sudo[104496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:39:09 devstack sudo[104496]: pam_unix(sudo:session): session closed for user root
Nov 03 18:39:09 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b37d9d5a-95e5-40de-b16f-43d22c0ee7d6 tempest-CinderUnicodeTest-1159000146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-65be0852-a876-44ba-b654-ec49e2181965.info" returned: 0 in 0.283s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:39:09 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-b37d9d5a-95e5-40de-b16f-43d22c0ee7d6 tempest-CinderUnicodeTest-1159000146 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.087s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:39:09 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-b37d9d5a-95e5-40de-b16f-43d22c0ee7d6 tempest-CinderUnicodeTest-1159000146 None] Create snapshot completed successfully
Nov 03 18:39:10 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-60f9c58e-502b-4b9d-834b-4b14ccbbe601 tempest-CinderUnicodeTest-1159000146 None] Acquiring lock "cinder-1a8d80aa-c1f1-4ff4-be41-99b0c9e353c3-delete_snapshot" by "delete_snapshot" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:39:10 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-60f9c58e-502b-4b9d-834b-4b14ccbbe601 tempest-CinderUnicodeTest-1159000146 None] Lock "cinder-1a8d80aa-c1f1-4ff4-be41-99b0c9e353c3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:39:10 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-60f9c58e-502b-4b9d-834b-4b14ccbbe601 tempest-CinderUnicodeTest-1159000146 None] Acquiring lock "cinder-quobyte-65be0852-a876-44ba-b654-ec49e2181965" by "delete_snapshot" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:39:10 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-60f9c58e-502b-4b9d-834b-4b14ccbbe601 tempest-CinderUnicodeTest-1159000146 None] Lock "cinder-quobyte-65be0852-a876-44ba-b654-ec49e2181965" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:39:10 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-60f9c58e-502b-4b9d-834b-4b14ccbbe601 tempest-CinderUnicodeTest-1159000146 None] Acquiring lock "cinder-quobyte-1a8d80aa-c1f1-4ff4-be41-99b0c9e353c3" by "_delete_snapshot" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:39:10 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-60f9c58e-502b-4b9d-834b-4b14ccbbe601 tempest-CinderUnicodeTest-1159000146 None] Lock "cinder-quobyte-1a8d80aa-c1f1-4ff4-be41-99b0c9e353c3" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:39:10 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-60f9c58e-502b-4b9d-834b-4b14ccbbe601 tempest-CinderUnicodeTest-1159000146 None] Deleting offline snapshot 1a8d80aa-c1f1-4ff4-be41-99b0c9e353c3 of volume 65be0852-a876-44ba-b654-ec49e2181965 {{(pid=86120) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 18:39:10 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-60f9c58e-502b-4b9d-834b-4b14ccbbe601 tempest-CinderUnicodeTest-1159000146 None] snapshot_file for this snap is: volume-65be0852-a876-44ba-b654-ec49e2181965.1a8d80aa-c1f1-4ff4-be41-99b0c9e353c3 {{(pid=86120) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 18:39:10 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[321483f9-37f9-4426-8f7d-aae681e488ea]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:39:10 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-60f9c58e-502b-4b9d-834b-4b14ccbbe601 tempest-CinderUnicodeTest-1159000146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-65be0852-a876-44ba-b654-ec49e2181965.1a8d80aa-c1f1-4ff4-be41-99b0c9e353c3 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:39:11 devstack sudo[104499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-65be0852-a876-44ba-b654-ec49e2181965.1a8d80aa-c1f1-4ff4-be41-99b0c9e353c3
Nov 03 18:39:11 devstack sudo[104499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:39:11 devstack sudo[104499]: pam_unix(sudo:session): session closed for user root
Nov 03 18:39:11 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-60f9c58e-502b-4b9d-834b-4b14ccbbe601 tempest-CinderUnicodeTest-1159000146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-65be0852-a876-44ba-b654-ec49e2181965.1a8d80aa-c1f1-4ff4-be41-99b0c9e353c3" returned: 0 in 0.393s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:39:11 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-60f9c58e-502b-4b9d-834b-4b14ccbbe601 tempest-CinderUnicodeTest-1159000146 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-65be0852-a876-44ba-b654-ec49e2181965(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86120) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 18:39:11 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[82cfb570-26c8-41f0-97e5-da97acc05442]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:39:11 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-60f9c58e-502b-4b9d-834b-4b14ccbbe601 tempest-CinderUnicodeTest-1159000146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-65be0852-a876-44ba-b654-ec49e2181965 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:39:11 devstack sudo[104504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-65be0852-a876-44ba-b654-ec49e2181965
Nov 03 18:39:11 devstack sudo[104504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:39:11 devstack sudo[104504]: pam_unix(sudo:session): session closed for user root
Nov 03 18:39:11 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-60f9c58e-502b-4b9d-834b-4b14ccbbe601 tempest-CinderUnicodeTest-1159000146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-65be0852-a876-44ba-b654-ec49e2181965" returned: 0 in 0.368s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:39:11 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-60f9c58e-502b-4b9d-834b-4b14ccbbe601 tempest-CinderUnicodeTest-1159000146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-65be0852-a876-44ba-b654-ec49e2181965.1a8d80aa-c1f1-4ff4-be41-99b0c9e353c3 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:39:11 devstack sudo[104509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-65be0852-a876-44ba-b654-ec49e2181965.1a8d80aa-c1f1-4ff4-be41-99b0c9e353c3
Nov 03 18:39:11 devstack sudo[104509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:39:12 devstack sudo[104509]: pam_unix(sudo:session): session closed for user root
Nov 03 18:39:12 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-60f9c58e-502b-4b9d-834b-4b14ccbbe601 tempest-CinderUnicodeTest-1159000146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-65be0852-a876-44ba-b654-ec49e2181965.1a8d80aa-c1f1-4ff4-be41-99b0c9e353c3" returned: 0 in 0.346s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:39:12 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-60f9c58e-502b-4b9d-834b-4b14ccbbe601 tempest-CinderUnicodeTest-1159000146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-65be0852-a876-44ba-b654-ec49e2181965.1a8d80aa-c1f1-4ff4-be41-99b0c9e353c3 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:39:12 devstack sudo[104514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-65be0852-a876-44ba-b654-ec49e2181965.1a8d80aa-c1f1-4ff4-be41-99b0c9e353c3
Nov 03 18:39:12 devstack sudo[104514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:39:12 devstack sudo[104514]: pam_unix(sudo:session): session closed for user root
Nov 03 18:39:12 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-60f9c58e-502b-4b9d-834b-4b14ccbbe601 tempest-CinderUnicodeTest-1159000146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-65be0852-a876-44ba-b654-ec49e2181965.1a8d80aa-c1f1-4ff4-be41-99b0c9e353c3" returned: 0 in 0.243s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:39:12 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-60f9c58e-502b-4b9d-834b-4b14ccbbe601 tempest-CinderUnicodeTest-1159000146 None] Lock "cinder-quobyte-1a8d80aa-c1f1-4ff4-be41-99b0c9e353c3" released by "_delete_snapshot" :: held 1.456s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:39:12 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-60f9c58e-502b-4b9d-834b-4b14ccbbe601 tempest-CinderUnicodeTest-1159000146 None] Lock "cinder-quobyte-65be0852-a876-44ba-b654-ec49e2181965" released by "delete_snapshot" :: held 1.479s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:39:12 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-60f9c58e-502b-4b9d-834b-4b14ccbbe601 tempest-CinderUnicodeTest-1159000146 None] Created reservations ['d2ba1401-6a88-42f4-88b4-fb4dae658946', '32fc5735-9a60-4a9f-9276-ab2f7f01c04c', '867f8502-c101-4e3c-8bb8-f0e21a893922', '886677bf-b6a5-4ad6-815e-2da563fa9b59'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:39:12 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-60f9c58e-502b-4b9d-834b-4b14ccbbe601 tempest-CinderUnicodeTest-1159000146 None] Delete snapshot completed successfully.
Nov 03 18:39:12 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-60f9c58e-502b-4b9d-834b-4b14ccbbe601 tempest-CinderUnicodeTest-1159000146 None] Lock "cinder-1a8d80aa-c1f1-4ff4-be41-99b0c9e353c3-delete_snapshot" released by "delete_snapshot" :: held 1.614s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:39:13 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-c4e0e697-bfe7-4760-9928-8c966659bbd3 tempest-CinderUnicodeTest-1159000146 None] Acquiring lock "cinder-65be0852-a876-44ba-b654-ec49e2181965-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:39:13 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-c4e0e697-bfe7-4760-9928-8c966659bbd3 tempest-CinderUnicodeTest-1159000146 None] Lock "cinder-65be0852-a876-44ba-b654-ec49e2181965-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:39:13 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-c4e0e697-bfe7-4760-9928-8c966659bbd3 tempest-CinderUnicodeTest-1159000146 None] Acquiring lock "cinder-quobyte-65be0852-a876-44ba-b654-ec49e2181965" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:39:13 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-c4e0e697-bfe7-4760-9928-8c966659bbd3 tempest-CinderUnicodeTest-1159000146 None] Lock "cinder-quobyte-65be0852-a876-44ba-b654-ec49e2181965" acquired by "delete_volume" :: waited 0.025s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:39:13 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[e045bcc2-79fb-48f1-8bc8-6afe823178ea]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:39:13 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-c4e0e697-bfe7-4760-9928-8c966659bbd3 tempest-CinderUnicodeTest-1159000146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-65be0852-a876-44ba-b654-ec49e2181965 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:39:13 devstack sudo[104521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-65be0852-a876-44ba-b654-ec49e2181965
Nov 03 18:39:13 devstack sudo[104521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:39:13 devstack sudo[104521]: pam_unix(sudo:session): session closed for user root
Nov 03 18:39:13 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-c4e0e697-bfe7-4760-9928-8c966659bbd3 tempest-CinderUnicodeTest-1159000146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-65be0852-a876-44ba-b654-ec49e2181965" returned: 0 in 0.384s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:39:13 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-c4e0e697-bfe7-4760-9928-8c966659bbd3 tempest-CinderUnicodeTest-1159000146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-65be0852-a876-44ba-b654-ec49e2181965 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:39:13 devstack sudo[104529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-65be0852-a876-44ba-b654-ec49e2181965
Nov 03 18:39:13 devstack sudo[104529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:39:13 devstack sudo[104529]: pam_unix(sudo:session): session closed for user root
Nov 03 18:39:13 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-c4e0e697-bfe7-4760-9928-8c966659bbd3 tempest-CinderUnicodeTest-1159000146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-65be0852-a876-44ba-b654-ec49e2181965" returned: 0 in 0.291s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:39:13 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-c4e0e697-bfe7-4760-9928-8c966659bbd3 tempest-CinderUnicodeTest-1159000146 None] Lock "cinder-quobyte-65be0852-a876-44ba-b654-ec49e2181965" released by "delete_volume" :: held 0.746s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:39:13 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [req-d47f2c1e-9849-42f0-a15d-994ee5a64a38 req-61ec4095-1ac8-4a70-bf82-617f3ccec6d4 tempest-TestInstancesWithCinderVolumes-517437558 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:39:13 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [req-d47f2c1e-9849-42f0-a15d-994ee5a64a38 req-61ec4095-1ac8-4a70-bf82-617f3ccec6d4 tempest-TestInstancesWithCinderVolumes-517437558 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:39:13 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-c4e0e697-bfe7-4760-9928-8c966659bbd3 tempest-CinderUnicodeTest-1159000146 None] Created reservations ['12bf9c54-4d5c-44cf-8098-8711a8c2a3f2', '3431c0eb-4a54-451a-b19d-d8ccb4adff21', '5b39e544-b57d-4b0a-9364-ca22527affab', 'b5724a66-7840-49b5-b6c7-e431bdd694e5'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:39:13 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [req-d47f2c1e-9849-42f0-a15d-994ee5a64a38 req-61ec4095-1ac8-4a70-bf82-617f3ccec6d4 tempest-TestInstancesWithCinderVolumes-517437558 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:39:13 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [req-d47f2c1e-9849-42f0-a15d-994ee5a64a38 req-61ec4095-1ac8-4a70-bf82-617f3ccec6d4 tempest-TestInstancesWithCinderVolumes-517437558 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c', 'name': 'volume-089e798d-b533-47c1-9822-a516a4fe0ba1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2edd6151-a892-4976-a910-713af0addc2a', 'enforce_multipath': True} {{(pid=86120) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 03 18:39:13 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-c4e0e697-bfe7-4760-9928-8c966659bbd3 tempest-CinderUnicodeTest-1159000146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:39:13 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-c4e0e697-bfe7-4760-9928-8c966659bbd3 tempest-CinderUnicodeTest-1159000146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:39:13 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-c4e0e697-bfe7-4760-9928-8c966659bbd3 tempest-CinderUnicodeTest-1159000146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:39:13 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-c4e0e697-bfe7-4760-9928-8c966659bbd3 tempest-CinderUnicodeTest-1159000146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:39:13 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-c4e0e697-bfe7-4760-9928-8c966659bbd3 tempest-CinderUnicodeTest-1159000146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:39:13 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-c4e0e697-bfe7-4760-9928-8c966659bbd3 tempest-CinderUnicodeTest-1159000146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:39:14 devstack sudo[104540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:39:14 devstack sudo[104540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:39:14 devstack cinder-volume[86120]: INFO cinder.volume.manager [req-d47f2c1e-9849-42f0-a15d-994ee5a64a38 req-61ec4095-1ac8-4a70-bf82-617f3ccec6d4 tempest-TestInstancesWithCinderVolumes-517437558 None] attachment_update completed successfully.
Nov 03 18:39:14 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-349b9380-6e8a-4ebb-b029-09f84e577a61 tempest-CinderUnicodeTest-1159000146 None] Acquiring lock "cinder-5d74850d-f572-4bec-a3db-1e0036d9e2b1-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:39:14 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-349b9380-6e8a-4ebb-b029-09f84e577a61 tempest-CinderUnicodeTest-1159000146 None] Lock "cinder-5d74850d-f572-4bec-a3db-1e0036d9e2b1-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:39:14 devstack sudo[104540]: pam_unix(sudo:session): session closed for user root
Nov 03 18:39:14 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-349b9380-6e8a-4ebb-b029-09f84e577a61 tempest-CinderUnicodeTest-1159000146 None] Acquiring lock "cinder-quobyte-5d74850d-f572-4bec-a3db-1e0036d9e2b1" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:39:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-c4e0e697-bfe7-4760-9928-8c966659bbd3 tempest-CinderUnicodeTest-1159000146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.313s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:39:14 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-c4e0e697-bfe7-4760-9928-8c966659bbd3 tempest-CinderUnicodeTest-1159000146 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:39:14 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-c4e0e697-bfe7-4760-9928-8c966659bbd3 tempest-CinderUnicodeTest-1159000146 None] Deleted volume successfully.
Nov 03 18:39:14 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-349b9380-6e8a-4ebb-b029-09f84e577a61 tempest-CinderUnicodeTest-1159000146 None] Lock "cinder-quobyte-5d74850d-f572-4bec-a3db-1e0036d9e2b1" acquired by "delete_volume" :: waited 0.026s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:39:14 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-c4e0e697-bfe7-4760-9928-8c966659bbd3 tempest-CinderUnicodeTest-1159000146 None] Lock "cinder-65be0852-a876-44ba-b654-ec49e2181965-delete_volume" released by "delete_volume" :: held 1.326s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:39:14 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[037e7ece-2a9a-4244-9b29-970959487937]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:39:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-349b9380-6e8a-4ebb-b029-09f84e577a61 tempest-CinderUnicodeTest-1159000146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-5d74850d-f572-4bec-a3db-1e0036d9e2b1 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:39:14 devstack sudo[104545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-5d74850d-f572-4bec-a3db-1e0036d9e2b1
Nov 03 18:39:14 devstack sudo[104545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:39:14 devstack sudo[104545]: pam_unix(sudo:session): session closed for user root
Nov 03 18:39:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-349b9380-6e8a-4ebb-b029-09f84e577a61 tempest-CinderUnicodeTest-1159000146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-5d74850d-f572-4bec-a3db-1e0036d9e2b1" returned: 0 in 0.413s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:39:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-349b9380-6e8a-4ebb-b029-09f84e577a61 tempest-CinderUnicodeTest-1159000146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-5d74850d-f572-4bec-a3db-1e0036d9e2b1 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:39:14 devstack sudo[104558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-5d74850d-f572-4bec-a3db-1e0036d9e2b1
Nov 03 18:39:14 devstack sudo[104558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:39:14 devstack cinder-volume[86120]: DEBUG oslo_service.periodic_task [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86120) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 18:39:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:39:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:39:14 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:39:14 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:39:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:39:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:39:14 devstack sudo[104562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:39:14 devstack sudo[104562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:39:15 devstack sudo[104558]: pam_unix(sudo:session): session closed for user root
Nov 03 18:39:15 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-349b9380-6e8a-4ebb-b029-09f84e577a61 tempest-CinderUnicodeTest-1159000146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-5d74850d-f572-4bec-a3db-1e0036d9e2b1" returned: 0 in 0.259s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:39:15 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-349b9380-6e8a-4ebb-b029-09f84e577a61 tempest-CinderUnicodeTest-1159000146 None] Lock "cinder-quobyte-5d74850d-f572-4bec-a3db-1e0036d9e2b1" released by "delete_volume" :: held 0.737s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:39:15 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-349b9380-6e8a-4ebb-b029-09f84e577a61 tempest-CinderUnicodeTest-1159000146 None] Created reservations ['db969fa2-68d3-421a-94ac-7d8bde798c25', '982d93b9-469d-4ceb-8c94-1fed1eb5bcb4', '769458ad-0c79-481d-9195-f2a0365cf513', 'd990f11d-c7fd-4251-8f95-ba053e97b8f7'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:39:15 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-349b9380-6e8a-4ebb-b029-09f84e577a61 tempest-CinderUnicodeTest-1159000146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:39:15 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-349b9380-6e8a-4ebb-b029-09f84e577a61 tempest-CinderUnicodeTest-1159000146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:39:15 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-349b9380-6e8a-4ebb-b029-09f84e577a61 tempest-CinderUnicodeTest-1159000146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:39:15 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-349b9380-6e8a-4ebb-b029-09f84e577a61 tempest-CinderUnicodeTest-1159000146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:39:15 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-349b9380-6e8a-4ebb-b029-09f84e577a61 tempest-CinderUnicodeTest-1159000146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:39:15 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-349b9380-6e8a-4ebb-b029-09f84e577a61 tempest-CinderUnicodeTest-1159000146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:39:15 devstack sudo[104568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:39:15 devstack sudo[104568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:39:15 devstack sudo[104562]: pam_unix(sudo:session): session closed for user root
Nov 03 18:39:15 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.266s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:39:15 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:39:15 devstack cinder-volume[86120]: DEBUG oslo_service.periodic_task [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Running periodic task VolumeManager._thread_info {{(pid=86120) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 18:39:15 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] thread count: 28 {{(pid=86120) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 03 18:39:15 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] thread info: [<_MainThread(MainThread, started 134747145822336)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134747033686336)>, <Thread(Thread-3 (stat_writer), started daemon 134747030828736)>, <Thread(Rabbit-heartbeat, started daemon 134747035433408)>, <Thread(Thread-5 (_runner), started daemon 134747029587392)>, <Thread(Thread-7 (_runner), started daemon 134747029784256)>, <Thread(fd_logger, started daemon 134747027909120)>, <Thread(privsep_reader, started daemon 134747027006592)>, <Thread(tpool_thread_0, started daemon 134747018950336)>, <Thread(tpool_thread_1, started daemon 134747010541248)>, <Thread(tpool_thread_2, started daemon 134747002132160)>, <Thread(tpool_thread_3, started daemon 134746993723072)>, <Thread(tpool_thread_4, started daemon 134746985313984)>, <Thread(tpool_thread_5, started daemon 134746976904896)>, <Thread(tpool_thread_6, started daemon 134746968495808)>, <Thread(tpool_thread_7, started daemon 134746960086720)>, <Thread(tpool_thread_8, started daemon 134746951677632)>, <Thread(tpool_thread_9, started daemon 134746943268544)>, <Thread(tpool_thread_10, started daemon 134746934859456)>, <Thread(tpool_thread_11, started daemon 134746926450368)>, <Thread(tpool_thread_12, started daemon 134746918041280)>, <Thread(tpool_thread_13, started daemon 134746909632192)>, <Thread(tpool_thread_14, started daemon 134746901223104)>, <Thread(tpool_thread_15, started daemon 134746892814016)>, <Thread(tpool_thread_16, started daemon 134746884404928)>, <Thread(tpool_thread_17, started daemon 134746875995840)>, <Thread(tpool_thread_18, started daemon 134746867586752)>, <Thread(tpool_thread_19, started daemon 134746859177664)>] {{(pid=86120) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 03 18:39:15 devstack sudo[104568]: pam_unix(sudo:session): session closed for user root
Nov 03 18:39:15 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-349b9380-6e8a-4ebb-b029-09f84e577a61 tempest-CinderUnicodeTest-1159000146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.289s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:39:15 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-349b9380-6e8a-4ebb-b029-09f84e577a61 tempest-CinderUnicodeTest-1159000146 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:39:15 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-349b9380-6e8a-4ebb-b029-09f84e577a61 tempest-CinderUnicodeTest-1159000146 None] Deleted volume successfully.
Nov 03 18:39:15 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-349b9380-6e8a-4ebb-b029-09f84e577a61 tempest-CinderUnicodeTest-1159000146 None] Lock "cinder-5d74850d-f572-4bec-a3db-1e0036d9e2b1-delete_volume" released by "delete_volume" :: held 1.298s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:39:16 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [req-0d71f464-0196-4de5-973d-6bc9d48f6a64 req-bf025db2-a871-4920-9968-4b5536c0280d tempest-TestInstancesWithCinderVolumes-517437558 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:39:16 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [req-0d71f464-0196-4de5-973d-6bc9d48f6a64 req-bf025db2-a871-4920-9968-4b5536c0280d tempest-TestInstancesWithCinderVolumes-517437558 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:39:16 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [req-0d71f464-0196-4de5-973d-6bc9d48f6a64 req-bf025db2-a871-4920-9968-4b5536c0280d tempest-TestInstancesWithCinderVolumes-517437558 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:39:16 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [req-0d71f464-0196-4de5-973d-6bc9d48f6a64 req-bf025db2-a871-4920-9968-4b5536c0280d tempest-TestInstancesWithCinderVolumes-517437558 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c', 'name': 'volume-53141f35-9fdc-4822-b70f-df3a1469c321', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ab98fec8-c6dd-4ee6-9b6e-9230d5039e5b', 'enforce_multipath': True} {{(pid=86120) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 03 18:39:16 devstack cinder-volume[86120]: INFO cinder.volume.manager [req-0d71f464-0196-4de5-973d-6bc9d48f6a64 req-bf025db2-a871-4920-9968-4b5536c0280d tempest-TestInstancesWithCinderVolumes-517437558 None] attachment_update completed successfully.
Nov 03 18:39:21 devstack cinder-volume[86120]: INFO cinder.volume.manager [req-06488bd7-aaa4-4a21-9e8a-8fa56e616e76 req-67a4dd5d-fe80-4ab9-ae34-b0c441efda30 tempest-TestInstancesWithCinderVolumes-517437558 None] Terminate volume connection completed successfully.
Nov 03 18:39:21 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [req-06488bd7-aaa4-4a21-9e8a-8fa56e616e76 req-67a4dd5d-fe80-4ab9-ae34-b0c441efda30 tempest-TestInstancesWithCinderVolumes-517437558 None] Deleting attachment 2edd6151-a892-4976-a910-713af0addc2a. {{(pid=86120) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 03 18:39:21 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-c1be0231-81dc-4207-8e78-7cbc27a35235 tempest-TestInstancesWithCinderVolumes-517437558 None] Acquiring lock "cinder-089e798d-b533-47c1-9822-a516a4fe0ba1-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:39:21 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-c1be0231-81dc-4207-8e78-7cbc27a35235 tempest-TestInstancesWithCinderVolumes-517437558 None] Lock "cinder-089e798d-b533-47c1-9822-a516a4fe0ba1-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:39:21 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-c1be0231-81dc-4207-8e78-7cbc27a35235 tempest-TestInstancesWithCinderVolumes-517437558 None] Acquiring lock "cinder-quobyte-089e798d-b533-47c1-9822-a516a4fe0ba1" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:39:21 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-c1be0231-81dc-4207-8e78-7cbc27a35235 tempest-TestInstancesWithCinderVolumes-517437558 None] Lock "cinder-quobyte-089e798d-b533-47c1-9822-a516a4fe0ba1" acquired by "delete_volume" :: waited 0.017s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:39:22 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb462c11-f716-428b-ad79-bc477c24a0ec]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:39:22 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-c1be0231-81dc-4207-8e78-7cbc27a35235 tempest-TestInstancesWithCinderVolumes-517437558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-089e798d-b533-47c1-9822-a516a4fe0ba1 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:39:22 devstack sudo[104621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-089e798d-b533-47c1-9822-a516a4fe0ba1
Nov 03 18:39:22 devstack sudo[104621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:39:22 devstack sudo[104621]: pam_unix(sudo:session): session closed for user root
Nov 03 18:39:22 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-c1be0231-81dc-4207-8e78-7cbc27a35235 tempest-TestInstancesWithCinderVolumes-517437558 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-089e798d-b533-47c1-9822-a516a4fe0ba1" returned: 0 in 0.519s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:39:22 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-c1be0231-81dc-4207-8e78-7cbc27a35235 tempest-TestInstancesWithCinderVolumes-517437558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-089e798d-b533-47c1-9822-a516a4fe0ba1 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:39:22 devstack sudo[104627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-089e798d-b533-47c1-9822-a516a4fe0ba1
Nov 03 18:39:22 devstack sudo[104627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:39:22 devstack sudo[104627]: pam_unix(sudo:session): session closed for user root
Nov 03 18:39:22 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-c1be0231-81dc-4207-8e78-7cbc27a35235 tempest-TestInstancesWithCinderVolumes-517437558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-089e798d-b533-47c1-9822-a516a4fe0ba1" returned: 0 in 0.294s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:39:22 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-c1be0231-81dc-4207-8e78-7cbc27a35235 tempest-TestInstancesWithCinderVolumes-517437558 None] Lock "cinder-quobyte-089e798d-b533-47c1-9822-a516a4fe0ba1" released by "delete_volume" :: held 0.873s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:39:22 devstack cinder-volume[86120]: DEBUG dbcounter [-] [86120] Writing DB stats cinder:SELECT=116,cinder:UPDATE=123,cinder:INSERT=41,cinder:DELETE=9 {{(pid=86120) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 18:39:22 devstack cinder-volume[86120]: DEBUG dbcounter [-] [86120] Writing DB stats cinder:SELECT=111,cinder:INSERT=25,cinder:UPDATE=129,cinder:DELETE=13 {{(pid=86120) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 18:39:22 devstack cinder-volume[86120]: WARNING cinder.quota [None req-c1be0231-81dc-4207-8e78-7cbc27a35235 tempest-TestInstancesWithCinderVolumes-517437558 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1753577121-75609137 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1753577121-75609137, it is now deprecated. Please use the default quota class for default quota.
Nov 03 18:39:22 devstack cinder-volume[86120]: WARNING cinder.quota [None req-c1be0231-81dc-4207-8e78-7cbc27a35235 tempest-TestInstancesWithCinderVolumes-517437558 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1753577121-75609137 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1753577121-75609137, it is now deprecated. Please use the default quota class for default quota.
Nov 03 18:39:22 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-c1be0231-81dc-4207-8e78-7cbc27a35235 tempest-TestInstancesWithCinderVolumes-517437558 None] Created reservations ['96682361-16ca-487a-8e34-aba3bd277267', '1d9807c6-ef48-41d7-8d06-69ea397ac352', '5f06ba13-7de8-4bf1-92be-7d80996a7bab', '6220ae65-0050-4c3e-8519-10dee266714a'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:39:22 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-c1be0231-81dc-4207-8e78-7cbc27a35235 tempest-TestInstancesWithCinderVolumes-517437558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:39:22 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-c1be0231-81dc-4207-8e78-7cbc27a35235 tempest-TestInstancesWithCinderVolumes-517437558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:39:22 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-c1be0231-81dc-4207-8e78-7cbc27a35235 tempest-TestInstancesWithCinderVolumes-517437558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:39:23 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-c1be0231-81dc-4207-8e78-7cbc27a35235 tempest-TestInstancesWithCinderVolumes-517437558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:39:23 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-c1be0231-81dc-4207-8e78-7cbc27a35235 tempest-TestInstancesWithCinderVolumes-517437558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:39:23 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-c1be0231-81dc-4207-8e78-7cbc27a35235 tempest-TestInstancesWithCinderVolumes-517437558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:39:23 devstack sudo[104630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:39:23 devstack sudo[104630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:39:23 devstack sudo[104630]: pam_unix(sudo:session): session closed for user root
Nov 03 18:39:23 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-c1be0231-81dc-4207-8e78-7cbc27a35235 tempest-TestInstancesWithCinderVolumes-517437558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.291s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:39:23 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-c1be0231-81dc-4207-8e78-7cbc27a35235 tempest-TestInstancesWithCinderVolumes-517437558 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:39:23 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-c1be0231-81dc-4207-8e78-7cbc27a35235 tempest-TestInstancesWithCinderVolumes-517437558 None] Deleted volume successfully.
Nov 03 18:39:23 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-c1be0231-81dc-4207-8e78-7cbc27a35235 tempest-TestInstancesWithCinderVolumes-517437558 None] Lock "cinder-089e798d-b533-47c1-9822-a516a4fe0ba1-delete_volume" released by "delete_volume" :: held 1.415s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:39:26 devstack cinder-volume[86120]: INFO cinder.volume.manager [req-4405fcb6-11fb-4e18-9e41-8d3817181d8c req-2d9aa3fb-648a-4118-a23e-8c89fae4bbd8 tempest-TestInstancesWithCinderVolumes-517437558 None] Terminate volume connection completed successfully.
Nov 03 18:39:26 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [req-4405fcb6-11fb-4e18-9e41-8d3817181d8c req-2d9aa3fb-648a-4118-a23e-8c89fae4bbd8 tempest-TestInstancesWithCinderVolumes-517437558 None] Deleting attachment ab98fec8-c6dd-4ee6-9b6e-9230d5039e5b. {{(pid=86120) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 03 18:39:26 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-7dd8ce8b-e0b7-4563-bf86-1a184cb0bf8c tempest-TestInstancesWithCinderVolumes-517437558 None] Acquiring lock "cinder-53141f35-9fdc-4822-b70f-df3a1469c321-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:39:26 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-7dd8ce8b-e0b7-4563-bf86-1a184cb0bf8c tempest-TestInstancesWithCinderVolumes-517437558 None] Lock "cinder-53141f35-9fdc-4822-b70f-df3a1469c321-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:39:26 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-7dd8ce8b-e0b7-4563-bf86-1a184cb0bf8c tempest-TestInstancesWithCinderVolumes-517437558 None] Acquiring lock "cinder-quobyte-53141f35-9fdc-4822-b70f-df3a1469c321" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:39:26 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-7dd8ce8b-e0b7-4563-bf86-1a184cb0bf8c tempest-TestInstancesWithCinderVolumes-517437558 None] Lock "cinder-quobyte-53141f35-9fdc-4822-b70f-df3a1469c321" acquired by "delete_volume" :: waited 0.016s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:39:26 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[a603aa05-c9b5-46ef-adf0-cdae6f2381bc]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:39:26 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-7dd8ce8b-e0b7-4563-bf86-1a184cb0bf8c tempest-TestInstancesWithCinderVolumes-517437558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-53141f35-9fdc-4822-b70f-df3a1469c321 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:39:27 devstack sudo[104658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-53141f35-9fdc-4822-b70f-df3a1469c321
Nov 03 18:39:27 devstack sudo[104658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:39:27 devstack sudo[104658]: pam_unix(sudo:session): session closed for user root
Nov 03 18:39:27 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-7dd8ce8b-e0b7-4563-bf86-1a184cb0bf8c tempest-TestInstancesWithCinderVolumes-517437558 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-53141f35-9fdc-4822-b70f-df3a1469c321" returned: 0 in 0.406s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:39:27 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-7dd8ce8b-e0b7-4563-bf86-1a184cb0bf8c tempest-TestInstancesWithCinderVolumes-517437558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-53141f35-9fdc-4822-b70f-df3a1469c321 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:39:27 devstack sudo[104663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-53141f35-9fdc-4822-b70f-df3a1469c321
Nov 03 18:39:27 devstack sudo[104663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:39:27 devstack sudo[104663]: pam_unix(sudo:session): session closed for user root
Nov 03 18:39:27 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-7dd8ce8b-e0b7-4563-bf86-1a184cb0bf8c tempest-TestInstancesWithCinderVolumes-517437558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-53141f35-9fdc-4822-b70f-df3a1469c321" returned: 0 in 0.281s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:39:27 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-7dd8ce8b-e0b7-4563-bf86-1a184cb0bf8c tempest-TestInstancesWithCinderVolumes-517437558 None] Lock "cinder-quobyte-53141f35-9fdc-4822-b70f-df3a1469c321" released by "delete_volume" :: held 0.742s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:39:27 devstack cinder-volume[86120]: WARNING cinder.quota [None req-7dd8ce8b-e0b7-4563-bf86-1a184cb0bf8c tempest-TestInstancesWithCinderVolumes-517437558 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1632367545-128349441 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1632367545-128349441, it is now deprecated. Please use the default quota class for default quota.
Nov 03 18:39:27 devstack cinder-volume[86120]: WARNING cinder.quota [None req-7dd8ce8b-e0b7-4563-bf86-1a184cb0bf8c tempest-TestInstancesWithCinderVolumes-517437558 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1632367545-128349441 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1632367545-128349441, it is now deprecated. Please use the default quota class for default quota.
Nov 03 18:39:27 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-7dd8ce8b-e0b7-4563-bf86-1a184cb0bf8c tempest-TestInstancesWithCinderVolumes-517437558 None] Created reservations ['dc04e584-6c49-4b39-905c-d43f8e6a487d', 'b9124407-adb8-4279-be53-bc95df879af6', '16e9659c-998c-4551-9d5f-81fa5debf879', '2f4dcdfc-1874-425c-972e-7f2ec66ec075'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:39:27 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-7dd8ce8b-e0b7-4563-bf86-1a184cb0bf8c tempest-TestInstancesWithCinderVolumes-517437558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:39:27 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-7dd8ce8b-e0b7-4563-bf86-1a184cb0bf8c tempest-TestInstancesWithCinderVolumes-517437558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:39:27 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-7dd8ce8b-e0b7-4563-bf86-1a184cb0bf8c tempest-TestInstancesWithCinderVolumes-517437558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:39:27 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-7dd8ce8b-e0b7-4563-bf86-1a184cb0bf8c tempest-TestInstancesWithCinderVolumes-517437558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:39:27 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-7dd8ce8b-e0b7-4563-bf86-1a184cb0bf8c tempest-TestInstancesWithCinderVolumes-517437558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:39:27 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-7dd8ce8b-e0b7-4563-bf86-1a184cb0bf8c tempest-TestInstancesWithCinderVolumes-517437558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:39:27 devstack sudo[104667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:39:27 devstack sudo[104667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:39:28 devstack sudo[104667]: pam_unix(sudo:session): session closed for user root
Nov 03 18:39:28 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-7dd8ce8b-e0b7-4563-bf86-1a184cb0bf8c tempest-TestInstancesWithCinderVolumes-517437558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.283s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:39:28 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-7dd8ce8b-e0b7-4563-bf86-1a184cb0bf8c tempest-TestInstancesWithCinderVolumes-517437558 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:39:28 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-7dd8ce8b-e0b7-4563-bf86-1a184cb0bf8c tempest-TestInstancesWithCinderVolumes-517437558 None] Deleted volume successfully.
Nov 03 18:39:28 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-7dd8ce8b-e0b7-4563-bf86-1a184cb0bf8c tempest-TestInstancesWithCinderVolumes-517437558 None] Lock "cinder-53141f35-9fdc-4822-b70f-df3a1469c321-delete_volume" released by "delete_volume" :: held 1.344s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:39:31 devstack cinder-volume[86120]: INFO cinder.volume.manager [req-26f7d63f-54eb-4d1a-bd1b-f8469ec111f8 req-3044d351-c4e6-4f33-bd20-be9df77df5e2 tempest-TestInstancesWithCinderVolumes-517437558 None] Terminate volume connection completed successfully.
Nov 03 18:39:31 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [req-26f7d63f-54eb-4d1a-bd1b-f8469ec111f8 req-3044d351-c4e6-4f33-bd20-be9df77df5e2 tempest-TestInstancesWithCinderVolumes-517437558 None] Deleting attachment 4a9cb274-1503-4477-bef1-d0a97acdcf27. {{(pid=86120) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 03 18:39:32 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-6628ca52-7914-4eff-9640-20071321d8a5 tempest-TestInstancesWithCinderVolumes-517437558 None] Acquiring lock "cinder-6d4d6c32-7256-40dc-a782-bc8a4f37c541-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:39:32 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-6628ca52-7914-4eff-9640-20071321d8a5 tempest-TestInstancesWithCinderVolumes-517437558 None] Lock "cinder-6d4d6c32-7256-40dc-a782-bc8a4f37c541-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:39:32 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-6628ca52-7914-4eff-9640-20071321d8a5 tempest-TestInstancesWithCinderVolumes-517437558 None] Acquiring lock "cinder-quobyte-6d4d6c32-7256-40dc-a782-bc8a4f37c541" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:39:32 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-6628ca52-7914-4eff-9640-20071321d8a5 tempest-TestInstancesWithCinderVolumes-517437558 None] Lock "cinder-quobyte-6d4d6c32-7256-40dc-a782-bc8a4f37c541" acquired by "delete_volume" :: waited 0.016s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:39:32 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0f6c129-d4e2-4eb9-aa4b-c7ad969eb00d]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:39:32 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-6628ca52-7914-4eff-9640-20071321d8a5 tempest-TestInstancesWithCinderVolumes-517437558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6d4d6c32-7256-40dc-a782-bc8a4f37c541 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:39:32 devstack sudo[104698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6d4d6c32-7256-40dc-a782-bc8a4f37c541
Nov 03 18:39:32 devstack sudo[104698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:39:33 devstack sudo[104698]: pam_unix(sudo:session): session closed for user root
Nov 03 18:39:33 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-6628ca52-7914-4eff-9640-20071321d8a5 tempest-TestInstancesWithCinderVolumes-517437558 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6d4d6c32-7256-40dc-a782-bc8a4f37c541" returned: 0 in 0.408s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:39:33 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-6628ca52-7914-4eff-9640-20071321d8a5 tempest-TestInstancesWithCinderVolumes-517437558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6d4d6c32-7256-40dc-a782-bc8a4f37c541 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:39:33 devstack sudo[104704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6d4d6c32-7256-40dc-a782-bc8a4f37c541
Nov 03 18:39:33 devstack sudo[104704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:39:33 devstack sudo[104704]: pam_unix(sudo:session): session closed for user root
Nov 03 18:39:33 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-6628ca52-7914-4eff-9640-20071321d8a5 tempest-TestInstancesWithCinderVolumes-517437558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6d4d6c32-7256-40dc-a782-bc8a4f37c541" returned: 0 in 0.266s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:39:33 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-6628ca52-7914-4eff-9640-20071321d8a5 tempest-TestInstancesWithCinderVolumes-517437558 None] Lock "cinder-quobyte-6d4d6c32-7256-40dc-a782-bc8a4f37c541" released by "delete_volume" :: held 0.725s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:39:33 devstack cinder-volume[86120]: WARNING cinder.quota [None req-6628ca52-7914-4eff-9640-20071321d8a5 tempest-TestInstancesWithCinderVolumes-517437558 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1306058836-404542811 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1306058836-404542811, it is now deprecated. Please use the default quota class for default quota.
Nov 03 18:39:33 devstack cinder-volume[86120]: WARNING cinder.quota [None req-6628ca52-7914-4eff-9640-20071321d8a5 tempest-TestInstancesWithCinderVolumes-517437558 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1306058836-404542811 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1306058836-404542811, it is now deprecated. Please use the default quota class for default quota.
Nov 03 18:39:33 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-6628ca52-7914-4eff-9640-20071321d8a5 tempest-TestInstancesWithCinderVolumes-517437558 None] Created reservations ['1304fc6b-be6d-4879-8fcf-95d3ac298276', '66d3abe9-ef25-400f-83d8-12bced112e67', '5f892c36-1b4a-49de-a940-c2bcf5218581', 'bb854f84-a9e0-4f59-b472-31df310150f4'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:39:33 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-6628ca52-7914-4eff-9640-20071321d8a5 tempest-TestInstancesWithCinderVolumes-517437558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:39:33 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-6628ca52-7914-4eff-9640-20071321d8a5 tempest-TestInstancesWithCinderVolumes-517437558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:39:33 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-6628ca52-7914-4eff-9640-20071321d8a5 tempest-TestInstancesWithCinderVolumes-517437558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:39:33 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-6628ca52-7914-4eff-9640-20071321d8a5 tempest-TestInstancesWithCinderVolumes-517437558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:39:33 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-6628ca52-7914-4eff-9640-20071321d8a5 tempest-TestInstancesWithCinderVolumes-517437558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:39:33 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-6628ca52-7914-4eff-9640-20071321d8a5 tempest-TestInstancesWithCinderVolumes-517437558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:39:33 devstack sudo[104707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:39:33 devstack sudo[104707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:39:33 devstack sudo[104707]: pam_unix(sudo:session): session closed for user root
Nov 03 18:39:33 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-6628ca52-7914-4eff-9640-20071321d8a5 tempest-TestInstancesWithCinderVolumes-517437558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.278s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:39:33 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-6628ca52-7914-4eff-9640-20071321d8a5 tempest-TestInstancesWithCinderVolumes-517437558 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:39:33 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-6628ca52-7914-4eff-9640-20071321d8a5 tempest-TestInstancesWithCinderVolumes-517437558 None] Deleted volume successfully.
Nov 03 18:39:33 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-6628ca52-7914-4eff-9640-20071321d8a5 tempest-TestInstancesWithCinderVolumes-517437558 None] Lock "cinder-6d4d6c32-7256-40dc-a782-bc8a4f37c541-delete_volume" released by "delete_volume" :: held 1.244s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:39:40 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-3352dd5c-7c53-452a-8adb-0152778f8146 tempest-SnapshotDependencyTests-1596045183 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:39:40 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-3352dd5c-7c53-452a-8adb-0152778f8146 tempest-SnapshotDependencyTests-1596045183 None] Flow 'volume_create_manager' (93013f39-d5a1-4edc-95c6-e3c5a5d5f51a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:39:40 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-3352dd5c-7c53-452a-8adb-0152778f8146 tempest-SnapshotDependencyTests-1596045183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf6b31d7-39a6-457e-80a9-49b5a348c0c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:39:40 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-3352dd5c-7c53-452a-8adb-0152778f8146 tempest-SnapshotDependencyTests-1596045183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf6b31d7-39a6-457e-80a9-49b5a348c0c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:39:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2119553745',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73867c34-cafe-44a8-bb76-fb56c605f441,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2271ffc421d64c35902eef71f18ec8bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:39:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:39:40Z,use_quota=True,user_id='486e4f08e54745d8a66c2d5fb599221b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:39:40 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-3352dd5c-7c53-452a-8adb-0152778f8146 tempest-SnapshotDependencyTests-1596045183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfaed73f-2998-4502-81c1-c16beb3c78ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:39:40 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-3352dd5c-7c53-452a-8adb-0152778f8146 tempest-SnapshotDependencyTests-1596045183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfaed73f-2998-4502-81c1-c16beb3c78ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:39:40 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-3352dd5c-7c53-452a-8adb-0152778f8146 tempest-SnapshotDependencyTests-1596045183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6968156f-e41c-44a8-83cd-a8b249840216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:39:40 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-3352dd5c-7c53-452a-8adb-0152778f8146 tempest-SnapshotDependencyTests-1596045183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6968156f-e41c-44a8-83cd-a8b249840216) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73867c34-cafe-44a8-bb76-fb56c605f441', 'volume_name': 'volume-73867c34-cafe-44a8-bb76-fb56c605f441', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:39:40 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-3352dd5c-7c53-452a-8adb-0152778f8146 tempest-SnapshotDependencyTests-1596045183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41411495-efbc-4ed7-a3a6-02c01d86df03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:39:40 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-3352dd5c-7c53-452a-8adb-0152778f8146 tempest-SnapshotDependencyTests-1596045183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41411495-efbc-4ed7-a3a6-02c01d86df03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:39:40 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-3352dd5c-7c53-452a-8adb-0152778f8146 tempest-SnapshotDependencyTests-1596045183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b64bd4f5-deef-48eb-a24c-d28e433b74fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:39:40 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-3352dd5c-7c53-452a-8adb-0152778f8146 tempest-SnapshotDependencyTests-1596045183 None] Volume 73867c34-cafe-44a8-bb76-fb56c605f441: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73867c34-cafe-44a8-bb76-fb56c605f441', 'volume_size': 1}
Nov 03 18:39:40 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-3352dd5c-7c53-452a-8adb-0152778f8146 tempest-SnapshotDependencyTests-1596045183 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:39:40 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-3352dd5c-7c53-452a-8adb-0152778f8146 tempest-SnapshotDependencyTests-1596045183 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:39:40 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-3352dd5c-7c53-452a-8adb-0152778f8146 tempest-SnapshotDependencyTests-1596045183 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:39:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2119553745',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73867c34-cafe-44a8-bb76-fb56c605f441,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2271ffc421d64c35902eef71f18ec8bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:39:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:39:40Z,use_quota=True,user_id='486e4f08e54745d8a66c2d5fb599221b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:39:40 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-3352dd5c-7c53-452a-8adb-0152778f8146 tempest-SnapshotDependencyTests-1596045183 None] Creating volume 73867c34-cafe-44a8-bb76-fb56c605f441 {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:39:40 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-3352dd5c-7c53-452a-8adb-0152778f8146 tempest-SnapshotDependencyTests-1596045183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:39:40 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-3352dd5c-7c53-452a-8adb-0152778f8146 tempest-SnapshotDependencyTests-1596045183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:39:40 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-3352dd5c-7c53-452a-8adb-0152778f8146 tempest-SnapshotDependencyTests-1596045183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:39:40 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-3352dd5c-7c53-452a-8adb-0152778f8146 tempest-SnapshotDependencyTests-1596045183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:39:40 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-3352dd5c-7c53-452a-8adb-0152778f8146 tempest-SnapshotDependencyTests-1596045183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:39:40 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-3352dd5c-7c53-452a-8adb-0152778f8146 tempest-SnapshotDependencyTests-1596045183 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:39:40 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-3352dd5c-7c53-452a-8adb-0152778f8146 tempest-SnapshotDependencyTests-1596045183 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:39:40 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-3352dd5c-7c53-452a-8adb-0152778f8146 tempest-SnapshotDependencyTests-1596045183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-73867c34-cafe-44a8-bb76-fb56c605f441 1073741824 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:39:40 devstack sudo[104749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-73867c34-cafe-44a8-bb76-fb56c605f441 1073741824
Nov 03 18:39:40 devstack sudo[104749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:39:41 devstack sudo[104749]: pam_unix(sudo:session): session closed for user root
Nov 03 18:39:41 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-3352dd5c-7c53-452a-8adb-0152778f8146 tempest-SnapshotDependencyTests-1596045183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-73867c34-cafe-44a8-bb76-fb56c605f441 1073741824" returned: 0 in 0.508s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:39:41 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-3352dd5c-7c53-452a-8adb-0152778f8146 tempest-SnapshotDependencyTests-1596045183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-73867c34-cafe-44a8-bb76-fb56c605f441 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:39:41 devstack sudo[104756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-73867c34-cafe-44a8-bb76-fb56c605f441
Nov 03 18:39:41 devstack sudo[104756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:39:41 devstack sudo[104756]: pam_unix(sudo:session): session closed for user root
Nov 03 18:39:41 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-3352dd5c-7c53-452a-8adb-0152778f8146 tempest-SnapshotDependencyTests-1596045183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-73867c34-cafe-44a8-bb76-fb56c605f441" returned: 0 in 0.264s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:39:41 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-3352dd5c-7c53-452a-8adb-0152778f8146 tempest-SnapshotDependencyTests-1596045183 None] <== create_volume: return (833ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:39:41 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-3352dd5c-7c53-452a-8adb-0152778f8146 tempest-SnapshotDependencyTests-1596045183 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.836s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:39:41 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-3352dd5c-7c53-452a-8adb-0152778f8146 tempest-SnapshotDependencyTests-1596045183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b64bd4f5-deef-48eb-a24c-d28e433b74fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73867c34-cafe-44a8-bb76-fb56c605f441', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:39:41 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-3352dd5c-7c53-452a-8adb-0152778f8146 tempest-SnapshotDependencyTests-1596045183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6650449e-29ee-46fa-831a-2403cf376e88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:39:41 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-3352dd5c-7c53-452a-8adb-0152778f8146 tempest-SnapshotDependencyTests-1596045183 None] Volume volume-73867c34-cafe-44a8-bb76-fb56c605f441 (73867c34-cafe-44a8-bb76-fb56c605f441): created successfully
Nov 03 18:39:41 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-3352dd5c-7c53-452a-8adb-0152778f8146 tempest-SnapshotDependencyTests-1596045183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6650449e-29ee-46fa-831a-2403cf376e88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:39:41 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-3352dd5c-7c53-452a-8adb-0152778f8146 tempest-SnapshotDependencyTests-1596045183 None] Flow 'volume_create_manager' (93013f39-d5a1-4edc-95c6-e3c5a5d5f51a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:39:41 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-3352dd5c-7c53-452a-8adb-0152778f8146 tempest-SnapshotDependencyTests-1596045183 None] Created volume successfully.
Nov 03 18:39:42 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-2baebeab-946b-43ad-821c-48b82611e78b tempest-SnapshotDependencyTests-1596045183 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:39:42 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-2baebeab-946b-43ad-821c-48b82611e78b tempest-SnapshotDependencyTests-1596045183 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:39:42 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-2baebeab-946b-43ad-821c-48b82611e78b tempest-SnapshotDependencyTests-1596045183 None] Creating offline snapshot be8264bc-4792-4808-9ce7-19ef0a9f9e3a of volume 73867c34-cafe-44a8-bb76-fb56c605f441 {{(pid=86120) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 18:39:42 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba848288-8766-449e-aa2d-db44b63f8b30]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:39:42 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-2baebeab-946b-43ad-821c-48b82611e78b tempest-SnapshotDependencyTests-1596045183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-73867c34-cafe-44a8-bb76-fb56c605f441 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:39:42 devstack sudo[104762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-73867c34-cafe-44a8-bb76-fb56c605f441
Nov 03 18:39:42 devstack sudo[104762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:39:43 devstack sudo[104762]: pam_unix(sudo:session): session closed for user root
Nov 03 18:39:43 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-2baebeab-946b-43ad-821c-48b82611e78b tempest-SnapshotDependencyTests-1596045183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-73867c34-cafe-44a8-bb76-fb56c605f441" returned: 0 in 0.359s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:39:43 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-2baebeab-946b-43ad-821c-48b82611e78b tempest-SnapshotDependencyTests-1596045183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-73867c34-cafe-44a8-bb76-fb56c605f441,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-73867c34-cafe-44a8-bb76-fb56c605f441.be8264bc-4792-4808-9ce7-19ef0a9f9e3a 1G {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:39:43 devstack sudo[104768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-73867c34-cafe-44a8-bb76-fb56c605f441,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-73867c34-cafe-44a8-bb76-fb56c605f441.be8264bc-4792-4808-9ce7-19ef0a9f9e3a 1G
Nov 03 18:39:43 devstack sudo[104768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:39:43 devstack sudo[104768]: pam_unix(sudo:session): session closed for user root
Nov 03 18:39:43 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-2baebeab-946b-43ad-821c-48b82611e78b tempest-SnapshotDependencyTests-1596045183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-73867c34-cafe-44a8-bb76-fb56c605f441,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-73867c34-cafe-44a8-bb76-fb56c605f441.be8264bc-4792-4808-9ce7-19ef0a9f9e3a 1G" returned: 0 in 0.427s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:39:43 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-2baebeab-946b-43ad-821c-48b82611e78b tempest-SnapshotDependencyTests-1596045183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73867c34-cafe-44a8-bb76-fb56c605f441 -F qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-73867c34-cafe-44a8-bb76-fb56c605f441.be8264bc-4792-4808-9ce7-19ef0a9f9e3a {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:39:43 devstack sudo[104773]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73867c34-cafe-44a8-bb76-fb56c605f441 -F qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-73867c34-cafe-44a8-bb76-fb56c605f441.be8264bc-4792-4808-9ce7-19ef0a9f9e3a
Nov 03 18:39:43 devstack sudo[104773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:39:43 devstack sudo[104773]: pam_unix(sudo:session): session closed for user root
Nov 03 18:39:43 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-2baebeab-946b-43ad-821c-48b82611e78b tempest-SnapshotDependencyTests-1596045183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73867c34-cafe-44a8-bb76-fb56c605f441 -F qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-73867c34-cafe-44a8-bb76-fb56c605f441.be8264bc-4792-4808-9ce7-19ef0a9f9e3a" returned: 0 in 0.276s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:39:43 devstack cinder-volume[86120]: WARNING cinder.volume.drivers.remotefs [None req-2baebeab-946b-43ad-821c-48b82611e78b tempest-SnapshotDependencyTests-1596045183 None] /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-73867c34-cafe-44a8-bb76-fb56c605f441.be8264bc-4792-4808-9ce7-19ef0a9f9e3a is being set with open permissions: ugo+rw
Nov 03 18:39:43 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-2baebeab-946b-43ad-821c-48b82611e78b tempest-SnapshotDependencyTests-1596045183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-73867c34-cafe-44a8-bb76-fb56c605f441.be8264bc-4792-4808-9ce7-19ef0a9f9e3a {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:39:43 devstack sudo[104778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-73867c34-cafe-44a8-bb76-fb56c605f441.be8264bc-4792-4808-9ce7-19ef0a9f9e3a
Nov 03 18:39:43 devstack sudo[104778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:39:44 devstack sudo[104778]: pam_unix(sudo:session): session closed for user root
Nov 03 18:39:44 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-2baebeab-946b-43ad-821c-48b82611e78b tempest-SnapshotDependencyTests-1596045183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-73867c34-cafe-44a8-bb76-fb56c605f441.be8264bc-4792-4808-9ce7-19ef0a9f9e3a" returned: 0 in 0.234s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:39:44 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-2baebeab-946b-43ad-821c-48b82611e78b tempest-SnapshotDependencyTests-1596045183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-73867c34-cafe-44a8-bb76-fb56c605f441.info {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:39:44 devstack sudo[104781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-73867c34-cafe-44a8-bb76-fb56c605f441.info
Nov 03 18:39:44 devstack sudo[104781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:39:44 devstack sudo[104781]: pam_unix(sudo:session): session closed for user root
Nov 03 18:39:44 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-2baebeab-946b-43ad-821c-48b82611e78b tempest-SnapshotDependencyTests-1596045183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-73867c34-cafe-44a8-bb76-fb56c605f441.info" returned: 0 in 0.282s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:39:44 devstack cinder-volume[86120]: WARNING cinder.volume.drivers.remotefs [None req-2baebeab-946b-43ad-821c-48b82611e78b tempest-SnapshotDependencyTests-1596045183 None] /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-73867c34-cafe-44a8-bb76-fb56c605f441.info is being set with open permissions: ugo+rw
Nov 03 18:39:44 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-2baebeab-946b-43ad-821c-48b82611e78b tempest-SnapshotDependencyTests-1596045183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-73867c34-cafe-44a8-bb76-fb56c605f441.info {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:39:44 devstack sudo[104784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-73867c34-cafe-44a8-bb76-fb56c605f441.info
Nov 03 18:39:44 devstack sudo[104784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:39:44 devstack sudo[104784]: pam_unix(sudo:session): session closed for user root
Nov 03 18:39:44 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-2baebeab-946b-43ad-821c-48b82611e78b tempest-SnapshotDependencyTests-1596045183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-73867c34-cafe-44a8-bb76-fb56c605f441.info" returned: 0 in 0.278s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:39:44 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-2baebeab-946b-43ad-821c-48b82611e78b tempest-SnapshotDependencyTests-1596045183 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.952s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:39:44 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-2baebeab-946b-43ad-821c-48b82611e78b tempest-SnapshotDependencyTests-1596045183 None] Create snapshot completed successfully
Nov 03 18:39:45 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-b35e439e-064d-4ef1-84d1-b1b107095d19 tempest-SnapshotDependencyTests-1596045183 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:39:45 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-b35e439e-064d-4ef1-84d1-b1b107095d19 tempest-SnapshotDependencyTests-1596045183 None] Flow 'volume_create_manager' (c1d99639-8eaa-4d33-a2fd-ee0302aed95b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:39:45 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-b35e439e-064d-4ef1-84d1-b1b107095d19 tempest-SnapshotDependencyTests-1596045183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcb6c836-40df-4e3c-9431-ab9f74ea8614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:39:45 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-b35e439e-064d-4ef1-84d1-b1b107095d19 tempest-SnapshotDependencyTests-1596045183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcb6c836-40df-4e3c-9431-ab9f74ea8614) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:39:45Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=802ebd7a-dd9d-4fb2-8a29-e62a22d43138,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2271ffc421d64c35902eef71f18ec8bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:39:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=be8264bc-4792-4808-9ce7-19ef0a9f9e3a,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:39:46Z,use_quota=True,user_id='486e4f08e54745d8a66c2d5fb599221b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:39:45 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-b35e439e-064d-4ef1-84d1-b1b107095d19 tempest-SnapshotDependencyTests-1596045183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1dafbd9c-36c7-4b96-8aae-54586c258b70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:39:45 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-b35e439e-064d-4ef1-84d1-b1b107095d19 tempest-SnapshotDependencyTests-1596045183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1dafbd9c-36c7-4b96-8aae-54586c258b70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:39:45 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-b35e439e-064d-4ef1-84d1-b1b107095d19 tempest-SnapshotDependencyTests-1596045183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88615359-651b-4403-b8b8-1d97b2894e07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:39:45 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-b35e439e-064d-4ef1-84d1-b1b107095d19 tempest-SnapshotDependencyTests-1596045183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88615359-651b-4403-b8b8-1d97b2894e07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '802ebd7a-dd9d-4fb2-8a29-e62a22d43138', 'volume_name': 'volume-802ebd7a-dd9d-4fb2-8a29-e62a22d43138', 'volume_size': 1, 'snapshot_id': 'be8264bc-4792-4808-9ce7-19ef0a9f9e3a'}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:39:45 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-b35e439e-064d-4ef1-84d1-b1b107095d19 tempest-SnapshotDependencyTests-1596045183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f493f11-ef2a-4072-b7d6-f093fed18a98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:39:45 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-b35e439e-064d-4ef1-84d1-b1b107095d19 tempest-SnapshotDependencyTests-1596045183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f493f11-ef2a-4072-b7d6-f093fed18a98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:39:45 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-b35e439e-064d-4ef1-84d1-b1b107095d19 tempest-SnapshotDependencyTests-1596045183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (211b3e91-ecaa-47e1-a1de-1ebf5ce6a781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:39:45 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-b35e439e-064d-4ef1-84d1-b1b107095d19 tempest-SnapshotDependencyTests-1596045183 None] Volume 802ebd7a-dd9d-4fb2-8a29-e62a22d43138: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-802ebd7a-dd9d-4fb2-8a29-e62a22d43138', 'volume_size': 1, 'snapshot_id': 'be8264bc-4792-4808-9ce7-19ef0a9f9e3a'}
Nov 03 18:39:45 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-b35e439e-064d-4ef1-84d1-b1b107095d19 tempest-SnapshotDependencyTests-1596045183 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:39:45 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-b35e439e-064d-4ef1-84d1-b1b107095d19 tempest-SnapshotDependencyTests-1596045183 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:39:45 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-b35e439e-064d-4ef1-84d1-b1b107095d19 tempest-SnapshotDependencyTests-1596045183 None] Acquiring lock "cinder-quobyte-be8264bc-4792-4808-9ce7-19ef0a9f9e3a-802ebd7a-dd9d-4fb2-8a29-e62a22d43138" by "_create_volume_from_snapshot" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:39:45 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-b35e439e-064d-4ef1-84d1-b1b107095d19 tempest-SnapshotDependencyTests-1596045183 None] Lock "cinder-quobyte-be8264bc-4792-4808-9ce7-19ef0a9f9e3a-802ebd7a-dd9d-4fb2-8a29-e62a22d43138" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:39:45 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-b35e439e-064d-4ef1-84d1-b1b107095d19 tempest-SnapshotDependencyTests-1596045183 None] Creating volume 802ebd7a-dd9d-4fb2-8a29-e62a22d43138 from snapshot be8264bc-4792-4808-9ce7-19ef0a9f9e3a {{(pid=86120) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 03 18:39:45 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-b35e439e-064d-4ef1-84d1-b1b107095d19 tempest-SnapshotDependencyTests-1596045183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:39:45 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-b35e439e-064d-4ef1-84d1-b1b107095d19 tempest-SnapshotDependencyTests-1596045183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:39:45 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-b35e439e-064d-4ef1-84d1-b1b107095d19 tempest-SnapshotDependencyTests-1596045183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:39:45 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-b35e439e-064d-4ef1-84d1-b1b107095d19 tempest-SnapshotDependencyTests-1596045183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:39:45 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-b35e439e-064d-4ef1-84d1-b1b107095d19 tempest-SnapshotDependencyTests-1596045183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:39:45 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-b35e439e-064d-4ef1-84d1-b1b107095d19 tempest-SnapshotDependencyTests-1596045183 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:39:45 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-b35e439e-064d-4ef1-84d1-b1b107095d19 tempest-SnapshotDependencyTests-1596045183 None] Acquiring lock "cinder-quobyte-802ebd7a-dd9d-4fb2-8a29-e62a22d43138" by "_copy_volume_from_snapshot" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:39:45 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-b35e439e-064d-4ef1-84d1-b1b107095d19 tempest-SnapshotDependencyTests-1596045183 None] Lock "cinder-quobyte-802ebd7a-dd9d-4fb2-8a29-e62a22d43138" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:39:45 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-b35e439e-064d-4ef1-84d1-b1b107095d19 tempest-SnapshotDependencyTests-1596045183 None] snapshot: be8264bc-4792-4808-9ce7-19ef0a9f9e3a, volume: 802ebd7a-dd9d-4fb2-8a29-e62a22d43138,  {{(pid=86120) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 03 18:39:45 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-b35e439e-064d-4ef1-84d1-b1b107095d19 tempest-SnapshotDependencyTests-1596045183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:39:45 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-b35e439e-064d-4ef1-84d1-b1b107095d19 tempest-SnapshotDependencyTests-1596045183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:39:45 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-b35e439e-064d-4ef1-84d1-b1b107095d19 tempest-SnapshotDependencyTests-1596045183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:39:45 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-b35e439e-064d-4ef1-84d1-b1b107095d19 tempest-SnapshotDependencyTests-1596045183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:39:45 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-b35e439e-064d-4ef1-84d1-b1b107095d19 tempest-SnapshotDependencyTests-1596045183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:39:45 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c693fe5-fbd3-4fd9-a465-e8efaabe4467]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:39:45 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b35e439e-064d-4ef1-84d1-b1b107095d19 tempest-SnapshotDependencyTests-1596045183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-73867c34-cafe-44a8-bb76-fb56c605f441.be8264bc-4792-4808-9ce7-19ef0a9f9e3a {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:39:45 devstack sudo[104788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-73867c34-cafe-44a8-bb76-fb56c605f441.be8264bc-4792-4808-9ce7-19ef0a9f9e3a
Nov 03 18:39:45 devstack sudo[104788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:39:46 devstack sudo[104788]: pam_unix(sudo:session): session closed for user root
Nov 03 18:39:46 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b35e439e-064d-4ef1-84d1-b1b107095d19 tempest-SnapshotDependencyTests-1596045183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-73867c34-cafe-44a8-bb76-fb56c605f441.be8264bc-4792-4808-9ce7-19ef0a9f9e3a" returned: 0 in 0.391s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:39:46 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-b35e439e-064d-4ef1-84d1-b1b107095d19 tempest-SnapshotDependencyTests-1596045183 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-73867c34-cafe-44a8-bb76-fb56c605f441(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86120) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 18:39:46 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fe25ae6-4db5-4c04-b780-91c1e807efed]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:39:46 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b35e439e-064d-4ef1-84d1-b1b107095d19 tempest-SnapshotDependencyTests-1596045183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-73867c34-cafe-44a8-bb76-fb56c605f441 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:39:46 devstack sudo[104793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-73867c34-cafe-44a8-bb76-fb56c605f441
Nov 03 18:39:46 devstack sudo[104793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:39:46 devstack sudo[104793]: pam_unix(sudo:session): session closed for user root
Nov 03 18:39:46 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b35e439e-064d-4ef1-84d1-b1b107095d19 tempest-SnapshotDependencyTests-1596045183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-73867c34-cafe-44a8-bb76-fb56c605f441" returned: 0 in 0.392s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:39:46 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-b35e439e-064d-4ef1-84d1-b1b107095d19 tempest-SnapshotDependencyTests-1596045183 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-73867c34-cafe-44a8-bb76-fb56c605f441 {{(pid=86120) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 03 18:39:46 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-b35e439e-064d-4ef1-84d1-b1b107095d19 tempest-SnapshotDependencyTests-1596045183 None] Creating direct copy from snapshot {{(pid=86120) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 03 18:39:46 devstack cinder-volume[86120]: DEBUG cinder.utils [None req-b35e439e-064d-4ef1-84d1-b1b107095d19 tempest-SnapshotDependencyTests-1596045183 None] Path /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-802ebd7a-dd9d-4fb2-8a29-e62a22d43138 not found in is_blk_device check {{(pid=86120) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 03 18:39:46 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b35e439e-064d-4ef1-84d1-b1b107095d19 tempest-SnapshotDependencyTests-1596045183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-73867c34-cafe-44a8-bb76-fb56c605f441 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-802ebd7a-dd9d-4fb2-8a29-e62a22d43138 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:39:46 devstack sudo[104799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-73867c34-cafe-44a8-bb76-fb56c605f441 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-802ebd7a-dd9d-4fb2-8a29-e62a22d43138
Nov 03 18:39:46 devstack sudo[104799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:39:53 devstack sudo[104799]: pam_unix(sudo:session): session closed for user root
Nov 03 18:39:53 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b35e439e-064d-4ef1-84d1-b1b107095d19 tempest-SnapshotDependencyTests-1596045183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-73867c34-cafe-44a8-bb76-fb56c605f441 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-802ebd7a-dd9d-4fb2-8a29-e62a22d43138" returned: 0 in 7.073s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:39:53 devstack cinder-volume[86120]: DEBUG cinder.image.image_utils [None req-b35e439e-064d-4ef1-84d1-b1b107095d19 tempest-SnapshotDependencyTests-1596045183 None] Image conversion details: src /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-73867c34-cafe-44a8-bb76-fb56c605f441, size 1024.00 MB, duration 7.07 sec, destination /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-802ebd7a-dd9d-4fb2-8a29-e62a22d43138 {{(pid=86120) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 03 18:39:53 devstack cinder-volume[86120]: INFO cinder.image.image_utils [None req-b35e439e-064d-4ef1-84d1-b1b107095d19 tempest-SnapshotDependencyTests-1596045183 None] Converted 1024.00 MB image at 144.76 MB/s
Nov 03 18:39:53 devstack cinder-volume[86120]: WARNING cinder.volume.drivers.remotefs [None req-b35e439e-064d-4ef1-84d1-b1b107095d19 tempest-SnapshotDependencyTests-1596045183 None] /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-802ebd7a-dd9d-4fb2-8a29-e62a22d43138 is being set with open permissions: ugo+rw
Nov 03 18:39:53 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b35e439e-064d-4ef1-84d1-b1b107095d19 tempest-SnapshotDependencyTests-1596045183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-802ebd7a-dd9d-4fb2-8a29-e62a22d43138 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:39:53 devstack sudo[104812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-802ebd7a-dd9d-4fb2-8a29-e62a22d43138
Nov 03 18:39:53 devstack sudo[104812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:39:53 devstack sudo[104812]: pam_unix(sudo:session): session closed for user root
Nov 03 18:39:53 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b35e439e-064d-4ef1-84d1-b1b107095d19 tempest-SnapshotDependencyTests-1596045183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-802ebd7a-dd9d-4fb2-8a29-e62a22d43138" returned: 0 in 0.249s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:39:53 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-b35e439e-064d-4ef1-84d1-b1b107095d19 tempest-SnapshotDependencyTests-1596045183 None] Lock "cinder-quobyte-802ebd7a-dd9d-4fb2-8a29-e62a22d43138" released by "_copy_volume_from_snapshot" :: held 8.212s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:39:53 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-b35e439e-064d-4ef1-84d1-b1b107095d19 tempest-SnapshotDependencyTests-1596045183 None] Lock "cinder-quobyte-be8264bc-4792-4808-9ce7-19ef0a9f9e3a-802ebd7a-dd9d-4fb2-8a29-e62a22d43138" released by "_create_volume_from_snapshot" :: held 8.289s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:39:53 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-b35e439e-064d-4ef1-84d1-b1b107095d19 tempest-SnapshotDependencyTests-1596045183 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.306s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:39:54 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-b35e439e-064d-4ef1-84d1-b1b107095d19 tempest-SnapshotDependencyTests-1596045183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (211b3e91-ecaa-47e1-a1de-1ebf5ce6a781) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-802ebd7a-dd9d-4fb2-8a29-e62a22d43138', 'volume_size': 1, 'snapshot_id': 'be8264bc-4792-4808-9ce7-19ef0a9f9e3a'}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:39:54 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-b35e439e-064d-4ef1-84d1-b1b107095d19 tempest-SnapshotDependencyTests-1596045183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd6d37d9-0454-496e-8944-9c86ac633384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:39:54 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-b35e439e-064d-4ef1-84d1-b1b107095d19 tempest-SnapshotDependencyTests-1596045183 None] Volume volume-802ebd7a-dd9d-4fb2-8a29-e62a22d43138 (802ebd7a-dd9d-4fb2-8a29-e62a22d43138): created successfully
Nov 03 18:39:54 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-b35e439e-064d-4ef1-84d1-b1b107095d19 tempest-SnapshotDependencyTests-1596045183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd6d37d9-0454-496e-8944-9c86ac633384) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:39:54 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-b35e439e-064d-4ef1-84d1-b1b107095d19 tempest-SnapshotDependencyTests-1596045183 None] Flow 'volume_create_manager' (c1d99639-8eaa-4d33-a2fd-ee0302aed95b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:39:54 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-b35e439e-064d-4ef1-84d1-b1b107095d19 tempest-SnapshotDependencyTests-1596045183 None] Created volume successfully.
Nov 03 18:39:54 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-80e45e3b-f15c-4b79-8ec1-c627cda47212 tempest-SnapshotDependencyTests-1596045183 None] Acquiring lock "cinder-be8264bc-4792-4808-9ce7-19ef0a9f9e3a-delete_snapshot" by "delete_snapshot" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:39:54 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-80e45e3b-f15c-4b79-8ec1-c627cda47212 tempest-SnapshotDependencyTests-1596045183 None] Lock "cinder-be8264bc-4792-4808-9ce7-19ef0a9f9e3a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:39:54 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-80e45e3b-f15c-4b79-8ec1-c627cda47212 tempest-SnapshotDependencyTests-1596045183 None] Acquiring lock "cinder-quobyte-73867c34-cafe-44a8-bb76-fb56c605f441" by "delete_snapshot" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:39:54 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-80e45e3b-f15c-4b79-8ec1-c627cda47212 tempest-SnapshotDependencyTests-1596045183 None] Lock "cinder-quobyte-73867c34-cafe-44a8-bb76-fb56c605f441" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:39:54 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-80e45e3b-f15c-4b79-8ec1-c627cda47212 tempest-SnapshotDependencyTests-1596045183 None] Acquiring lock "cinder-quobyte-be8264bc-4792-4808-9ce7-19ef0a9f9e3a" by "_delete_snapshot" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:39:54 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-80e45e3b-f15c-4b79-8ec1-c627cda47212 tempest-SnapshotDependencyTests-1596045183 None] Lock "cinder-quobyte-be8264bc-4792-4808-9ce7-19ef0a9f9e3a" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:39:54 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-80e45e3b-f15c-4b79-8ec1-c627cda47212 tempest-SnapshotDependencyTests-1596045183 None] Deleting offline snapshot be8264bc-4792-4808-9ce7-19ef0a9f9e3a of volume 73867c34-cafe-44a8-bb76-fb56c605f441 {{(pid=86120) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 18:39:54 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-80e45e3b-f15c-4b79-8ec1-c627cda47212 tempest-SnapshotDependencyTests-1596045183 None] snapshot_file for this snap is: volume-73867c34-cafe-44a8-bb76-fb56c605f441.be8264bc-4792-4808-9ce7-19ef0a9f9e3a {{(pid=86120) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 18:39:54 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[69106a12-4703-4be5-a7f4-70978a8b0b3f]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:39:54 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-80e45e3b-f15c-4b79-8ec1-c627cda47212 tempest-SnapshotDependencyTests-1596045183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-73867c34-cafe-44a8-bb76-fb56c605f441.be8264bc-4792-4808-9ce7-19ef0a9f9e3a {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:39:54 devstack sudo[104815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-73867c34-cafe-44a8-bb76-fb56c605f441.be8264bc-4792-4808-9ce7-19ef0a9f9e3a
Nov 03 18:39:54 devstack sudo[104815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:39:54 devstack sudo[104815]: pam_unix(sudo:session): session closed for user root
Nov 03 18:39:54 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-80e45e3b-f15c-4b79-8ec1-c627cda47212 tempest-SnapshotDependencyTests-1596045183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-73867c34-cafe-44a8-bb76-fb56c605f441.be8264bc-4792-4808-9ce7-19ef0a9f9e3a" returned: 0 in 0.381s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:39:54 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-80e45e3b-f15c-4b79-8ec1-c627cda47212 tempest-SnapshotDependencyTests-1596045183 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-73867c34-cafe-44a8-bb76-fb56c605f441(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86120) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 18:39:54 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[75bd2d68-a97b-43ad-a93e-dd5df385b98b]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:39:54 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-80e45e3b-f15c-4b79-8ec1-c627cda47212 tempest-SnapshotDependencyTests-1596045183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-73867c34-cafe-44a8-bb76-fb56c605f441 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:39:55 devstack sudo[104820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-73867c34-cafe-44a8-bb76-fb56c605f441
Nov 03 18:39:55 devstack sudo[104820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:39:55 devstack sudo[104820]: pam_unix(sudo:session): session closed for user root
Nov 03 18:39:55 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-80e45e3b-f15c-4b79-8ec1-c627cda47212 tempest-SnapshotDependencyTests-1596045183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-73867c34-cafe-44a8-bb76-fb56c605f441" returned: 0 in 0.623s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:39:55 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-80e45e3b-f15c-4b79-8ec1-c627cda47212 tempest-SnapshotDependencyTests-1596045183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-73867c34-cafe-44a8-bb76-fb56c605f441.be8264bc-4792-4808-9ce7-19ef0a9f9e3a {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:39:55 devstack sudo[104825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-73867c34-cafe-44a8-bb76-fb56c605f441.be8264bc-4792-4808-9ce7-19ef0a9f9e3a
Nov 03 18:39:55 devstack sudo[104825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:39:55 devstack sudo[104825]: pam_unix(sudo:session): session closed for user root
Nov 03 18:39:55 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-80e45e3b-f15c-4b79-8ec1-c627cda47212 tempest-SnapshotDependencyTests-1596045183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-73867c34-cafe-44a8-bb76-fb56c605f441.be8264bc-4792-4808-9ce7-19ef0a9f9e3a" returned: 0 in 0.365s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:39:55 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-80e45e3b-f15c-4b79-8ec1-c627cda47212 tempest-SnapshotDependencyTests-1596045183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-73867c34-cafe-44a8-bb76-fb56c605f441.be8264bc-4792-4808-9ce7-19ef0a9f9e3a {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:39:55 devstack sudo[104830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-73867c34-cafe-44a8-bb76-fb56c605f441.be8264bc-4792-4808-9ce7-19ef0a9f9e3a
Nov 03 18:39:55 devstack sudo[104830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:39:56 devstack sudo[104830]: pam_unix(sudo:session): session closed for user root
Nov 03 18:39:56 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-80e45e3b-f15c-4b79-8ec1-c627cda47212 tempest-SnapshotDependencyTests-1596045183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-73867c34-cafe-44a8-bb76-fb56c605f441.be8264bc-4792-4808-9ce7-19ef0a9f9e3a" returned: 0 in 0.247s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:39:56 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-80e45e3b-f15c-4b79-8ec1-c627cda47212 tempest-SnapshotDependencyTests-1596045183 None] Lock "cinder-quobyte-be8264bc-4792-4808-9ce7-19ef0a9f9e3a" released by "_delete_snapshot" :: held 1.730s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:39:56 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-80e45e3b-f15c-4b79-8ec1-c627cda47212 tempest-SnapshotDependencyTests-1596045183 None] Lock "cinder-quobyte-73867c34-cafe-44a8-bb76-fb56c605f441" released by "delete_snapshot" :: held 1.752s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:39:56 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-80e45e3b-f15c-4b79-8ec1-c627cda47212 tempest-SnapshotDependencyTests-1596045183 None] Created reservations ['9802a798-c83b-45a4-8e20-450b27ebb6d7', 'a85a038a-8654-4969-8847-88b6a57dc7b0', '1241cade-f794-45ba-8718-d1dc2bf8786a', '2f778dc6-f990-496a-932c-435cbe3a93b8'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:39:56 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-80e45e3b-f15c-4b79-8ec1-c627cda47212 tempest-SnapshotDependencyTests-1596045183 None] Delete snapshot completed successfully.
Nov 03 18:39:56 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-80e45e3b-f15c-4b79-8ec1-c627cda47212 tempest-SnapshotDependencyTests-1596045183 None] Lock "cinder-be8264bc-4792-4808-9ce7-19ef0a9f9e3a-delete_snapshot" released by "delete_snapshot" :: held 1.915s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:39:56 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-7e8cd173-7675-4d29-a80d-ef65752dc279 tempest-SnapshotDependencyTests-1596045183 None] Acquiring lock "cinder-73867c34-cafe-44a8-bb76-fb56c605f441-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:39:56 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-7e8cd173-7675-4d29-a80d-ef65752dc279 tempest-SnapshotDependencyTests-1596045183 None] Lock "cinder-73867c34-cafe-44a8-bb76-fb56c605f441-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:39:56 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-7e8cd173-7675-4d29-a80d-ef65752dc279 tempest-SnapshotDependencyTests-1596045183 None] Acquiring lock "cinder-quobyte-73867c34-cafe-44a8-bb76-fb56c605f441" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:39:56 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-7e8cd173-7675-4d29-a80d-ef65752dc279 tempest-SnapshotDependencyTests-1596045183 None] Lock "cinder-quobyte-73867c34-cafe-44a8-bb76-fb56c605f441" acquired by "delete_volume" :: waited 0.021s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:39:56 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5528a93-51b6-459f-b3e3-aa00ccada1c0]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:39:56 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-7e8cd173-7675-4d29-a80d-ef65752dc279 tempest-SnapshotDependencyTests-1596045183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-73867c34-cafe-44a8-bb76-fb56c605f441 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:39:56 devstack sudo[104833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-73867c34-cafe-44a8-bb76-fb56c605f441
Nov 03 18:39:56 devstack sudo[104833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:39:57 devstack sudo[104833]: pam_unix(sudo:session): session closed for user root
Nov 03 18:39:57 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-7e8cd173-7675-4d29-a80d-ef65752dc279 tempest-SnapshotDependencyTests-1596045183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-73867c34-cafe-44a8-bb76-fb56c605f441" returned: 0 in 0.384s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:39:57 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-7e8cd173-7675-4d29-a80d-ef65752dc279 tempest-SnapshotDependencyTests-1596045183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-73867c34-cafe-44a8-bb76-fb56c605f441 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:39:57 devstack sudo[104838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-73867c34-cafe-44a8-bb76-fb56c605f441
Nov 03 18:39:57 devstack sudo[104838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:39:57 devstack sudo[104838]: pam_unix(sudo:session): session closed for user root
Nov 03 18:39:57 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-7e8cd173-7675-4d29-a80d-ef65752dc279 tempest-SnapshotDependencyTests-1596045183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-73867c34-cafe-44a8-bb76-fb56c605f441" returned: 0 in 0.253s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:39:57 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-7e8cd173-7675-4d29-a80d-ef65752dc279 tempest-SnapshotDependencyTests-1596045183 None] Lock "cinder-quobyte-73867c34-cafe-44a8-bb76-fb56c605f441" released by "delete_volume" :: held 0.714s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:39:57 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-7e8cd173-7675-4d29-a80d-ef65752dc279 tempest-SnapshotDependencyTests-1596045183 None] Created reservations ['f1fd0622-1031-468a-904d-c51fa26cba71', '3a6a7368-531f-4912-89a5-c37001003eb7', 'a2695c45-3515-4873-81ce-a4f9130b88eb', 'f293e102-2432-4f10-ae12-9749be4e929e'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:39:57 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-7e8cd173-7675-4d29-a80d-ef65752dc279 tempest-SnapshotDependencyTests-1596045183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:39:57 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-7e8cd173-7675-4d29-a80d-ef65752dc279 tempest-SnapshotDependencyTests-1596045183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:39:57 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-7e8cd173-7675-4d29-a80d-ef65752dc279 tempest-SnapshotDependencyTests-1596045183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:39:57 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-7e8cd173-7675-4d29-a80d-ef65752dc279 tempest-SnapshotDependencyTests-1596045183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:39:57 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-7e8cd173-7675-4d29-a80d-ef65752dc279 tempest-SnapshotDependencyTests-1596045183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:39:57 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-7e8cd173-7675-4d29-a80d-ef65752dc279 tempest-SnapshotDependencyTests-1596045183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:39:57 devstack sudo[104841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:39:57 devstack sudo[104841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:39:57 devstack sudo[104841]: pam_unix(sudo:session): session closed for user root
Nov 03 18:39:57 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-927f2921-3a85-4102-a5a3-f42aa7734697 tempest-SnapshotDependencyTests-1596045183 None] Acquiring lock "cinder-802ebd7a-dd9d-4fb2-8a29-e62a22d43138-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:39:57 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-7e8cd173-7675-4d29-a80d-ef65752dc279 tempest-SnapshotDependencyTests-1596045183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.304s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:39:57 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-7e8cd173-7675-4d29-a80d-ef65752dc279 tempest-SnapshotDependencyTests-1596045183 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:39:57 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-7e8cd173-7675-4d29-a80d-ef65752dc279 tempest-SnapshotDependencyTests-1596045183 None] Deleted volume successfully.
Nov 03 18:39:57 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-927f2921-3a85-4102-a5a3-f42aa7734697 tempest-SnapshotDependencyTests-1596045183 None] Lock "cinder-802ebd7a-dd9d-4fb2-8a29-e62a22d43138-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:39:57 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-7e8cd173-7675-4d29-a80d-ef65752dc279 tempest-SnapshotDependencyTests-1596045183 None] Lock "cinder-73867c34-cafe-44a8-bb76-fb56c605f441-delete_volume" released by "delete_volume" :: held 1.270s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:39:57 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-927f2921-3a85-4102-a5a3-f42aa7734697 tempest-SnapshotDependencyTests-1596045183 None] Acquiring lock "cinder-quobyte-802ebd7a-dd9d-4fb2-8a29-e62a22d43138" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:39:57 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-927f2921-3a85-4102-a5a3-f42aa7734697 tempest-SnapshotDependencyTests-1596045183 None] Lock "cinder-quobyte-802ebd7a-dd9d-4fb2-8a29-e62a22d43138" acquired by "delete_volume" :: waited 0.018s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:39:58 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[2694afc5-d82e-4dbd-a08a-6f0b06a0d966]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:39:58 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-927f2921-3a85-4102-a5a3-f42aa7734697 tempest-SnapshotDependencyTests-1596045183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-802ebd7a-dd9d-4fb2-8a29-e62a22d43138 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:39:58 devstack sudo[104844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-802ebd7a-dd9d-4fb2-8a29-e62a22d43138
Nov 03 18:39:58 devstack sudo[104844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:39:58 devstack sudo[104844]: pam_unix(sudo:session): session closed for user root
Nov 03 18:39:58 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-927f2921-3a85-4102-a5a3-f42aa7734697 tempest-SnapshotDependencyTests-1596045183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-802ebd7a-dd9d-4fb2-8a29-e62a22d43138" returned: 0 in 0.383s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:39:58 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-927f2921-3a85-4102-a5a3-f42aa7734697 tempest-SnapshotDependencyTests-1596045183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-802ebd7a-dd9d-4fb2-8a29-e62a22d43138 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:39:58 devstack sudo[104849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-802ebd7a-dd9d-4fb2-8a29-e62a22d43138
Nov 03 18:39:58 devstack sudo[104849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:39:58 devstack sudo[104849]: pam_unix(sudo:session): session closed for user root
Nov 03 18:39:58 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-927f2921-3a85-4102-a5a3-f42aa7734697 tempest-SnapshotDependencyTests-1596045183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-802ebd7a-dd9d-4fb2-8a29-e62a22d43138" returned: 0 in 0.273s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:39:58 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-927f2921-3a85-4102-a5a3-f42aa7734697 tempest-SnapshotDependencyTests-1596045183 None] Lock "cinder-quobyte-802ebd7a-dd9d-4fb2-8a29-e62a22d43138" released by "delete_volume" :: held 0.708s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:39:58 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-927f2921-3a85-4102-a5a3-f42aa7734697 tempest-SnapshotDependencyTests-1596045183 None] Created reservations ['cd518205-b797-41a3-9512-3869e1a28e45', '049e1929-fc12-4eb9-aa57-026959e2d6be', 'dda5020e-bf09-48fd-9b17-3bdc0ece5ccf', 'a1019716-dd8d-45ee-b83e-6d1695fb522e'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:39:58 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-927f2921-3a85-4102-a5a3-f42aa7734697 tempest-SnapshotDependencyTests-1596045183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:39:58 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-927f2921-3a85-4102-a5a3-f42aa7734697 tempest-SnapshotDependencyTests-1596045183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:39:58 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-927f2921-3a85-4102-a5a3-f42aa7734697 tempest-SnapshotDependencyTests-1596045183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:39:58 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-927f2921-3a85-4102-a5a3-f42aa7734697 tempest-SnapshotDependencyTests-1596045183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:39:58 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-927f2921-3a85-4102-a5a3-f42aa7734697 tempest-SnapshotDependencyTests-1596045183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:39:58 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-927f2921-3a85-4102-a5a3-f42aa7734697 tempest-SnapshotDependencyTests-1596045183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:39:58 devstack sudo[104852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:39:58 devstack sudo[104852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:39:59 devstack sudo[104852]: pam_unix(sudo:session): session closed for user root
Nov 03 18:39:59 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-927f2921-3a85-4102-a5a3-f42aa7734697 tempest-SnapshotDependencyTests-1596045183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.289s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:39:59 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-927f2921-3a85-4102-a5a3-f42aa7734697 tempest-SnapshotDependencyTests-1596045183 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:39:59 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-927f2921-3a85-4102-a5a3-f42aa7734697 tempest-SnapshotDependencyTests-1596045183 None] Deleted volume successfully.
Nov 03 18:39:59 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-927f2921-3a85-4102-a5a3-f42aa7734697 tempest-SnapshotDependencyTests-1596045183 None] Lock "cinder-802ebd7a-dd9d-4fb2-8a29-e62a22d43138-delete_volume" released by "delete_volume" :: held 1.263s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:40:08 devstack cinder-volume[86120]: DEBUG dbcounter [-] [86120] Writing DB stats cinder:INSERT=13,cinder:UPDATE=52,cinder:SELECT=39,cinder:DELETE=4 {{(pid=86120) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 18:40:09 devstack cinder-volume[86120]: DEBUG dbcounter [-] [86120] Writing DB stats cinder:SELECT=41,cinder:INSERT=14,cinder:UPDATE=54,cinder:DELETE=4 {{(pid=86120) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 18:40:14 devstack cinder-volume[86120]: DEBUG oslo_service.periodic_task [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86120) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 18:40:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:40:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:40:14 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:40:14 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:40:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:40:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:40:14 devstack sudo[104872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:40:14 devstack sudo[104872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:40:15 devstack sudo[104872]: pam_unix(sudo:session): session closed for user root
Nov 03 18:40:15 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.243s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:40:15 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:40:15 devstack cinder-volume[86120]: DEBUG oslo_service.periodic_task [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Running periodic task VolumeManager._thread_info {{(pid=86120) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 18:40:15 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] thread count: 28 {{(pid=86120) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 03 18:40:15 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] thread info: [<_MainThread(MainThread, started 134747145822336)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134747033686336)>, <Thread(Thread-3 (stat_writer), started daemon 134747030828736)>, <Thread(Rabbit-heartbeat, started daemon 134747035433408)>, <Thread(Thread-5 (_runner), started daemon 134747029587392)>, <Thread(Thread-7 (_runner), started daemon 134747029784256)>, <Thread(fd_logger, started daemon 134747027909120)>, <Thread(privsep_reader, started daemon 134747027006592)>, <Thread(tpool_thread_0, started daemon 134747018950336)>, <Thread(tpool_thread_1, started daemon 134747010541248)>, <Thread(tpool_thread_2, started daemon 134747002132160)>, <Thread(tpool_thread_3, started daemon 134746993723072)>, <Thread(tpool_thread_4, started daemon 134746985313984)>, <Thread(tpool_thread_5, started daemon 134746976904896)>, <Thread(tpool_thread_6, started daemon 134746968495808)>, <Thread(tpool_thread_7, started daemon 134746960086720)>, <Thread(tpool_thread_8, started daemon 134746951677632)>, <Thread(tpool_thread_9, started daemon 134746943268544)>, <Thread(tpool_thread_10, started daemon 134746934859456)>, <Thread(tpool_thread_11, started daemon 134746926450368)>, <Thread(tpool_thread_12, started daemon 134746918041280)>, <Thread(tpool_thread_13, started daemon 134746909632192)>, <Thread(tpool_thread_14, started daemon 134746901223104)>, <Thread(tpool_thread_15, started daemon 134746892814016)>, <Thread(tpool_thread_16, started daemon 134746884404928)>, <Thread(tpool_thread_17, started daemon 134746875995840)>, <Thread(tpool_thread_18, started daemon 134746867586752)>, <Thread(tpool_thread_19, started daemon 134746859177664)>] {{(pid=86120) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 03 18:40:16 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b586bfe-6ca8-4001-bd07-a0ee03084297 tempest-TestShelveInstance-705610550 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:40:16 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-2b586bfe-6ca8-4001-bd07-a0ee03084297 tempest-TestShelveInstance-705610550 None] Flow 'volume_create_manager' (e98ea874-a97b-4c31-a13f-a51328dcf589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:40:16 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-2b586bfe-6ca8-4001-bd07-a0ee03084297 tempest-TestShelveInstance-705610550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81897a71-7479-4fba-ab0d-d82d072ba76f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:40:16 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-2b586bfe-6ca8-4001-bd07-a0ee03084297 tempest-TestShelveInstance-705610550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81897a71-7479-4fba-ab0d-d82d072ba76f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:40:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1036850435',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=351960bb-3e4b-42b3-8070-032ec00dc103,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6db22de85ecd433ca1f5f5fedf304f3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:40:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:40:16Z,use_quota=True,user_id='54d2631df86545d483fdb08740e420fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:40:16 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-2b586bfe-6ca8-4001-bd07-a0ee03084297 tempest-TestShelveInstance-705610550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb6d06c1-f7c7-49af-9ac8-969e97b59975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:40:16 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-2b586bfe-6ca8-4001-bd07-a0ee03084297 tempest-TestShelveInstance-705610550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb6d06c1-f7c7-49af-9ac8-969e97b59975) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:40:16 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-2b586bfe-6ca8-4001-bd07-a0ee03084297 tempest-TestShelveInstance-705610550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6eb7817-7946-4f5b-9a62-74d7e0d2ddd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:40:16 devstack cinder-volume[86120]: DEBUG cinder.image.glance [None req-2b586bfe-6ca8-4001-bd07-a0ee03084297 tempest-TestShelveInstance-705610550 None] Creating Keystone auth plugin from conf {{(pid=86120) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 03 18:40:16 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-2b586bfe-6ca8-4001-bd07-a0ee03084297 tempest-TestShelveInstance-705610550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6eb7817-7946-4f5b-9a62-74d7e0d2ddd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '351960bb-3e4b-42b3-8070-032ec00dc103', 'volume_name': 'volume-351960bb-3e4b-42b3-8070-032ec00dc103', 'volume_size': 1, 'image_id': '83b28d58-14b6-4404-8354-5cfe237c5c95', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/83b28d58-14b6-4404-8354-5cfe237c5c95', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4b0f900e807a4827ba1f8686981981d9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '83b28d58-14b6-4404-8354-5cfe237c5c95', 'created_at': datetime.datetime(2026, 11, 3, 17, 17, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 17, 17, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/83b28d58-14b6-4404-8354-5cfe237c5c95/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7a8d3c5e0200>}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:40:16 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-2b586bfe-6ca8-4001-bd07-a0ee03084297 tempest-TestShelveInstance-705610550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df9eb856-a1a1-4006-a3c0-c3d24dd52549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:40:16 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-2b586bfe-6ca8-4001-bd07-a0ee03084297 tempest-TestShelveInstance-705610550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df9eb856-a1a1-4006-a3c0-c3d24dd52549) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:40:16 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-2b586bfe-6ca8-4001-bd07-a0ee03084297 tempest-TestShelveInstance-705610550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a67f98c0-7d30-448d-bd14-e0911b6c61dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:40:16 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-2b586bfe-6ca8-4001-bd07-a0ee03084297 tempest-TestShelveInstance-705610550 None] Volume 351960bb-3e4b-42b3-8070-032ec00dc103: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-351960bb-3e4b-42b3-8070-032ec00dc103', 'volume_size': 1, 'image_id': '83b28d58-14b6-4404-8354-5cfe237c5c95', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/83b28d58-14b6-4404-8354-5cfe237c5c95', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4b0f900e807a4827ba1f8686981981d9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '83b28d58-14b6-4404-8354-5cfe237c5c95', 'created_at': datetime.datetime(2026, 11, 3, 17, 17, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 17, 17, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/83b28d58-14b6-4404-8354-5cfe237c5c95/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7a8d3c5e0200>}
Nov 03 18:40:16 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b586bfe-6ca8-4001-bd07-a0ee03084297 tempest-TestShelveInstance-705610550 None] Trying to clone 351960bb-3e4b-42b3-8070-032ec00dc103 from image 83b28d58-14b6-4404-8354-5cfe237c5c95 at location (None, [{'url': 'file:///opt/stack/data/glance/images/83b28d58-14b6-4404-8354-5cfe237c5c95', 'metadata': {}}]). {{(pid=86120) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 03 18:40:17 devstack cinder-volume[86120]: DEBUG cinder.image.image_utils [None req-2b586bfe-6ca8-4001-bd07-a0ee03084297 tempest-TestShelveInstance-705610550 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_83b28d58-14b6-4404-8354-5cfe237c5c95_se740f64devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86120) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 03 18:40:17 devstack cinder-volume[86120]: INFO cinder.image.image_utils [None req-2b586bfe-6ca8-4001-bd07-a0ee03084297 tempest-TestShelveInstance-705610550 None] Image download 20.69 MB at 20.69 MB/s
Nov 03 18:40:17 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[e03948b2-ab4f-40ec-9b6f-4ec175fbc303]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:40:17 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-2b586bfe-6ca8-4001-bd07-a0ee03084297 tempest-TestShelveInstance-705610550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_83b28d58-14b6-4404-8354-5cfe237c5c95_se740f64devstack@QuobyteHD {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:40:17 devstack sudo[104876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_83b28d58-14b6-4404-8354-5cfe237c5c95_se740f64devstack@QuobyteHD
Nov 03 18:40:17 devstack sudo[104876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:40:17 devstack sudo[104876]: pam_unix(sudo:session): session closed for user root
Nov 03 18:40:17 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-2b586bfe-6ca8-4001-bd07-a0ee03084297 tempest-TestShelveInstance-705610550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_83b28d58-14b6-4404-8354-5cfe237c5c95_se740f64devstack@QuobyteHD" returned: 0 in 0.335s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:40:17 devstack cinder-volume[86120]: DEBUG cinder.image.image_utils [None req-2b586bfe-6ca8-4001-bd07-a0ee03084297 tempest-TestShelveInstance-705610550 None] Temporary image 83b28d58-14b6-4404-8354-5cfe237c5c95 is fetched for user 54d2631df86545d483fdb08740e420fd. {{(pid=86120) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 03 18:40:17 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[44695d8e-ba1e-49a0-a075-ce2620aed0b0]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:40:17 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-2b586bfe-6ca8-4001-bd07-a0ee03084297 tempest-TestShelveInstance-705610550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_83b28d58-14b6-4404-8354-5cfe237c5c95_se740f64devstack@QuobyteHD {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:40:17 devstack sudo[104881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_83b28d58-14b6-4404-8354-5cfe237c5c95_se740f64devstack@QuobyteHD
Nov 03 18:40:17 devstack sudo[104881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:40:17 devstack sudo[104881]: pam_unix(sudo:session): session closed for user root
Nov 03 18:40:17 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-2b586bfe-6ca8-4001-bd07-a0ee03084297 tempest-TestShelveInstance-705610550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_83b28d58-14b6-4404-8354-5cfe237c5c95_se740f64devstack@QuobyteHD" returned: 0 in 0.339s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:40:17 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-2b586bfe-6ca8-4001-bd07-a0ee03084297 tempest-TestShelveInstance-705610550 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:40:17 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-2b586bfe-6ca8-4001-bd07-a0ee03084297 tempest-TestShelveInstance-705610550 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:40:17 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-2b586bfe-6ca8-4001-bd07-a0ee03084297 tempest-TestShelveInstance-705610550 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:40:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1036850435',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=351960bb-3e4b-42b3-8070-032ec00dc103,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6db22de85ecd433ca1f5f5fedf304f3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:40:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:40:16Z,use_quota=True,user_id='54d2631df86545d483fdb08740e420fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:40:17 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-2b586bfe-6ca8-4001-bd07-a0ee03084297 tempest-TestShelveInstance-705610550 None] Creating volume 351960bb-3e4b-42b3-8070-032ec00dc103 {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:40:17 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-2b586bfe-6ca8-4001-bd07-a0ee03084297 tempest-TestShelveInstance-705610550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:40:17 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-2b586bfe-6ca8-4001-bd07-a0ee03084297 tempest-TestShelveInstance-705610550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:40:17 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-2b586bfe-6ca8-4001-bd07-a0ee03084297 tempest-TestShelveInstance-705610550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:40:17 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-2b586bfe-6ca8-4001-bd07-a0ee03084297 tempest-TestShelveInstance-705610550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:40:17 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-2b586bfe-6ca8-4001-bd07-a0ee03084297 tempest-TestShelveInstance-705610550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:40:17 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-2b586bfe-6ca8-4001-bd07-a0ee03084297 tempest-TestShelveInstance-705610550 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:40:17 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-2b586bfe-6ca8-4001-bd07-a0ee03084297 tempest-TestShelveInstance-705610550 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:40:17 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-2b586bfe-6ca8-4001-bd07-a0ee03084297 tempest-TestShelveInstance-705610550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-351960bb-3e4b-42b3-8070-032ec00dc103 1073741824 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:40:17 devstack sudo[104886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-351960bb-3e4b-42b3-8070-032ec00dc103 1073741824
Nov 03 18:40:17 devstack sudo[104886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:40:18 devstack sudo[104886]: pam_unix(sudo:session): session closed for user root
Nov 03 18:40:18 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-2b586bfe-6ca8-4001-bd07-a0ee03084297 tempest-TestShelveInstance-705610550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-351960bb-3e4b-42b3-8070-032ec00dc103 1073741824" returned: 0 in 0.407s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:40:18 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-2b586bfe-6ca8-4001-bd07-a0ee03084297 tempest-TestShelveInstance-705610550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-351960bb-3e4b-42b3-8070-032ec00dc103 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:40:18 devstack sudo[104892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-351960bb-3e4b-42b3-8070-032ec00dc103
Nov 03 18:40:18 devstack sudo[104892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:40:18 devstack sudo[104892]: pam_unix(sudo:session): session closed for user root
Nov 03 18:40:18 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-2b586bfe-6ca8-4001-bd07-a0ee03084297 tempest-TestShelveInstance-705610550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-351960bb-3e4b-42b3-8070-032ec00dc103" returned: 0 in 0.237s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:40:18 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-2b586bfe-6ca8-4001-bd07-a0ee03084297 tempest-TestShelveInstance-705610550 None] <== create_volume: return (683ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:40:18 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-2b586bfe-6ca8-4001-bd07-a0ee03084297 tempest-TestShelveInstance-705610550 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.686s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:40:18 devstack cinder-volume[86120]: DEBUG cinder.volume.volume_utils [None req-2b586bfe-6ca8-4001-bd07-a0ee03084297 tempest-TestShelveInstance-705610550 None] Attempting download of 83b28d58-14b6-4404-8354-5cfe237c5c95 ((None, [{'url': 'file:///opt/stack/data/glance/images/83b28d58-14b6-4404-8354-5cfe237c5c95', 'metadata': {}}])) to volume 351960bb-3e4b-42b3-8070-032ec00dc103. {{(pid=86120) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 03 18:40:18 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[f39c8b03-ec55-474a-856e-37e5e35bec86]: (4, 'raw') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:40:18 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-2b586bfe-6ca8-4001-bd07-a0ee03084297 tempest-TestShelveInstance-705610550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_83b28d58-14b6-4404-8354-5cfe237c5c95__if04d9j {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:40:18 devstack sudo[104895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_83b28d58-14b6-4404-8354-5cfe237c5c95__if04d9j
Nov 03 18:40:18 devstack sudo[104895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:40:19 devstack sudo[104895]: pam_unix(sudo:session): session closed for user root
Nov 03 18:40:19 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-2b586bfe-6ca8-4001-bd07-a0ee03084297 tempest-TestShelveInstance-705610550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_83b28d58-14b6-4404-8354-5cfe237c5c95__if04d9j" returned: 0 in 0.322s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:40:19 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-2b586bfe-6ca8-4001-bd07-a0ee03084297 tempest-TestShelveInstance-705610550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_83b28d58-14b6-4404-8354-5cfe237c5c95__if04d9j {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:40:19 devstack sudo[104899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_83b28d58-14b6-4404-8354-5cfe237c5c95__if04d9j
Nov 03 18:40:19 devstack sudo[104899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:40:19 devstack sudo[104899]: pam_unix(sudo:session): session closed for user root
Nov 03 18:40:19 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-2b586bfe-6ca8-4001-bd07-a0ee03084297 tempest-TestShelveInstance-705610550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_83b28d58-14b6-4404-8354-5cfe237c5c95__if04d9j" returned: 1 in 0.327s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:40:19 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-2b586bfe-6ca8-4001-bd07-a0ee03084297 tempest-TestShelveInstance-705610550 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_83b28d58-14b6-4404-8354-5cfe237c5c95__if04d9j' failed. Not Retrying. {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 03 18:40:19 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[3654d904-e7b7-4d00-a324-78dbfa7dcf5d]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:40:19 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-2b586bfe-6ca8-4001-bd07-a0ee03084297 tempest-TestShelveInstance-705610550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_83b28d58-14b6-4404-8354-5cfe237c5c95_se740f64devstack@QuobyteHD {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:40:19 devstack sudo[104904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_83b28d58-14b6-4404-8354-5cfe237c5c95_se740f64devstack@QuobyteHD
Nov 03 18:40:19 devstack sudo[104904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:40:19 devstack sudo[104904]: pam_unix(sudo:session): session closed for user root
Nov 03 18:40:19 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-2b586bfe-6ca8-4001-bd07-a0ee03084297 tempest-TestShelveInstance-705610550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_83b28d58-14b6-4404-8354-5cfe237c5c95_se740f64devstack@QuobyteHD" returned: 0 in 0.316s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:40:19 devstack cinder-volume[86120]: DEBUG cinder.image.image_utils [None req-2b586bfe-6ca8-4001-bd07-a0ee03084297 tempest-TestShelveInstance-705610550 None] 83b28d58-14b6-4404-8354-5cfe237c5c95 was qcow2, converting to qcow2 {{(pid=86120) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 03 18:40:19 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-2b586bfe-6ca8-4001-bd07-a0ee03084297 tempest-TestShelveInstance-705610550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_83b28d58-14b6-4404-8354-5cfe237c5c95_se740f64devstack@QuobyteHD /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-351960bb-3e4b-42b3-8070-032ec00dc103 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:40:19 devstack sudo[104909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_83b28d58-14b6-4404-8354-5cfe237c5c95_se740f64devstack@QuobyteHD /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-351960bb-3e4b-42b3-8070-032ec00dc103
Nov 03 18:40:19 devstack sudo[104909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:40:21 devstack sudo[104909]: pam_unix(sudo:session): session closed for user root
Nov 03 18:40:21 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-2b586bfe-6ca8-4001-bd07-a0ee03084297 tempest-TestShelveInstance-705610550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_83b28d58-14b6-4404-8354-5cfe237c5c95_se740f64devstack@QuobyteHD /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-351960bb-3e4b-42b3-8070-032ec00dc103" returned: 0 in 1.693s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:40:21 devstack cinder-volume[86120]: DEBUG cinder.image.image_utils [None req-2b586bfe-6ca8-4001-bd07-a0ee03084297 tempest-TestShelveInstance-705610550 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_83b28d58-14b6-4404-8354-5cfe237c5c95_se740f64devstack@QuobyteHD, size 112.00 MB, duration 1.69 sec, destination /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-351960bb-3e4b-42b3-8070-032ec00dc103 {{(pid=86120) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 03 18:40:21 devstack cinder-volume[86120]: INFO cinder.image.image_utils [None req-2b586bfe-6ca8-4001-bd07-a0ee03084297 tempest-TestShelveInstance-705610550 None] Converted 112.00 MB image at 66.11 MB/s
Nov 03 18:40:21 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-2b586bfe-6ca8-4001-bd07-a0ee03084297 tempest-TestShelveInstance-705610550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-351960bb-3e4b-42b3-8070-032ec00dc103 1G {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:40:21 devstack sudo[104917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-351960bb-3e4b-42b3-8070-032ec00dc103 1G
Nov 03 18:40:21 devstack sudo[104917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:40:21 devstack sudo[104917]: pam_unix(sudo:session): session closed for user root
Nov 03 18:40:21 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-2b586bfe-6ca8-4001-bd07-a0ee03084297 tempest-TestShelveInstance-705610550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-351960bb-3e4b-42b3-8070-032ec00dc103 1G" returned: 0 in 0.319s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:40:21 devstack cinder-volume[86120]: DEBUG cinder.volume.volume_utils [None req-2b586bfe-6ca8-4001-bd07-a0ee03084297 tempest-TestShelveInstance-705610550 None] Downloaded image 83b28d58-14b6-4404-8354-5cfe237c5c95 ((None, [{'url': 'file:///opt/stack/data/glance/images/83b28d58-14b6-4404-8354-5cfe237c5c95', 'metadata': {}}])) to volume 351960bb-3e4b-42b3-8070-032ec00dc103 successfully. {{(pid=86120) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 03 18:40:21 devstack cinder-volume[86120]: DEBUG cinder.image.image_utils [None req-2b586bfe-6ca8-4001-bd07-a0ee03084297 tempest-TestShelveInstance-705610550 None] Temporary image 83b28d58-14b6-4404-8354-5cfe237c5c95 for user 54d2631df86545d483fdb08740e420fd is deleted. {{(pid=86120) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 03 18:40:21 devstack cinder-volume[86120]: DEBUG cinder.volume.volume_utils [None req-2b586bfe-6ca8-4001-bd07-a0ee03084297 tempest-TestShelveInstance-705610550 None] Marking volume 351960bb-3e4b-42b3-8070-032ec00dc103 as bootable. {{(pid=86120) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 03 18:40:21 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b586bfe-6ca8-4001-bd07-a0ee03084297 tempest-TestShelveInstance-705610550 None] Copying metadata from image 83b28d58-14b6-4404-8354-5cfe237c5c95 to 351960bb-3e4b-42b3-8070-032ec00dc103. {{(pid=86120) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 03 18:40:21 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b586bfe-6ca8-4001-bd07-a0ee03084297 tempest-TestShelveInstance-705610550 None] Creating volume glance metadata for volume 351960bb-3e4b-42b3-8070-032ec00dc103 backed by image 83b28d58-14b6-4404-8354-5cfe237c5c95 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '83b28d58-14b6-4404-8354-5cfe237c5c95', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86120) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 03 18:40:21 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-2b586bfe-6ca8-4001-bd07-a0ee03084297 tempest-TestShelveInstance-705610550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a67f98c0-7d30-448d-bd14-e0911b6c61dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-351960bb-3e4b-42b3-8070-032ec00dc103', 'volume_size': 1, 'image_id': '83b28d58-14b6-4404-8354-5cfe237c5c95', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/83b28d58-14b6-4404-8354-5cfe237c5c95', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4b0f900e807a4827ba1f8686981981d9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '83b28d58-14b6-4404-8354-5cfe237c5c95', 'created_at': datetime.datetime(2026, 11, 3, 17, 17, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 17, 17, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/83b28d58-14b6-4404-8354-5cfe237c5c95/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7a8d3c5e0200>}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:40:21 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-2b586bfe-6ca8-4001-bd07-a0ee03084297 tempest-TestShelveInstance-705610550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6ee13ac-a3c0-4581-9b89-3fe70fca7602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:40:21 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-2b586bfe-6ca8-4001-bd07-a0ee03084297 tempest-TestShelveInstance-705610550 None] Volume volume-351960bb-3e4b-42b3-8070-032ec00dc103 (351960bb-3e4b-42b3-8070-032ec00dc103): created successfully
Nov 03 18:40:21 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-2b586bfe-6ca8-4001-bd07-a0ee03084297 tempest-TestShelveInstance-705610550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6ee13ac-a3c0-4581-9b89-3fe70fca7602) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:40:21 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-2b586bfe-6ca8-4001-bd07-a0ee03084297 tempest-TestShelveInstance-705610550 None] Flow 'volume_create_manager' (e98ea874-a97b-4c31-a13f-a51328dcf589) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:40:21 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-2b586bfe-6ca8-4001-bd07-a0ee03084297 tempest-TestShelveInstance-705610550 None] Created volume successfully.
Nov 03 18:40:24 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [req-5ed12f18-7960-4a6f-ae95-ae1e0220e2df req-da680287-9472-4642-a184-d717e7686f9a tempest-TestShelveInstance-705610550 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:40:24 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [req-5ed12f18-7960-4a6f-ae95-ae1e0220e2df req-da680287-9472-4642-a184-d717e7686f9a tempest-TestShelveInstance-705610550 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:40:24 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [req-5ed12f18-7960-4a6f-ae95-ae1e0220e2df req-da680287-9472-4642-a184-d717e7686f9a tempest-TestShelveInstance-705610550 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:40:25 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [req-5ed12f18-7960-4a6f-ae95-ae1e0220e2df req-da680287-9472-4642-a184-d717e7686f9a tempest-TestShelveInstance-705610550 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c', 'name': 'volume-351960bb-3e4b-42b3-8070-032ec00dc103', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6d4dfa98-5ac1-4ca9-99c7-94312687c291', 'enforce_multipath': True} {{(pid=86120) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 03 18:40:25 devstack cinder-volume[86120]: INFO cinder.volume.manager [req-5ed12f18-7960-4a6f-ae95-ae1e0220e2df req-da680287-9472-4642-a184-d717e7686f9a tempest-TestShelveInstance-705610550 None] attachment_update completed successfully.
Nov 03 18:40:35 devstack cinder-volume[86120]: DEBUG dbcounter [-] [86120] Writing DB stats cinder:SELECT=14,cinder:UPDATE=6,cinder:INSERT=8 {{(pid=86120) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 18:40:35 devstack cinder-volume[86120]: DEBUG dbcounter [-] [86120] Writing DB stats cinder:UPDATE=6,cinder:SELECT=18,cinder:INSERT=6,cinder:DELETE=1 {{(pid=86120) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 18:40:54 devstack cinder-volume[86120]: INFO cinder.volume.manager [req-f3308985-0b80-4520-8e3d-78dfa62f8a6c req-8820f638-fead-4e0f-afc2-d7999f05d30e tempest-TestShelveInstance-705610550 None] Terminate volume connection completed successfully.
Nov 03 18:40:54 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [req-f3308985-0b80-4520-8e3d-78dfa62f8a6c req-8820f638-fead-4e0f-afc2-d7999f05d30e tempest-TestShelveInstance-705610550 None] Deleting attachment 6d4dfa98-5ac1-4ca9-99c7-94312687c291. {{(pid=86120) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 03 18:40:56 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [req-abe8b468-1a7f-4f83-9f53-9923c2b7d72e req-c38e5e62-871a-4bdb-bf45-262f818b4dfb tempest-TestShelveInstance-705610550 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:40:56 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [req-abe8b468-1a7f-4f83-9f53-9923c2b7d72e req-c38e5e62-871a-4bdb-bf45-262f818b4dfb tempest-TestShelveInstance-705610550 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:40:56 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [req-abe8b468-1a7f-4f83-9f53-9923c2b7d72e req-c38e5e62-871a-4bdb-bf45-262f818b4dfb tempest-TestShelveInstance-705610550 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:40:56 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [req-abe8b468-1a7f-4f83-9f53-9923c2b7d72e req-c38e5e62-871a-4bdb-bf45-262f818b4dfb tempest-TestShelveInstance-705610550 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c', 'name': 'volume-351960bb-3e4b-42b3-8070-032ec00dc103', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0526653d-167b-4dfa-8a93-676c0f410f67', 'enforce_multipath': True} {{(pid=86120) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 03 18:40:56 devstack cinder-volume[86120]: INFO cinder.volume.manager [req-abe8b468-1a7f-4f83-9f53-9923c2b7d72e req-c38e5e62-871a-4bdb-bf45-262f818b4dfb tempest-TestShelveInstance-705610550 None] attachment_update completed successfully.
Nov 03 18:41:06 devstack cinder-volume[86120]: DEBUG dbcounter [-] [86120] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=86120) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 18:41:06 devstack cinder-volume[86120]: DEBUG dbcounter [-] [86120] Writing DB stats cinder:SELECT=10,cinder:UPDATE=1 {{(pid=86120) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 18:41:14 devstack cinder-volume[86120]: DEBUG oslo_service.periodic_task [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86120) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 18:41:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:41:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:41:14 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:41:14 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:41:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:41:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:41:14 devstack sudo[106049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:41:14 devstack sudo[106049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:41:15 devstack sudo[106049]: pam_unix(sudo:session): session closed for user root
Nov 03 18:41:15 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.228s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:41:15 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:41:15 devstack cinder-volume[86120]: DEBUG oslo_service.periodic_task [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Running periodic task VolumeManager._thread_info {{(pid=86120) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 18:41:15 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] thread count: 28 {{(pid=86120) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 03 18:41:15 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] thread info: [<_MainThread(MainThread, started 134747145822336)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134747033686336)>, <Thread(Thread-3 (stat_writer), started daemon 134747030828736)>, <Thread(Rabbit-heartbeat, started daemon 134747035433408)>, <Thread(Thread-5 (_runner), started daemon 134747029587392)>, <Thread(Thread-7 (_runner), started daemon 134747029784256)>, <Thread(fd_logger, started daemon 134747027909120)>, <Thread(privsep_reader, started daemon 134747027006592)>, <Thread(tpool_thread_0, started daemon 134747018950336)>, <Thread(tpool_thread_1, started daemon 134747010541248)>, <Thread(tpool_thread_2, started daemon 134747002132160)>, <Thread(tpool_thread_3, started daemon 134746993723072)>, <Thread(tpool_thread_4, started daemon 134746985313984)>, <Thread(tpool_thread_5, started daemon 134746976904896)>, <Thread(tpool_thread_6, started daemon 134746968495808)>, <Thread(tpool_thread_7, started daemon 134746960086720)>, <Thread(tpool_thread_8, started daemon 134746951677632)>, <Thread(tpool_thread_9, started daemon 134746943268544)>, <Thread(tpool_thread_10, started daemon 134746934859456)>, <Thread(tpool_thread_11, started daemon 134746926450368)>, <Thread(tpool_thread_12, started daemon 134746918041280)>, <Thread(tpool_thread_13, started daemon 134746909632192)>, <Thread(tpool_thread_14, started daemon 134746901223104)>, <Thread(tpool_thread_15, started daemon 134746892814016)>, <Thread(tpool_thread_16, started daemon 134746884404928)>, <Thread(tpool_thread_17, started daemon 134746875995840)>, <Thread(tpool_thread_18, started daemon 134746867586752)>, <Thread(tpool_thread_19, started daemon 134746859177664)>] {{(pid=86120) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 03 18:41:39 devstack cinder-volume[86120]: INFO cinder.volume.manager [req-4570def3-3ca7-4cb9-9d97-1858809d02d2 req-d3d1a09e-7114-4779-975e-c983e18134e1 tempest-TestShelveInstance-705610550 None] Terminate volume connection completed successfully.
Nov 03 18:41:39 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [req-4570def3-3ca7-4cb9-9d97-1858809d02d2 req-d3d1a09e-7114-4779-975e-c983e18134e1 tempest-TestShelveInstance-705610550 None] Deleting attachment 0526653d-167b-4dfa-8a93-676c0f410f67. {{(pid=86120) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 03 18:41:39 devstack cinder-volume[86120]: DEBUG cinder.coordination [req-4570def3-3ca7-4cb9-9d97-1858809d02d2 req-8751966c-d5c4-4f6e-b92a-fc3000c9b931 tempest-TestShelveInstance-705610550 None] Acquiring lock "cinder-351960bb-3e4b-42b3-8070-032ec00dc103-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:41:39 devstack cinder-volume[86120]: DEBUG cinder.coordination [req-4570def3-3ca7-4cb9-9d97-1858809d02d2 req-8751966c-d5c4-4f6e-b92a-fc3000c9b931 tempest-TestShelveInstance-705610550 None] Lock "cinder-351960bb-3e4b-42b3-8070-032ec00dc103-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:41:39 devstack cinder-volume[86120]: DEBUG cinder.coordination [req-4570def3-3ca7-4cb9-9d97-1858809d02d2 req-8751966c-d5c4-4f6e-b92a-fc3000c9b931 tempest-TestShelveInstance-705610550 None] Acquiring lock "cinder-quobyte-351960bb-3e4b-42b3-8070-032ec00dc103" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:41:39 devstack cinder-volume[86120]: DEBUG cinder.coordination [req-4570def3-3ca7-4cb9-9d97-1858809d02d2 req-8751966c-d5c4-4f6e-b92a-fc3000c9b931 tempest-TestShelveInstance-705610550 None] Lock "cinder-quobyte-351960bb-3e4b-42b3-8070-032ec00dc103" acquired by "delete_volume" :: waited 0.015s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:41:39 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[a91c0112-882f-4583-a15a-ad9e9b631b81]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:41:39 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [req-4570def3-3ca7-4cb9-9d97-1858809d02d2 req-8751966c-d5c4-4f6e-b92a-fc3000c9b931 tempest-TestShelveInstance-705610550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-351960bb-3e4b-42b3-8070-032ec00dc103 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:41:39 devstack sudo[106146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-351960bb-3e4b-42b3-8070-032ec00dc103
Nov 03 18:41:39 devstack sudo[106146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:41:39 devstack sudo[106146]: pam_unix(sudo:session): session closed for user root
Nov 03 18:41:39 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [req-4570def3-3ca7-4cb9-9d97-1858809d02d2 req-8751966c-d5c4-4f6e-b92a-fc3000c9b931 tempest-TestShelveInstance-705610550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-351960bb-3e4b-42b3-8070-032ec00dc103" returned: 0 in 0.385s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:41:39 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [req-4570def3-3ca7-4cb9-9d97-1858809d02d2 req-8751966c-d5c4-4f6e-b92a-fc3000c9b931 tempest-TestShelveInstance-705610550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-351960bb-3e4b-42b3-8070-032ec00dc103 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:41:39 devstack sudo[106151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-351960bb-3e4b-42b3-8070-032ec00dc103
Nov 03 18:41:39 devstack sudo[106151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:41:40 devstack sudo[106151]: pam_unix(sudo:session): session closed for user root
Nov 03 18:41:40 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [req-4570def3-3ca7-4cb9-9d97-1858809d02d2 req-8751966c-d5c4-4f6e-b92a-fc3000c9b931 tempest-TestShelveInstance-705610550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-351960bb-3e4b-42b3-8070-032ec00dc103" returned: 0 in 0.238s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:41:40 devstack cinder-volume[86120]: DEBUG cinder.coordination [req-4570def3-3ca7-4cb9-9d97-1858809d02d2 req-8751966c-d5c4-4f6e-b92a-fc3000c9b931 tempest-TestShelveInstance-705610550 None] Lock "cinder-quobyte-351960bb-3e4b-42b3-8070-032ec00dc103" released by "delete_volume" :: held 0.669s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:41:40 devstack cinder-volume[86120]: DEBUG cinder.quota [req-4570def3-3ca7-4cb9-9d97-1858809d02d2 req-8751966c-d5c4-4f6e-b92a-fc3000c9b931 tempest-TestShelveInstance-705610550 None] Created reservations ['1c7dd58e-504e-4324-9bd0-36857449ca46', '16ea81bb-e2ef-4a36-b1bb-3bbd168948c4', '6efc16c3-d30b-4431-b9c9-bb721861a535', '194ee617-b4b2-46b1-94a9-f5d8d7963a79'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:41:40 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [req-4570def3-3ca7-4cb9-9d97-1858809d02d2 req-8751966c-d5c4-4f6e-b92a-fc3000c9b931 tempest-TestShelveInstance-705610550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:41:40 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [req-4570def3-3ca7-4cb9-9d97-1858809d02d2 req-8751966c-d5c4-4f6e-b92a-fc3000c9b931 tempest-TestShelveInstance-705610550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:41:40 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [req-4570def3-3ca7-4cb9-9d97-1858809d02d2 req-8751966c-d5c4-4f6e-b92a-fc3000c9b931 tempest-TestShelveInstance-705610550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:41:40 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [req-4570def3-3ca7-4cb9-9d97-1858809d02d2 req-8751966c-d5c4-4f6e-b92a-fc3000c9b931 tempest-TestShelveInstance-705610550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:41:40 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [req-4570def3-3ca7-4cb9-9d97-1858809d02d2 req-8751966c-d5c4-4f6e-b92a-fc3000c9b931 tempest-TestShelveInstance-705610550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:41:40 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [req-4570def3-3ca7-4cb9-9d97-1858809d02d2 req-8751966c-d5c4-4f6e-b92a-fc3000c9b931 tempest-TestShelveInstance-705610550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:41:40 devstack sudo[106154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:41:40 devstack sudo[106154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:41:40 devstack sudo[106154]: pam_unix(sudo:session): session closed for user root
Nov 03 18:41:40 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [req-4570def3-3ca7-4cb9-9d97-1858809d02d2 req-8751966c-d5c4-4f6e-b92a-fc3000c9b931 tempest-TestShelveInstance-705610550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.245s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:41:40 devstack cinder-volume[86120]: DEBUG cinder.manager [req-4570def3-3ca7-4cb9-9d97-1858809d02d2 req-8751966c-d5c4-4f6e-b92a-fc3000c9b931 tempest-TestShelveInstance-705610550 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:41:40 devstack cinder-volume[86120]: INFO cinder.volume.manager [req-4570def3-3ca7-4cb9-9d97-1858809d02d2 req-8751966c-d5c4-4f6e-b92a-fc3000c9b931 tempest-TestShelveInstance-705610550 None] Deleted volume successfully.
Nov 03 18:41:40 devstack cinder-volume[86120]: DEBUG cinder.coordination [req-4570def3-3ca7-4cb9-9d97-1858809d02d2 req-8751966c-d5c4-4f6e-b92a-fc3000c9b931 tempest-TestShelveInstance-705610550 None] Lock "cinder-351960bb-3e4b-42b3-8070-032ec00dc103-delete_volume" released by "delete_volume" :: held 1.107s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:41:54 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-abdcb46a-e0c5-4880-85fd-cedbde2eb578 tempest-VolumeAndVolumeTypeFromImageTest-1004984232 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:41:54 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-abdcb46a-e0c5-4880-85fd-cedbde2eb578 tempest-VolumeAndVolumeTypeFromImageTest-1004984232 None] Flow 'volume_create_manager' (5d09857f-1f3f-4ffa-be3f-29db52404d05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:41:54 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-abdcb46a-e0c5-4880-85fd-cedbde2eb578 tempest-VolumeAndVolumeTypeFromImageTest-1004984232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e641f07-24de-47ec-b8dc-05014456bba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:41:54 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-abdcb46a-e0c5-4880-85fd-cedbde2eb578 tempest-VolumeAndVolumeTypeFromImageTest-1004984232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e641f07-24de-47ec-b8dc-05014456bba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:41:54Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90257259-a54d-4a75-8418-9273643900eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4749fb11fc7465296f325f780575ac3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:41:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:41:55Z,use_quota=True,user_id='53a49dbc9a1b40d4a3cd033e7f55ba31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cedd1a8e-881b-4597-bb6c-863434e0fb3b),volume_type_id=cedd1a8e-881b-4597-bb6c-863434e0fb3b)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:41:54 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-abdcb46a-e0c5-4880-85fd-cedbde2eb578 tempest-VolumeAndVolumeTypeFromImageTest-1004984232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4bf16b0-bfce-4114-b843-2ddad309a245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:41:54 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-abdcb46a-e0c5-4880-85fd-cedbde2eb578 tempest-VolumeAndVolumeTypeFromImageTest-1004984232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4bf16b0-bfce-4114-b843-2ddad309a245) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:41:54 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-abdcb46a-e0c5-4880-85fd-cedbde2eb578 tempest-VolumeAndVolumeTypeFromImageTest-1004984232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19139cf3-50cf-478e-b5b3-5000cb469b15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:41:54 devstack cinder-volume[86120]: DEBUG cinder.image.glance [None req-abdcb46a-e0c5-4880-85fd-cedbde2eb578 tempest-VolumeAndVolumeTypeFromImageTest-1004984232 None] Creating Keystone auth plugin from conf {{(pid=86120) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 03 18:41:55 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-abdcb46a-e0c5-4880-85fd-cedbde2eb578 tempest-VolumeAndVolumeTypeFromImageTest-1004984232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19139cf3-50cf-478e-b5b3-5000cb469b15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '90257259-a54d-4a75-8418-9273643900eb', 'volume_name': 'volume-90257259-a54d-4a75-8418-9273643900eb', 'volume_size': 1, 'image_id': '00758f66-62d2-484e-af23-50c18df4e8a7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/00758f66-62d2-484e-af23-50c18df4e8a7', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ecf17c9749a886cbd0a2960c90cf654e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c4749fb11fc7465296f325f780575ac3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '50802988287fe35355ad41b287910358f02b871692562457ccc69bfd9254fe787ceecab2e741a70af501be096977902b31c117a574dc93b8872d91f1bccbea02', 'id': '00758f66-62d2-484e-af23-50c18df4e8a7', 'created_at': datetime.datetime(2026, 11, 3, 17, 41, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 17, 41, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/00758f66-62d2-484e-af23-50c18df4e8a7/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7a8d3c445e20>}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:41:55 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-abdcb46a-e0c5-4880-85fd-cedbde2eb578 tempest-VolumeAndVolumeTypeFromImageTest-1004984232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30c7ed8f-89b8-46e1-b666-2ff7f35b9917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:41:55 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-abdcb46a-e0c5-4880-85fd-cedbde2eb578 tempest-VolumeAndVolumeTypeFromImageTest-1004984232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30c7ed8f-89b8-46e1-b666-2ff7f35b9917) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:41:55 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-abdcb46a-e0c5-4880-85fd-cedbde2eb578 tempest-VolumeAndVolumeTypeFromImageTest-1004984232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdc7147f-f741-4962-a54d-63c69eee1585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:41:55 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-abdcb46a-e0c5-4880-85fd-cedbde2eb578 tempest-VolumeAndVolumeTypeFromImageTest-1004984232 None] Volume 90257259-a54d-4a75-8418-9273643900eb: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-90257259-a54d-4a75-8418-9273643900eb', 'volume_size': 1, 'image_id': '00758f66-62d2-484e-af23-50c18df4e8a7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/00758f66-62d2-484e-af23-50c18df4e8a7', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ecf17c9749a886cbd0a2960c90cf654e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c4749fb11fc7465296f325f780575ac3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '50802988287fe35355ad41b287910358f02b871692562457ccc69bfd9254fe787ceecab2e741a70af501be096977902b31c117a574dc93b8872d91f1bccbea02', 'id': '00758f66-62d2-484e-af23-50c18df4e8a7', 'created_at': datetime.datetime(2026, 11, 3, 17, 41, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 17, 41, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/00758f66-62d2-484e-af23-50c18df4e8a7/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7a8d3c445e20>}
Nov 03 18:41:55 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-abdcb46a-e0c5-4880-85fd-cedbde2eb578 tempest-VolumeAndVolumeTypeFromImageTest-1004984232 None] Trying to clone 90257259-a54d-4a75-8418-9273643900eb from image 00758f66-62d2-484e-af23-50c18df4e8a7 at location (None, [{'url': 'file:///opt/stack/data/glance/images/00758f66-62d2-484e-af23-50c18df4e8a7', 'metadata': {}}]). {{(pid=86120) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 03 18:41:55 devstack cinder-volume[86120]: DEBUG cinder.image.image_utils [None req-abdcb46a-e0c5-4880-85fd-cedbde2eb578 tempest-VolumeAndVolumeTypeFromImageTest-1004984232 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_00758f66-62d2-484e-af23-50c18df4e8a7_h6l3nco7devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86120) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 03 18:41:55 devstack cinder-volume[86120]: INFO cinder.image.image_utils [None req-abdcb46a-e0c5-4880-85fd-cedbde2eb578 tempest-VolumeAndVolumeTypeFromImageTest-1004984232 None] Image download 0.00 MB at 0.00 MB/s
Nov 03 18:41:55 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[72608c7b-960b-4197-b624-722e8e4594e3]: (4, 'raw') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:41:55 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-abdcb46a-e0c5-4880-85fd-cedbde2eb578 tempest-VolumeAndVolumeTypeFromImageTest-1004984232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_00758f66-62d2-484e-af23-50c18df4e8a7_h6l3nco7devstack@QuobyteHD {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:41:55 devstack sudo[106166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_00758f66-62d2-484e-af23-50c18df4e8a7_h6l3nco7devstack@QuobyteHD
Nov 03 18:41:55 devstack sudo[106166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:41:55 devstack sudo[106166]: pam_unix(sudo:session): session closed for user root
Nov 03 18:41:55 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-abdcb46a-e0c5-4880-85fd-cedbde2eb578 tempest-VolumeAndVolumeTypeFromImageTest-1004984232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_00758f66-62d2-484e-af23-50c18df4e8a7_h6l3nco7devstack@QuobyteHD" returned: 0 in 0.316s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:41:55 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-abdcb46a-e0c5-4880-85fd-cedbde2eb578 tempest-VolumeAndVolumeTypeFromImageTest-1004984232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_00758f66-62d2-484e-af23-50c18df4e8a7_h6l3nco7devstack@QuobyteHD {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:41:55 devstack sudo[106170]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_00758f66-62d2-484e-af23-50c18df4e8a7_h6l3nco7devstack@QuobyteHD
Nov 03 18:41:55 devstack sudo[106170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:41:55 devstack sudo[106170]: pam_unix(sudo:session): session closed for user root
Nov 03 18:41:55 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-abdcb46a-e0c5-4880-85fd-cedbde2eb578 tempest-VolumeAndVolumeTypeFromImageTest-1004984232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_00758f66-62d2-484e-af23-50c18df4e8a7_h6l3nco7devstack@QuobyteHD" returned: 1 in 0.327s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:41:55 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-abdcb46a-e0c5-4880-85fd-cedbde2eb578 tempest-VolumeAndVolumeTypeFromImageTest-1004984232 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_00758f66-62d2-484e-af23-50c18df4e8a7_h6l3nco7devstack@QuobyteHD' failed. Not Retrying. {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 03 18:41:55 devstack cinder-volume[86120]: DEBUG cinder.image.image_utils [None req-abdcb46a-e0c5-4880-85fd-cedbde2eb578 tempest-VolumeAndVolumeTypeFromImageTest-1004984232 None] Temporary image 00758f66-62d2-484e-af23-50c18df4e8a7 is fetched for user 53a49dbc9a1b40d4a3cd033e7f55ba31. {{(pid=86120) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 03 18:41:55 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[91067c8d-302a-4824-9044-b85194439f02]: (4, 'raw') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:41:55 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-abdcb46a-e0c5-4880-85fd-cedbde2eb578 tempest-VolumeAndVolumeTypeFromImageTest-1004984232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_00758f66-62d2-484e-af23-50c18df4e8a7_h6l3nco7devstack@QuobyteHD {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:41:55 devstack sudo[106175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_00758f66-62d2-484e-af23-50c18df4e8a7_h6l3nco7devstack@QuobyteHD
Nov 03 18:41:55 devstack sudo[106175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:41:56 devstack sudo[106175]: pam_unix(sudo:session): session closed for user root
Nov 03 18:41:56 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-abdcb46a-e0c5-4880-85fd-cedbde2eb578 tempest-VolumeAndVolumeTypeFromImageTest-1004984232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_00758f66-62d2-484e-af23-50c18df4e8a7_h6l3nco7devstack@QuobyteHD" returned: 0 in 0.313s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:41:56 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-abdcb46a-e0c5-4880-85fd-cedbde2eb578 tempest-VolumeAndVolumeTypeFromImageTest-1004984232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_00758f66-62d2-484e-af23-50c18df4e8a7_h6l3nco7devstack@QuobyteHD {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:41:56 devstack sudo[106179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_00758f66-62d2-484e-af23-50c18df4e8a7_h6l3nco7devstack@QuobyteHD
Nov 03 18:41:56 devstack sudo[106179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:41:56 devstack sudo[106179]: pam_unix(sudo:session): session closed for user root
Nov 03 18:41:56 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-abdcb46a-e0c5-4880-85fd-cedbde2eb578 tempest-VolumeAndVolumeTypeFromImageTest-1004984232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_00758f66-62d2-484e-af23-50c18df4e8a7_h6l3nco7devstack@QuobyteHD" returned: 1 in 0.319s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:41:56 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-abdcb46a-e0c5-4880-85fd-cedbde2eb578 tempest-VolumeAndVolumeTypeFromImageTest-1004984232 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_00758f66-62d2-484e-af23-50c18df4e8a7_h6l3nco7devstack@QuobyteHD' failed. Not Retrying. {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 03 18:41:56 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-abdcb46a-e0c5-4880-85fd-cedbde2eb578 tempest-VolumeAndVolumeTypeFromImageTest-1004984232 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:41:56 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-abdcb46a-e0c5-4880-85fd-cedbde2eb578 tempest-VolumeAndVolumeTypeFromImageTest-1004984232 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:41:56 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-abdcb46a-e0c5-4880-85fd-cedbde2eb578 tempest-VolumeAndVolumeTypeFromImageTest-1004984232 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:41:54Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90257259-a54d-4a75-8418-9273643900eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4749fb11fc7465296f325f780575ac3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:41:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:41:55Z,use_quota=True,user_id='53a49dbc9a1b40d4a3cd033e7f55ba31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cedd1a8e-881b-4597-bb6c-863434e0fb3b),volume_type_id=cedd1a8e-881b-4597-bb6c-863434e0fb3b)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:41:56 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-abdcb46a-e0c5-4880-85fd-cedbde2eb578 tempest-VolumeAndVolumeTypeFromImageTest-1004984232 None] Creating volume 90257259-a54d-4a75-8418-9273643900eb {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:41:56 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-abdcb46a-e0c5-4880-85fd-cedbde2eb578 tempest-VolumeAndVolumeTypeFromImageTest-1004984232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:41:56 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-abdcb46a-e0c5-4880-85fd-cedbde2eb578 tempest-VolumeAndVolumeTypeFromImageTest-1004984232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:41:56 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-abdcb46a-e0c5-4880-85fd-cedbde2eb578 tempest-VolumeAndVolumeTypeFromImageTest-1004984232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:41:56 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-abdcb46a-e0c5-4880-85fd-cedbde2eb578 tempest-VolumeAndVolumeTypeFromImageTest-1004984232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:41:56 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-abdcb46a-e0c5-4880-85fd-cedbde2eb578 tempest-VolumeAndVolumeTypeFromImageTest-1004984232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:41:56 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-abdcb46a-e0c5-4880-85fd-cedbde2eb578 tempest-VolumeAndVolumeTypeFromImageTest-1004984232 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:41:56 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-abdcb46a-e0c5-4880-85fd-cedbde2eb578 tempest-VolumeAndVolumeTypeFromImageTest-1004984232 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:41:56 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-abdcb46a-e0c5-4880-85fd-cedbde2eb578 tempest-VolumeAndVolumeTypeFromImageTest-1004984232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-90257259-a54d-4a75-8418-9273643900eb 1073741824 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:41:56 devstack sudo[106184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-90257259-a54d-4a75-8418-9273643900eb 1073741824
Nov 03 18:41:56 devstack sudo[106184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:41:56 devstack sudo[106184]: pam_unix(sudo:session): session closed for user root
Nov 03 18:41:56 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-abdcb46a-e0c5-4880-85fd-cedbde2eb578 tempest-VolumeAndVolumeTypeFromImageTest-1004984232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-90257259-a54d-4a75-8418-9273643900eb 1073741824" returned: 0 in 0.398s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:41:56 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-abdcb46a-e0c5-4880-85fd-cedbde2eb578 tempest-VolumeAndVolumeTypeFromImageTest-1004984232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-90257259-a54d-4a75-8418-9273643900eb {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:41:56 devstack sudo[106189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-90257259-a54d-4a75-8418-9273643900eb
Nov 03 18:41:56 devstack sudo[106189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:41:57 devstack sudo[106189]: pam_unix(sudo:session): session closed for user root
Nov 03 18:41:57 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-abdcb46a-e0c5-4880-85fd-cedbde2eb578 tempest-VolumeAndVolumeTypeFromImageTest-1004984232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-90257259-a54d-4a75-8418-9273643900eb" returned: 0 in 0.242s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:41:57 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-abdcb46a-e0c5-4880-85fd-cedbde2eb578 tempest-VolumeAndVolumeTypeFromImageTest-1004984232 None] <== create_volume: return (683ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:41:57 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-abdcb46a-e0c5-4880-85fd-cedbde2eb578 tempest-VolumeAndVolumeTypeFromImageTest-1004984232 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.686s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:41:57 devstack cinder-volume[86120]: DEBUG cinder.volume.volume_utils [None req-abdcb46a-e0c5-4880-85fd-cedbde2eb578 tempest-VolumeAndVolumeTypeFromImageTest-1004984232 None] Attempting download of 00758f66-62d2-484e-af23-50c18df4e8a7 ((None, [{'url': 'file:///opt/stack/data/glance/images/00758f66-62d2-484e-af23-50c18df4e8a7', 'metadata': {}}])) to volume 90257259-a54d-4a75-8418-9273643900eb. {{(pid=86120) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 03 18:41:57 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e5f94c3-3074-4db1-a57c-3a8725cc106e]: (4, 'raw') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:41:57 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-abdcb46a-e0c5-4880-85fd-cedbde2eb578 tempest-VolumeAndVolumeTypeFromImageTest-1004984232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_00758f66-62d2-484e-af23-50c18df4e8a7_woifecy5 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:41:57 devstack sudo[106192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_00758f66-62d2-484e-af23-50c18df4e8a7_woifecy5
Nov 03 18:41:57 devstack sudo[106192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:41:57 devstack sudo[106192]: pam_unix(sudo:session): session closed for user root
Nov 03 18:41:57 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-abdcb46a-e0c5-4880-85fd-cedbde2eb578 tempest-VolumeAndVolumeTypeFromImageTest-1004984232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_00758f66-62d2-484e-af23-50c18df4e8a7_woifecy5" returned: 0 in 0.316s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:41:57 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-abdcb46a-e0c5-4880-85fd-cedbde2eb578 tempest-VolumeAndVolumeTypeFromImageTest-1004984232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_00758f66-62d2-484e-af23-50c18df4e8a7_woifecy5 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:41:57 devstack sudo[106196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_00758f66-62d2-484e-af23-50c18df4e8a7_woifecy5
Nov 03 18:41:57 devstack sudo[106196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:41:57 devstack sudo[106196]: pam_unix(sudo:session): session closed for user root
Nov 03 18:41:57 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-abdcb46a-e0c5-4880-85fd-cedbde2eb578 tempest-VolumeAndVolumeTypeFromImageTest-1004984232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_00758f66-62d2-484e-af23-50c18df4e8a7_woifecy5" returned: 1 in 0.318s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:41:57 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-abdcb46a-e0c5-4880-85fd-cedbde2eb578 tempest-VolumeAndVolumeTypeFromImageTest-1004984232 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_00758f66-62d2-484e-af23-50c18df4e8a7_woifecy5' failed. Not Retrying. {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 03 18:41:57 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[36ca5d1d-e5fe-4a23-85c1-512088a3ba1e]: (4, 'raw') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:41:57 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-abdcb46a-e0c5-4880-85fd-cedbde2eb578 tempest-VolumeAndVolumeTypeFromImageTest-1004984232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_00758f66-62d2-484e-af23-50c18df4e8a7_h6l3nco7devstack@QuobyteHD {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:41:58 devstack sudo[106200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_00758f66-62d2-484e-af23-50c18df4e8a7_h6l3nco7devstack@QuobyteHD
Nov 03 18:41:58 devstack sudo[106200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:41:58 devstack sudo[106200]: pam_unix(sudo:session): session closed for user root
Nov 03 18:41:58 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-abdcb46a-e0c5-4880-85fd-cedbde2eb578 tempest-VolumeAndVolumeTypeFromImageTest-1004984232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_00758f66-62d2-484e-af23-50c18df4e8a7_h6l3nco7devstack@QuobyteHD" returned: 0 in 0.310s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:41:58 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-abdcb46a-e0c5-4880-85fd-cedbde2eb578 tempest-VolumeAndVolumeTypeFromImageTest-1004984232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_00758f66-62d2-484e-af23-50c18df4e8a7_h6l3nco7devstack@QuobyteHD {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:41:58 devstack sudo[106204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_00758f66-62d2-484e-af23-50c18df4e8a7_h6l3nco7devstack@QuobyteHD
Nov 03 18:41:58 devstack sudo[106204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:41:58 devstack sudo[106204]: pam_unix(sudo:session): session closed for user root
Nov 03 18:41:58 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-abdcb46a-e0c5-4880-85fd-cedbde2eb578 tempest-VolumeAndVolumeTypeFromImageTest-1004984232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_00758f66-62d2-484e-af23-50c18df4e8a7_h6l3nco7devstack@QuobyteHD" returned: 1 in 0.313s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:41:58 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-abdcb46a-e0c5-4880-85fd-cedbde2eb578 tempest-VolumeAndVolumeTypeFromImageTest-1004984232 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_00758f66-62d2-484e-af23-50c18df4e8a7_h6l3nco7devstack@QuobyteHD' failed. Not Retrying. {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 03 18:41:58 devstack cinder-volume[86120]: DEBUG cinder.image.image_utils [None req-abdcb46a-e0c5-4880-85fd-cedbde2eb578 tempest-VolumeAndVolumeTypeFromImageTest-1004984232 None] 00758f66-62d2-484e-af23-50c18df4e8a7 was raw, converting to qcow2 {{(pid=86120) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 03 18:41:58 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-abdcb46a-e0c5-4880-85fd-cedbde2eb578 tempest-VolumeAndVolumeTypeFromImageTest-1004984232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_00758f66-62d2-484e-af23-50c18df4e8a7_h6l3nco7devstack@QuobyteHD /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-90257259-a54d-4a75-8418-9273643900eb {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:41:58 devstack sudo[106209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_00758f66-62d2-484e-af23-50c18df4e8a7_h6l3nco7devstack@QuobyteHD /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-90257259-a54d-4a75-8418-9273643900eb
Nov 03 18:41:58 devstack sudo[106209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:41:58 devstack sudo[106209]: pam_unix(sudo:session): session closed for user root
Nov 03 18:41:58 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-abdcb46a-e0c5-4880-85fd-cedbde2eb578 tempest-VolumeAndVolumeTypeFromImageTest-1004984232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_00758f66-62d2-484e-af23-50c18df4e8a7_h6l3nco7devstack@QuobyteHD /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-90257259-a54d-4a75-8418-9273643900eb" returned: 0 in 0.430s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:41:58 devstack cinder-volume[86120]: DEBUG cinder.image.image_utils [None req-abdcb46a-e0c5-4880-85fd-cedbde2eb578 tempest-VolumeAndVolumeTypeFromImageTest-1004984232 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_00758f66-62d2-484e-af23-50c18df4e8a7_h6l3nco7devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-90257259-a54d-4a75-8418-9273643900eb {{(pid=86120) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 03 18:41:58 devstack cinder-volume[86120]: INFO cinder.image.image_utils [None req-abdcb46a-e0c5-4880-85fd-cedbde2eb578 tempest-VolumeAndVolumeTypeFromImageTest-1004984232 None] Converted 0.00 MB image at 0.00 MB/s
Nov 03 18:41:58 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-abdcb46a-e0c5-4880-85fd-cedbde2eb578 tempest-VolumeAndVolumeTypeFromImageTest-1004984232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-90257259-a54d-4a75-8418-9273643900eb 1G {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:41:59 devstack sudo[106215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-90257259-a54d-4a75-8418-9273643900eb 1G
Nov 03 18:41:59 devstack sudo[106215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:41:59 devstack sudo[106215]: pam_unix(sudo:session): session closed for user root
Nov 03 18:41:59 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-abdcb46a-e0c5-4880-85fd-cedbde2eb578 tempest-VolumeAndVolumeTypeFromImageTest-1004984232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-90257259-a54d-4a75-8418-9273643900eb 1G" returned: 0 in 0.296s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:41:59 devstack cinder-volume[86120]: DEBUG cinder.volume.volume_utils [None req-abdcb46a-e0c5-4880-85fd-cedbde2eb578 tempest-VolumeAndVolumeTypeFromImageTest-1004984232 None] Downloaded image 00758f66-62d2-484e-af23-50c18df4e8a7 ((None, [{'url': 'file:///opt/stack/data/glance/images/00758f66-62d2-484e-af23-50c18df4e8a7', 'metadata': {}}])) to volume 90257259-a54d-4a75-8418-9273643900eb successfully. {{(pid=86120) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 03 18:41:59 devstack cinder-volume[86120]: DEBUG cinder.image.image_utils [None req-abdcb46a-e0c5-4880-85fd-cedbde2eb578 tempest-VolumeAndVolumeTypeFromImageTest-1004984232 None] Temporary image 00758f66-62d2-484e-af23-50c18df4e8a7 for user 53a49dbc9a1b40d4a3cd033e7f55ba31 is deleted. {{(pid=86120) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 03 18:41:59 devstack cinder-volume[86120]: DEBUG cinder.volume.volume_utils [None req-abdcb46a-e0c5-4880-85fd-cedbde2eb578 tempest-VolumeAndVolumeTypeFromImageTest-1004984232 None] Marking volume 90257259-a54d-4a75-8418-9273643900eb as bootable. {{(pid=86120) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 03 18:41:59 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-abdcb46a-e0c5-4880-85fd-cedbde2eb578 tempest-VolumeAndVolumeTypeFromImageTest-1004984232 None] Copying metadata from image 00758f66-62d2-484e-af23-50c18df4e8a7 to 90257259-a54d-4a75-8418-9273643900eb. {{(pid=86120) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 03 18:41:59 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-abdcb46a-e0c5-4880-85fd-cedbde2eb578 tempest-VolumeAndVolumeTypeFromImageTest-1004984232 None] Creating volume glance metadata for volume 90257259-a54d-4a75-8418-9273643900eb backed by image 00758f66-62d2-484e-af23-50c18df4e8a7 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '00758f66-62d2-484e-af23-50c18df4e8a7', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'ecf17c9749a886cbd0a2960c90cf654e', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86120) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 03 18:41:59 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-abdcb46a-e0c5-4880-85fd-cedbde2eb578 tempest-VolumeAndVolumeTypeFromImageTest-1004984232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdc7147f-f741-4962-a54d-63c69eee1585) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90257259-a54d-4a75-8418-9273643900eb', 'volume_size': 1, 'image_id': '00758f66-62d2-484e-af23-50c18df4e8a7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/00758f66-62d2-484e-af23-50c18df4e8a7', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ecf17c9749a886cbd0a2960c90cf654e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c4749fb11fc7465296f325f780575ac3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '50802988287fe35355ad41b287910358f02b871692562457ccc69bfd9254fe787ceecab2e741a70af501be096977902b31c117a574dc93b8872d91f1bccbea02', 'id': '00758f66-62d2-484e-af23-50c18df4e8a7', 'created_at': datetime.datetime(2026, 11, 3, 17, 41, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 17, 41, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/00758f66-62d2-484e-af23-50c18df4e8a7/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7a8d3c445e20>}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:41:59 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-abdcb46a-e0c5-4880-85fd-cedbde2eb578 tempest-VolumeAndVolumeTypeFromImageTest-1004984232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de4f3c38-5fbf-4e2b-8e98-e81885d9a114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:41:59 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-abdcb46a-e0c5-4880-85fd-cedbde2eb578 tempest-VolumeAndVolumeTypeFromImageTest-1004984232 None] Volume volume-90257259-a54d-4a75-8418-9273643900eb (90257259-a54d-4a75-8418-9273643900eb): created successfully
Nov 03 18:41:59 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-abdcb46a-e0c5-4880-85fd-cedbde2eb578 tempest-VolumeAndVolumeTypeFromImageTest-1004984232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de4f3c38-5fbf-4e2b-8e98-e81885d9a114) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:41:59 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-abdcb46a-e0c5-4880-85fd-cedbde2eb578 tempest-VolumeAndVolumeTypeFromImageTest-1004984232 None] Flow 'volume_create_manager' (5d09857f-1f3f-4ffa-be3f-29db52404d05) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:41:59 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-abdcb46a-e0c5-4880-85fd-cedbde2eb578 tempest-VolumeAndVolumeTypeFromImageTest-1004984232 None] Created volume successfully.
Nov 03 18:41:59 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-5f65b02b-c111-435b-82fa-cd9dfd0cadd2 tempest-VolumeAndVolumeTypeFromImageTest-1004984232 None] Acquiring lock "cinder-90257259-a54d-4a75-8418-9273643900eb-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:41:59 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-5f65b02b-c111-435b-82fa-cd9dfd0cadd2 tempest-VolumeAndVolumeTypeFromImageTest-1004984232 None] Lock "cinder-90257259-a54d-4a75-8418-9273643900eb-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:41:59 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-5f65b02b-c111-435b-82fa-cd9dfd0cadd2 tempest-VolumeAndVolumeTypeFromImageTest-1004984232 None] Acquiring lock "cinder-quobyte-90257259-a54d-4a75-8418-9273643900eb" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:41:59 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-5f65b02b-c111-435b-82fa-cd9dfd0cadd2 tempest-VolumeAndVolumeTypeFromImageTest-1004984232 None] Lock "cinder-quobyte-90257259-a54d-4a75-8418-9273643900eb" acquired by "delete_volume" :: waited 0.016s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:42:00 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e5ddb0d-4f24-4fc8-8b03-1f69dd574c2d]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:42:00 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-5f65b02b-c111-435b-82fa-cd9dfd0cadd2 tempest-VolumeAndVolumeTypeFromImageTest-1004984232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-90257259-a54d-4a75-8418-9273643900eb {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:42:00 devstack sudo[106221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-90257259-a54d-4a75-8418-9273643900eb
Nov 03 18:42:00 devstack sudo[106221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:42:00 devstack sudo[106221]: pam_unix(sudo:session): session closed for user root
Nov 03 18:42:00 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-5f65b02b-c111-435b-82fa-cd9dfd0cadd2 tempest-VolumeAndVolumeTypeFromImageTest-1004984232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-90257259-a54d-4a75-8418-9273643900eb" returned: 0 in 0.352s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:42:00 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-5f65b02b-c111-435b-82fa-cd9dfd0cadd2 tempest-VolumeAndVolumeTypeFromImageTest-1004984232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-90257259-a54d-4a75-8418-9273643900eb {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:42:00 devstack sudo[106226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-90257259-a54d-4a75-8418-9273643900eb
Nov 03 18:42:00 devstack sudo[106226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:42:00 devstack sudo[106226]: pam_unix(sudo:session): session closed for user root
Nov 03 18:42:00 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-5f65b02b-c111-435b-82fa-cd9dfd0cadd2 tempest-VolumeAndVolumeTypeFromImageTest-1004984232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-90257259-a54d-4a75-8418-9273643900eb" returned: 0 in 0.264s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:42:00 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-5f65b02b-c111-435b-82fa-cd9dfd0cadd2 tempest-VolumeAndVolumeTypeFromImageTest-1004984232 None] Lock "cinder-quobyte-90257259-a54d-4a75-8418-9273643900eb" released by "delete_volume" :: held 0.662s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:42:00 devstack cinder-volume[86120]: WARNING cinder.quota [None req-5f65b02b-c111-435b-82fa-cd9dfd0cadd2 tempest-VolumeAndVolumeTypeFromImageTest-1004984232 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Nov 03 18:42:00 devstack cinder-volume[86120]: WARNING cinder.quota [None req-5f65b02b-c111-435b-82fa-cd9dfd0cadd2 tempest-VolumeAndVolumeTypeFromImageTest-1004984232 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Nov 03 18:42:00 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-5f65b02b-c111-435b-82fa-cd9dfd0cadd2 tempest-VolumeAndVolumeTypeFromImageTest-1004984232 None] Created reservations ['456d97aa-5190-4d2f-93b6-0a46128290c6', 'feeebda2-6da7-4a32-b79c-33be4f6da178', 'ef926a7a-1cbf-488e-906e-6e79865f1d54', 'f83381a9-b329-46ea-983f-be1e2b346e61'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:42:00 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-5f65b02b-c111-435b-82fa-cd9dfd0cadd2 tempest-VolumeAndVolumeTypeFromImageTest-1004984232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:42:00 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-5f65b02b-c111-435b-82fa-cd9dfd0cadd2 tempest-VolumeAndVolumeTypeFromImageTest-1004984232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:42:00 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-5f65b02b-c111-435b-82fa-cd9dfd0cadd2 tempest-VolumeAndVolumeTypeFromImageTest-1004984232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:42:00 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-5f65b02b-c111-435b-82fa-cd9dfd0cadd2 tempest-VolumeAndVolumeTypeFromImageTest-1004984232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:42:00 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-5f65b02b-c111-435b-82fa-cd9dfd0cadd2 tempest-VolumeAndVolumeTypeFromImageTest-1004984232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:42:00 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-5f65b02b-c111-435b-82fa-cd9dfd0cadd2 tempest-VolumeAndVolumeTypeFromImageTest-1004984232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:42:00 devstack sudo[106231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:42:00 devstack sudo[106231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:42:01 devstack sudo[106231]: pam_unix(sudo:session): session closed for user root
Nov 03 18:42:01 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-5f65b02b-c111-435b-82fa-cd9dfd0cadd2 tempest-VolumeAndVolumeTypeFromImageTest-1004984232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.259s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:42:01 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-5f65b02b-c111-435b-82fa-cd9dfd0cadd2 tempest-VolumeAndVolumeTypeFromImageTest-1004984232 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:42:01 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-5f65b02b-c111-435b-82fa-cd9dfd0cadd2 tempest-VolumeAndVolumeTypeFromImageTest-1004984232 None] Deleted volume successfully.
Nov 03 18:42:01 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-5f65b02b-c111-435b-82fa-cd9dfd0cadd2 tempest-VolumeAndVolumeTypeFromImageTest-1004984232 None] Lock "cinder-90257259-a54d-4a75-8418-9273643900eb-delete_volume" released by "delete_volume" :: held 1.121s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:42:05 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-b61ee902-1353-42ae-9ad8-81683d19e01d tempest-VolumeDependencyTests-64910899 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:42:05 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-b61ee902-1353-42ae-9ad8-81683d19e01d tempest-VolumeDependencyTests-64910899 None] Flow 'volume_create_manager' (603164be-c717-46ef-9070-72fb537b7e20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:42:05 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-b61ee902-1353-42ae-9ad8-81683d19e01d tempest-VolumeDependencyTests-64910899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2206f331-5bbf-43fe-88e2-168d179e34cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:42:05 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-b61ee902-1353-42ae-9ad8-81683d19e01d tempest-VolumeDependencyTests-64910899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2206f331-5bbf-43fe-88e2-168d179e34cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:42:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-772864607',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b962a7f4-d202-4fdc-8d56-fef29b4aab9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75e7e2ecab8f455b9258d87e7963a958',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:42:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:42:05Z,use_quota=True,user_id='8b6b859832b24a3ea38f375cf5c10331',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:42:05 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-b61ee902-1353-42ae-9ad8-81683d19e01d tempest-VolumeDependencyTests-64910899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9aa9c2d4-8c34-4933-9bfa-c742a19741b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:42:05 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-b61ee902-1353-42ae-9ad8-81683d19e01d tempest-VolumeDependencyTests-64910899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9aa9c2d4-8c34-4933-9bfa-c742a19741b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:42:05 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-b61ee902-1353-42ae-9ad8-81683d19e01d tempest-VolumeDependencyTests-64910899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66bc1a15-85b4-4430-8fcf-fb15f294e62e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:42:05 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-b61ee902-1353-42ae-9ad8-81683d19e01d tempest-VolumeDependencyTests-64910899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66bc1a15-85b4-4430-8fcf-fb15f294e62e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b962a7f4-d202-4fdc-8d56-fef29b4aab9c', 'volume_name': 'volume-b962a7f4-d202-4fdc-8d56-fef29b4aab9c', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:42:05 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-b61ee902-1353-42ae-9ad8-81683d19e01d tempest-VolumeDependencyTests-64910899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c80ccbb-3f98-4d92-a93e-72839ff6eb0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:42:05 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-b61ee902-1353-42ae-9ad8-81683d19e01d tempest-VolumeDependencyTests-64910899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c80ccbb-3f98-4d92-a93e-72839ff6eb0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:42:05 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-b61ee902-1353-42ae-9ad8-81683d19e01d tempest-VolumeDependencyTests-64910899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d49f61de-65b2-43b2-a991-ec475ab84544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:42:05 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-b61ee902-1353-42ae-9ad8-81683d19e01d tempest-VolumeDependencyTests-64910899 None] Volume b962a7f4-d202-4fdc-8d56-fef29b4aab9c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b962a7f4-d202-4fdc-8d56-fef29b4aab9c', 'volume_size': 1}
Nov 03 18:42:05 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-b61ee902-1353-42ae-9ad8-81683d19e01d tempest-VolumeDependencyTests-64910899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:42:05 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-b61ee902-1353-42ae-9ad8-81683d19e01d tempest-VolumeDependencyTests-64910899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:42:05 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-b61ee902-1353-42ae-9ad8-81683d19e01d tempest-VolumeDependencyTests-64910899 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:42:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-772864607',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b962a7f4-d202-4fdc-8d56-fef29b4aab9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75e7e2ecab8f455b9258d87e7963a958',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:42:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:42:05Z,use_quota=True,user_id='8b6b859832b24a3ea38f375cf5c10331',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:42:05 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-b61ee902-1353-42ae-9ad8-81683d19e01d tempest-VolumeDependencyTests-64910899 None] Creating volume b962a7f4-d202-4fdc-8d56-fef29b4aab9c {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:42:05 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-b61ee902-1353-42ae-9ad8-81683d19e01d tempest-VolumeDependencyTests-64910899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:42:05 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-b61ee902-1353-42ae-9ad8-81683d19e01d tempest-VolumeDependencyTests-64910899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:42:05 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-b61ee902-1353-42ae-9ad8-81683d19e01d tempest-VolumeDependencyTests-64910899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:42:05 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-b61ee902-1353-42ae-9ad8-81683d19e01d tempest-VolumeDependencyTests-64910899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:42:05 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-b61ee902-1353-42ae-9ad8-81683d19e01d tempest-VolumeDependencyTests-64910899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:42:05 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-b61ee902-1353-42ae-9ad8-81683d19e01d tempest-VolumeDependencyTests-64910899 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:42:05 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-b61ee902-1353-42ae-9ad8-81683d19e01d tempest-VolumeDependencyTests-64910899 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:42:05 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b61ee902-1353-42ae-9ad8-81683d19e01d tempest-VolumeDependencyTests-64910899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-b962a7f4-d202-4fdc-8d56-fef29b4aab9c 1073741824 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:42:05 devstack sudo[106234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-b962a7f4-d202-4fdc-8d56-fef29b4aab9c 1073741824
Nov 03 18:42:05 devstack sudo[106234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:42:05 devstack sudo[106234]: pam_unix(sudo:session): session closed for user root
Nov 03 18:42:05 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b61ee902-1353-42ae-9ad8-81683d19e01d tempest-VolumeDependencyTests-64910899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-b962a7f4-d202-4fdc-8d56-fef29b4aab9c 1073741824" returned: 0 in 0.399s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:42:05 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b61ee902-1353-42ae-9ad8-81683d19e01d tempest-VolumeDependencyTests-64910899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-b962a7f4-d202-4fdc-8d56-fef29b4aab9c {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:42:05 devstack sudo[106239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-b962a7f4-d202-4fdc-8d56-fef29b4aab9c
Nov 03 18:42:05 devstack sudo[106239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:42:05 devstack sudo[106239]: pam_unix(sudo:session): session closed for user root
Nov 03 18:42:05 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b61ee902-1353-42ae-9ad8-81683d19e01d tempest-VolumeDependencyTests-64910899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-b962a7f4-d202-4fdc-8d56-fef29b4aab9c" returned: 0 in 0.249s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:42:05 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-b61ee902-1353-42ae-9ad8-81683d19e01d tempest-VolumeDependencyTests-64910899 None] <== create_volume: return (688ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:42:05 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-b61ee902-1353-42ae-9ad8-81683d19e01d tempest-VolumeDependencyTests-64910899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.690s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:42:05 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-b61ee902-1353-42ae-9ad8-81683d19e01d tempest-VolumeDependencyTests-64910899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d49f61de-65b2-43b2-a991-ec475ab84544) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b962a7f4-d202-4fdc-8d56-fef29b4aab9c', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:42:05 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-b61ee902-1353-42ae-9ad8-81683d19e01d tempest-VolumeDependencyTests-64910899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9bcd361-3163-42b5-83db-d796aa5a08c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:42:05 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-b61ee902-1353-42ae-9ad8-81683d19e01d tempest-VolumeDependencyTests-64910899 None] Volume volume-b962a7f4-d202-4fdc-8d56-fef29b4aab9c (b962a7f4-d202-4fdc-8d56-fef29b4aab9c): created successfully
Nov 03 18:42:05 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-b61ee902-1353-42ae-9ad8-81683d19e01d tempest-VolumeDependencyTests-64910899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9bcd361-3163-42b5-83db-d796aa5a08c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:42:05 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-b61ee902-1353-42ae-9ad8-81683d19e01d tempest-VolumeDependencyTests-64910899 None] Flow 'volume_create_manager' (603164be-c717-46ef-9070-72fb537b7e20) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:42:05 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-b61ee902-1353-42ae-9ad8-81683d19e01d tempest-VolumeDependencyTests-64910899 None] Created volume successfully.
Nov 03 18:42:06 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-708f7b9b-35dc-481e-a2a5-2bca206bd5bd tempest-VolumeDependencyTests-64910899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:42:06 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-708f7b9b-35dc-481e-a2a5-2bca206bd5bd tempest-VolumeDependencyTests-64910899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:42:06 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-708f7b9b-35dc-481e-a2a5-2bca206bd5bd tempest-VolumeDependencyTests-64910899 None] Creating offline snapshot 640fd152-c783-42dd-abcd-411f7fe61c69 of volume b962a7f4-d202-4fdc-8d56-fef29b4aab9c {{(pid=86120) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 18:42:06 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3fede7f-9f81-4a0c-842c-16b455b20c83]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:42:06 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-708f7b9b-35dc-481e-a2a5-2bca206bd5bd tempest-VolumeDependencyTests-64910899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-b962a7f4-d202-4fdc-8d56-fef29b4aab9c {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:42:06 devstack sudo[106242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-b962a7f4-d202-4fdc-8d56-fef29b4aab9c
Nov 03 18:42:06 devstack sudo[106242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:42:06 devstack sudo[106242]: pam_unix(sudo:session): session closed for user root
Nov 03 18:42:06 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-708f7b9b-35dc-481e-a2a5-2bca206bd5bd tempest-VolumeDependencyTests-64910899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-b962a7f4-d202-4fdc-8d56-fef29b4aab9c" returned: 0 in 0.345s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:42:06 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-708f7b9b-35dc-481e-a2a5-2bca206bd5bd tempest-VolumeDependencyTests-64910899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-b962a7f4-d202-4fdc-8d56-fef29b4aab9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-b962a7f4-d202-4fdc-8d56-fef29b4aab9c.640fd152-c783-42dd-abcd-411f7fe61c69 1G {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:42:06 devstack sudo[106247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-b962a7f4-d202-4fdc-8d56-fef29b4aab9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-b962a7f4-d202-4fdc-8d56-fef29b4aab9c.640fd152-c783-42dd-abcd-411f7fe61c69 1G
Nov 03 18:42:06 devstack sudo[106247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:42:06 devstack sudo[106247]: pam_unix(sudo:session): session closed for user root
Nov 03 18:42:06 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-708f7b9b-35dc-481e-a2a5-2bca206bd5bd tempest-VolumeDependencyTests-64910899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-b962a7f4-d202-4fdc-8d56-fef29b4aab9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-b962a7f4-d202-4fdc-8d56-fef29b4aab9c.640fd152-c783-42dd-abcd-411f7fe61c69 1G" returned: 0 in 0.373s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:42:06 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-708f7b9b-35dc-481e-a2a5-2bca206bd5bd tempest-VolumeDependencyTests-64910899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b962a7f4-d202-4fdc-8d56-fef29b4aab9c -F qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-b962a7f4-d202-4fdc-8d56-fef29b4aab9c.640fd152-c783-42dd-abcd-411f7fe61c69 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:42:06 devstack sudo[106252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b962a7f4-d202-4fdc-8d56-fef29b4aab9c -F qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-b962a7f4-d202-4fdc-8d56-fef29b4aab9c.640fd152-c783-42dd-abcd-411f7fe61c69
Nov 03 18:42:06 devstack sudo[106252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:42:07 devstack sudo[106252]: pam_unix(sudo:session): session closed for user root
Nov 03 18:42:07 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-708f7b9b-35dc-481e-a2a5-2bca206bd5bd tempest-VolumeDependencyTests-64910899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b962a7f4-d202-4fdc-8d56-fef29b4aab9c -F qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-b962a7f4-d202-4fdc-8d56-fef29b4aab9c.640fd152-c783-42dd-abcd-411f7fe61c69" returned: 0 in 0.276s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:42:07 devstack cinder-volume[86120]: WARNING cinder.volume.drivers.remotefs [None req-708f7b9b-35dc-481e-a2a5-2bca206bd5bd tempest-VolumeDependencyTests-64910899 None] /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-b962a7f4-d202-4fdc-8d56-fef29b4aab9c.640fd152-c783-42dd-abcd-411f7fe61c69 is being set with open permissions: ugo+rw
Nov 03 18:42:07 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-708f7b9b-35dc-481e-a2a5-2bca206bd5bd tempest-VolumeDependencyTests-64910899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-b962a7f4-d202-4fdc-8d56-fef29b4aab9c.640fd152-c783-42dd-abcd-411f7fe61c69 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:42:07 devstack sudo[106257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-b962a7f4-d202-4fdc-8d56-fef29b4aab9c.640fd152-c783-42dd-abcd-411f7fe61c69
Nov 03 18:42:07 devstack sudo[106257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:42:07 devstack sudo[106257]: pam_unix(sudo:session): session closed for user root
Nov 03 18:42:07 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-708f7b9b-35dc-481e-a2a5-2bca206bd5bd tempest-VolumeDependencyTests-64910899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-b962a7f4-d202-4fdc-8d56-fef29b4aab9c.640fd152-c783-42dd-abcd-411f7fe61c69" returned: 0 in 0.231s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:42:07 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-708f7b9b-35dc-481e-a2a5-2bca206bd5bd tempest-VolumeDependencyTests-64910899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-b962a7f4-d202-4fdc-8d56-fef29b4aab9c.info {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:42:07 devstack sudo[106260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-b962a7f4-d202-4fdc-8d56-fef29b4aab9c.info
Nov 03 18:42:07 devstack sudo[106260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:42:07 devstack sudo[106260]: pam_unix(sudo:session): session closed for user root
Nov 03 18:42:07 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-708f7b9b-35dc-481e-a2a5-2bca206bd5bd tempest-VolumeDependencyTests-64910899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-b962a7f4-d202-4fdc-8d56-fef29b4aab9c.info" returned: 0 in 0.236s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:42:07 devstack cinder-volume[86120]: WARNING cinder.volume.drivers.remotefs [None req-708f7b9b-35dc-481e-a2a5-2bca206bd5bd tempest-VolumeDependencyTests-64910899 None] /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-b962a7f4-d202-4fdc-8d56-fef29b4aab9c.info is being set with open permissions: ugo+rw
Nov 03 18:42:07 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-708f7b9b-35dc-481e-a2a5-2bca206bd5bd tempest-VolumeDependencyTests-64910899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-b962a7f4-d202-4fdc-8d56-fef29b4aab9c.info {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:42:07 devstack sudo[106263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-b962a7f4-d202-4fdc-8d56-fef29b4aab9c.info
Nov 03 18:42:07 devstack sudo[106263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:42:07 devstack sudo[106263]: pam_unix(sudo:session): session closed for user root
Nov 03 18:42:07 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-708f7b9b-35dc-481e-a2a5-2bca206bd5bd tempest-VolumeDependencyTests-64910899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-b962a7f4-d202-4fdc-8d56-fef29b4aab9c.info" returned: 0 in 0.228s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:42:07 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-708f7b9b-35dc-481e-a2a5-2bca206bd5bd tempest-VolumeDependencyTests-64910899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.774s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:42:07 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-708f7b9b-35dc-481e-a2a5-2bca206bd5bd tempest-VolumeDependencyTests-64910899 None] Create snapshot completed successfully
Nov 03 18:42:08 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-234b7c17-9f9b-43d4-b1d7-1e1a02591644 tempest-VolumeDependencyTests-64910899 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:42:08 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-234b7c17-9f9b-43d4-b1d7-1e1a02591644 tempest-VolumeDependencyTests-64910899 None] Flow 'volume_create_manager' (3ddc97b3-b97b-477a-a414-9e1d78228a85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:42:08 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-234b7c17-9f9b-43d4-b1d7-1e1a02591644 tempest-VolumeDependencyTests-64910899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebd07c8c-d3b0-4a6f-b8d2-56731a66f554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:42:08 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-234b7c17-9f9b-43d4-b1d7-1e1a02591644 tempest-VolumeDependencyTests-64910899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebd07c8c-d3b0-4a6f-b8d2-56731a66f554) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:42:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-94086035',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e61cc6b7-b6d2-48b4-9ad4-31d7e469a8c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75e7e2ecab8f455b9258d87e7963a958',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:42:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=640fd152-c783-42dd-abcd-411f7fe61c69,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:42:09Z,use_quota=True,user_id='8b6b859832b24a3ea38f375cf5c10331',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:42:08 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-234b7c17-9f9b-43d4-b1d7-1e1a02591644 tempest-VolumeDependencyTests-64910899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99b43ced-e2fa-4e58-a727-5b197cbb5dc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:42:08 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-234b7c17-9f9b-43d4-b1d7-1e1a02591644 tempest-VolumeDependencyTests-64910899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99b43ced-e2fa-4e58-a727-5b197cbb5dc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:42:08 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-234b7c17-9f9b-43d4-b1d7-1e1a02591644 tempest-VolumeDependencyTests-64910899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1be0b581-a15b-4483-9680-ba68c6208768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:42:08 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-234b7c17-9f9b-43d4-b1d7-1e1a02591644 tempest-VolumeDependencyTests-64910899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1be0b581-a15b-4483-9680-ba68c6208768) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e61cc6b7-b6d2-48b4-9ad4-31d7e469a8c6', 'volume_name': 'volume-e61cc6b7-b6d2-48b4-9ad4-31d7e469a8c6', 'volume_size': 1, 'snapshot_id': '640fd152-c783-42dd-abcd-411f7fe61c69'}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:42:08 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-234b7c17-9f9b-43d4-b1d7-1e1a02591644 tempest-VolumeDependencyTests-64910899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (149ac5bc-a20c-4797-98c2-79786fd3a9a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:42:08 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-234b7c17-9f9b-43d4-b1d7-1e1a02591644 tempest-VolumeDependencyTests-64910899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (149ac5bc-a20c-4797-98c2-79786fd3a9a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:42:08 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-234b7c17-9f9b-43d4-b1d7-1e1a02591644 tempest-VolumeDependencyTests-64910899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a343dc6-7b32-4d68-b9d0-991d283f38e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:42:08 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-234b7c17-9f9b-43d4-b1d7-1e1a02591644 tempest-VolumeDependencyTests-64910899 None] Volume e61cc6b7-b6d2-48b4-9ad4-31d7e469a8c6: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e61cc6b7-b6d2-48b4-9ad4-31d7e469a8c6', 'volume_size': 1, 'snapshot_id': '640fd152-c783-42dd-abcd-411f7fe61c69'}
Nov 03 18:42:08 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-234b7c17-9f9b-43d4-b1d7-1e1a02591644 tempest-VolumeDependencyTests-64910899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:42:08 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-234b7c17-9f9b-43d4-b1d7-1e1a02591644 tempest-VolumeDependencyTests-64910899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:42:08 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-234b7c17-9f9b-43d4-b1d7-1e1a02591644 tempest-VolumeDependencyTests-64910899 None] Acquiring lock "cinder-quobyte-640fd152-c783-42dd-abcd-411f7fe61c69-e61cc6b7-b6d2-48b4-9ad4-31d7e469a8c6" by "_create_volume_from_snapshot" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:42:08 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-234b7c17-9f9b-43d4-b1d7-1e1a02591644 tempest-VolumeDependencyTests-64910899 None] Lock "cinder-quobyte-640fd152-c783-42dd-abcd-411f7fe61c69-e61cc6b7-b6d2-48b4-9ad4-31d7e469a8c6" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:42:08 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-234b7c17-9f9b-43d4-b1d7-1e1a02591644 tempest-VolumeDependencyTests-64910899 None] Creating volume e61cc6b7-b6d2-48b4-9ad4-31d7e469a8c6 from snapshot 640fd152-c783-42dd-abcd-411f7fe61c69 {{(pid=86120) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 03 18:42:08 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-234b7c17-9f9b-43d4-b1d7-1e1a02591644 tempest-VolumeDependencyTests-64910899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:42:08 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-234b7c17-9f9b-43d4-b1d7-1e1a02591644 tempest-VolumeDependencyTests-64910899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:42:08 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-234b7c17-9f9b-43d4-b1d7-1e1a02591644 tempest-VolumeDependencyTests-64910899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:42:08 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-234b7c17-9f9b-43d4-b1d7-1e1a02591644 tempest-VolumeDependencyTests-64910899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:42:08 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-234b7c17-9f9b-43d4-b1d7-1e1a02591644 tempest-VolumeDependencyTests-64910899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:42:08 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-234b7c17-9f9b-43d4-b1d7-1e1a02591644 tempest-VolumeDependencyTests-64910899 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:42:08 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-234b7c17-9f9b-43d4-b1d7-1e1a02591644 tempest-VolumeDependencyTests-64910899 None] Acquiring lock "cinder-quobyte-e61cc6b7-b6d2-48b4-9ad4-31d7e469a8c6" by "_copy_volume_from_snapshot" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:42:08 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-234b7c17-9f9b-43d4-b1d7-1e1a02591644 tempest-VolumeDependencyTests-64910899 None] Lock "cinder-quobyte-e61cc6b7-b6d2-48b4-9ad4-31d7e469a8c6" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:42:08 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-234b7c17-9f9b-43d4-b1d7-1e1a02591644 tempest-VolumeDependencyTests-64910899 None] snapshot: 640fd152-c783-42dd-abcd-411f7fe61c69, volume: e61cc6b7-b6d2-48b4-9ad4-31d7e469a8c6,  {{(pid=86120) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 03 18:42:08 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-234b7c17-9f9b-43d4-b1d7-1e1a02591644 tempest-VolumeDependencyTests-64910899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:42:08 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-234b7c17-9f9b-43d4-b1d7-1e1a02591644 tempest-VolumeDependencyTests-64910899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:42:08 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-234b7c17-9f9b-43d4-b1d7-1e1a02591644 tempest-VolumeDependencyTests-64910899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:42:08 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-234b7c17-9f9b-43d4-b1d7-1e1a02591644 tempest-VolumeDependencyTests-64910899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:42:08 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-234b7c17-9f9b-43d4-b1d7-1e1a02591644 tempest-VolumeDependencyTests-64910899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:42:08 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8018c9d-7f98-4e26-ae61-6061cad96ab6]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:42:08 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-234b7c17-9f9b-43d4-b1d7-1e1a02591644 tempest-VolumeDependencyTests-64910899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-b962a7f4-d202-4fdc-8d56-fef29b4aab9c.640fd152-c783-42dd-abcd-411f7fe61c69 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:42:09 devstack sudo[106267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-b962a7f4-d202-4fdc-8d56-fef29b4aab9c.640fd152-c783-42dd-abcd-411f7fe61c69
Nov 03 18:42:09 devstack sudo[106267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:42:09 devstack sudo[106267]: pam_unix(sudo:session): session closed for user root
Nov 03 18:42:09 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-234b7c17-9f9b-43d4-b1d7-1e1a02591644 tempest-VolumeDependencyTests-64910899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-b962a7f4-d202-4fdc-8d56-fef29b4aab9c.640fd152-c783-42dd-abcd-411f7fe61c69" returned: 0 in 0.351s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:42:09 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-234b7c17-9f9b-43d4-b1d7-1e1a02591644 tempest-VolumeDependencyTests-64910899 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b962a7f4-d202-4fdc-8d56-fef29b4aab9c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86120) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 18:42:09 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1ba6b5b-8388-4d84-8652-9a78185b89dd]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:42:09 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-234b7c17-9f9b-43d4-b1d7-1e1a02591644 tempest-VolumeDependencyTests-64910899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-b962a7f4-d202-4fdc-8d56-fef29b4aab9c {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:42:09 devstack sudo[106273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-b962a7f4-d202-4fdc-8d56-fef29b4aab9c
Nov 03 18:42:09 devstack sudo[106273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:42:09 devstack sudo[106273]: pam_unix(sudo:session): session closed for user root
Nov 03 18:42:09 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-234b7c17-9f9b-43d4-b1d7-1e1a02591644 tempest-VolumeDependencyTests-64910899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-b962a7f4-d202-4fdc-8d56-fef29b4aab9c" returned: 0 in 0.349s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:42:09 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-234b7c17-9f9b-43d4-b1d7-1e1a02591644 tempest-VolumeDependencyTests-64910899 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-b962a7f4-d202-4fdc-8d56-fef29b4aab9c {{(pid=86120) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 03 18:42:09 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-234b7c17-9f9b-43d4-b1d7-1e1a02591644 tempest-VolumeDependencyTests-64910899 None] Creating direct copy from snapshot {{(pid=86120) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 03 18:42:09 devstack cinder-volume[86120]: DEBUG cinder.utils [None req-234b7c17-9f9b-43d4-b1d7-1e1a02591644 tempest-VolumeDependencyTests-64910899 None] Path /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e61cc6b7-b6d2-48b4-9ad4-31d7e469a8c6 not found in is_blk_device check {{(pid=86120) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 03 18:42:09 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-234b7c17-9f9b-43d4-b1d7-1e1a02591644 tempest-VolumeDependencyTests-64910899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-b962a7f4-d202-4fdc-8d56-fef29b4aab9c /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e61cc6b7-b6d2-48b4-9ad4-31d7e469a8c6 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:42:09 devstack sudo[106279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-b962a7f4-d202-4fdc-8d56-fef29b4aab9c /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e61cc6b7-b6d2-48b4-9ad4-31d7e469a8c6
Nov 03 18:42:09 devstack sudo[106279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:42:14 devstack cinder-volume[86120]: DEBUG oslo_service.periodic_task [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86120) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 18:42:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:42:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:42:14 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:42:14 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:42:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:42:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:42:15 devstack sudo[106298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:42:15 devstack sudo[106298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:42:15 devstack sudo[106298]: pam_unix(sudo:session): session closed for user root
Nov 03 18:42:15 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.397s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:42:15 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:42:15 devstack cinder-volume[86120]: DEBUG oslo_service.periodic_task [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Running periodic task VolumeManager._thread_info {{(pid=86120) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 18:42:15 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] thread count: 28 {{(pid=86120) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 03 18:42:15 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] thread info: [<_MainThread(MainThread, started 134747145822336)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134747033686336)>, <Thread(Thread-3 (stat_writer), started daemon 134747030828736)>, <Thread(Rabbit-heartbeat, started daemon 134747035433408)>, <Thread(Thread-5 (_runner), started daemon 134747029587392)>, <Thread(Thread-7 (_runner), started daemon 134747029784256)>, <Thread(fd_logger, started daemon 134747027909120)>, <Thread(privsep_reader, started daemon 134747027006592)>, <Thread(tpool_thread_0, started daemon 134747018950336)>, <Thread(tpool_thread_1, started daemon 134747010541248)>, <Thread(tpool_thread_2, started daemon 134747002132160)>, <Thread(tpool_thread_3, started daemon 134746993723072)>, <Thread(tpool_thread_4, started daemon 134746985313984)>, <Thread(tpool_thread_5, started daemon 134746976904896)>, <Thread(tpool_thread_6, started daemon 134746968495808)>, <Thread(tpool_thread_7, started daemon 134746960086720)>, <Thread(tpool_thread_8, started daemon 134746951677632)>, <Thread(tpool_thread_9, started daemon 134746943268544)>, <Thread(tpool_thread_10, started daemon 134746934859456)>, <Thread(tpool_thread_11, started daemon 134746926450368)>, <Thread(tpool_thread_12, started daemon 134746918041280)>, <Thread(tpool_thread_13, started daemon 134746909632192)>, <Thread(tpool_thread_14, started daemon 134746901223104)>, <Thread(tpool_thread_15, started daemon 134746892814016)>, <Thread(tpool_thread_16, started daemon 134746884404928)>, <Thread(tpool_thread_17, started daemon 134746875995840)>, <Thread(tpool_thread_18, started daemon 134746867586752)>, <Thread(tpool_thread_19, started daemon 134746859177664)>] {{(pid=86120) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 03 18:42:15 devstack sudo[106279]: pam_unix(sudo:session): session closed for user root
Nov 03 18:42:15 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-234b7c17-9f9b-43d4-b1d7-1e1a02591644 tempest-VolumeDependencyTests-64910899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-b962a7f4-d202-4fdc-8d56-fef29b4aab9c /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e61cc6b7-b6d2-48b4-9ad4-31d7e469a8c6" returned: 0 in 5.815s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:42:15 devstack cinder-volume[86120]: DEBUG cinder.image.image_utils [None req-234b7c17-9f9b-43d4-b1d7-1e1a02591644 tempest-VolumeDependencyTests-64910899 None] Image conversion details: src /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-b962a7f4-d202-4fdc-8d56-fef29b4aab9c, size 1024.00 MB, duration 5.82 sec, destination /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e61cc6b7-b6d2-48b4-9ad4-31d7e469a8c6 {{(pid=86120) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 03 18:42:15 devstack cinder-volume[86120]: INFO cinder.image.image_utils [None req-234b7c17-9f9b-43d4-b1d7-1e1a02591644 tempest-VolumeDependencyTests-64910899 None] Converted 1024.00 MB image at 176.06 MB/s
Nov 03 18:42:15 devstack cinder-volume[86120]: WARNING cinder.volume.drivers.remotefs [None req-234b7c17-9f9b-43d4-b1d7-1e1a02591644 tempest-VolumeDependencyTests-64910899 None] /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e61cc6b7-b6d2-48b4-9ad4-31d7e469a8c6 is being set with open permissions: ugo+rw
Nov 03 18:42:15 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-234b7c17-9f9b-43d4-b1d7-1e1a02591644 tempest-VolumeDependencyTests-64910899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e61cc6b7-b6d2-48b4-9ad4-31d7e469a8c6 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:42:15 devstack sudo[106301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e61cc6b7-b6d2-48b4-9ad4-31d7e469a8c6
Nov 03 18:42:15 devstack sudo[106301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:42:15 devstack sudo[106301]: pam_unix(sudo:session): session closed for user root
Nov 03 18:42:15 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-234b7c17-9f9b-43d4-b1d7-1e1a02591644 tempest-VolumeDependencyTests-64910899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e61cc6b7-b6d2-48b4-9ad4-31d7e469a8c6" returned: 0 in 0.252s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:42:15 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-234b7c17-9f9b-43d4-b1d7-1e1a02591644 tempest-VolumeDependencyTests-64910899 None] Lock "cinder-quobyte-e61cc6b7-b6d2-48b4-9ad4-31d7e469a8c6" released by "_copy_volume_from_snapshot" :: held 6.847s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:42:15 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-234b7c17-9f9b-43d4-b1d7-1e1a02591644 tempest-VolumeDependencyTests-64910899 None] Lock "cinder-quobyte-640fd152-c783-42dd-abcd-411f7fe61c69-e61cc6b7-b6d2-48b4-9ad4-31d7e469a8c6" released by "_create_volume_from_snapshot" :: held 6.916s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:42:15 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-234b7c17-9f9b-43d4-b1d7-1e1a02591644 tempest-VolumeDependencyTests-64910899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.930s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:42:15 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-234b7c17-9f9b-43d4-b1d7-1e1a02591644 tempest-VolumeDependencyTests-64910899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a343dc6-7b32-4d68-b9d0-991d283f38e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e61cc6b7-b6d2-48b4-9ad4-31d7e469a8c6', 'volume_size': 1, 'snapshot_id': '640fd152-c783-42dd-abcd-411f7fe61c69'}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:42:15 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-234b7c17-9f9b-43d4-b1d7-1e1a02591644 tempest-VolumeDependencyTests-64910899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e0d37f6-1960-4bfc-9185-330574d83f81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:42:15 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-234b7c17-9f9b-43d4-b1d7-1e1a02591644 tempest-VolumeDependencyTests-64910899 None] Volume volume-e61cc6b7-b6d2-48b4-9ad4-31d7e469a8c6 (e61cc6b7-b6d2-48b4-9ad4-31d7e469a8c6): created successfully
Nov 03 18:42:15 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-234b7c17-9f9b-43d4-b1d7-1e1a02591644 tempest-VolumeDependencyTests-64910899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e0d37f6-1960-4bfc-9185-330574d83f81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:42:15 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-234b7c17-9f9b-43d4-b1d7-1e1a02591644 tempest-VolumeDependencyTests-64910899 None] Flow 'volume_create_manager' (3ddc97b3-b97b-477a-a414-9e1d78228a85) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:42:15 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-234b7c17-9f9b-43d4-b1d7-1e1a02591644 tempest-VolumeDependencyTests-64910899 None] Created volume successfully.
Nov 03 18:42:16 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-e178b307-89ee-4e8d-b38c-6744e4e517b9 tempest-VolumeDependencyTests-64910899 None] Acquiring lock "cinder-640fd152-c783-42dd-abcd-411f7fe61c69-delete_snapshot" by "delete_snapshot" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:42:16 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-e178b307-89ee-4e8d-b38c-6744e4e517b9 tempest-VolumeDependencyTests-64910899 None] Lock "cinder-640fd152-c783-42dd-abcd-411f7fe61c69-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:42:16 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-e178b307-89ee-4e8d-b38c-6744e4e517b9 tempest-VolumeDependencyTests-64910899 None] Acquiring lock "cinder-quobyte-b962a7f4-d202-4fdc-8d56-fef29b4aab9c" by "delete_snapshot" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:42:16 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-e178b307-89ee-4e8d-b38c-6744e4e517b9 tempest-VolumeDependencyTests-64910899 None] Lock "cinder-quobyte-b962a7f4-d202-4fdc-8d56-fef29b4aab9c" acquired by "delete_snapshot" :: waited 0.013s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:42:16 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-e178b307-89ee-4e8d-b38c-6744e4e517b9 tempest-VolumeDependencyTests-64910899 None] Acquiring lock "cinder-quobyte-640fd152-c783-42dd-abcd-411f7fe61c69" by "_delete_snapshot" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:42:16 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-e178b307-89ee-4e8d-b38c-6744e4e517b9 tempest-VolumeDependencyTests-64910899 None] Lock "cinder-quobyte-640fd152-c783-42dd-abcd-411f7fe61c69" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:42:16 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-e178b307-89ee-4e8d-b38c-6744e4e517b9 tempest-VolumeDependencyTests-64910899 None] Deleting offline snapshot 640fd152-c783-42dd-abcd-411f7fe61c69 of volume b962a7f4-d202-4fdc-8d56-fef29b4aab9c {{(pid=86120) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 18:42:16 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-e178b307-89ee-4e8d-b38c-6744e4e517b9 tempest-VolumeDependencyTests-64910899 None] snapshot_file for this snap is: volume-b962a7f4-d202-4fdc-8d56-fef29b4aab9c.640fd152-c783-42dd-abcd-411f7fe61c69 {{(pid=86120) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 18:42:16 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[208a3ee3-99c2-4527-bbf4-3f43d7f97984]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:42:16 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-e178b307-89ee-4e8d-b38c-6744e4e517b9 tempest-VolumeDependencyTests-64910899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-b962a7f4-d202-4fdc-8d56-fef29b4aab9c.640fd152-c783-42dd-abcd-411f7fe61c69 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:42:16 devstack sudo[106304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-b962a7f4-d202-4fdc-8d56-fef29b4aab9c.640fd152-c783-42dd-abcd-411f7fe61c69
Nov 03 18:42:16 devstack sudo[106304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:42:16 devstack sudo[106304]: pam_unix(sudo:session): session closed for user root
Nov 03 18:42:16 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-e178b307-89ee-4e8d-b38c-6744e4e517b9 tempest-VolumeDependencyTests-64910899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-b962a7f4-d202-4fdc-8d56-fef29b4aab9c.640fd152-c783-42dd-abcd-411f7fe61c69" returned: 0 in 0.345s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:42:16 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-e178b307-89ee-4e8d-b38c-6744e4e517b9 tempest-VolumeDependencyTests-64910899 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b962a7f4-d202-4fdc-8d56-fef29b4aab9c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86120) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 18:42:16 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fbfd233-36bc-4346-9ce6-494e4abe38bd]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:42:16 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-e178b307-89ee-4e8d-b38c-6744e4e517b9 tempest-VolumeDependencyTests-64910899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-b962a7f4-d202-4fdc-8d56-fef29b4aab9c {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:42:16 devstack sudo[106309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-b962a7f4-d202-4fdc-8d56-fef29b4aab9c
Nov 03 18:42:16 devstack sudo[106309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:42:17 devstack sudo[106309]: pam_unix(sudo:session): session closed for user root
Nov 03 18:42:17 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-e178b307-89ee-4e8d-b38c-6744e4e517b9 tempest-VolumeDependencyTests-64910899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-b962a7f4-d202-4fdc-8d56-fef29b4aab9c" returned: 0 in 0.533s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:42:17 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-e178b307-89ee-4e8d-b38c-6744e4e517b9 tempest-VolumeDependencyTests-64910899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-b962a7f4-d202-4fdc-8d56-fef29b4aab9c.640fd152-c783-42dd-abcd-411f7fe61c69 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:42:17 devstack sudo[106314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-b962a7f4-d202-4fdc-8d56-fef29b4aab9c.640fd152-c783-42dd-abcd-411f7fe61c69
Nov 03 18:42:17 devstack sudo[106314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:42:17 devstack sudo[106314]: pam_unix(sudo:session): session closed for user root
Nov 03 18:42:17 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-e178b307-89ee-4e8d-b38c-6744e4e517b9 tempest-VolumeDependencyTests-64910899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-b962a7f4-d202-4fdc-8d56-fef29b4aab9c.640fd152-c783-42dd-abcd-411f7fe61c69" returned: 0 in 0.327s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:42:17 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-e178b307-89ee-4e8d-b38c-6744e4e517b9 tempest-VolumeDependencyTests-64910899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-b962a7f4-d202-4fdc-8d56-fef29b4aab9c.640fd152-c783-42dd-abcd-411f7fe61c69 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:42:17 devstack sudo[106319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-b962a7f4-d202-4fdc-8d56-fef29b4aab9c.640fd152-c783-42dd-abcd-411f7fe61c69
Nov 03 18:42:17 devstack sudo[106319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:42:17 devstack sudo[106319]: pam_unix(sudo:session): session closed for user root
Nov 03 18:42:17 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-e178b307-89ee-4e8d-b38c-6744e4e517b9 tempest-VolumeDependencyTests-64910899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-b962a7f4-d202-4fdc-8d56-fef29b4aab9c.640fd152-c783-42dd-abcd-411f7fe61c69" returned: 0 in 0.242s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:42:17 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-e178b307-89ee-4e8d-b38c-6744e4e517b9 tempest-VolumeDependencyTests-64910899 None] Lock "cinder-quobyte-640fd152-c783-42dd-abcd-411f7fe61c69" released by "_delete_snapshot" :: held 1.547s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:42:17 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-e178b307-89ee-4e8d-b38c-6744e4e517b9 tempest-VolumeDependencyTests-64910899 None] Lock "cinder-quobyte-b962a7f4-d202-4fdc-8d56-fef29b4aab9c" released by "delete_snapshot" :: held 1.572s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:42:17 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-e178b307-89ee-4e8d-b38c-6744e4e517b9 tempest-VolumeDependencyTests-64910899 None] Created reservations ['00880a84-e951-49ad-9183-a8896235c27b', '00316496-7cd7-44ce-9924-47ffb89d8974', '10527f97-5d2c-43f2-bb1d-be158f2ae655', 'e620e76f-01a3-46cd-9be9-72da3ee7f215'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:42:17 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-e178b307-89ee-4e8d-b38c-6744e4e517b9 tempest-VolumeDependencyTests-64910899 None] Delete snapshot completed successfully.
Nov 03 18:42:17 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-e178b307-89ee-4e8d-b38c-6744e4e517b9 tempest-VolumeDependencyTests-64910899 None] Lock "cinder-640fd152-c783-42dd-abcd-411f7fe61c69-delete_snapshot" released by "delete_snapshot" :: held 1.688s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:42:18 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-7073ec5b-5d1e-4ece-885a-e5661e66a4e0 tempest-VolumeDependencyTests-64910899 None] Acquiring lock "cinder-b962a7f4-d202-4fdc-8d56-fef29b4aab9c-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:42:18 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-7073ec5b-5d1e-4ece-885a-e5661e66a4e0 tempest-VolumeDependencyTests-64910899 None] Lock "cinder-b962a7f4-d202-4fdc-8d56-fef29b4aab9c-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:42:18 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-7073ec5b-5d1e-4ece-885a-e5661e66a4e0 tempest-VolumeDependencyTests-64910899 None] Acquiring lock "cinder-quobyte-b962a7f4-d202-4fdc-8d56-fef29b4aab9c" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:42:18 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-7073ec5b-5d1e-4ece-885a-e5661e66a4e0 tempest-VolumeDependencyTests-64910899 None] Lock "cinder-quobyte-b962a7f4-d202-4fdc-8d56-fef29b4aab9c" acquired by "delete_volume" :: waited 0.017s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:42:18 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff968f9f-825d-4e03-8429-a7daa36ee78a]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:42:18 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-7073ec5b-5d1e-4ece-885a-e5661e66a4e0 tempest-VolumeDependencyTests-64910899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-b962a7f4-d202-4fdc-8d56-fef29b4aab9c {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:42:18 devstack sudo[106322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-b962a7f4-d202-4fdc-8d56-fef29b4aab9c
Nov 03 18:42:18 devstack sudo[106322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:42:18 devstack sudo[106322]: pam_unix(sudo:session): session closed for user root
Nov 03 18:42:18 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-7073ec5b-5d1e-4ece-885a-e5661e66a4e0 tempest-VolumeDependencyTests-64910899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-b962a7f4-d202-4fdc-8d56-fef29b4aab9c" returned: 0 in 0.349s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:42:18 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-7073ec5b-5d1e-4ece-885a-e5661e66a4e0 tempest-VolumeDependencyTests-64910899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-b962a7f4-d202-4fdc-8d56-fef29b4aab9c {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:42:18 devstack sudo[106327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-b962a7f4-d202-4fdc-8d56-fef29b4aab9c
Nov 03 18:42:18 devstack sudo[106327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:42:19 devstack sudo[106327]: pam_unix(sudo:session): session closed for user root
Nov 03 18:42:19 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-7073ec5b-5d1e-4ece-885a-e5661e66a4e0 tempest-VolumeDependencyTests-64910899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-b962a7f4-d202-4fdc-8d56-fef29b4aab9c" returned: 0 in 0.240s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:42:19 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-7073ec5b-5d1e-4ece-885a-e5661e66a4e0 tempest-VolumeDependencyTests-64910899 None] Lock "cinder-quobyte-b962a7f4-d202-4fdc-8d56-fef29b4aab9c" released by "delete_volume" :: held 0.650s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:42:19 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-7073ec5b-5d1e-4ece-885a-e5661e66a4e0 tempest-VolumeDependencyTests-64910899 None] Created reservations ['bf6b0420-6546-4c53-857e-10d5ae347f98', '95d9d6f9-d001-49df-a21b-ae8e700e7529', 'c58a1eb6-1e90-4dc0-8bdb-54b1ce86e815', '27023481-ed9d-4400-b238-5cce0b92b375'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:42:19 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-7073ec5b-5d1e-4ece-885a-e5661e66a4e0 tempest-VolumeDependencyTests-64910899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:42:19 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-7073ec5b-5d1e-4ece-885a-e5661e66a4e0 tempest-VolumeDependencyTests-64910899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:42:19 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-7073ec5b-5d1e-4ece-885a-e5661e66a4e0 tempest-VolumeDependencyTests-64910899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:42:19 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-7073ec5b-5d1e-4ece-885a-e5661e66a4e0 tempest-VolumeDependencyTests-64910899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:42:19 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-7073ec5b-5d1e-4ece-885a-e5661e66a4e0 tempest-VolumeDependencyTests-64910899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:42:19 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-7073ec5b-5d1e-4ece-885a-e5661e66a4e0 tempest-VolumeDependencyTests-64910899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:42:19 devstack sudo[106330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:42:19 devstack sudo[106330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:42:19 devstack sudo[106330]: pam_unix(sudo:session): session closed for user root
Nov 03 18:42:19 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-7073ec5b-5d1e-4ece-885a-e5661e66a4e0 tempest-VolumeDependencyTests-64910899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.249s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:42:19 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-7073ec5b-5d1e-4ece-885a-e5661e66a4e0 tempest-VolumeDependencyTests-64910899 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:42:19 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-7073ec5b-5d1e-4ece-885a-e5661e66a4e0 tempest-VolumeDependencyTests-64910899 None] Deleted volume successfully.
Nov 03 18:42:19 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-7073ec5b-5d1e-4ece-885a-e5661e66a4e0 tempest-VolumeDependencyTests-64910899 None] Lock "cinder-b962a7f4-d202-4fdc-8d56-fef29b4aab9c-delete_volume" released by "delete_volume" :: held 1.095s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:42:19 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-bbf9744b-81a3-402d-adb4-5dc3e11a4c83 tempest-VolumeDependencyTests-64910899 None] Acquiring lock "cinder-e61cc6b7-b6d2-48b4-9ad4-31d7e469a8c6-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:42:19 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-bbf9744b-81a3-402d-adb4-5dc3e11a4c83 tempest-VolumeDependencyTests-64910899 None] Lock "cinder-e61cc6b7-b6d2-48b4-9ad4-31d7e469a8c6-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:42:19 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-bbf9744b-81a3-402d-adb4-5dc3e11a4c83 tempest-VolumeDependencyTests-64910899 None] Acquiring lock "cinder-quobyte-e61cc6b7-b6d2-48b4-9ad4-31d7e469a8c6" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:42:19 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-bbf9744b-81a3-402d-adb4-5dc3e11a4c83 tempest-VolumeDependencyTests-64910899 None] Lock "cinder-quobyte-e61cc6b7-b6d2-48b4-9ad4-31d7e469a8c6" acquired by "delete_volume" :: waited 0.014s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:42:19 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b659705-43ef-4b06-9ccc-01ec1b588994]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:42:19 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-bbf9744b-81a3-402d-adb4-5dc3e11a4c83 tempest-VolumeDependencyTests-64910899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e61cc6b7-b6d2-48b4-9ad4-31d7e469a8c6 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:42:19 devstack sudo[106334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e61cc6b7-b6d2-48b4-9ad4-31d7e469a8c6
Nov 03 18:42:19 devstack sudo[106334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:42:20 devstack sudo[106334]: pam_unix(sudo:session): session closed for user root
Nov 03 18:42:20 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-bbf9744b-81a3-402d-adb4-5dc3e11a4c83 tempest-VolumeDependencyTests-64910899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e61cc6b7-b6d2-48b4-9ad4-31d7e469a8c6" returned: 0 in 0.360s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:42:20 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-bbf9744b-81a3-402d-adb4-5dc3e11a4c83 tempest-VolumeDependencyTests-64910899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e61cc6b7-b6d2-48b4-9ad4-31d7e469a8c6 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:42:20 devstack sudo[106339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e61cc6b7-b6d2-48b4-9ad4-31d7e469a8c6
Nov 03 18:42:20 devstack sudo[106339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:42:20 devstack sudo[106339]: pam_unix(sudo:session): session closed for user root
Nov 03 18:42:20 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-bbf9744b-81a3-402d-adb4-5dc3e11a4c83 tempest-VolumeDependencyTests-64910899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-e61cc6b7-b6d2-48b4-9ad4-31d7e469a8c6" returned: 0 in 0.244s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:42:20 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-bbf9744b-81a3-402d-adb4-5dc3e11a4c83 tempest-VolumeDependencyTests-64910899 None] Lock "cinder-quobyte-e61cc6b7-b6d2-48b4-9ad4-31d7e469a8c6" released by "delete_volume" :: held 0.645s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:42:20 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-bbf9744b-81a3-402d-adb4-5dc3e11a4c83 tempest-VolumeDependencyTests-64910899 None] Created reservations ['21b0561e-c10f-4e4f-855b-1dd8e83aab99', '51afbe56-3c1c-462f-aed8-8b38caed204a', 'd9952c5a-09bd-4b03-be3a-7bc27cdff2a8', 'bcf7d8a0-e69f-47e4-a5f1-eb42c416188c'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:42:20 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-bbf9744b-81a3-402d-adb4-5dc3e11a4c83 tempest-VolumeDependencyTests-64910899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:42:20 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-bbf9744b-81a3-402d-adb4-5dc3e11a4c83 tempest-VolumeDependencyTests-64910899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:42:20 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-bbf9744b-81a3-402d-adb4-5dc3e11a4c83 tempest-VolumeDependencyTests-64910899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:42:20 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-bbf9744b-81a3-402d-adb4-5dc3e11a4c83 tempest-VolumeDependencyTests-64910899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:42:20 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-bbf9744b-81a3-402d-adb4-5dc3e11a4c83 tempest-VolumeDependencyTests-64910899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:42:20 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-bbf9744b-81a3-402d-adb4-5dc3e11a4c83 tempest-VolumeDependencyTests-64910899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:42:20 devstack sudo[106342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:42:20 devstack sudo[106342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:42:20 devstack sudo[106342]: pam_unix(sudo:session): session closed for user root
Nov 03 18:42:20 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-bbf9744b-81a3-402d-adb4-5dc3e11a4c83 tempest-VolumeDependencyTests-64910899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.248s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:42:20 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-bbf9744b-81a3-402d-adb4-5dc3e11a4c83 tempest-VolumeDependencyTests-64910899 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:42:20 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-bbf9744b-81a3-402d-adb4-5dc3e11a4c83 tempest-VolumeDependencyTests-64910899 None] Deleted volume successfully.
Nov 03 18:42:20 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-bbf9744b-81a3-402d-adb4-5dc3e11a4c83 tempest-VolumeDependencyTests-64910899 None] Lock "cinder-e61cc6b7-b6d2-48b4-9ad4-31d7e469a8c6-delete_volume" released by "delete_volume" :: held 1.089s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:42:30 devstack cinder-volume[86120]: DEBUG dbcounter [-] [86120] Writing DB stats cinder:SELECT=41,cinder:INSERT=20,cinder:UPDATE=53,cinder:DELETE=4 {{(pid=86120) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 18:42:30 devstack cinder-volume[86120]: DEBUG dbcounter [-] [86120] Writing DB stats cinder:SELECT=47,cinder:UPDATE=47,cinder:INSERT=14,cinder:DELETE=4 {{(pid=86120) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 18:42:41 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-d843f253-f471-48ef-a61f-eb023766da7a tempest-VolumeDependencyTests-1180853825 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:42:41 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-d843f253-f471-48ef-a61f-eb023766da7a tempest-VolumeDependencyTests-1180853825 None] Flow 'volume_create_manager' (1c482c23-992e-4e52-9347-f37f91ee7d1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:42:41 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-d843f253-f471-48ef-a61f-eb023766da7a tempest-VolumeDependencyTests-1180853825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2add0ac-c0c7-410b-8957-faa37f8ec45b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:42:41 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-427b9d91-4f81-46d7-a90c-e936aaa6ce67 tempest-CreateVolumesFromImageTest-52926536 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:42:41 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-427b9d91-4f81-46d7-a90c-e936aaa6ce67 tempest-CreateVolumesFromImageTest-52926536 None] Flow 'volume_create_manager' (104c5805-5beb-45ea-8ca7-d5d681e8cb94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:42:41 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-427b9d91-4f81-46d7-a90c-e936aaa6ce67 tempest-CreateVolumesFromImageTest-52926536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e028755-5202-4e29-a4dc-95c92deb77e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:42:41 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-d843f253-f471-48ef-a61f-eb023766da7a tempest-VolumeDependencyTests-1180853825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2add0ac-c0c7-410b-8957-faa37f8ec45b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:42:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1183437867',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50f2588d-fbda-417a-a67f-0b7e6a294e3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23b7da727b1d42ce83f063565ef2f42e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:42:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:42:41Z,use_quota=True,user_id='8df0db0d5ef749c097672c73fee66eac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:42:41 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-d843f253-f471-48ef-a61f-eb023766da7a tempest-VolumeDependencyTests-1180853825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (615fab8a-8fa9-49df-a9fc-19cdc045ad09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:42:41 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-d843f253-f471-48ef-a61f-eb023766da7a tempest-VolumeDependencyTests-1180853825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (615fab8a-8fa9-49df-a9fc-19cdc045ad09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:42:41 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-d843f253-f471-48ef-a61f-eb023766da7a tempest-VolumeDependencyTests-1180853825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae428184-bf10-409c-af87-939970a01e39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:42:41 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-d843f253-f471-48ef-a61f-eb023766da7a tempest-VolumeDependencyTests-1180853825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae428184-bf10-409c-af87-939970a01e39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50f2588d-fbda-417a-a67f-0b7e6a294e3d', 'volume_name': 'volume-50f2588d-fbda-417a-a67f-0b7e6a294e3d', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:42:41 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-d843f253-f471-48ef-a61f-eb023766da7a tempest-VolumeDependencyTests-1180853825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aca0f3e5-4e93-4448-b037-48b433486605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:42:41 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-d843f253-f471-48ef-a61f-eb023766da7a tempest-VolumeDependencyTests-1180853825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aca0f3e5-4e93-4448-b037-48b433486605) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:42:41 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-d843f253-f471-48ef-a61f-eb023766da7a tempest-VolumeDependencyTests-1180853825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (121c7d47-1401-4ddc-a59a-b9f6a8260b88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:42:41 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-d843f253-f471-48ef-a61f-eb023766da7a tempest-VolumeDependencyTests-1180853825 None] Volume 50f2588d-fbda-417a-a67f-0b7e6a294e3d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50f2588d-fbda-417a-a67f-0b7e6a294e3d', 'volume_size': 1}
Nov 03 18:42:41 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-d843f253-f471-48ef-a61f-eb023766da7a tempest-VolumeDependencyTests-1180853825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:42:41 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-d843f253-f471-48ef-a61f-eb023766da7a tempest-VolumeDependencyTests-1180853825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:42:41 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-d843f253-f471-48ef-a61f-eb023766da7a tempest-VolumeDependencyTests-1180853825 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:42:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1183437867',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50f2588d-fbda-417a-a67f-0b7e6a294e3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23b7da727b1d42ce83f063565ef2f42e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:42:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:42:41Z,use_quota=True,user_id='8df0db0d5ef749c097672c73fee66eac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:42:41 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-d843f253-f471-48ef-a61f-eb023766da7a tempest-VolumeDependencyTests-1180853825 None] Creating volume 50f2588d-fbda-417a-a67f-0b7e6a294e3d {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:42:41 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-d843f253-f471-48ef-a61f-eb023766da7a tempest-VolumeDependencyTests-1180853825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:42:41 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-d843f253-f471-48ef-a61f-eb023766da7a tempest-VolumeDependencyTests-1180853825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:42:41 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-d843f253-f471-48ef-a61f-eb023766da7a tempest-VolumeDependencyTests-1180853825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:42:41 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-d843f253-f471-48ef-a61f-eb023766da7a tempest-VolumeDependencyTests-1180853825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:42:41 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-d843f253-f471-48ef-a61f-eb023766da7a tempest-VolumeDependencyTests-1180853825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:42:41 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-d843f253-f471-48ef-a61f-eb023766da7a tempest-VolumeDependencyTests-1180853825 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:42:41 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-d843f253-f471-48ef-a61f-eb023766da7a tempest-VolumeDependencyTests-1180853825 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:42:41 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-d843f253-f471-48ef-a61f-eb023766da7a tempest-VolumeDependencyTests-1180853825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-50f2588d-fbda-417a-a67f-0b7e6a294e3d 1073741824 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:42:41 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-427b9d91-4f81-46d7-a90c-e936aaa6ce67 tempest-CreateVolumesFromImageTest-52926536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e028755-5202-4e29-a4dc-95c92deb77e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:42:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-868873839',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fce4ea3-1bc6-422b-9654-9b571973f5b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b40834fc3b94e69b7e982ab9a49bbc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:42:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:42:41Z,use_quota=True,user_id='f22cfead44ef4634905c276429b8a089',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:42:41 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-427b9d91-4f81-46d7-a90c-e936aaa6ce67 tempest-CreateVolumesFromImageTest-52926536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea01126f-16b2-4764-89fb-2dd35dc723d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:42:41 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-427b9d91-4f81-46d7-a90c-e936aaa6ce67 tempest-CreateVolumesFromImageTest-52926536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea01126f-16b2-4764-89fb-2dd35dc723d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:42:41 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-427b9d91-4f81-46d7-a90c-e936aaa6ce67 tempest-CreateVolumesFromImageTest-52926536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3968c8c2-d027-4fbc-bfc4-075b17b26549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:42:41 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-427b9d91-4f81-46d7-a90c-e936aaa6ce67 tempest-CreateVolumesFromImageTest-52926536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3968c8c2-d027-4fbc-bfc4-075b17b26549) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8fce4ea3-1bc6-422b-9654-9b571973f5b4', 'volume_name': 'volume-8fce4ea3-1bc6-422b-9654-9b571973f5b4', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:42:41 devstack sudo[106424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-50f2588d-fbda-417a-a67f-0b7e6a294e3d 1073741824
Nov 03 18:42:41 devstack sudo[106424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:42:41 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-427b9d91-4f81-46d7-a90c-e936aaa6ce67 tempest-CreateVolumesFromImageTest-52926536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2978ac6-0362-46e8-8ab3-1830bcda0c05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:42:41 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-427b9d91-4f81-46d7-a90c-e936aaa6ce67 tempest-CreateVolumesFromImageTest-52926536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2978ac6-0362-46e8-8ab3-1830bcda0c05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:42:41 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-427b9d91-4f81-46d7-a90c-e936aaa6ce67 tempest-CreateVolumesFromImageTest-52926536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54f6f3d8-8bf9-4f7d-948f-068509bb6ad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:42:41 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-427b9d91-4f81-46d7-a90c-e936aaa6ce67 tempest-CreateVolumesFromImageTest-52926536 None] Volume 8fce4ea3-1bc6-422b-9654-9b571973f5b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8fce4ea3-1bc6-422b-9654-9b571973f5b4', 'volume_size': 1}
Nov 03 18:42:41 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-427b9d91-4f81-46d7-a90c-e936aaa6ce67 tempest-CreateVolumesFromImageTest-52926536 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:42:41 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-43b31915-a913-46f7-9f2f-9bfdc92ea15f tempest-CreateVolumesFromImageTest-52926536 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:42:41 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-43b31915-a913-46f7-9f2f-9bfdc92ea15f tempest-CreateVolumesFromImageTest-52926536 None] Flow 'volume_create_manager' (fff57cec-4217-45be-88ff-0e12644110ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:42:41 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-43b31915-a913-46f7-9f2f-9bfdc92ea15f tempest-CreateVolumesFromImageTest-52926536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f65b919f-61fe-4e2a-94f9-a5c8bac66e26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:42:41 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-43b31915-a913-46f7-9f2f-9bfdc92ea15f tempest-CreateVolumesFromImageTest-52926536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f65b919f-61fe-4e2a-94f9-a5c8bac66e26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:42:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-965346994',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b92c2915-b133-4e70-86f4-74e9fc084f5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b40834fc3b94e69b7e982ab9a49bbc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:42:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:42:42Z,use_quota=True,user_id='f22cfead44ef4634905c276429b8a089',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:42:41 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-43b31915-a913-46f7-9f2f-9bfdc92ea15f tempest-CreateVolumesFromImageTest-52926536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77c59e49-54be-44d9-987d-e21ac3889aa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:42:41 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-43b31915-a913-46f7-9f2f-9bfdc92ea15f tempest-CreateVolumesFromImageTest-52926536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77c59e49-54be-44d9-987d-e21ac3889aa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:42:41 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-43b31915-a913-46f7-9f2f-9bfdc92ea15f tempest-CreateVolumesFromImageTest-52926536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbbde8e2-9458-4256-984e-5eadc8fd68b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:42:41 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-43b31915-a913-46f7-9f2f-9bfdc92ea15f tempest-CreateVolumesFromImageTest-52926536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbbde8e2-9458-4256-984e-5eadc8fd68b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b92c2915-b133-4e70-86f4-74e9fc084f5a', 'volume_name': 'volume-b92c2915-b133-4e70-86f4-74e9fc084f5a', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:42:41 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-43b31915-a913-46f7-9f2f-9bfdc92ea15f tempest-CreateVolumesFromImageTest-52926536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99916330-609a-4de6-abd5-be3935a6f440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:42:41 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-43b31915-a913-46f7-9f2f-9bfdc92ea15f tempest-CreateVolumesFromImageTest-52926536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99916330-609a-4de6-abd5-be3935a6f440) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:42:41 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-43b31915-a913-46f7-9f2f-9bfdc92ea15f tempest-CreateVolumesFromImageTest-52926536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa94b39a-4cd7-47e5-b117-84669d78b334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:42:41 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-43b31915-a913-46f7-9f2f-9bfdc92ea15f tempest-CreateVolumesFromImageTest-52926536 None] Volume b92c2915-b133-4e70-86f4-74e9fc084f5a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b92c2915-b133-4e70-86f4-74e9fc084f5a', 'volume_size': 1}
Nov 03 18:42:41 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-43b31915-a913-46f7-9f2f-9bfdc92ea15f tempest-CreateVolumesFromImageTest-52926536 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:42:42 devstack sudo[106424]: pam_unix(sudo:session): session closed for user root
Nov 03 18:42:42 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-d843f253-f471-48ef-a61f-eb023766da7a tempest-VolumeDependencyTests-1180853825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-50f2588d-fbda-417a-a67f-0b7e6a294e3d 1073741824" returned: 0 in 0.644s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:42:42 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-e152b7ee-b43b-49f6-a2a4-f92028abc53c tempest-CreateVolumesFromImageTest-52926536 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:42:42 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-e152b7ee-b43b-49f6-a2a4-f92028abc53c tempest-CreateVolumesFromImageTest-52926536 None] Flow 'volume_create_manager' (11778ad3-5dca-4077-aec6-10095c6c27f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:42:42 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-e152b7ee-b43b-49f6-a2a4-f92028abc53c tempest-CreateVolumesFromImageTest-52926536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c464911c-2805-40d5-b869-4145d9d0aa8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:42:42 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-d843f253-f471-48ef-a61f-eb023766da7a tempest-VolumeDependencyTests-1180853825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-50f2588d-fbda-417a-a67f-0b7e6a294e3d {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:42:42 devstack sudo[106430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-50f2588d-fbda-417a-a67f-0b7e6a294e3d
Nov 03 18:42:42 devstack sudo[106430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:42:42 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-e152b7ee-b43b-49f6-a2a4-f92028abc53c tempest-CreateVolumesFromImageTest-52926536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c464911c-2805-40d5-b869-4145d9d0aa8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:42:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-840411111',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=763de466-e29d-46b7-b981-974c1b1f3f78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b40834fc3b94e69b7e982ab9a49bbc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:42:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:42:42Z,use_quota=True,user_id='f22cfead44ef4634905c276429b8a089',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:42:42 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-e152b7ee-b43b-49f6-a2a4-f92028abc53c tempest-CreateVolumesFromImageTest-52926536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a0a8054-4752-42cb-a48b-053988b11129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:42:42 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-e152b7ee-b43b-49f6-a2a4-f92028abc53c tempest-CreateVolumesFromImageTest-52926536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a0a8054-4752-42cb-a48b-053988b11129) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:42:42 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-e152b7ee-b43b-49f6-a2a4-f92028abc53c tempest-CreateVolumesFromImageTest-52926536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba7f319c-cdef-4884-8cb6-88b97968c2d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:42:42 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-e152b7ee-b43b-49f6-a2a4-f92028abc53c tempest-CreateVolumesFromImageTest-52926536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba7f319c-cdef-4884-8cb6-88b97968c2d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '763de466-e29d-46b7-b981-974c1b1f3f78', 'volume_name': 'volume-763de466-e29d-46b7-b981-974c1b1f3f78', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:42:42 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-e152b7ee-b43b-49f6-a2a4-f92028abc53c tempest-CreateVolumesFromImageTest-52926536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6eab0311-69bc-43ef-a0db-3f60a58c7e46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:42:42 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-e152b7ee-b43b-49f6-a2a4-f92028abc53c tempest-CreateVolumesFromImageTest-52926536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6eab0311-69bc-43ef-a0db-3f60a58c7e46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:42:42 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-e152b7ee-b43b-49f6-a2a4-f92028abc53c tempest-CreateVolumesFromImageTest-52926536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fd32e9c-0765-438f-8b03-c1009c18189c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:42:42 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-e152b7ee-b43b-49f6-a2a4-f92028abc53c tempest-CreateVolumesFromImageTest-52926536 None] Volume 763de466-e29d-46b7-b981-974c1b1f3f78: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-763de466-e29d-46b7-b981-974c1b1f3f78', 'volume_size': 1}
Nov 03 18:42:42 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-e152b7ee-b43b-49f6-a2a4-f92028abc53c tempest-CreateVolumesFromImageTest-52926536 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:42:42 devstack sudo[106430]: pam_unix(sudo:session): session closed for user root
Nov 03 18:42:42 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-d843f253-f471-48ef-a61f-eb023766da7a tempest-VolumeDependencyTests-1180853825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-50f2588d-fbda-417a-a67f-0b7e6a294e3d" returned: 0 in 0.325s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:42:42 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-d843f253-f471-48ef-a61f-eb023766da7a tempest-VolumeDependencyTests-1180853825 None] <== create_volume: return (1082ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:42:42 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-d843f253-f471-48ef-a61f-eb023766da7a tempest-VolumeDependencyTests-1180853825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.091s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:42:42 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-427b9d91-4f81-46d7-a90c-e936aaa6ce67 tempest-CreateVolumesFromImageTest-52926536 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.976s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:42:42 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-427b9d91-4f81-46d7-a90c-e936aaa6ce67 tempest-CreateVolumesFromImageTest-52926536 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:42:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-868873839',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fce4ea3-1bc6-422b-9654-9b571973f5b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b40834fc3b94e69b7e982ab9a49bbc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:42:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:42:41Z,use_quota=True,user_id='f22cfead44ef4634905c276429b8a089',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:42:42 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-427b9d91-4f81-46d7-a90c-e936aaa6ce67 tempest-CreateVolumesFromImageTest-52926536 None] Creating volume 8fce4ea3-1bc6-422b-9654-9b571973f5b4 {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:42:42 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-427b9d91-4f81-46d7-a90c-e936aaa6ce67 tempest-CreateVolumesFromImageTest-52926536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:42:42 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-427b9d91-4f81-46d7-a90c-e936aaa6ce67 tempest-CreateVolumesFromImageTest-52926536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:42:42 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-427b9d91-4f81-46d7-a90c-e936aaa6ce67 tempest-CreateVolumesFromImageTest-52926536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:42:42 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-427b9d91-4f81-46d7-a90c-e936aaa6ce67 tempest-CreateVolumesFromImageTest-52926536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:42:42 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-427b9d91-4f81-46d7-a90c-e936aaa6ce67 tempest-CreateVolumesFromImageTest-52926536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:42:42 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-427b9d91-4f81-46d7-a90c-e936aaa6ce67 tempest-CreateVolumesFromImageTest-52926536 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:42:42 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-427b9d91-4f81-46d7-a90c-e936aaa6ce67 tempest-CreateVolumesFromImageTest-52926536 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:42:42 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-427b9d91-4f81-46d7-a90c-e936aaa6ce67 tempest-CreateVolumesFromImageTest-52926536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8fce4ea3-1bc6-422b-9654-9b571973f5b4 1073741824 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:42:42 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-d843f253-f471-48ef-a61f-eb023766da7a tempest-VolumeDependencyTests-1180853825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (121c7d47-1401-4ddc-a59a-b9f6a8260b88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50f2588d-fbda-417a-a67f-0b7e6a294e3d', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:42:42 devstack sudo[106433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8fce4ea3-1bc6-422b-9654-9b571973f5b4 1073741824
Nov 03 18:42:42 devstack sudo[106433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:42:42 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-d843f253-f471-48ef-a61f-eb023766da7a tempest-VolumeDependencyTests-1180853825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b57050f7-c260-40e8-be57-5ee3c0739e48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:42:42 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-d843f253-f471-48ef-a61f-eb023766da7a tempest-VolumeDependencyTests-1180853825 None] Volume volume-50f2588d-fbda-417a-a67f-0b7e6a294e3d (50f2588d-fbda-417a-a67f-0b7e6a294e3d): created successfully
Nov 03 18:42:42 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-d843f253-f471-48ef-a61f-eb023766da7a tempest-VolumeDependencyTests-1180853825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b57050f7-c260-40e8-be57-5ee3c0739e48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:42:42 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-d843f253-f471-48ef-a61f-eb023766da7a tempest-VolumeDependencyTests-1180853825 None] Flow 'volume_create_manager' (1c482c23-992e-4e52-9347-f37f91ee7d1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:42:42 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-d843f253-f471-48ef-a61f-eb023766da7a tempest-VolumeDependencyTests-1180853825 None] Created volume successfully.
Nov 03 18:42:42 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-beb59c02-528d-4580-a9b0-2494aebfa18f tempest-CreateVolumesFromImageTest-52926536 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:42:42 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-beb59c02-528d-4580-a9b0-2494aebfa18f tempest-CreateVolumesFromImageTest-52926536 None] Flow 'volume_create_manager' (04a2e9da-aae6-4a3b-ac78-43f49d55995f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:42:42 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-beb59c02-528d-4580-a9b0-2494aebfa18f tempest-CreateVolumesFromImageTest-52926536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (449eeb76-6a1d-4860-b638-12c10a0d251a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:42:42 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-beb59c02-528d-4580-a9b0-2494aebfa18f tempest-CreateVolumesFromImageTest-52926536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (449eeb76-6a1d-4860-b638-12c10a0d251a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:42:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-346796559',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a589b19c-e32f-4494-97e7-13c899670bd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b40834fc3b94e69b7e982ab9a49bbc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:42:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:42:43Z,use_quota=True,user_id='f22cfead44ef4634905c276429b8a089',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:42:42 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-beb59c02-528d-4580-a9b0-2494aebfa18f tempest-CreateVolumesFromImageTest-52926536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a5fc2f9-7bd5-4d35-8c36-efa93c739298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:42:42 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-beb59c02-528d-4580-a9b0-2494aebfa18f tempest-CreateVolumesFromImageTest-52926536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a5fc2f9-7bd5-4d35-8c36-efa93c739298) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:42:42 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-beb59c02-528d-4580-a9b0-2494aebfa18f tempest-CreateVolumesFromImageTest-52926536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2ae78f5-505f-4798-954e-a4e22e3d7056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:42:42 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-beb59c02-528d-4580-a9b0-2494aebfa18f tempest-CreateVolumesFromImageTest-52926536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2ae78f5-505f-4798-954e-a4e22e3d7056) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a589b19c-e32f-4494-97e7-13c899670bd0', 'volume_name': 'volume-a589b19c-e32f-4494-97e7-13c899670bd0', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:42:42 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-beb59c02-528d-4580-a9b0-2494aebfa18f tempest-CreateVolumesFromImageTest-52926536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c35c919-8ec1-4c78-b75a-9bb8ae95eb34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:42:42 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-beb59c02-528d-4580-a9b0-2494aebfa18f tempest-CreateVolumesFromImageTest-52926536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c35c919-8ec1-4c78-b75a-9bb8ae95eb34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:42:42 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-beb59c02-528d-4580-a9b0-2494aebfa18f tempest-CreateVolumesFromImageTest-52926536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ce4c803-a633-4e51-a9bd-3c896fa23ef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:42:42 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-beb59c02-528d-4580-a9b0-2494aebfa18f tempest-CreateVolumesFromImageTest-52926536 None] Volume a589b19c-e32f-4494-97e7-13c899670bd0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a589b19c-e32f-4494-97e7-13c899670bd0', 'volume_size': 1}
Nov 03 18:42:42 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-beb59c02-528d-4580-a9b0-2494aebfa18f tempest-CreateVolumesFromImageTest-52926536 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:42:43 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e929b68-acdb-4afa-b7ce-76eb3f057624 tempest-CreateVolumesFromImageTest-52926536 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:42:43 devstack sudo[106433]: pam_unix(sudo:session): session closed for user root
Nov 03 18:42:43 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-2e929b68-acdb-4afa-b7ce-76eb3f057624 tempest-CreateVolumesFromImageTest-52926536 None] Flow 'volume_create_manager' (6f709f47-ed1e-4c85-85c4-041c1c3cf82c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:42:43 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-2e929b68-acdb-4afa-b7ce-76eb3f057624 tempest-CreateVolumesFromImageTest-52926536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b39d4dbe-6ceb-4dc7-93ad-5b99500f8189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:42:43 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-427b9d91-4f81-46d7-a90c-e936aaa6ce67 tempest-CreateVolumesFromImageTest-52926536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8fce4ea3-1bc6-422b-9654-9b571973f5b4 1073741824" returned: 0 in 0.834s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:42:43 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-2e929b68-acdb-4afa-b7ce-76eb3f057624 tempest-CreateVolumesFromImageTest-52926536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b39d4dbe-6ceb-4dc7-93ad-5b99500f8189) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:42:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-154789043',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ef43b40-4660-4939-8f77-e366abbca90c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b40834fc3b94e69b7e982ab9a49bbc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:42:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:42:43Z,use_quota=True,user_id='f22cfead44ef4634905c276429b8a089',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:42:43 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-2e929b68-acdb-4afa-b7ce-76eb3f057624 tempest-CreateVolumesFromImageTest-52926536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd55d137-9d45-43c1-a905-ad0064afe8e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:42:43 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-2e929b68-acdb-4afa-b7ce-76eb3f057624 tempest-CreateVolumesFromImageTest-52926536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd55d137-9d45-43c1-a905-ad0064afe8e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:42:43 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-2e929b68-acdb-4afa-b7ce-76eb3f057624 tempest-CreateVolumesFromImageTest-52926536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62f25caa-ac82-426d-818a-7472157fdc3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:42:43 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-2e929b68-acdb-4afa-b7ce-76eb3f057624 tempest-CreateVolumesFromImageTest-52926536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62f25caa-ac82-426d-818a-7472157fdc3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ef43b40-4660-4939-8f77-e366abbca90c', 'volume_name': 'volume-6ef43b40-4660-4939-8f77-e366abbca90c', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:42:43 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-2e929b68-acdb-4afa-b7ce-76eb3f057624 tempest-CreateVolumesFromImageTest-52926536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd338c22-66f1-4e63-b883-4b5bba346441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:42:43 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-2e929b68-acdb-4afa-b7ce-76eb3f057624 tempest-CreateVolumesFromImageTest-52926536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd338c22-66f1-4e63-b883-4b5bba346441) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:42:43 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-2e929b68-acdb-4afa-b7ce-76eb3f057624 tempest-CreateVolumesFromImageTest-52926536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc85b360-1df3-4d23-818f-c04bd166bdd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:42:43 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-2e929b68-acdb-4afa-b7ce-76eb3f057624 tempest-CreateVolumesFromImageTest-52926536 None] Volume 6ef43b40-4660-4939-8f77-e366abbca90c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ef43b40-4660-4939-8f77-e366abbca90c', 'volume_size': 1}
Nov 03 18:42:43 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-2e929b68-acdb-4afa-b7ce-76eb3f057624 tempest-CreateVolumesFromImageTest-52926536 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:42:43 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-60e5ffa8-8ec9-4d73-9732-bc6bed7d01cc tempest-VolumeDependencyTests-1180853825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:42:43 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-427b9d91-4f81-46d7-a90c-e936aaa6ce67 tempest-CreateVolumesFromImageTest-52926536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8fce4ea3-1bc6-422b-9654-9b571973f5b4 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:42:43 devstack sudo[106438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8fce4ea3-1bc6-422b-9654-9b571973f5b4
Nov 03 18:42:43 devstack sudo[106438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:42:43 devstack sudo[106438]: pam_unix(sudo:session): session closed for user root
Nov 03 18:42:43 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-427b9d91-4f81-46d7-a90c-e936aaa6ce67 tempest-CreateVolumesFromImageTest-52926536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8fce4ea3-1bc6-422b-9654-9b571973f5b4" returned: 0 in 0.259s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:42:43 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-427b9d91-4f81-46d7-a90c-e936aaa6ce67 tempest-CreateVolumesFromImageTest-52926536 None] <== create_volume: return (1193ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:42:43 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-427b9d91-4f81-46d7-a90c-e936aaa6ce67 tempest-CreateVolumesFromImageTest-52926536 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.201s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:42:43 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-43b31915-a913-46f7-9f2f-9bfdc92ea15f tempest-CreateVolumesFromImageTest-52926536 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.960s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:42:43 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-43b31915-a913-46f7-9f2f-9bfdc92ea15f tempest-CreateVolumesFromImageTest-52926536 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:42:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-965346994',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b92c2915-b133-4e70-86f4-74e9fc084f5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b40834fc3b94e69b7e982ab9a49bbc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:42:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:42:42Z,use_quota=True,user_id='f22cfead44ef4634905c276429b8a089',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:42:43 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-43b31915-a913-46f7-9f2f-9bfdc92ea15f tempest-CreateVolumesFromImageTest-52926536 None] Creating volume b92c2915-b133-4e70-86f4-74e9fc084f5a {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:42:43 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-43b31915-a913-46f7-9f2f-9bfdc92ea15f tempest-CreateVolumesFromImageTest-52926536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:42:43 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-43b31915-a913-46f7-9f2f-9bfdc92ea15f tempest-CreateVolumesFromImageTest-52926536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:42:43 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-43b31915-a913-46f7-9f2f-9bfdc92ea15f tempest-CreateVolumesFromImageTest-52926536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:42:43 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-43b31915-a913-46f7-9f2f-9bfdc92ea15f tempest-CreateVolumesFromImageTest-52926536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:42:43 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-43b31915-a913-46f7-9f2f-9bfdc92ea15f tempest-CreateVolumesFromImageTest-52926536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:42:43 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-43b31915-a913-46f7-9f2f-9bfdc92ea15f tempest-CreateVolumesFromImageTest-52926536 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:42:43 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-43b31915-a913-46f7-9f2f-9bfdc92ea15f tempest-CreateVolumesFromImageTest-52926536 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:42:43 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-43b31915-a913-46f7-9f2f-9bfdc92ea15f tempest-CreateVolumesFromImageTest-52926536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-b92c2915-b133-4e70-86f4-74e9fc084f5a 1073741824 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:42:43 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-427b9d91-4f81-46d7-a90c-e936aaa6ce67 tempest-CreateVolumesFromImageTest-52926536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54f6f3d8-8bf9-4f7d-948f-068509bb6ad1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8fce4ea3-1bc6-422b-9654-9b571973f5b4', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:42:43 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-427b9d91-4f81-46d7-a90c-e936aaa6ce67 tempest-CreateVolumesFromImageTest-52926536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (107da403-fd62-4bed-a567-a8784a9df881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:42:43 devstack sudo[106441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-b92c2915-b133-4e70-86f4-74e9fc084f5a 1073741824
Nov 03 18:42:43 devstack sudo[106441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:42:43 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-427b9d91-4f81-46d7-a90c-e936aaa6ce67 tempest-CreateVolumesFromImageTest-52926536 None] Volume volume-8fce4ea3-1bc6-422b-9654-9b571973f5b4 (8fce4ea3-1bc6-422b-9654-9b571973f5b4): created successfully
Nov 03 18:42:43 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-427b9d91-4f81-46d7-a90c-e936aaa6ce67 tempest-CreateVolumesFromImageTest-52926536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (107da403-fd62-4bed-a567-a8784a9df881) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:42:43 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-427b9d91-4f81-46d7-a90c-e936aaa6ce67 tempest-CreateVolumesFromImageTest-52926536 None] Flow 'volume_create_manager' (104c5805-5beb-45ea-8ca7-d5d681e8cb94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:42:43 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-427b9d91-4f81-46d7-a90c-e936aaa6ce67 tempest-CreateVolumesFromImageTest-52926536 None] Created volume successfully.
Nov 03 18:42:44 devstack sudo[106441]: pam_unix(sudo:session): session closed for user root
Nov 03 18:42:44 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-43b31915-a913-46f7-9f2f-9bfdc92ea15f tempest-CreateVolumesFromImageTest-52926536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-b92c2915-b133-4e70-86f4-74e9fc084f5a 1073741824" returned: 0 in 0.508s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:42:44 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-43b31915-a913-46f7-9f2f-9bfdc92ea15f tempest-CreateVolumesFromImageTest-52926536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-b92c2915-b133-4e70-86f4-74e9fc084f5a {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:42:44 devstack sudo[106447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-b92c2915-b133-4e70-86f4-74e9fc084f5a
Nov 03 18:42:44 devstack sudo[106447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:42:44 devstack sudo[106447]: pam_unix(sudo:session): session closed for user root
Nov 03 18:42:44 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-43b31915-a913-46f7-9f2f-9bfdc92ea15f tempest-CreateVolumesFromImageTest-52926536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-b92c2915-b133-4e70-86f4-74e9fc084f5a" returned: 0 in 0.297s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:42:44 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-43b31915-a913-46f7-9f2f-9bfdc92ea15f tempest-CreateVolumesFromImageTest-52926536 None] <== create_volume: return (873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:42:44 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-43b31915-a913-46f7-9f2f-9bfdc92ea15f tempest-CreateVolumesFromImageTest-52926536 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.877s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:42:44 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-e152b7ee-b43b-49f6-a2a4-f92028abc53c tempest-CreateVolumesFromImageTest-52926536 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.303s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:42:44 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-e152b7ee-b43b-49f6-a2a4-f92028abc53c tempest-CreateVolumesFromImageTest-52926536 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:42:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-840411111',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=763de466-e29d-46b7-b981-974c1b1f3f78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b40834fc3b94e69b7e982ab9a49bbc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:42:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:42:42Z,use_quota=True,user_id='f22cfead44ef4634905c276429b8a089',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:42:44 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-e152b7ee-b43b-49f6-a2a4-f92028abc53c tempest-CreateVolumesFromImageTest-52926536 None] Creating volume 763de466-e29d-46b7-b981-974c1b1f3f78 {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:42:44 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-e152b7ee-b43b-49f6-a2a4-f92028abc53c tempest-CreateVolumesFromImageTest-52926536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:42:44 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-e152b7ee-b43b-49f6-a2a4-f92028abc53c tempest-CreateVolumesFromImageTest-52926536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:42:44 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-e152b7ee-b43b-49f6-a2a4-f92028abc53c tempest-CreateVolumesFromImageTest-52926536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:42:44 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-e152b7ee-b43b-49f6-a2a4-f92028abc53c tempest-CreateVolumesFromImageTest-52926536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:42:44 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-e152b7ee-b43b-49f6-a2a4-f92028abc53c tempest-CreateVolumesFromImageTest-52926536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:42:44 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-e152b7ee-b43b-49f6-a2a4-f92028abc53c tempest-CreateVolumesFromImageTest-52926536 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:42:44 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-e152b7ee-b43b-49f6-a2a4-f92028abc53c tempest-CreateVolumesFromImageTest-52926536 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:42:44 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-e152b7ee-b43b-49f6-a2a4-f92028abc53c tempest-CreateVolumesFromImageTest-52926536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-763de466-e29d-46b7-b981-974c1b1f3f78 1073741824 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:42:44 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-43b31915-a913-46f7-9f2f-9bfdc92ea15f tempest-CreateVolumesFromImageTest-52926536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa94b39a-4cd7-47e5-b117-84669d78b334) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b92c2915-b133-4e70-86f4-74e9fc084f5a', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:42:44 devstack sudo[106450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-763de466-e29d-46b7-b981-974c1b1f3f78 1073741824
Nov 03 18:42:44 devstack sudo[106450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:42:44 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-43b31915-a913-46f7-9f2f-9bfdc92ea15f tempest-CreateVolumesFromImageTest-52926536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac736975-5136-42c1-a89a-4318532467db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:42:44 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-43b31915-a913-46f7-9f2f-9bfdc92ea15f tempest-CreateVolumesFromImageTest-52926536 None] Volume volume-b92c2915-b133-4e70-86f4-74e9fc084f5a (b92c2915-b133-4e70-86f4-74e9fc084f5a): created successfully
Nov 03 18:42:44 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-43b31915-a913-46f7-9f2f-9bfdc92ea15f tempest-CreateVolumesFromImageTest-52926536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac736975-5136-42c1-a89a-4318532467db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:42:44 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-43b31915-a913-46f7-9f2f-9bfdc92ea15f tempest-CreateVolumesFromImageTest-52926536 None] Flow 'volume_create_manager' (fff57cec-4217-45be-88ff-0e12644110ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:42:44 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-43b31915-a913-46f7-9f2f-9bfdc92ea15f tempest-CreateVolumesFromImageTest-52926536 None] Created volume successfully.
Nov 03 18:42:45 devstack sudo[106450]: pam_unix(sudo:session): session closed for user root
Nov 03 18:42:45 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-e152b7ee-b43b-49f6-a2a4-f92028abc53c tempest-CreateVolumesFromImageTest-52926536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-763de466-e29d-46b7-b981-974c1b1f3f78 1073741824" returned: 0 in 0.569s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:42:45 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-e152b7ee-b43b-49f6-a2a4-f92028abc53c tempest-CreateVolumesFromImageTest-52926536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-763de466-e29d-46b7-b981-974c1b1f3f78 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:42:45 devstack sudo[106456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-763de466-e29d-46b7-b981-974c1b1f3f78
Nov 03 18:42:45 devstack sudo[106456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:42:45 devstack sudo[106456]: pam_unix(sudo:session): session closed for user root
Nov 03 18:42:45 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-e152b7ee-b43b-49f6-a2a4-f92028abc53c tempest-CreateVolumesFromImageTest-52926536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-763de466-e29d-46b7-b981-974c1b1f3f78" returned: 0 in 0.275s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:42:45 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-e152b7ee-b43b-49f6-a2a4-f92028abc53c tempest-CreateVolumesFromImageTest-52926536 None] <== create_volume: return (887ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:42:45 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-e152b7ee-b43b-49f6-a2a4-f92028abc53c tempest-CreateVolumesFromImageTest-52926536 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.890s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:42:45 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-beb59c02-528d-4580-a9b0-2494aebfa18f tempest-CreateVolumesFromImageTest-52926536 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.588s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:42:45 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-beb59c02-528d-4580-a9b0-2494aebfa18f tempest-CreateVolumesFromImageTest-52926536 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:42:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-346796559',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a589b19c-e32f-4494-97e7-13c899670bd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b40834fc3b94e69b7e982ab9a49bbc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:42:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:42:43Z,use_quota=True,user_id='f22cfead44ef4634905c276429b8a089',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:42:45 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-beb59c02-528d-4580-a9b0-2494aebfa18f tempest-CreateVolumesFromImageTest-52926536 None] Creating volume a589b19c-e32f-4494-97e7-13c899670bd0 {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:42:45 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-beb59c02-528d-4580-a9b0-2494aebfa18f tempest-CreateVolumesFromImageTest-52926536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:42:45 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-beb59c02-528d-4580-a9b0-2494aebfa18f tempest-CreateVolumesFromImageTest-52926536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:42:45 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-beb59c02-528d-4580-a9b0-2494aebfa18f tempest-CreateVolumesFromImageTest-52926536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:42:45 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-beb59c02-528d-4580-a9b0-2494aebfa18f tempest-CreateVolumesFromImageTest-52926536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:42:45 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-beb59c02-528d-4580-a9b0-2494aebfa18f tempest-CreateVolumesFromImageTest-52926536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:42:45 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-beb59c02-528d-4580-a9b0-2494aebfa18f tempest-CreateVolumesFromImageTest-52926536 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:42:45 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-beb59c02-528d-4580-a9b0-2494aebfa18f tempest-CreateVolumesFromImageTest-52926536 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:42:45 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-beb59c02-528d-4580-a9b0-2494aebfa18f tempest-CreateVolumesFromImageTest-52926536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-a589b19c-e32f-4494-97e7-13c899670bd0 1073741824 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:42:45 devstack sudo[106459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-a589b19c-e32f-4494-97e7-13c899670bd0 1073741824
Nov 03 18:42:45 devstack sudo[106459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:42:45 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-e152b7ee-b43b-49f6-a2a4-f92028abc53c tempest-CreateVolumesFromImageTest-52926536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fd32e9c-0765-438f-8b03-c1009c18189c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-763de466-e29d-46b7-b981-974c1b1f3f78', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:42:45 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-e152b7ee-b43b-49f6-a2a4-f92028abc53c tempest-CreateVolumesFromImageTest-52926536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a87bb1f-6bef-4289-90d3-03a47caba0a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:42:45 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-e152b7ee-b43b-49f6-a2a4-f92028abc53c tempest-CreateVolumesFromImageTest-52926536 None] Volume volume-763de466-e29d-46b7-b981-974c1b1f3f78 (763de466-e29d-46b7-b981-974c1b1f3f78): created successfully
Nov 03 18:42:45 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-e152b7ee-b43b-49f6-a2a4-f92028abc53c tempest-CreateVolumesFromImageTest-52926536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a87bb1f-6bef-4289-90d3-03a47caba0a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:42:45 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-e152b7ee-b43b-49f6-a2a4-f92028abc53c tempest-CreateVolumesFromImageTest-52926536 None] Flow 'volume_create_manager' (11778ad3-5dca-4077-aec6-10095c6c27f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:42:45 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-e152b7ee-b43b-49f6-a2a4-f92028abc53c tempest-CreateVolumesFromImageTest-52926536 None] Created volume successfully.
Nov 03 18:42:45 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a4daae5-223c-4378-87cd-93fc253819cd tempest-VolumeAndVolumeTypeFromImageTest-1310239933 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:42:45 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-9a4daae5-223c-4378-87cd-93fc253819cd tempest-VolumeAndVolumeTypeFromImageTest-1310239933 None] Flow 'volume_create_manager' (53dc70c7-fc48-432a-918a-c438e6a24900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:42:45 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-9a4daae5-223c-4378-87cd-93fc253819cd tempest-VolumeAndVolumeTypeFromImageTest-1310239933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcc5ce88-0886-4f03-b9ac-c34b76ac530c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:42:45 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-9a4daae5-223c-4378-87cd-93fc253819cd tempest-VolumeAndVolumeTypeFromImageTest-1310239933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcc5ce88-0886-4f03-b9ac-c34b76ac530c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:42:46Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1b4de5e-5760-48c2-aae4-0481e5591d16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d422377d349a4c41b48b63c298384c18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:42:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:42:46Z,use_quota=True,user_id='0bf7f06ee3884f8ab57472536f229484',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cf1380f0-913b-4e6b-bd88-5fe983422626),volume_type_id=cf1380f0-913b-4e6b-bd88-5fe983422626)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:42:46 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-9a4daae5-223c-4378-87cd-93fc253819cd tempest-VolumeAndVolumeTypeFromImageTest-1310239933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3b72d4c-207e-4a1a-8fb3-b06f6ef20f4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:42:46 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-9a4daae5-223c-4378-87cd-93fc253819cd tempest-VolumeAndVolumeTypeFromImageTest-1310239933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3b72d4c-207e-4a1a-8fb3-b06f6ef20f4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:42:46 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-9a4daae5-223c-4378-87cd-93fc253819cd tempest-VolumeAndVolumeTypeFromImageTest-1310239933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (085bea80-1f17-48fb-b75d-d473d30bdc73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:42:46 devstack cinder-volume[86120]: DEBUG cinder.image.glance [None req-9a4daae5-223c-4378-87cd-93fc253819cd tempest-VolumeAndVolumeTypeFromImageTest-1310239933 None] Creating Keystone auth plugin from conf {{(pid=86120) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 03 18:42:46 devstack sudo[106459]: pam_unix(sudo:session): session closed for user root
Nov 03 18:42:46 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-beb59c02-528d-4580-a9b0-2494aebfa18f tempest-CreateVolumesFromImageTest-52926536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-a589b19c-e32f-4494-97e7-13c899670bd0 1073741824" returned: 0 in 0.473s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:42:46 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-beb59c02-528d-4580-a9b0-2494aebfa18f tempest-CreateVolumesFromImageTest-52926536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-a589b19c-e32f-4494-97e7-13c899670bd0 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:42:46 devstack sudo[106465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-a589b19c-e32f-4494-97e7-13c899670bd0
Nov 03 18:42:46 devstack sudo[106465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:42:46 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-9a4daae5-223c-4378-87cd-93fc253819cd tempest-VolumeAndVolumeTypeFromImageTest-1310239933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (085bea80-1f17-48fb-b75d-d473d30bdc73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd1b4de5e-5760-48c2-aae4-0481e5591d16', 'volume_name': 'volume-d1b4de5e-5760-48c2-aae4-0481e5591d16', 'volume_size': 1, 'image_id': '569e5359-3efa-448a-a111-ab2d88fda773', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/569e5359-3efa-448a-a111-ab2d88fda773', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '355021f19b1a48df9de5f3177bdf9969', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd422377d349a4c41b48b63c298384c18', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '161491dd199f373a11a2e939f0d06c47fb70c9174a9f15cd695665318a26f332cda64d69ee26cf8fc477a27c93625a50cdbc05d6163c54a78a39257ed6807208', 'id': '569e5359-3efa-448a-a111-ab2d88fda773', 'created_at': datetime.datetime(2026, 11, 3, 17, 42, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 17, 42, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/569e5359-3efa-448a-a111-ab2d88fda773/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7a8d3c5f63f0>}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:42:46 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-9a4daae5-223c-4378-87cd-93fc253819cd tempest-VolumeAndVolumeTypeFromImageTest-1310239933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06362039-0068-4afe-b061-1816a61ea831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:42:46 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-9a4daae5-223c-4378-87cd-93fc253819cd tempest-VolumeAndVolumeTypeFromImageTest-1310239933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06362039-0068-4afe-b061-1816a61ea831) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:42:46 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-9a4daae5-223c-4378-87cd-93fc253819cd tempest-VolumeAndVolumeTypeFromImageTest-1310239933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (094a196e-aa79-4ae2-9204-43cd5565ac84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:42:46 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-9a4daae5-223c-4378-87cd-93fc253819cd tempest-VolumeAndVolumeTypeFromImageTest-1310239933 None] Volume d1b4de5e-5760-48c2-aae4-0481e5591d16: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d1b4de5e-5760-48c2-aae4-0481e5591d16', 'volume_size': 1, 'image_id': '569e5359-3efa-448a-a111-ab2d88fda773', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/569e5359-3efa-448a-a111-ab2d88fda773', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '355021f19b1a48df9de5f3177bdf9969', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd422377d349a4c41b48b63c298384c18', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '161491dd199f373a11a2e939f0d06c47fb70c9174a9f15cd695665318a26f332cda64d69ee26cf8fc477a27c93625a50cdbc05d6163c54a78a39257ed6807208', 'id': '569e5359-3efa-448a-a111-ab2d88fda773', 'created_at': datetime.datetime(2026, 11, 3, 17, 42, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 17, 42, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/569e5359-3efa-448a-a111-ab2d88fda773/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7a8d3c5f63f0>}
Nov 03 18:42:46 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a4daae5-223c-4378-87cd-93fc253819cd tempest-VolumeAndVolumeTypeFromImageTest-1310239933 None] Trying to clone d1b4de5e-5760-48c2-aae4-0481e5591d16 from image 569e5359-3efa-448a-a111-ab2d88fda773 at location (None, [{'url': 'file:///opt/stack/data/glance/images/569e5359-3efa-448a-a111-ab2d88fda773', 'metadata': {}}]). {{(pid=86120) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 03 18:42:46 devstack sudo[106465]: pam_unix(sudo:session): session closed for user root
Nov 03 18:42:46 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-beb59c02-528d-4580-a9b0-2494aebfa18f tempest-CreateVolumesFromImageTest-52926536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-a589b19c-e32f-4494-97e7-13c899670bd0" returned: 0 in 0.286s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:42:46 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-beb59c02-528d-4580-a9b0-2494aebfa18f tempest-CreateVolumesFromImageTest-52926536 None] <== create_volume: return (811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:42:46 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-beb59c02-528d-4580-a9b0-2494aebfa18f tempest-CreateVolumesFromImageTest-52926536 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.816s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:42:46 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-2e929b68-acdb-4afa-b7ce-76eb3f057624 tempest-CreateVolumesFromImageTest-52926536 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.890s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:42:46 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-2e929b68-acdb-4afa-b7ce-76eb3f057624 tempest-CreateVolumesFromImageTest-52926536 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:42:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-154789043',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ef43b40-4660-4939-8f77-e366abbca90c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b40834fc3b94e69b7e982ab9a49bbc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:42:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:42:43Z,use_quota=True,user_id='f22cfead44ef4634905c276429b8a089',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:42:46 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-2e929b68-acdb-4afa-b7ce-76eb3f057624 tempest-CreateVolumesFromImageTest-52926536 None] Creating volume 6ef43b40-4660-4939-8f77-e366abbca90c {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:42:46 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-2e929b68-acdb-4afa-b7ce-76eb3f057624 tempest-CreateVolumesFromImageTest-52926536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:42:46 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-2e929b68-acdb-4afa-b7ce-76eb3f057624 tempest-CreateVolumesFromImageTest-52926536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:42:46 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-2e929b68-acdb-4afa-b7ce-76eb3f057624 tempest-CreateVolumesFromImageTest-52926536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:42:46 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-2e929b68-acdb-4afa-b7ce-76eb3f057624 tempest-CreateVolumesFromImageTest-52926536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:42:46 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-2e929b68-acdb-4afa-b7ce-76eb3f057624 tempest-CreateVolumesFromImageTest-52926536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:42:46 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-2e929b68-acdb-4afa-b7ce-76eb3f057624 tempest-CreateVolumesFromImageTest-52926536 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:42:46 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-2e929b68-acdb-4afa-b7ce-76eb3f057624 tempest-CreateVolumesFromImageTest-52926536 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:42:46 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-2e929b68-acdb-4afa-b7ce-76eb3f057624 tempest-CreateVolumesFromImageTest-52926536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6ef43b40-4660-4939-8f77-e366abbca90c 1073741824 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:42:46 devstack cinder-volume[86120]: DEBUG cinder.image.image_utils [None req-9a4daae5-223c-4378-87cd-93fc253819cd tempest-VolumeAndVolumeTypeFromImageTest-1310239933 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_569e5359-3efa-448a-a111-ab2d88fda773_a7yklky6devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86120) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 03 18:42:46 devstack cinder-volume[86120]: INFO cinder.image.image_utils [None req-9a4daae5-223c-4378-87cd-93fc253819cd tempest-VolumeAndVolumeTypeFromImageTest-1310239933 None] Image download 0.00 MB at 0.00 MB/s
Nov 03 18:42:46 devstack sudo[106468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6ef43b40-4660-4939-8f77-e366abbca90c 1073741824
Nov 03 18:42:46 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-beb59c02-528d-4580-a9b0-2494aebfa18f tempest-CreateVolumesFromImageTest-52926536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ce4c803-a633-4e51-a9bd-3c896fa23ef3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a589b19c-e32f-4494-97e7-13c899670bd0', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:42:46 devstack sudo[106468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:42:46 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-beb59c02-528d-4580-a9b0-2494aebfa18f tempest-CreateVolumesFromImageTest-52926536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2f0d24a-16b3-4760-93c1-8b227e988224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:42:46 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-beb59c02-528d-4580-a9b0-2494aebfa18f tempest-CreateVolumesFromImageTest-52926536 None] Volume volume-a589b19c-e32f-4494-97e7-13c899670bd0 (a589b19c-e32f-4494-97e7-13c899670bd0): created successfully
Nov 03 18:42:46 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-beb59c02-528d-4580-a9b0-2494aebfa18f tempest-CreateVolumesFromImageTest-52926536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2f0d24a-16b3-4760-93c1-8b227e988224) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:42:46 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-beb59c02-528d-4580-a9b0-2494aebfa18f tempest-CreateVolumesFromImageTest-52926536 None] Flow 'volume_create_manager' (04a2e9da-aae6-4a3b-ac78-43f49d55995f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:42:46 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[966c7850-d0f2-47d5-95a5-03a227f52981]: (4, 'raw') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:42:46 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-9a4daae5-223c-4378-87cd-93fc253819cd tempest-VolumeAndVolumeTypeFromImageTest-1310239933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_569e5359-3efa-448a-a111-ab2d88fda773_a7yklky6devstack@QuobyteHD {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:42:46 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-beb59c02-528d-4580-a9b0-2494aebfa18f tempest-CreateVolumesFromImageTest-52926536 None] Created volume successfully.
Nov 03 18:42:46 devstack sudo[106470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_569e5359-3efa-448a-a111-ab2d88fda773_a7yklky6devstack@QuobyteHD
Nov 03 18:42:46 devstack sudo[106470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:42:46 devstack sudo[106470]: pam_unix(sudo:session): session closed for user root
Nov 03 18:42:46 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-9a4daae5-223c-4378-87cd-93fc253819cd tempest-VolumeAndVolumeTypeFromImageTest-1310239933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_569e5359-3efa-448a-a111-ab2d88fda773_a7yklky6devstack@QuobyteHD" returned: 0 in 0.409s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:42:46 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-9a4daae5-223c-4378-87cd-93fc253819cd tempest-VolumeAndVolumeTypeFromImageTest-1310239933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_569e5359-3efa-448a-a111-ab2d88fda773_a7yklky6devstack@QuobyteHD {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:42:47 devstack sudo[106468]: pam_unix(sudo:session): session closed for user root
Nov 03 18:42:47 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-2e929b68-acdb-4afa-b7ce-76eb3f057624 tempest-CreateVolumesFromImageTest-52926536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6ef43b40-4660-4939-8f77-e366abbca90c 1073741824" returned: 0 in 0.603s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:42:47 devstack sudo[106478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_569e5359-3efa-448a-a111-ab2d88fda773_a7yklky6devstack@QuobyteHD
Nov 03 18:42:47 devstack sudo[106478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:42:47 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-2e929b68-acdb-4afa-b7ce-76eb3f057624 tempest-CreateVolumesFromImageTest-52926536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6ef43b40-4660-4939-8f77-e366abbca90c {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:42:47 devstack sudo[106480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6ef43b40-4660-4939-8f77-e366abbca90c
Nov 03 18:42:47 devstack sudo[106480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:42:47 devstack sudo[106478]: pam_unix(sudo:session): session closed for user root
Nov 03 18:42:47 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-9a4daae5-223c-4378-87cd-93fc253819cd tempest-VolumeAndVolumeTypeFromImageTest-1310239933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_569e5359-3efa-448a-a111-ab2d88fda773_a7yklky6devstack@QuobyteHD" returned: 1 in 0.359s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:42:47 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-9a4daae5-223c-4378-87cd-93fc253819cd tempest-VolumeAndVolumeTypeFromImageTest-1310239933 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_569e5359-3efa-448a-a111-ab2d88fda773_a7yklky6devstack@QuobyteHD' failed. Not Retrying. {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 03 18:42:47 devstack cinder-volume[86120]: DEBUG cinder.image.image_utils [None req-9a4daae5-223c-4378-87cd-93fc253819cd tempest-VolumeAndVolumeTypeFromImageTest-1310239933 None] Temporary image 569e5359-3efa-448a-a111-ab2d88fda773 is fetched for user 0bf7f06ee3884f8ab57472536f229484. {{(pid=86120) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 03 18:42:47 devstack sudo[106480]: pam_unix(sudo:session): session closed for user root
Nov 03 18:42:47 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-2e929b68-acdb-4afa-b7ce-76eb3f057624 tempest-CreateVolumesFromImageTest-52926536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6ef43b40-4660-4939-8f77-e366abbca90c" returned: 0 in 0.249s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:42:47 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-2e929b68-acdb-4afa-b7ce-76eb3f057624 tempest-CreateVolumesFromImageTest-52926536 None] <== create_volume: return (903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:42:47 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-2e929b68-acdb-4afa-b7ce-76eb3f057624 tempest-CreateVolumesFromImageTest-52926536 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.907s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:42:47 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-60e5ffa8-8ec9-4d73-9732-bc6bed7d01cc tempest-VolumeDependencyTests-1180853825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.783s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:42:47 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-2e929b68-acdb-4afa-b7ce-76eb3f057624 tempest-CreateVolumesFromImageTest-52926536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc85b360-1df3-4d23-818f-c04bd166bdd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ef43b40-4660-4939-8f77-e366abbca90c', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:42:47 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-2e929b68-acdb-4afa-b7ce-76eb3f057624 tempest-CreateVolumesFromImageTest-52926536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (521df481-10af-4548-a083-8b182c050b91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:42:47 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-60e5ffa8-8ec9-4d73-9732-bc6bed7d01cc tempest-VolumeDependencyTests-1180853825 None] Creating offline snapshot 7e451827-d038-48f4-989e-566093823c38 of volume 50f2588d-fbda-417a-a67f-0b7e6a294e3d {{(pid=86120) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 18:42:47 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-2e929b68-acdb-4afa-b7ce-76eb3f057624 tempest-CreateVolumesFromImageTest-52926536 None] Volume volume-6ef43b40-4660-4939-8f77-e366abbca90c (6ef43b40-4660-4939-8f77-e366abbca90c): created successfully
Nov 03 18:42:47 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-2e929b68-acdb-4afa-b7ce-76eb3f057624 tempest-CreateVolumesFromImageTest-52926536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (521df481-10af-4548-a083-8b182c050b91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:42:47 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-2e929b68-acdb-4afa-b7ce-76eb3f057624 tempest-CreateVolumesFromImageTest-52926536 None] Flow 'volume_create_manager' (6f709f47-ed1e-4c85-85c4-041c1c3cf82c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:42:47 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[423d041c-7836-413e-b88a-02d30912f3a7]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:42:47 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-60e5ffa8-8ec9-4d73-9732-bc6bed7d01cc tempest-VolumeDependencyTests-1180853825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-50f2588d-fbda-417a-a67f-0b7e6a294e3d {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:42:47 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[a232fa3d-6f86-4d3b-8b0e-30c233e91879]: (4, 'raw') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:42:47 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-9a4daae5-223c-4378-87cd-93fc253819cd tempest-VolumeAndVolumeTypeFromImageTest-1310239933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_569e5359-3efa-448a-a111-ab2d88fda773_a7yklky6devstack@QuobyteHD {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:42:47 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-2e929b68-acdb-4afa-b7ce-76eb3f057624 tempest-CreateVolumesFromImageTest-52926536 None] Created volume successfully.
Nov 03 18:42:47 devstack sudo[106486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-50f2588d-fbda-417a-a67f-0b7e6a294e3d
Nov 03 18:42:47 devstack sudo[106486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:42:47 devstack sudo[106487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_569e5359-3efa-448a-a111-ab2d88fda773_a7yklky6devstack@QuobyteHD
Nov 03 18:42:47 devstack sudo[106487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:42:47 devstack sudo[106487]: pam_unix(sudo:session): session closed for user root
Nov 03 18:42:47 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-9a4daae5-223c-4378-87cd-93fc253819cd tempest-VolumeAndVolumeTypeFromImageTest-1310239933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_569e5359-3efa-448a-a111-ab2d88fda773_a7yklky6devstack@QuobyteHD" returned: 0 in 0.336s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:42:47 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-9a4daae5-223c-4378-87cd-93fc253819cd tempest-VolumeAndVolumeTypeFromImageTest-1310239933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_569e5359-3efa-448a-a111-ab2d88fda773_a7yklky6devstack@QuobyteHD {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:42:47 devstack sudo[106486]: pam_unix(sudo:session): session closed for user root
Nov 03 18:42:47 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-60e5ffa8-8ec9-4d73-9732-bc6bed7d01cc tempest-VolumeDependencyTests-1180853825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-50f2588d-fbda-417a-a67f-0b7e6a294e3d" returned: 0 in 0.375s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:42:47 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-60e5ffa8-8ec9-4d73-9732-bc6bed7d01cc tempest-VolumeDependencyTests-1180853825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-50f2588d-fbda-417a-a67f-0b7e6a294e3d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-50f2588d-fbda-417a-a67f-0b7e6a294e3d.7e451827-d038-48f4-989e-566093823c38 1G {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:42:47 devstack sudo[106496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-50f2588d-fbda-417a-a67f-0b7e6a294e3d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-50f2588d-fbda-417a-a67f-0b7e6a294e3d.7e451827-d038-48f4-989e-566093823c38 1G
Nov 03 18:42:47 devstack sudo[106496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:42:47 devstack sudo[106495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_569e5359-3efa-448a-a111-ab2d88fda773_a7yklky6devstack@QuobyteHD
Nov 03 18:42:47 devstack sudo[106495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:42:47 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-b4f3e5d7-5fef-4fa4-92c5-3cf0c2e9c64f tempest-CreateVolumesFromImageTest-52926536 None] Acquiring lock "cinder-6ef43b40-4660-4939-8f77-e366abbca90c-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:42:47 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-b4f3e5d7-5fef-4fa4-92c5-3cf0c2e9c64f tempest-CreateVolumesFromImageTest-52926536 None] Lock "cinder-6ef43b40-4660-4939-8f77-e366abbca90c-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:42:48 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-b4f3e5d7-5fef-4fa4-92c5-3cf0c2e9c64f tempest-CreateVolumesFromImageTest-52926536 None] Acquiring lock "cinder-quobyte-6ef43b40-4660-4939-8f77-e366abbca90c" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:42:48 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-b4f3e5d7-5fef-4fa4-92c5-3cf0c2e9c64f tempest-CreateVolumesFromImageTest-52926536 None] Lock "cinder-quobyte-6ef43b40-4660-4939-8f77-e366abbca90c" acquired by "delete_volume" :: waited 0.019s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:42:48 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7b16b7e-273b-4773-bd09-ce3502d3905c]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:42:48 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b4f3e5d7-5fef-4fa4-92c5-3cf0c2e9c64f tempest-CreateVolumesFromImageTest-52926536 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6ef43b40-4660-4939-8f77-e366abbca90c {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:42:48 devstack sudo[106495]: pam_unix(sudo:session): session closed for user root
Nov 03 18:42:48 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-9a4daae5-223c-4378-87cd-93fc253819cd tempest-VolumeAndVolumeTypeFromImageTest-1310239933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_569e5359-3efa-448a-a111-ab2d88fda773_a7yklky6devstack@QuobyteHD" returned: 1 in 0.383s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:42:48 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-9a4daae5-223c-4378-87cd-93fc253819cd tempest-VolumeAndVolumeTypeFromImageTest-1310239933 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_569e5359-3efa-448a-a111-ab2d88fda773_a7yklky6devstack@QuobyteHD' failed. Not Retrying. {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 03 18:42:48 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-9a4daae5-223c-4378-87cd-93fc253819cd tempest-VolumeAndVolumeTypeFromImageTest-1310239933 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:42:48 devstack sudo[106506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6ef43b40-4660-4939-8f77-e366abbca90c
Nov 03 18:42:48 devstack sudo[106506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:42:48 devstack sudo[106496]: pam_unix(sudo:session): session closed for user root
Nov 03 18:42:48 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-60e5ffa8-8ec9-4d73-9732-bc6bed7d01cc tempest-VolumeDependencyTests-1180853825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-50f2588d-fbda-417a-a67f-0b7e6a294e3d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-50f2588d-fbda-417a-a67f-0b7e6a294e3d.7e451827-d038-48f4-989e-566093823c38 1G" returned: 0 in 0.517s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:42:48 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-60e5ffa8-8ec9-4d73-9732-bc6bed7d01cc tempest-VolumeDependencyTests-1180853825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-50f2588d-fbda-417a-a67f-0b7e6a294e3d -F qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-50f2588d-fbda-417a-a67f-0b7e6a294e3d.7e451827-d038-48f4-989e-566093823c38 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:42:48 devstack sudo[106508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-50f2588d-fbda-417a-a67f-0b7e6a294e3d -F qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-50f2588d-fbda-417a-a67f-0b7e6a294e3d.7e451827-d038-48f4-989e-566093823c38
Nov 03 18:42:48 devstack sudo[106508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:42:48 devstack sudo[106506]: pam_unix(sudo:session): session closed for user root
Nov 03 18:42:48 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b4f3e5d7-5fef-4fa4-92c5-3cf0c2e9c64f tempest-CreateVolumesFromImageTest-52926536 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6ef43b40-4660-4939-8f77-e366abbca90c" returned: 0 in 0.413s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:42:48 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b4f3e5d7-5fef-4fa4-92c5-3cf0c2e9c64f tempest-CreateVolumesFromImageTest-52926536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6ef43b40-4660-4939-8f77-e366abbca90c {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:42:48 devstack sudo[106515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6ef43b40-4660-4939-8f77-e366abbca90c
Nov 03 18:42:48 devstack sudo[106515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:42:48 devstack sudo[106508]: pam_unix(sudo:session): session closed for user root
Nov 03 18:42:48 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-60e5ffa8-8ec9-4d73-9732-bc6bed7d01cc tempest-VolumeDependencyTests-1180853825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-50f2588d-fbda-417a-a67f-0b7e6a294e3d -F qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-50f2588d-fbda-417a-a67f-0b7e6a294e3d.7e451827-d038-48f4-989e-566093823c38" returned: 0 in 0.343s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:42:48 devstack cinder-volume[86120]: WARNING cinder.volume.drivers.remotefs [None req-60e5ffa8-8ec9-4d73-9732-bc6bed7d01cc tempest-VolumeDependencyTests-1180853825 None] /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-50f2588d-fbda-417a-a67f-0b7e6a294e3d.7e451827-d038-48f4-989e-566093823c38 is being set with open permissions: ugo+rw
Nov 03 18:42:48 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-60e5ffa8-8ec9-4d73-9732-bc6bed7d01cc tempest-VolumeDependencyTests-1180853825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-50f2588d-fbda-417a-a67f-0b7e6a294e3d.7e451827-d038-48f4-989e-566093823c38 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:42:48 devstack sudo[106519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-50f2588d-fbda-417a-a67f-0b7e6a294e3d.7e451827-d038-48f4-989e-566093823c38
Nov 03 18:42:48 devstack sudo[106519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:42:48 devstack sudo[106515]: pam_unix(sudo:session): session closed for user root
Nov 03 18:42:48 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b4f3e5d7-5fef-4fa4-92c5-3cf0c2e9c64f tempest-CreateVolumesFromImageTest-52926536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6ef43b40-4660-4939-8f77-e366abbca90c" returned: 0 in 0.276s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:42:48 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-b4f3e5d7-5fef-4fa4-92c5-3cf0c2e9c64f tempest-CreateVolumesFromImageTest-52926536 None] Lock "cinder-quobyte-6ef43b40-4660-4939-8f77-e366abbca90c" released by "delete_volume" :: held 0.753s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:42:48 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-b4f3e5d7-5fef-4fa4-92c5-3cf0c2e9c64f tempest-CreateVolumesFromImageTest-52926536 None] Created reservations ['deb11334-4604-473e-863e-9af06b45437d', '349f22b6-01f4-4147-b301-06967f377978', '93e98330-4417-4889-9d19-58434ad2c8e4', 'ed61548f-a3a5-4f2b-b806-ad2f517a1ee4'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:42:48 devstack sudo[106519]: pam_unix(sudo:session): session closed for user root
Nov 03 18:42:48 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-60e5ffa8-8ec9-4d73-9732-bc6bed7d01cc tempest-VolumeDependencyTests-1180853825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-50f2588d-fbda-417a-a67f-0b7e6a294e3d.7e451827-d038-48f4-989e-566093823c38" returned: 0 in 0.285s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:42:48 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-b4f3e5d7-5fef-4fa4-92c5-3cf0c2e9c64f tempest-CreateVolumesFromImageTest-52926536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:42:48 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-b4f3e5d7-5fef-4fa4-92c5-3cf0c2e9c64f tempest-CreateVolumesFromImageTest-52926536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:42:48 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-b4f3e5d7-5fef-4fa4-92c5-3cf0c2e9c64f tempest-CreateVolumesFromImageTest-52926536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:42:48 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-b4f3e5d7-5fef-4fa4-92c5-3cf0c2e9c64f tempest-CreateVolumesFromImageTest-52926536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:42:48 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-b4f3e5d7-5fef-4fa4-92c5-3cf0c2e9c64f tempest-CreateVolumesFromImageTest-52926536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:42:48 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b4f3e5d7-5fef-4fa4-92c5-3cf0c2e9c64f tempest-CreateVolumesFromImageTest-52926536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:42:48 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-60e5ffa8-8ec9-4d73-9732-bc6bed7d01cc tempest-VolumeDependencyTests-1180853825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-50f2588d-fbda-417a-a67f-0b7e6a294e3d.info {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:42:48 devstack sudo[106523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:42:48 devstack sudo[106523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:42:48 devstack sudo[106524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-50f2588d-fbda-417a-a67f-0b7e6a294e3d.info
Nov 03 18:42:48 devstack sudo[106524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:42:49 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-d2f61d7f-07e4-44c4-9b44-400436fc7396 tempest-CreateVolumesFromImageTest-52926536 None] Acquiring lock "cinder-a589b19c-e32f-4494-97e7-13c899670bd0-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:42:49 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-d2f61d7f-07e4-44c4-9b44-400436fc7396 tempest-CreateVolumesFromImageTest-52926536 None] Lock "cinder-a589b19c-e32f-4494-97e7-13c899670bd0-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:42:49 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-d2f61d7f-07e4-44c4-9b44-400436fc7396 tempest-CreateVolumesFromImageTest-52926536 None] Acquiring lock "cinder-quobyte-a589b19c-e32f-4494-97e7-13c899670bd0" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:42:49 devstack sudo[106524]: pam_unix(sudo:session): session closed for user root
Nov 03 18:42:49 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-60e5ffa8-8ec9-4d73-9732-bc6bed7d01cc tempest-VolumeDependencyTests-1180853825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-50f2588d-fbda-417a-a67f-0b7e6a294e3d.info" returned: 0 in 0.307s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:42:49 devstack cinder-volume[86120]: WARNING cinder.volume.drivers.remotefs [None req-60e5ffa8-8ec9-4d73-9732-bc6bed7d01cc tempest-VolumeDependencyTests-1180853825 None] /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-50f2588d-fbda-417a-a67f-0b7e6a294e3d.info is being set with open permissions: ugo+rw
Nov 03 18:42:49 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-60e5ffa8-8ec9-4d73-9732-bc6bed7d01cc tempest-VolumeDependencyTests-1180853825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-50f2588d-fbda-417a-a67f-0b7e6a294e3d.info {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:42:49 devstack sudo[106523]: pam_unix(sudo:session): session closed for user root
Nov 03 18:42:49 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-d2f61d7f-07e4-44c4-9b44-400436fc7396 tempest-CreateVolumesFromImageTest-52926536 None] Lock "cinder-quobyte-a589b19c-e32f-4494-97e7-13c899670bd0" acquired by "delete_volume" :: waited 0.029s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:42:49 devstack sudo[106529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-50f2588d-fbda-417a-a67f-0b7e6a294e3d.info
Nov 03 18:42:49 devstack sudo[106529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:42:49 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b4f3e5d7-5fef-4fa4-92c5-3cf0c2e9c64f tempest-CreateVolumesFromImageTest-52926536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.369s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:42:49 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-b4f3e5d7-5fef-4fa4-92c5-3cf0c2e9c64f tempest-CreateVolumesFromImageTest-52926536 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:42:49 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-b4f3e5d7-5fef-4fa4-92c5-3cf0c2e9c64f tempest-CreateVolumesFromImageTest-52926536 None] Deleted volume successfully.
Nov 03 18:42:49 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[0abd265f-49a4-4666-8308-6e384a99923f]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:42:49 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-d2f61d7f-07e4-44c4-9b44-400436fc7396 tempest-CreateVolumesFromImageTest-52926536 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-a589b19c-e32f-4494-97e7-13c899670bd0 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:42:49 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-b4f3e5d7-5fef-4fa4-92c5-3cf0c2e9c64f tempest-CreateVolumesFromImageTest-52926536 None] Lock "cinder-6ef43b40-4660-4939-8f77-e366abbca90c-delete_volume" released by "delete_volume" :: held 1.411s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:42:49 devstack sudo[106531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-a589b19c-e32f-4494-97e7-13c899670bd0
Nov 03 18:42:49 devstack sudo[106531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:42:49 devstack sudo[106529]: pam_unix(sudo:session): session closed for user root
Nov 03 18:42:49 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-60e5ffa8-8ec9-4d73-9732-bc6bed7d01cc tempest-VolumeDependencyTests-1180853825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-50f2588d-fbda-417a-a67f-0b7e6a294e3d.info" returned: 0 in 0.292s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:42:49 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-60e5ffa8-8ec9-4d73-9732-bc6bed7d01cc tempest-VolumeDependencyTests-1180853825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.284s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:42:49 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-9a4daae5-223c-4378-87cd-93fc253819cd tempest-VolumeAndVolumeTypeFromImageTest-1310239933 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.475s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:42:49 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-9a4daae5-223c-4378-87cd-93fc253819cd tempest-VolumeAndVolumeTypeFromImageTest-1310239933 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:42:46Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1b4de5e-5760-48c2-aae4-0481e5591d16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d422377d349a4c41b48b63c298384c18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:42:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:42:46Z,use_quota=True,user_id='0bf7f06ee3884f8ab57472536f229484',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cf1380f0-913b-4e6b-bd88-5fe983422626),volume_type_id=cf1380f0-913b-4e6b-bd88-5fe983422626)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:42:49 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-9a4daae5-223c-4378-87cd-93fc253819cd tempest-VolumeAndVolumeTypeFromImageTest-1310239933 None] Creating volume d1b4de5e-5760-48c2-aae4-0481e5591d16 {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:42:49 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-9a4daae5-223c-4378-87cd-93fc253819cd tempest-VolumeAndVolumeTypeFromImageTest-1310239933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:42:49 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-9a4daae5-223c-4378-87cd-93fc253819cd tempest-VolumeAndVolumeTypeFromImageTest-1310239933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:42:49 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-9a4daae5-223c-4378-87cd-93fc253819cd tempest-VolumeAndVolumeTypeFromImageTest-1310239933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:42:49 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-9a4daae5-223c-4378-87cd-93fc253819cd tempest-VolumeAndVolumeTypeFromImageTest-1310239933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:42:49 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-9a4daae5-223c-4378-87cd-93fc253819cd tempest-VolumeAndVolumeTypeFromImageTest-1310239933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:42:49 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-9a4daae5-223c-4378-87cd-93fc253819cd tempest-VolumeAndVolumeTypeFromImageTest-1310239933 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:42:49 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-9a4daae5-223c-4378-87cd-93fc253819cd tempest-VolumeAndVolumeTypeFromImageTest-1310239933 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:42:49 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-9a4daae5-223c-4378-87cd-93fc253819cd tempest-VolumeAndVolumeTypeFromImageTest-1310239933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d1b4de5e-5760-48c2-aae4-0481e5591d16 1073741824 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:42:49 devstack sudo[106535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d1b4de5e-5760-48c2-aae4-0481e5591d16 1073741824
Nov 03 18:42:49 devstack sudo[106535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:42:49 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-60e5ffa8-8ec9-4d73-9732-bc6bed7d01cc tempest-VolumeDependencyTests-1180853825 None] Create snapshot completed successfully
Nov 03 18:42:49 devstack sudo[106531]: pam_unix(sudo:session): session closed for user root
Nov 03 18:42:49 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-d2f61d7f-07e4-44c4-9b44-400436fc7396 tempest-CreateVolumesFromImageTest-52926536 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-a589b19c-e32f-4494-97e7-13c899670bd0" returned: 0 in 0.487s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:42:49 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-d2f61d7f-07e4-44c4-9b44-400436fc7396 tempest-CreateVolumesFromImageTest-52926536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-a589b19c-e32f-4494-97e7-13c899670bd0 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:42:49 devstack sudo[106541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-a589b19c-e32f-4494-97e7-13c899670bd0
Nov 03 18:42:49 devstack sudo[106541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:42:50 devstack sudo[106541]: pam_unix(sudo:session): session closed for user root
Nov 03 18:42:50 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-d2f61d7f-07e4-44c4-9b44-400436fc7396 tempest-CreateVolumesFromImageTest-52926536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-a589b19c-e32f-4494-97e7-13c899670bd0" returned: 0 in 0.302s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:42:50 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-d2f61d7f-07e4-44c4-9b44-400436fc7396 tempest-CreateVolumesFromImageTest-52926536 None] Lock "cinder-quobyte-a589b19c-e32f-4494-97e7-13c899670bd0" released by "delete_volume" :: held 0.863s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:42:50 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-d2f61d7f-07e4-44c4-9b44-400436fc7396 tempest-CreateVolumesFromImageTest-52926536 None] Created reservations ['88c04ceb-fdd5-4185-8426-0d105ceaea42', 'e5d7a5d9-2c74-4a94-b55a-908a19982777', '6c9a9f32-e3e3-4153-8ebe-18a4e02c2911', '57ebf4d8-a9f5-46ee-b349-b934f5e3c368'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:42:50 devstack sudo[106535]: pam_unix(sudo:session): session closed for user root
Nov 03 18:42:50 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-9a4daae5-223c-4378-87cd-93fc253819cd tempest-VolumeAndVolumeTypeFromImageTest-1310239933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d1b4de5e-5760-48c2-aae4-0481e5591d16 1073741824" returned: 0 in 0.624s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:42:50 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-9a4daae5-223c-4378-87cd-93fc253819cd tempest-VolumeAndVolumeTypeFromImageTest-1310239933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d1b4de5e-5760-48c2-aae4-0481e5591d16 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:42:50 devstack sudo[106548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d1b4de5e-5760-48c2-aae4-0481e5591d16
Nov 03 18:42:50 devstack sudo[106548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:42:50 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-d2f61d7f-07e4-44c4-9b44-400436fc7396 tempest-CreateVolumesFromImageTest-52926536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:42:50 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-d2f61d7f-07e4-44c4-9b44-400436fc7396 tempest-CreateVolumesFromImageTest-52926536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:42:50 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-d2f61d7f-07e4-44c4-9b44-400436fc7396 tempest-CreateVolumesFromImageTest-52926536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:42:50 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-d2f61d7f-07e4-44c4-9b44-400436fc7396 tempest-CreateVolumesFromImageTest-52926536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:42:50 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-d2f61d7f-07e4-44c4-9b44-400436fc7396 tempest-CreateVolumesFromImageTest-52926536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:42:50 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-d2f61d7f-07e4-44c4-9b44-400436fc7396 tempest-CreateVolumesFromImageTest-52926536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:42:50 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-075cc291-c699-46b5-93e2-3e21d244858e tempest-CreateVolumesFromImageTest-52926536 None] Acquiring lock "cinder-763de466-e29d-46b7-b981-974c1b1f3f78-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:42:50 devstack sudo[106550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:42:50 devstack sudo[106550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:42:50 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-075cc291-c699-46b5-93e2-3e21d244858e tempest-CreateVolumesFromImageTest-52926536 None] Lock "cinder-763de466-e29d-46b7-b981-974c1b1f3f78-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:42:50 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-075cc291-c699-46b5-93e2-3e21d244858e tempest-CreateVolumesFromImageTest-52926536 None] Acquiring lock "cinder-quobyte-763de466-e29d-46b7-b981-974c1b1f3f78" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:42:50 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-075cc291-c699-46b5-93e2-3e21d244858e tempest-CreateVolumesFromImageTest-52926536 None] Lock "cinder-quobyte-763de466-e29d-46b7-b981-974c1b1f3f78" acquired by "delete_volume" :: waited 0.035s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:42:50 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[3debf74e-19a4-430d-9385-6046d24679e0]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:42:50 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-075cc291-c699-46b5-93e2-3e21d244858e tempest-CreateVolumesFromImageTest-52926536 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-763de466-e29d-46b7-b981-974c1b1f3f78 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:42:50 devstack sudo[106548]: pam_unix(sudo:session): session closed for user root
Nov 03 18:42:50 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ee96dc7-30f4-4d3c-85fd-22e7be6ac309 tempest-VolumeDependencyTests-1180853825 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:42:50 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-9a4daae5-223c-4378-87cd-93fc253819cd tempest-VolumeAndVolumeTypeFromImageTest-1310239933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d1b4de5e-5760-48c2-aae4-0481e5591d16" returned: 0 in 0.380s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:42:50 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-9a4daae5-223c-4378-87cd-93fc253819cd tempest-VolumeAndVolumeTypeFromImageTest-1310239933 None] <== create_volume: return (1080ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:42:50 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-9a4daae5-223c-4378-87cd-93fc253819cd tempest-VolumeAndVolumeTypeFromImageTest-1310239933 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.085s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:42:50 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-1ee96dc7-30f4-4d3c-85fd-22e7be6ac309 tempest-VolumeDependencyTests-1180853825 None] Flow 'volume_create_manager' (f2151f35-4f45-4420-9b82-b2d9b1ec6bdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:42:50 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-1ee96dc7-30f4-4d3c-85fd-22e7be6ac309 tempest-VolumeDependencyTests-1180853825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b61209e9-a8ce-4ecd-9032-a58b77e0876a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:42:50 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-1ee96dc7-30f4-4d3c-85fd-22e7be6ac309 tempest-VolumeDependencyTests-1180853825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b61209e9-a8ce-4ecd-9032-a58b77e0876a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:42:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-310427342',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60fc7e60-2347-45e7-85b0-6ee397f40780,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23b7da727b1d42ce83f063565ef2f42e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:42:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=7e451827-d038-48f4-989e-566093823c38,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:42:51Z,use_quota=True,user_id='8df0db0d5ef749c097672c73fee66eac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:42:50 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-1ee96dc7-30f4-4d3c-85fd-22e7be6ac309 tempest-VolumeDependencyTests-1180853825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af400444-51e5-4c23-a107-965318c9952b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:42:50 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-1ee96dc7-30f4-4d3c-85fd-22e7be6ac309 tempest-VolumeDependencyTests-1180853825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af400444-51e5-4c23-a107-965318c9952b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:42:50 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-1ee96dc7-30f4-4d3c-85fd-22e7be6ac309 tempest-VolumeDependencyTests-1180853825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfccf0b9-3036-4b07-939f-35a9f2a6910c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:42:50 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-1ee96dc7-30f4-4d3c-85fd-22e7be6ac309 tempest-VolumeDependencyTests-1180853825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfccf0b9-3036-4b07-939f-35a9f2a6910c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '60fc7e60-2347-45e7-85b0-6ee397f40780', 'volume_name': 'volume-60fc7e60-2347-45e7-85b0-6ee397f40780', 'volume_size': 1, 'snapshot_id': '7e451827-d038-48f4-989e-566093823c38'}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:42:50 devstack sudo[106553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-763de466-e29d-46b7-b981-974c1b1f3f78
Nov 03 18:42:50 devstack sudo[106553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:42:50 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-1ee96dc7-30f4-4d3c-85fd-22e7be6ac309 tempest-VolumeDependencyTests-1180853825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db8caac5-9d4d-43ed-bc46-caa5f8fc2c62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:42:50 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-1ee96dc7-30f4-4d3c-85fd-22e7be6ac309 tempest-VolumeDependencyTests-1180853825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db8caac5-9d4d-43ed-bc46-caa5f8fc2c62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:42:50 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-1ee96dc7-30f4-4d3c-85fd-22e7be6ac309 tempest-VolumeDependencyTests-1180853825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8476a413-7ded-4d90-a3b6-e3f8fb8333a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:42:50 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-1ee96dc7-30f4-4d3c-85fd-22e7be6ac309 tempest-VolumeDependencyTests-1180853825 None] Volume 60fc7e60-2347-45e7-85b0-6ee397f40780: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-60fc7e60-2347-45e7-85b0-6ee397f40780', 'volume_size': 1, 'snapshot_id': '7e451827-d038-48f4-989e-566093823c38'}
Nov 03 18:42:50 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-1ee96dc7-30f4-4d3c-85fd-22e7be6ac309 tempest-VolumeDependencyTests-1180853825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:42:50 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-1ee96dc7-30f4-4d3c-85fd-22e7be6ac309 tempest-VolumeDependencyTests-1180853825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:42:50 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-1ee96dc7-30f4-4d3c-85fd-22e7be6ac309 tempest-VolumeDependencyTests-1180853825 None] Acquiring lock "cinder-quobyte-7e451827-d038-48f4-989e-566093823c38-60fc7e60-2347-45e7-85b0-6ee397f40780" by "_create_volume_from_snapshot" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:42:50 devstack cinder-volume[86120]: DEBUG cinder.volume.volume_utils [None req-9a4daae5-223c-4378-87cd-93fc253819cd tempest-VolumeAndVolumeTypeFromImageTest-1310239933 None] Attempting download of 569e5359-3efa-448a-a111-ab2d88fda773 ((None, [{'url': 'file:///opt/stack/data/glance/images/569e5359-3efa-448a-a111-ab2d88fda773', 'metadata': {}}])) to volume d1b4de5e-5760-48c2-aae4-0481e5591d16. {{(pid=86120) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 03 18:42:50 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-1ee96dc7-30f4-4d3c-85fd-22e7be6ac309 tempest-VolumeDependencyTests-1180853825 None] Lock "cinder-quobyte-7e451827-d038-48f4-989e-566093823c38-60fc7e60-2347-45e7-85b0-6ee397f40780" acquired by "_create_volume_from_snapshot" :: waited 0.050s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:42:50 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-1ee96dc7-30f4-4d3c-85fd-22e7be6ac309 tempest-VolumeDependencyTests-1180853825 None] Creating volume 60fc7e60-2347-45e7-85b0-6ee397f40780 from snapshot 7e451827-d038-48f4-989e-566093823c38 {{(pid=86120) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 03 18:42:50 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-1ee96dc7-30f4-4d3c-85fd-22e7be6ac309 tempest-VolumeDependencyTests-1180853825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:42:50 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-1ee96dc7-30f4-4d3c-85fd-22e7be6ac309 tempest-VolumeDependencyTests-1180853825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:42:50 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-1ee96dc7-30f4-4d3c-85fd-22e7be6ac309 tempest-VolumeDependencyTests-1180853825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:42:50 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-1ee96dc7-30f4-4d3c-85fd-22e7be6ac309 tempest-VolumeDependencyTests-1180853825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:42:50 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-1ee96dc7-30f4-4d3c-85fd-22e7be6ac309 tempest-VolumeDependencyTests-1180853825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:42:50 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-1ee96dc7-30f4-4d3c-85fd-22e7be6ac309 tempest-VolumeDependencyTests-1180853825 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:42:50 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-1ee96dc7-30f4-4d3c-85fd-22e7be6ac309 tempest-VolumeDependencyTests-1180853825 None] Acquiring lock "cinder-quobyte-60fc7e60-2347-45e7-85b0-6ee397f40780" by "_copy_volume_from_snapshot" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:42:50 devstack sudo[106550]: pam_unix(sudo:session): session closed for user root
Nov 03 18:42:50 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-d2f61d7f-07e4-44c4-9b44-400436fc7396 tempest-CreateVolumesFromImageTest-52926536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.513s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:42:50 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-d2f61d7f-07e4-44c4-9b44-400436fc7396 tempest-CreateVolumesFromImageTest-52926536 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:42:50 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-1ee96dc7-30f4-4d3c-85fd-22e7be6ac309 tempest-VolumeDependencyTests-1180853825 None] Lock "cinder-quobyte-60fc7e60-2347-45e7-85b0-6ee397f40780" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:42:50 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-1ee96dc7-30f4-4d3c-85fd-22e7be6ac309 tempest-VolumeDependencyTests-1180853825 None] snapshot: 7e451827-d038-48f4-989e-566093823c38, volume: 60fc7e60-2347-45e7-85b0-6ee397f40780,  {{(pid=86120) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 03 18:42:50 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-d2f61d7f-07e4-44c4-9b44-400436fc7396 tempest-CreateVolumesFromImageTest-52926536 None] Deleted volume successfully.
Nov 03 18:42:50 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a98cdfd-416e-490a-a1f0-bfb5364bd564]: (4, 'raw') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:42:50 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-9a4daae5-223c-4378-87cd-93fc253819cd tempest-VolumeAndVolumeTypeFromImageTest-1310239933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_569e5359-3efa-448a-a111-ab2d88fda773_i4rnmkod {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:42:51 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-1ee96dc7-30f4-4d3c-85fd-22e7be6ac309 tempest-VolumeDependencyTests-1180853825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:42:51 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-1ee96dc7-30f4-4d3c-85fd-22e7be6ac309 tempest-VolumeDependencyTests-1180853825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:42:51 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-1ee96dc7-30f4-4d3c-85fd-22e7be6ac309 tempest-VolumeDependencyTests-1180853825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:42:51 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-1ee96dc7-30f4-4d3c-85fd-22e7be6ac309 tempest-VolumeDependencyTests-1180853825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:42:51 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-1ee96dc7-30f4-4d3c-85fd-22e7be6ac309 tempest-VolumeDependencyTests-1180853825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:42:51 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-d2f61d7f-07e4-44c4-9b44-400436fc7396 tempest-CreateVolumesFromImageTest-52926536 None] Lock "cinder-a589b19c-e32f-4494-97e7-13c899670bd0-delete_volume" released by "delete_volume" :: held 1.853s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:42:51 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[d65396ac-122c-4592-9a2b-248dcc89589e]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:42:51 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-1ee96dc7-30f4-4d3c-85fd-22e7be6ac309 tempest-VolumeDependencyTests-1180853825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-50f2588d-fbda-417a-a67f-0b7e6a294e3d.7e451827-d038-48f4-989e-566093823c38 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:42:51 devstack sudo[106556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_569e5359-3efa-448a-a111-ab2d88fda773_i4rnmkod
Nov 03 18:42:51 devstack sudo[106556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:42:51 devstack sudo[106553]: pam_unix(sudo:session): session closed for user root
Nov 03 18:42:51 devstack sudo[106557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-50f2588d-fbda-417a-a67f-0b7e6a294e3d.7e451827-d038-48f4-989e-566093823c38
Nov 03 18:42:51 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-075cc291-c699-46b5-93e2-3e21d244858e tempest-CreateVolumesFromImageTest-52926536 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-763de466-e29d-46b7-b981-974c1b1f3f78" returned: 0 in 0.549s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:42:51 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-075cc291-c699-46b5-93e2-3e21d244858e tempest-CreateVolumesFromImageTest-52926536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-763de466-e29d-46b7-b981-974c1b1f3f78 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:42:51 devstack sudo[106557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:42:51 devstack sudo[106563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-763de466-e29d-46b7-b981-974c1b1f3f78
Nov 03 18:42:51 devstack sudo[106563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:42:51 devstack sudo[106556]: pam_unix(sudo:session): session closed for user root
Nov 03 18:42:51 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-9a4daae5-223c-4378-87cd-93fc253819cd tempest-VolumeAndVolumeTypeFromImageTest-1310239933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_569e5359-3efa-448a-a111-ab2d88fda773_i4rnmkod" returned: 0 in 0.386s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:42:51 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-9a4daae5-223c-4378-87cd-93fc253819cd tempest-VolumeAndVolumeTypeFromImageTest-1310239933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_569e5359-3efa-448a-a111-ab2d88fda773_i4rnmkod {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:42:51 devstack sudo[106567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_569e5359-3efa-448a-a111-ab2d88fda773_i4rnmkod
Nov 03 18:42:51 devstack sudo[106567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:42:51 devstack sudo[106557]: pam_unix(sudo:session): session closed for user root
Nov 03 18:42:51 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-1ee96dc7-30f4-4d3c-85fd-22e7be6ac309 tempest-VolumeDependencyTests-1180853825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-50f2588d-fbda-417a-a67f-0b7e6a294e3d.7e451827-d038-48f4-989e-566093823c38" returned: 0 in 0.422s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:42:51 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-1ee96dc7-30f4-4d3c-85fd-22e7be6ac309 tempest-VolumeDependencyTests-1180853825 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-50f2588d-fbda-417a-a67f-0b7e6a294e3d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86120) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 18:42:51 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[30a53f42-41be-4244-a6f1-9a1d7b5f4dfc]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:42:51 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-1ee96dc7-30f4-4d3c-85fd-22e7be6ac309 tempest-VolumeDependencyTests-1180853825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-50f2588d-fbda-417a-a67f-0b7e6a294e3d {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:42:51 devstack sudo[106563]: pam_unix(sudo:session): session closed for user root
Nov 03 18:42:51 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-075cc291-c699-46b5-93e2-3e21d244858e tempest-CreateVolumesFromImageTest-52926536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-763de466-e29d-46b7-b981-974c1b1f3f78" returned: 0 in 0.324s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:42:51 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-075cc291-c699-46b5-93e2-3e21d244858e tempest-CreateVolumesFromImageTest-52926536 None] Lock "cinder-quobyte-763de466-e29d-46b7-b981-974c1b1f3f78" released by "delete_volume" :: held 0.955s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:42:51 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-075cc291-c699-46b5-93e2-3e21d244858e tempest-CreateVolumesFromImageTest-52926536 None] Created reservations ['672be4be-4ac3-4abe-a0ce-217d0dd9b798', 'c791c40c-7c82-48cd-9d16-126b2a84f5f4', 'bbcbfd12-a0d1-4687-894c-0236c8a85fd3', '2b9f98ea-21b6-4502-bee5-b980400dd623'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:42:51 devstack sudo[106573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-50f2588d-fbda-417a-a67f-0b7e6a294e3d
Nov 03 18:42:51 devstack sudo[106573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:42:51 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-075cc291-c699-46b5-93e2-3e21d244858e tempest-CreateVolumesFromImageTest-52926536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:42:51 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-075cc291-c699-46b5-93e2-3e21d244858e tempest-CreateVolumesFromImageTest-52926536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:42:51 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-075cc291-c699-46b5-93e2-3e21d244858e tempest-CreateVolumesFromImageTest-52926536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:42:51 devstack sudo[106567]: pam_unix(sudo:session): session closed for user root
Nov 03 18:42:51 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-075cc291-c699-46b5-93e2-3e21d244858e tempest-CreateVolumesFromImageTest-52926536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:42:51 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-075cc291-c699-46b5-93e2-3e21d244858e tempest-CreateVolumesFromImageTest-52926536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:42:51 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-075cc291-c699-46b5-93e2-3e21d244858e tempest-CreateVolumesFromImageTest-52926536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:42:51 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-9a4daae5-223c-4378-87cd-93fc253819cd tempest-VolumeAndVolumeTypeFromImageTest-1310239933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_569e5359-3efa-448a-a111-ab2d88fda773_i4rnmkod" returned: 1 in 0.445s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:42:51 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-9a4daae5-223c-4378-87cd-93fc253819cd tempest-VolumeAndVolumeTypeFromImageTest-1310239933 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_569e5359-3efa-448a-a111-ab2d88fda773_i4rnmkod' failed. Not Retrying. {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 03 18:42:51 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff226935-9f7a-456b-a613-1f26dc581df0]: (4, 'raw') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:42:51 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-9a4daae5-223c-4378-87cd-93fc253819cd tempest-VolumeAndVolumeTypeFromImageTest-1310239933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_569e5359-3efa-448a-a111-ab2d88fda773_a7yklky6devstack@QuobyteHD {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:42:51 devstack sudo[106577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:42:51 devstack sudo[106577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:42:51 devstack sudo[106578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_569e5359-3efa-448a-a111-ab2d88fda773_a7yklky6devstack@QuobyteHD
Nov 03 18:42:51 devstack sudo[106578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:42:52 devstack sudo[106573]: pam_unix(sudo:session): session closed for user root
Nov 03 18:42:52 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-1ee96dc7-30f4-4d3c-85fd-22e7be6ac309 tempest-VolumeDependencyTests-1180853825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-50f2588d-fbda-417a-a67f-0b7e6a294e3d" returned: 0 in 0.555s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:42:52 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-1ee96dc7-30f4-4d3c-85fd-22e7be6ac309 tempest-VolumeDependencyTests-1180853825 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-50f2588d-fbda-417a-a67f-0b7e6a294e3d {{(pid=86120) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 03 18:42:52 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-1ee96dc7-30f4-4d3c-85fd-22e7be6ac309 tempest-VolumeDependencyTests-1180853825 None] Creating direct copy from snapshot {{(pid=86120) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 03 18:42:52 devstack cinder-volume[86120]: DEBUG cinder.utils [None req-1ee96dc7-30f4-4d3c-85fd-22e7be6ac309 tempest-VolumeDependencyTests-1180853825 None] Path /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-60fc7e60-2347-45e7-85b0-6ee397f40780 not found in is_blk_device check {{(pid=86120) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 03 18:42:52 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-1ee96dc7-30f4-4d3c-85fd-22e7be6ac309 tempest-VolumeDependencyTests-1180853825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-50f2588d-fbda-417a-a67f-0b7e6a294e3d /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-60fc7e60-2347-45e7-85b0-6ee397f40780 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:42:52 devstack sudo[106577]: pam_unix(sudo:session): session closed for user root
Nov 03 18:42:52 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-075cc291-c699-46b5-93e2-3e21d244858e tempest-CreateVolumesFromImageTest-52926536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.324s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:42:52 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-075cc291-c699-46b5-93e2-3e21d244858e tempest-CreateVolumesFromImageTest-52926536 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:42:52 devstack sudo[106585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-50f2588d-fbda-417a-a67f-0b7e6a294e3d /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-60fc7e60-2347-45e7-85b0-6ee397f40780
Nov 03 18:42:52 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-075cc291-c699-46b5-93e2-3e21d244858e tempest-CreateVolumesFromImageTest-52926536 None] Deleted volume successfully.
Nov 03 18:42:52 devstack sudo[106585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:42:52 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-075cc291-c699-46b5-93e2-3e21d244858e tempest-CreateVolumesFromImageTest-52926536 None] Lock "cinder-763de466-e29d-46b7-b981-974c1b1f3f78-delete_volume" released by "delete_volume" :: held 1.653s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:42:52 devstack sudo[106578]: pam_unix(sudo:session): session closed for user root
Nov 03 18:42:52 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-9a4daae5-223c-4378-87cd-93fc253819cd tempest-VolumeAndVolumeTypeFromImageTest-1310239933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_569e5359-3efa-448a-a111-ab2d88fda773_a7yklky6devstack@QuobyteHD" returned: 0 in 0.358s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:42:52 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-9a4daae5-223c-4378-87cd-93fc253819cd tempest-VolumeAndVolumeTypeFromImageTest-1310239933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_569e5359-3efa-448a-a111-ab2d88fda773_a7yklky6devstack@QuobyteHD {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:42:52 devstack sudo[106589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_569e5359-3efa-448a-a111-ab2d88fda773_a7yklky6devstack@QuobyteHD
Nov 03 18:42:52 devstack sudo[106589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:42:52 devstack sudo[106589]: pam_unix(sudo:session): session closed for user root
Nov 03 18:42:52 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-9a4daae5-223c-4378-87cd-93fc253819cd tempest-VolumeAndVolumeTypeFromImageTest-1310239933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_569e5359-3efa-448a-a111-ab2d88fda773_a7yklky6devstack@QuobyteHD" returned: 1 in 0.392s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:42:52 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-9a4daae5-223c-4378-87cd-93fc253819cd tempest-VolumeAndVolumeTypeFromImageTest-1310239933 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_569e5359-3efa-448a-a111-ab2d88fda773_a7yklky6devstack@QuobyteHD' failed. Not Retrying. {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 03 18:42:52 devstack cinder-volume[86120]: DEBUG cinder.image.image_utils [None req-9a4daae5-223c-4378-87cd-93fc253819cd tempest-VolumeAndVolumeTypeFromImageTest-1310239933 None] 569e5359-3efa-448a-a111-ab2d88fda773 was raw, converting to qcow2 {{(pid=86120) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 03 18:42:52 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-9a4daae5-223c-4378-87cd-93fc253819cd tempest-VolumeAndVolumeTypeFromImageTest-1310239933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_569e5359-3efa-448a-a111-ab2d88fda773_a7yklky6devstack@QuobyteHD /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d1b4de5e-5760-48c2-aae4-0481e5591d16 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:42:52 devstack sudo[106597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_569e5359-3efa-448a-a111-ab2d88fda773_a7yklky6devstack@QuobyteHD /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d1b4de5e-5760-48c2-aae4-0481e5591d16
Nov 03 18:42:52 devstack sudo[106597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:42:52 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-4aa72815-d182-410d-a817-237538616773 tempest-CreateVolumesFromImageTest-52926536 None] Acquiring lock "cinder-b92c2915-b133-4e70-86f4-74e9fc084f5a-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:42:52 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-4aa72815-d182-410d-a817-237538616773 tempest-CreateVolumesFromImageTest-52926536 None] Lock "cinder-b92c2915-b133-4e70-86f4-74e9fc084f5a-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:42:53 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-4aa72815-d182-410d-a817-237538616773 tempest-CreateVolumesFromImageTest-52926536 None] Acquiring lock "cinder-quobyte-b92c2915-b133-4e70-86f4-74e9fc084f5a" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:42:53 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-4aa72815-d182-410d-a817-237538616773 tempest-CreateVolumesFromImageTest-52926536 None] Lock "cinder-quobyte-b92c2915-b133-4e70-86f4-74e9fc084f5a" acquired by "delete_volume" :: waited 0.023s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:42:53 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[03fd4764-0963-427b-a542-f0c277487800]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:42:53 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-4aa72815-d182-410d-a817-237538616773 tempest-CreateVolumesFromImageTest-52926536 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-b92c2915-b133-4e70-86f4-74e9fc084f5a {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:42:53 devstack sudo[106610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-b92c2915-b133-4e70-86f4-74e9fc084f5a
Nov 03 18:42:53 devstack sudo[106610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:42:53 devstack sudo[106597]: pam_unix(sudo:session): session closed for user root
Nov 03 18:42:53 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-9a4daae5-223c-4378-87cd-93fc253819cd tempest-VolumeAndVolumeTypeFromImageTest-1310239933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_569e5359-3efa-448a-a111-ab2d88fda773_a7yklky6devstack@QuobyteHD /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d1b4de5e-5760-48c2-aae4-0481e5591d16" returned: 0 in 1.235s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:42:53 devstack cinder-volume[86120]: DEBUG cinder.image.image_utils [None req-9a4daae5-223c-4378-87cd-93fc253819cd tempest-VolumeAndVolumeTypeFromImageTest-1310239933 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_569e5359-3efa-448a-a111-ab2d88fda773_a7yklky6devstack@QuobyteHD, size 0.00 MB, duration 1.24 sec, destination /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d1b4de5e-5760-48c2-aae4-0481e5591d16 {{(pid=86120) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 03 18:42:53 devstack cinder-volume[86120]: INFO cinder.image.image_utils [None req-9a4daae5-223c-4378-87cd-93fc253819cd tempest-VolumeAndVolumeTypeFromImageTest-1310239933 None] Converted 0.00 MB image at 0.00 MB/s
Nov 03 18:42:53 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-9a4daae5-223c-4378-87cd-93fc253819cd tempest-VolumeAndVolumeTypeFromImageTest-1310239933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d1b4de5e-5760-48c2-aae4-0481e5591d16 1G {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:42:53 devstack sudo[106613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d1b4de5e-5760-48c2-aae4-0481e5591d16 1G
Nov 03 18:42:53 devstack sudo[106613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:42:54 devstack sudo[106610]: pam_unix(sudo:session): session closed for user root
Nov 03 18:42:54 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-4aa72815-d182-410d-a817-237538616773 tempest-CreateVolumesFromImageTest-52926536 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-b92c2915-b133-4e70-86f4-74e9fc084f5a" returned: 0 in 0.892s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:42:54 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-4aa72815-d182-410d-a817-237538616773 tempest-CreateVolumesFromImageTest-52926536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-b92c2915-b133-4e70-86f4-74e9fc084f5a {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:42:54 devstack sudo[106619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-b92c2915-b133-4e70-86f4-74e9fc084f5a
Nov 03 18:42:54 devstack sudo[106619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:42:54 devstack sudo[106619]: pam_unix(sudo:session): session closed for user root
Nov 03 18:42:54 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-4aa72815-d182-410d-a817-237538616773 tempest-CreateVolumesFromImageTest-52926536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-b92c2915-b133-4e70-86f4-74e9fc084f5a" returned: 0 in 0.420s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:42:54 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-4aa72815-d182-410d-a817-237538616773 tempest-CreateVolumesFromImageTest-52926536 None] Lock "cinder-quobyte-b92c2915-b133-4e70-86f4-74e9fc084f5a" released by "delete_volume" :: held 1.402s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:42:54 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-4aa72815-d182-410d-a817-237538616773 tempest-CreateVolumesFromImageTest-52926536 None] Created reservations ['bda98a5b-6336-49c3-909c-4f70d9b56754', '02d8b3d8-7f4e-471d-b1f0-87820159717e', '3b531de2-2450-421d-a1d8-6573b9a9b6f1', '9beb61bb-76bf-4217-b6aa-e187abf10bf1'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:42:54 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-4aa72815-d182-410d-a817-237538616773 tempest-CreateVolumesFromImageTest-52926536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:42:54 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-4aa72815-d182-410d-a817-237538616773 tempest-CreateVolumesFromImageTest-52926536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:42:54 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-4aa72815-d182-410d-a817-237538616773 tempest-CreateVolumesFromImageTest-52926536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:42:54 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-4aa72815-d182-410d-a817-237538616773 tempest-CreateVolumesFromImageTest-52926536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:42:54 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-4aa72815-d182-410d-a817-237538616773 tempest-CreateVolumesFromImageTest-52926536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:42:54 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-4aa72815-d182-410d-a817-237538616773 tempest-CreateVolumesFromImageTest-52926536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:42:54 devstack sudo[106613]: pam_unix(sudo:session): session closed for user root
Nov 03 18:42:54 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-9a4daae5-223c-4378-87cd-93fc253819cd tempest-VolumeAndVolumeTypeFromImageTest-1310239933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d1b4de5e-5760-48c2-aae4-0481e5591d16 1G" returned: 0 in 0.926s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:42:54 devstack cinder-volume[86120]: DEBUG cinder.volume.volume_utils [None req-9a4daae5-223c-4378-87cd-93fc253819cd tempest-VolumeAndVolumeTypeFromImageTest-1310239933 None] Downloaded image 569e5359-3efa-448a-a111-ab2d88fda773 ((None, [{'url': 'file:///opt/stack/data/glance/images/569e5359-3efa-448a-a111-ab2d88fda773', 'metadata': {}}])) to volume d1b4de5e-5760-48c2-aae4-0481e5591d16 successfully. {{(pid=86120) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 03 18:42:54 devstack cinder-volume[86120]: DEBUG cinder.image.image_utils [None req-9a4daae5-223c-4378-87cd-93fc253819cd tempest-VolumeAndVolumeTypeFromImageTest-1310239933 None] Temporary image 569e5359-3efa-448a-a111-ab2d88fda773 for user 0bf7f06ee3884f8ab57472536f229484 is deleted. {{(pid=86120) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 03 18:42:54 devstack cinder-volume[86120]: DEBUG cinder.volume.volume_utils [None req-9a4daae5-223c-4378-87cd-93fc253819cd tempest-VolumeAndVolumeTypeFromImageTest-1310239933 None] Marking volume d1b4de5e-5760-48c2-aae4-0481e5591d16 as bootable. {{(pid=86120) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 03 18:42:54 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a4daae5-223c-4378-87cd-93fc253819cd tempest-VolumeAndVolumeTypeFromImageTest-1310239933 None] Copying metadata from image 569e5359-3efa-448a-a111-ab2d88fda773 to d1b4de5e-5760-48c2-aae4-0481e5591d16. {{(pid=86120) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 03 18:42:54 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a4daae5-223c-4378-87cd-93fc253819cd tempest-VolumeAndVolumeTypeFromImageTest-1310239933 None] Creating volume glance metadata for volume d1b4de5e-5760-48c2-aae4-0481e5591d16 backed by image 569e5359-3efa-448a-a111-ab2d88fda773 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '569e5359-3efa-448a-a111-ab2d88fda773', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '355021f19b1a48df9de5f3177bdf9969', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86120) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 03 18:42:54 devstack sudo[106626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:42:54 devstack sudo[106626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:42:54 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-9a4daae5-223c-4378-87cd-93fc253819cd tempest-VolumeAndVolumeTypeFromImageTest-1310239933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (094a196e-aa79-4ae2-9204-43cd5565ac84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1b4de5e-5760-48c2-aae4-0481e5591d16', 'volume_size': 1, 'image_id': '569e5359-3efa-448a-a111-ab2d88fda773', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/569e5359-3efa-448a-a111-ab2d88fda773', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '355021f19b1a48df9de5f3177bdf9969', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd422377d349a4c41b48b63c298384c18', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '161491dd199f373a11a2e939f0d06c47fb70c9174a9f15cd695665318a26f332cda64d69ee26cf8fc477a27c93625a50cdbc05d6163c54a78a39257ed6807208', 'id': '569e5359-3efa-448a-a111-ab2d88fda773', 'created_at': datetime.datetime(2026, 11, 3, 17, 42, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 17, 42, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/569e5359-3efa-448a-a111-ab2d88fda773/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7a8d3c5f63f0>}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:42:54 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-9a4daae5-223c-4378-87cd-93fc253819cd tempest-VolumeAndVolumeTypeFromImageTest-1310239933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfdf641f-d990-41aa-961e-37850c9a0034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:42:54 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-9a4daae5-223c-4378-87cd-93fc253819cd tempest-VolumeAndVolumeTypeFromImageTest-1310239933 None] Volume volume-d1b4de5e-5760-48c2-aae4-0481e5591d16 (d1b4de5e-5760-48c2-aae4-0481e5591d16): created successfully
Nov 03 18:42:54 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-9a4daae5-223c-4378-87cd-93fc253819cd tempest-VolumeAndVolumeTypeFromImageTest-1310239933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfdf641f-d990-41aa-961e-37850c9a0034) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:42:54 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-9a4daae5-223c-4378-87cd-93fc253819cd tempest-VolumeAndVolumeTypeFromImageTest-1310239933 None] Flow 'volume_create_manager' (53dc70c7-fc48-432a-918a-c438e6a24900) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:42:54 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-9a4daae5-223c-4378-87cd-93fc253819cd tempest-VolumeAndVolumeTypeFromImageTest-1310239933 None] Created volume successfully.
Nov 03 18:42:55 devstack sudo[106626]: pam_unix(sudo:session): session closed for user root
Nov 03 18:42:55 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-4aa72815-d182-410d-a817-237538616773 tempest-CreateVolumesFromImageTest-52926536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.674s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:42:55 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-4aa72815-d182-410d-a817-237538616773 tempest-CreateVolumesFromImageTest-52926536 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:42:55 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-67803ab7-d7f9-4ee1-99d0-1555640106bb tempest-CreateVolumesFromImageTest-52926536 None] Acquiring lock "cinder-8fce4ea3-1bc6-422b-9654-9b571973f5b4-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:42:55 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-4aa72815-d182-410d-a817-237538616773 tempest-CreateVolumesFromImageTest-52926536 None] Deleted volume successfully.
Nov 03 18:42:55 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-67803ab7-d7f9-4ee1-99d0-1555640106bb tempest-CreateVolumesFromImageTest-52926536 None] Lock "cinder-8fce4ea3-1bc6-422b-9654-9b571973f5b4-delete_volume" acquired by "delete_volume" :: waited 0.089s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:42:55 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-4aa72815-d182-410d-a817-237538616773 tempest-CreateVolumesFromImageTest-52926536 None] Lock "cinder-b92c2915-b133-4e70-86f4-74e9fc084f5a-delete_volume" released by "delete_volume" :: held 2.523s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:42:55 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-67803ab7-d7f9-4ee1-99d0-1555640106bb tempest-CreateVolumesFromImageTest-52926536 None] Acquiring lock "cinder-quobyte-8fce4ea3-1bc6-422b-9654-9b571973f5b4" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:42:55 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-67803ab7-d7f9-4ee1-99d0-1555640106bb tempest-CreateVolumesFromImageTest-52926536 None] Lock "cinder-quobyte-8fce4ea3-1bc6-422b-9654-9b571973f5b4" acquired by "delete_volume" :: waited 0.022s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:42:55 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9ed3d64-f1a4-4ad7-9f8a-f59c01c30db7]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:42:55 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-67803ab7-d7f9-4ee1-99d0-1555640106bb tempest-CreateVolumesFromImageTest-52926536 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8fce4ea3-1bc6-422b-9654-9b571973f5b4 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:42:55 devstack sudo[106629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8fce4ea3-1bc6-422b-9654-9b571973f5b4
Nov 03 18:42:55 devstack sudo[106629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:42:56 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-60015237-dd48-4d26-9d69-1307b83105cd tempest-VolumeAndVolumeTypeFromImageTest-1310239933 None] Acquiring lock "cinder-d1b4de5e-5760-48c2-aae4-0481e5591d16-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:42:56 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-60015237-dd48-4d26-9d69-1307b83105cd tempest-VolumeAndVolumeTypeFromImageTest-1310239933 None] Lock "cinder-d1b4de5e-5760-48c2-aae4-0481e5591d16-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:42:56 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-60015237-dd48-4d26-9d69-1307b83105cd tempest-VolumeAndVolumeTypeFromImageTest-1310239933 None] Acquiring lock "cinder-quobyte-d1b4de5e-5760-48c2-aae4-0481e5591d16" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:42:56 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-60015237-dd48-4d26-9d69-1307b83105cd tempest-VolumeAndVolumeTypeFromImageTest-1310239933 None] Lock "cinder-quobyte-d1b4de5e-5760-48c2-aae4-0481e5591d16" acquired by "delete_volume" :: waited 0.024s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:42:56 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[47de02c1-aacb-42b6-8d4f-e0a6e074d4dc]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:42:56 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-60015237-dd48-4d26-9d69-1307b83105cd tempest-VolumeAndVolumeTypeFromImageTest-1310239933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d1b4de5e-5760-48c2-aae4-0481e5591d16 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:42:56 devstack sudo[106631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d1b4de5e-5760-48c2-aae4-0481e5591d16
Nov 03 18:42:56 devstack sudo[106631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:42:56 devstack sudo[106629]: pam_unix(sudo:session): session closed for user root
Nov 03 18:42:56 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-67803ab7-d7f9-4ee1-99d0-1555640106bb tempest-CreateVolumesFromImageTest-52926536 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8fce4ea3-1bc6-422b-9654-9b571973f5b4" returned: 0 in 0.912s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:42:56 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-67803ab7-d7f9-4ee1-99d0-1555640106bb tempest-CreateVolumesFromImageTest-52926536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8fce4ea3-1bc6-422b-9654-9b571973f5b4 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:42:56 devstack sudo[106636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8fce4ea3-1bc6-422b-9654-9b571973f5b4
Nov 03 18:42:56 devstack sudo[106636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:42:57 devstack sudo[106636]: pam_unix(sudo:session): session closed for user root
Nov 03 18:42:57 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-67803ab7-d7f9-4ee1-99d0-1555640106bb tempest-CreateVolumesFromImageTest-52926536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8fce4ea3-1bc6-422b-9654-9b571973f5b4" returned: 0 in 0.619s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:42:57 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-67803ab7-d7f9-4ee1-99d0-1555640106bb tempest-CreateVolumesFromImageTest-52926536 None] Lock "cinder-quobyte-8fce4ea3-1bc6-422b-9654-9b571973f5b4" released by "delete_volume" :: held 1.636s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:42:57 devstack sudo[106631]: pam_unix(sudo:session): session closed for user root
Nov 03 18:42:57 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-60015237-dd48-4d26-9d69-1307b83105cd tempest-VolumeAndVolumeTypeFromImageTest-1310239933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d1b4de5e-5760-48c2-aae4-0481e5591d16" returned: 0 in 1.015s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:42:57 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-60015237-dd48-4d26-9d69-1307b83105cd tempest-VolumeAndVolumeTypeFromImageTest-1310239933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d1b4de5e-5760-48c2-aae4-0481e5591d16 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:42:57 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-67803ab7-d7f9-4ee1-99d0-1555640106bb tempest-CreateVolumesFromImageTest-52926536 None] Created reservations ['9828de15-b955-466a-9b5d-957860379c3b', 'bc9297a2-ed23-45b0-9483-4b30bcc77b29', 'c7ba83d5-34ef-441a-8ea8-44b6b72731be', '495db3c2-164a-492c-8ada-7ce4e135f7cc'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:42:57 devstack sudo[106642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d1b4de5e-5760-48c2-aae4-0481e5591d16
Nov 03 18:42:57 devstack sudo[106642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:42:57 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-67803ab7-d7f9-4ee1-99d0-1555640106bb tempest-CreateVolumesFromImageTest-52926536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:42:57 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-67803ab7-d7f9-4ee1-99d0-1555640106bb tempest-CreateVolumesFromImageTest-52926536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:42:57 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-67803ab7-d7f9-4ee1-99d0-1555640106bb tempest-CreateVolumesFromImageTest-52926536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:42:57 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-67803ab7-d7f9-4ee1-99d0-1555640106bb tempest-CreateVolumesFromImageTest-52926536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:42:57 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-67803ab7-d7f9-4ee1-99d0-1555640106bb tempest-CreateVolumesFromImageTest-52926536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:42:57 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-67803ab7-d7f9-4ee1-99d0-1555640106bb tempest-CreateVolumesFromImageTest-52926536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:42:57 devstack sudo[106644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:42:57 devstack sudo[106644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:42:57 devstack sudo[106642]: pam_unix(sudo:session): session closed for user root
Nov 03 18:42:57 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-60015237-dd48-4d26-9d69-1307b83105cd tempest-VolumeAndVolumeTypeFromImageTest-1310239933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-d1b4de5e-5760-48c2-aae4-0481e5591d16" returned: 0 in 0.485s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:42:57 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-60015237-dd48-4d26-9d69-1307b83105cd tempest-VolumeAndVolumeTypeFromImageTest-1310239933 None] Lock "cinder-quobyte-d1b4de5e-5760-48c2-aae4-0481e5591d16" released by "delete_volume" :: held 1.647s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:42:57 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-60015237-dd48-4d26-9d69-1307b83105cd tempest-VolumeAndVolumeTypeFromImageTest-1310239933 None] Created reservations ['e288b1f1-2c7c-4260-bf36-c0a39e2d24d4', 'adf9d49e-3802-4bf3-8e76-aa314d77deed', '0226af11-4866-4c2c-a6d4-943af98ec612', '11e8e2ab-762a-4305-a64c-22e3905ac93f'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:42:57 devstack sudo[106644]: pam_unix(sudo:session): session closed for user root
Nov 03 18:42:57 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-67803ab7-d7f9-4ee1-99d0-1555640106bb tempest-CreateVolumesFromImageTest-52926536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.436s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:42:57 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-67803ab7-d7f9-4ee1-99d0-1555640106bb tempest-CreateVolumesFromImageTest-52926536 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:42:57 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-67803ab7-d7f9-4ee1-99d0-1555640106bb tempest-CreateVolumesFromImageTest-52926536 None] Deleted volume successfully.
Nov 03 18:42:58 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-67803ab7-d7f9-4ee1-99d0-1555640106bb tempest-CreateVolumesFromImageTest-52926536 None] Lock "cinder-8fce4ea3-1bc6-422b-9654-9b571973f5b4-delete_volume" released by "delete_volume" :: held 2.534s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:42:58 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-60015237-dd48-4d26-9d69-1307b83105cd tempest-VolumeAndVolumeTypeFromImageTest-1310239933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:42:58 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-60015237-dd48-4d26-9d69-1307b83105cd tempest-VolumeAndVolumeTypeFromImageTest-1310239933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:42:58 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-60015237-dd48-4d26-9d69-1307b83105cd tempest-VolumeAndVolumeTypeFromImageTest-1310239933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:42:58 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-60015237-dd48-4d26-9d69-1307b83105cd tempest-VolumeAndVolumeTypeFromImageTest-1310239933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:42:58 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-60015237-dd48-4d26-9d69-1307b83105cd tempest-VolumeAndVolumeTypeFromImageTest-1310239933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:42:58 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-60015237-dd48-4d26-9d69-1307b83105cd tempest-VolumeAndVolumeTypeFromImageTest-1310239933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:42:58 devstack sudo[106648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:42:58 devstack sudo[106648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:42:58 devstack sudo[106648]: pam_unix(sudo:session): session closed for user root
Nov 03 18:42:58 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-60015237-dd48-4d26-9d69-1307b83105cd tempest-VolumeAndVolumeTypeFromImageTest-1310239933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.684s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:42:58 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-60015237-dd48-4d26-9d69-1307b83105cd tempest-VolumeAndVolumeTypeFromImageTest-1310239933 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:42:58 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-60015237-dd48-4d26-9d69-1307b83105cd tempest-VolumeAndVolumeTypeFromImageTest-1310239933 None] Deleted volume successfully.
Nov 03 18:42:58 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-60015237-dd48-4d26-9d69-1307b83105cd tempest-VolumeAndVolumeTypeFromImageTest-1310239933 None] Lock "cinder-d1b4de5e-5760-48c2-aae4-0481e5591d16-delete_volume" released by "delete_volume" :: held 2.860s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:43:01 devstack sudo[106585]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:01 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-1ee96dc7-30f4-4d3c-85fd-22e7be6ac309 tempest-VolumeDependencyTests-1180853825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-50f2588d-fbda-417a-a67f-0b7e6a294e3d /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-60fc7e60-2347-45e7-85b0-6ee397f40780" returned: 0 in 9.037s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:01 devstack cinder-volume[86120]: DEBUG cinder.image.image_utils [None req-1ee96dc7-30f4-4d3c-85fd-22e7be6ac309 tempest-VolumeDependencyTests-1180853825 None] Image conversion details: src /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-50f2588d-fbda-417a-a67f-0b7e6a294e3d, size 1024.00 MB, duration 9.04 sec, destination /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-60fc7e60-2347-45e7-85b0-6ee397f40780 {{(pid=86120) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 03 18:43:01 devstack cinder-volume[86120]: INFO cinder.image.image_utils [None req-1ee96dc7-30f4-4d3c-85fd-22e7be6ac309 tempest-VolumeDependencyTests-1180853825 None] Converted 1024.00 MB image at 113.30 MB/s
Nov 03 18:43:01 devstack cinder-volume[86120]: WARNING cinder.volume.drivers.remotefs [None req-1ee96dc7-30f4-4d3c-85fd-22e7be6ac309 tempest-VolumeDependencyTests-1180853825 None] /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-60fc7e60-2347-45e7-85b0-6ee397f40780 is being set with open permissions: ugo+rw
Nov 03 18:43:01 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-1ee96dc7-30f4-4d3c-85fd-22e7be6ac309 tempest-VolumeDependencyTests-1180853825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-60fc7e60-2347-45e7-85b0-6ee397f40780 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:01 devstack sudo[106652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-60fc7e60-2347-45e7-85b0-6ee397f40780
Nov 03 18:43:01 devstack sudo[106652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:01 devstack sudo[106652]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:01 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-1ee96dc7-30f4-4d3c-85fd-22e7be6ac309 tempest-VolumeDependencyTests-1180853825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-60fc7e60-2347-45e7-85b0-6ee397f40780" returned: 0 in 0.366s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:01 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-1ee96dc7-30f4-4d3c-85fd-22e7be6ac309 tempest-VolumeDependencyTests-1180853825 None] Lock "cinder-quobyte-60fc7e60-2347-45e7-85b0-6ee397f40780" released by "_copy_volume_from_snapshot" :: held 10.555s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:43:01 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-1ee96dc7-30f4-4d3c-85fd-22e7be6ac309 tempest-VolumeDependencyTests-1180853825 None] Lock "cinder-quobyte-7e451827-d038-48f4-989e-566093823c38-60fc7e60-2347-45e7-85b0-6ee397f40780" released by "_create_volume_from_snapshot" :: held 10.666s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:43:01 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-1ee96dc7-30f4-4d3c-85fd-22e7be6ac309 tempest-VolumeDependencyTests-1180853825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.721s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:43:01 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-1ee96dc7-30f4-4d3c-85fd-22e7be6ac309 tempest-VolumeDependencyTests-1180853825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8476a413-7ded-4d90-a3b6-e3f8fb8333a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60fc7e60-2347-45e7-85b0-6ee397f40780', 'volume_size': 1, 'snapshot_id': '7e451827-d038-48f4-989e-566093823c38'}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:43:01 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-1ee96dc7-30f4-4d3c-85fd-22e7be6ac309 tempest-VolumeDependencyTests-1180853825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae02c1ff-9315-4d56-9a99-9e88c35bebf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:43:01 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-1ee96dc7-30f4-4d3c-85fd-22e7be6ac309 tempest-VolumeDependencyTests-1180853825 None] Volume volume-60fc7e60-2347-45e7-85b0-6ee397f40780 (60fc7e60-2347-45e7-85b0-6ee397f40780): created successfully
Nov 03 18:43:01 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-1ee96dc7-30f4-4d3c-85fd-22e7be6ac309 tempest-VolumeDependencyTests-1180853825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae02c1ff-9315-4d56-9a99-9e88c35bebf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:43:01 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-1ee96dc7-30f4-4d3c-85fd-22e7be6ac309 tempest-VolumeDependencyTests-1180853825 None] Flow 'volume_create_manager' (f2151f35-4f45-4420-9b82-b2d9b1ec6bdf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:43:01 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-1ee96dc7-30f4-4d3c-85fd-22e7be6ac309 tempest-VolumeDependencyTests-1180853825 None] Created volume successfully.
Nov 03 18:43:02 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-62b934a4-2780-465c-b619-29da34df9331 tempest-VolumeDependencyTests-1180853825 None] Acquiring lock "cinder-7e451827-d038-48f4-989e-566093823c38-delete_snapshot" by "delete_snapshot" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:43:02 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-62b934a4-2780-465c-b619-29da34df9331 tempest-VolumeDependencyTests-1180853825 None] Lock "cinder-7e451827-d038-48f4-989e-566093823c38-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:43:02 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-62b934a4-2780-465c-b619-29da34df9331 tempest-VolumeDependencyTests-1180853825 None] Acquiring lock "cinder-quobyte-50f2588d-fbda-417a-a67f-0b7e6a294e3d" by "delete_snapshot" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:43:02 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-62b934a4-2780-465c-b619-29da34df9331 tempest-VolumeDependencyTests-1180853825 None] Lock "cinder-quobyte-50f2588d-fbda-417a-a67f-0b7e6a294e3d" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:43:02 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-62b934a4-2780-465c-b619-29da34df9331 tempest-VolumeDependencyTests-1180853825 None] Acquiring lock "cinder-quobyte-7e451827-d038-48f4-989e-566093823c38" by "_delete_snapshot" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:43:02 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-62b934a4-2780-465c-b619-29da34df9331 tempest-VolumeDependencyTests-1180853825 None] Lock "cinder-quobyte-7e451827-d038-48f4-989e-566093823c38" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:43:02 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-62b934a4-2780-465c-b619-29da34df9331 tempest-VolumeDependencyTests-1180853825 None] Deleting offline snapshot 7e451827-d038-48f4-989e-566093823c38 of volume 50f2588d-fbda-417a-a67f-0b7e6a294e3d {{(pid=86120) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 18:43:02 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-62b934a4-2780-465c-b619-29da34df9331 tempest-VolumeDependencyTests-1180853825 None] snapshot_file for this snap is: volume-50f2588d-fbda-417a-a67f-0b7e6a294e3d.7e451827-d038-48f4-989e-566093823c38 {{(pid=86120) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 18:43:02 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ef8794b-97a2-4571-a1a2-67eae6386072]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:43:02 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-62b934a4-2780-465c-b619-29da34df9331 tempest-VolumeDependencyTests-1180853825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-50f2588d-fbda-417a-a67f-0b7e6a294e3d.7e451827-d038-48f4-989e-566093823c38 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:02 devstack sudo[106655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-50f2588d-fbda-417a-a67f-0b7e6a294e3d.7e451827-d038-48f4-989e-566093823c38
Nov 03 18:43:02 devstack sudo[106655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:02 devstack sudo[106655]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:02 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-62b934a4-2780-465c-b619-29da34df9331 tempest-VolumeDependencyTests-1180853825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-50f2588d-fbda-417a-a67f-0b7e6a294e3d.7e451827-d038-48f4-989e-566093823c38" returned: 0 in 0.425s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:02 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-62b934a4-2780-465c-b619-29da34df9331 tempest-VolumeDependencyTests-1180853825 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-50f2588d-fbda-417a-a67f-0b7e6a294e3d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86120) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 18:43:02 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[0da423d3-e864-4ce7-8c64-5b2394d5bc55]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:43:02 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-62b934a4-2780-465c-b619-29da34df9331 tempest-VolumeDependencyTests-1180853825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-50f2588d-fbda-417a-a67f-0b7e6a294e3d {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:02 devstack sudo[106661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-50f2588d-fbda-417a-a67f-0b7e6a294e3d
Nov 03 18:43:02 devstack sudo[106661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:03 devstack sudo[106661]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:03 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-62b934a4-2780-465c-b619-29da34df9331 tempest-VolumeDependencyTests-1180853825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-50f2588d-fbda-417a-a67f-0b7e6a294e3d" returned: 0 in 0.780s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:03 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-62b934a4-2780-465c-b619-29da34df9331 tempest-VolumeDependencyTests-1180853825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-50f2588d-fbda-417a-a67f-0b7e6a294e3d.7e451827-d038-48f4-989e-566093823c38 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:03 devstack sudo[106666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-50f2588d-fbda-417a-a67f-0b7e6a294e3d.7e451827-d038-48f4-989e-566093823c38
Nov 03 18:43:03 devstack sudo[106666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:03 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-8aef2a70-253b-4a9d-be9f-17f6f51cda52 tempest-CreateVolumesFromSnapshotTest-853708760 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:43:03 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-8aef2a70-253b-4a9d-be9f-17f6f51cda52 tempest-CreateVolumesFromSnapshotTest-853708760 None] Flow 'volume_create_manager' (93b66217-6694-4142-aef7-ca648b25e760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:43:03 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-8aef2a70-253b-4a9d-be9f-17f6f51cda52 tempest-CreateVolumesFromSnapshotTest-853708760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b179f7e0-7a62-48f6-95cc-32a608156a67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:43:03 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-8aef2a70-253b-4a9d-be9f-17f6f51cda52 tempest-CreateVolumesFromSnapshotTest-853708760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b179f7e0-7a62-48f6-95cc-32a608156a67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:43:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-855322472',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9db187f-e9b2-43db-973d-03dbca2d38c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d47f25975e39410f88fd40a8e64746a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:43:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:43:04Z,use_quota=True,user_id='6365179a55154fcea6e31f1fb7949df3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:43:03 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-8aef2a70-253b-4a9d-be9f-17f6f51cda52 tempest-CreateVolumesFromSnapshotTest-853708760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82616465-9ab5-4b5d-a61b-aabc2923c07a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:43:03 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-8aef2a70-253b-4a9d-be9f-17f6f51cda52 tempest-CreateVolumesFromSnapshotTest-853708760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82616465-9ab5-4b5d-a61b-aabc2923c07a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:43:03 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-8aef2a70-253b-4a9d-be9f-17f6f51cda52 tempest-CreateVolumesFromSnapshotTest-853708760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (441494e8-42cf-4080-ab9f-293842945ac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:43:03 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-8aef2a70-253b-4a9d-be9f-17f6f51cda52 tempest-CreateVolumesFromSnapshotTest-853708760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (441494e8-42cf-4080-ab9f-293842945ac3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9db187f-e9b2-43db-973d-03dbca2d38c0', 'volume_name': 'volume-f9db187f-e9b2-43db-973d-03dbca2d38c0', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:43:03 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-8aef2a70-253b-4a9d-be9f-17f6f51cda52 tempest-CreateVolumesFromSnapshotTest-853708760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db0a7a98-af89-47a6-86a4-517f3002ea60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:43:03 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-8aef2a70-253b-4a9d-be9f-17f6f51cda52 tempest-CreateVolumesFromSnapshotTest-853708760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db0a7a98-af89-47a6-86a4-517f3002ea60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:43:03 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-8aef2a70-253b-4a9d-be9f-17f6f51cda52 tempest-CreateVolumesFromSnapshotTest-853708760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97f44503-51cd-4f02-b803-6eea08ad0444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:43:03 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-8aef2a70-253b-4a9d-be9f-17f6f51cda52 tempest-CreateVolumesFromSnapshotTest-853708760 None] Volume f9db187f-e9b2-43db-973d-03dbca2d38c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9db187f-e9b2-43db-973d-03dbca2d38c0', 'volume_size': 1}
Nov 03 18:43:03 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-8aef2a70-253b-4a9d-be9f-17f6f51cda52 tempest-CreateVolumesFromSnapshotTest-853708760 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:43:03 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-8aef2a70-253b-4a9d-be9f-17f6f51cda52 tempest-CreateVolumesFromSnapshotTest-853708760 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:43:03 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-8aef2a70-253b-4a9d-be9f-17f6f51cda52 tempest-CreateVolumesFromSnapshotTest-853708760 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:43:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-855322472',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9db187f-e9b2-43db-973d-03dbca2d38c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d47f25975e39410f88fd40a8e64746a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:43:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:43:04Z,use_quota=True,user_id='6365179a55154fcea6e31f1fb7949df3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:43:03 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-8aef2a70-253b-4a9d-be9f-17f6f51cda52 tempest-CreateVolumesFromSnapshotTest-853708760 None] Creating volume f9db187f-e9b2-43db-973d-03dbca2d38c0 {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:43:03 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-8aef2a70-253b-4a9d-be9f-17f6f51cda52 tempest-CreateVolumesFromSnapshotTest-853708760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:43:03 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-8aef2a70-253b-4a9d-be9f-17f6f51cda52 tempest-CreateVolumesFromSnapshotTest-853708760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:43:03 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-8aef2a70-253b-4a9d-be9f-17f6f51cda52 tempest-CreateVolumesFromSnapshotTest-853708760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:43:03 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-8aef2a70-253b-4a9d-be9f-17f6f51cda52 tempest-CreateVolumesFromSnapshotTest-853708760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:43:03 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-8aef2a70-253b-4a9d-be9f-17f6f51cda52 tempest-CreateVolumesFromSnapshotTest-853708760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:43:03 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-8aef2a70-253b-4a9d-be9f-17f6f51cda52 tempest-CreateVolumesFromSnapshotTest-853708760 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:43:03 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-8aef2a70-253b-4a9d-be9f-17f6f51cda52 tempest-CreateVolumesFromSnapshotTest-853708760 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:43:03 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-8aef2a70-253b-4a9d-be9f-17f6f51cda52 tempest-CreateVolumesFromSnapshotTest-853708760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f9db187f-e9b2-43db-973d-03dbca2d38c0 1073741824 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:03 devstack sudo[106668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f9db187f-e9b2-43db-973d-03dbca2d38c0 1073741824
Nov 03 18:43:03 devstack sudo[106668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:03 devstack sudo[106666]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:03 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-62b934a4-2780-465c-b619-29da34df9331 tempest-VolumeDependencyTests-1180853825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-50f2588d-fbda-417a-a67f-0b7e6a294e3d.7e451827-d038-48f4-989e-566093823c38" returned: 0 in 0.542s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:03 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-62b934a4-2780-465c-b619-29da34df9331 tempest-VolumeDependencyTests-1180853825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-50f2588d-fbda-417a-a67f-0b7e6a294e3d.7e451827-d038-48f4-989e-566093823c38 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:04 devstack sudo[106673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-50f2588d-fbda-417a-a67f-0b7e6a294e3d.7e451827-d038-48f4-989e-566093823c38
Nov 03 18:43:04 devstack sudo[106673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:04 devstack sudo[106673]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:04 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-62b934a4-2780-465c-b619-29da34df9331 tempest-VolumeDependencyTests-1180853825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-50f2588d-fbda-417a-a67f-0b7e6a294e3d.7e451827-d038-48f4-989e-566093823c38" returned: 0 in 0.298s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:04 devstack sudo[106668]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:04 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-8aef2a70-253b-4a9d-be9f-17f6f51cda52 tempest-CreateVolumesFromSnapshotTest-853708760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f9db187f-e9b2-43db-973d-03dbca2d38c0 1073741824" returned: 0 in 0.571s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:04 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-62b934a4-2780-465c-b619-29da34df9331 tempest-VolumeDependencyTests-1180853825 None] Lock "cinder-quobyte-7e451827-d038-48f4-989e-566093823c38" released by "_delete_snapshot" :: held 2.219s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:43:04 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-62b934a4-2780-465c-b619-29da34df9331 tempest-VolumeDependencyTests-1180853825 None] Lock "cinder-quobyte-50f2588d-fbda-417a-a67f-0b7e6a294e3d" released by "delete_snapshot" :: held 2.255s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:43:04 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-8aef2a70-253b-4a9d-be9f-17f6f51cda52 tempest-CreateVolumesFromSnapshotTest-853708760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f9db187f-e9b2-43db-973d-03dbca2d38c0 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:04 devstack sudo[106680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f9db187f-e9b2-43db-973d-03dbca2d38c0
Nov 03 18:43:04 devstack sudo[106680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:04 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-62b934a4-2780-465c-b619-29da34df9331 tempest-VolumeDependencyTests-1180853825 None] Created reservations ['5ec83717-293c-4576-bcfe-b7035a2c6fb9', 'dd9e4d9d-6f66-4325-b5ed-8ddc0c527405', 'e3a73d02-ddb2-476f-8063-ed35b78a120d', '402d817b-3a10-4c35-9fb5-fbef48a81a37'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:43:04 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-62b934a4-2780-465c-b619-29da34df9331 tempest-VolumeDependencyTests-1180853825 None] Delete snapshot completed successfully.
Nov 03 18:43:04 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-62b934a4-2780-465c-b619-29da34df9331 tempest-VolumeDependencyTests-1180853825 None] Lock "cinder-7e451827-d038-48f4-989e-566093823c38-delete_snapshot" released by "delete_snapshot" :: held 2.472s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:43:04 devstack sudo[106680]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:04 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-8aef2a70-253b-4a9d-be9f-17f6f51cda52 tempest-CreateVolumesFromSnapshotTest-853708760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f9db187f-e9b2-43db-973d-03dbca2d38c0" returned: 0 in 0.339s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:04 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-8aef2a70-253b-4a9d-be9f-17f6f51cda52 tempest-CreateVolumesFromSnapshotTest-853708760 None] <== create_volume: return (1004ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:43:04 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-8aef2a70-253b-4a9d-be9f-17f6f51cda52 tempest-CreateVolumesFromSnapshotTest-853708760 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.006s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:43:04 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-8aef2a70-253b-4a9d-be9f-17f6f51cda52 tempest-CreateVolumesFromSnapshotTest-853708760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97f44503-51cd-4f02-b803-6eea08ad0444) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9db187f-e9b2-43db-973d-03dbca2d38c0', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:43:04 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-8aef2a70-253b-4a9d-be9f-17f6f51cda52 tempest-CreateVolumesFromSnapshotTest-853708760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d46170cc-222f-436c-b5a0-b97f01ab8f99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:43:04 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-8aef2a70-253b-4a9d-be9f-17f6f51cda52 tempest-CreateVolumesFromSnapshotTest-853708760 None] Volume volume-f9db187f-e9b2-43db-973d-03dbca2d38c0 (f9db187f-e9b2-43db-973d-03dbca2d38c0): created successfully
Nov 03 18:43:04 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-8aef2a70-253b-4a9d-be9f-17f6f51cda52 tempest-CreateVolumesFromSnapshotTest-853708760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d46170cc-222f-436c-b5a0-b97f01ab8f99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:43:04 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-8aef2a70-253b-4a9d-be9f-17f6f51cda52 tempest-CreateVolumesFromSnapshotTest-853708760 None] Flow 'volume_create_manager' (93b66217-6694-4142-aef7-ca648b25e760) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:43:04 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-8aef2a70-253b-4a9d-be9f-17f6f51cda52 tempest-CreateVolumesFromSnapshotTest-853708760 None] Created volume successfully.
Nov 03 18:43:05 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-491578e7-8e21-4810-8a2b-6ab82a099a58 tempest-VolumeDependencyTests-1180853825 None] Acquiring lock "cinder-50f2588d-fbda-417a-a67f-0b7e6a294e3d-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:43:05 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-491578e7-8e21-4810-8a2b-6ab82a099a58 tempest-VolumeDependencyTests-1180853825 None] Lock "cinder-50f2588d-fbda-417a-a67f-0b7e6a294e3d-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:43:05 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-491578e7-8e21-4810-8a2b-6ab82a099a58 tempest-VolumeDependencyTests-1180853825 None] Acquiring lock "cinder-quobyte-50f2588d-fbda-417a-a67f-0b7e6a294e3d" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:43:05 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-491578e7-8e21-4810-8a2b-6ab82a099a58 tempest-VolumeDependencyTests-1180853825 None] Lock "cinder-quobyte-50f2588d-fbda-417a-a67f-0b7e6a294e3d" acquired by "delete_volume" :: waited 0.019s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:43:05 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dfc6b3b-1d51-49fa-9d38-0f05c22afad7]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:43:05 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-491578e7-8e21-4810-8a2b-6ab82a099a58 tempest-VolumeDependencyTests-1180853825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-50f2588d-fbda-417a-a67f-0b7e6a294e3d {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:05 devstack sudo[106683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-50f2588d-fbda-417a-a67f-0b7e6a294e3d
Nov 03 18:43:05 devstack sudo[106683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:05 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-669ae632-bf6a-407b-aed4-b9ad573f7f58 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:43:05 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-669ae632-bf6a-407b-aed4-b9ad573f7f58 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Flow 'volume_create_manager' (3d12b9b0-bebe-4ee5-bb71-234fea30bd30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:43:05 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-669ae632-bf6a-407b-aed4-b9ad573f7f58 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6ee2589-0cfc-42aa-a4ed-d64088ec9d0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:43:05 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-669ae632-bf6a-407b-aed4-b9ad573f7f58 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6ee2589-0cfc-42aa-a4ed-d64088ec9d0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:43:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2025207790',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08981357-ce62-4c51-b5d4-2eb176f096f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b20ba539b6054041bece3cb278c0f45e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:43:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:43:06Z,use_quota=True,user_id='242d6128218647498d97b4fda5b559e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:43:05 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-669ae632-bf6a-407b-aed4-b9ad573f7f58 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffb664ab-5b36-4ad2-bb4f-58851992acaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:43:05 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-669ae632-bf6a-407b-aed4-b9ad573f7f58 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffb664ab-5b36-4ad2-bb4f-58851992acaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:43:05 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-669ae632-bf6a-407b-aed4-b9ad573f7f58 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a29d42f8-c8c8-45a5-b86b-fcc966a48dfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:43:05 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-669ae632-bf6a-407b-aed4-b9ad573f7f58 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a29d42f8-c8c8-45a5-b86b-fcc966a48dfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08981357-ce62-4c51-b5d4-2eb176f096f3', 'volume_name': 'volume-08981357-ce62-4c51-b5d4-2eb176f096f3', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:43:05 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-669ae632-bf6a-407b-aed4-b9ad573f7f58 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcedfa69-bb9f-4981-a6b9-788af82bb487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:43:05 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-669ae632-bf6a-407b-aed4-b9ad573f7f58 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcedfa69-bb9f-4981-a6b9-788af82bb487) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:43:05 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-669ae632-bf6a-407b-aed4-b9ad573f7f58 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46fca3c1-19bd-40a6-be78-0ed613ea5446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:43:05 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-669ae632-bf6a-407b-aed4-b9ad573f7f58 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Volume 08981357-ce62-4c51-b5d4-2eb176f096f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08981357-ce62-4c51-b5d4-2eb176f096f3', 'volume_size': 1}
Nov 03 18:43:05 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-669ae632-bf6a-407b-aed4-b9ad573f7f58 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:43:05 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-669ae632-bf6a-407b-aed4-b9ad573f7f58 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:43:05 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-669ae632-bf6a-407b-aed4-b9ad573f7f58 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:43:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2025207790',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08981357-ce62-4c51-b5d4-2eb176f096f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b20ba539b6054041bece3cb278c0f45e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:43:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:43:06Z,use_quota=True,user_id='242d6128218647498d97b4fda5b559e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:43:05 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-669ae632-bf6a-407b-aed4-b9ad573f7f58 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Creating volume 08981357-ce62-4c51-b5d4-2eb176f096f3 {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:43:05 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-669ae632-bf6a-407b-aed4-b9ad573f7f58 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:43:05 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-669ae632-bf6a-407b-aed4-b9ad573f7f58 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:43:05 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-669ae632-bf6a-407b-aed4-b9ad573f7f58 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:43:05 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-669ae632-bf6a-407b-aed4-b9ad573f7f58 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:43:05 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-669ae632-bf6a-407b-aed4-b9ad573f7f58 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:43:05 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-669ae632-bf6a-407b-aed4-b9ad573f7f58 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:43:05 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-669ae632-bf6a-407b-aed4-b9ad573f7f58 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:43:06 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-669ae632-bf6a-407b-aed4-b9ad573f7f58 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-08981357-ce62-4c51-b5d4-2eb176f096f3 1073741824 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:06 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a0e218f-a5b5-4186-bbd9-5886a1a2335d tempest-ProjectReaderTests-964059183 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:43:06 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-7a0e218f-a5b5-4186-bbd9-5886a1a2335d tempest-ProjectReaderTests-964059183 None] Flow 'volume_create_manager' (b8ba6dda-941a-4108-9bc3-f48fec4a4865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:43:06 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-7a0e218f-a5b5-4186-bbd9-5886a1a2335d tempest-ProjectReaderTests-964059183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1dc823fa-bdba-4358-83e1-7690d082d65f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:43:06 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-7a0e218f-a5b5-4186-bbd9-5886a1a2335d tempest-ProjectReaderTests-964059183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1dc823fa-bdba-4358-83e1-7690d082d65f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:43:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-945701603',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=baa0c688-01f3-46f7-90b5-52bef38970f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f24206f5f1e4ac19bde23d31d296883',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:43:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:43:06Z,use_quota=True,user_id='e6c9675a59f54b34b6743622a5b243b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:43:06 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-7a0e218f-a5b5-4186-bbd9-5886a1a2335d tempest-ProjectReaderTests-964059183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd22410b-2426-4f29-a31b-54948afe0314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:43:06 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-7a0e218f-a5b5-4186-bbd9-5886a1a2335d tempest-ProjectReaderTests-964059183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd22410b-2426-4f29-a31b-54948afe0314) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:43:05 devstack sudo[106686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-08981357-ce62-4c51-b5d4-2eb176f096f3 1073741824
Nov 03 18:43:06 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-7a0e218f-a5b5-4186-bbd9-5886a1a2335d tempest-ProjectReaderTests-964059183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b713b3bc-92ec-42d9-b0a1-c15613d2c3d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:43:06 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-7a0e218f-a5b5-4186-bbd9-5886a1a2335d tempest-ProjectReaderTests-964059183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b713b3bc-92ec-42d9-b0a1-c15613d2c3d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'baa0c688-01f3-46f7-90b5-52bef38970f1', 'volume_name': 'volume-baa0c688-01f3-46f7-90b5-52bef38970f1', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:43:06 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-7a0e218f-a5b5-4186-bbd9-5886a1a2335d tempest-ProjectReaderTests-964059183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9efd0dc-0b39-45d3-94ef-4ea65dfc7e88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:43:05 devstack sudo[106686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:06 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-7a0e218f-a5b5-4186-bbd9-5886a1a2335d tempest-ProjectReaderTests-964059183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9efd0dc-0b39-45d3-94ef-4ea65dfc7e88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:43:06 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-7a0e218f-a5b5-4186-bbd9-5886a1a2335d tempest-ProjectReaderTests-964059183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eeb98981-2979-4fc1-80ea-8d30a7b155bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:43:06 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-7a0e218f-a5b5-4186-bbd9-5886a1a2335d tempest-ProjectReaderTests-964059183 None] Volume baa0c688-01f3-46f7-90b5-52bef38970f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-baa0c688-01f3-46f7-90b5-52bef38970f1', 'volume_size': 1}
Nov 03 18:43:06 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-7a0e218f-a5b5-4186-bbd9-5886a1a2335d tempest-ProjectReaderTests-964059183 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:43:06 devstack sudo[106683]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:06 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-491578e7-8e21-4810-8a2b-6ab82a099a58 tempest-VolumeDependencyTests-1180853825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-50f2588d-fbda-417a-a67f-0b7e6a294e3d" returned: 0 in 0.456s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:06 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-491578e7-8e21-4810-8a2b-6ab82a099a58 tempest-VolumeDependencyTests-1180853825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-50f2588d-fbda-417a-a67f-0b7e6a294e3d {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:06 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-8dc462e0-3894-4e6e-a952-586d23a7aefa tempest-CreateVolumesFromSnapshotTest-853708760 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:43:06 devstack sudo[106693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-50f2588d-fbda-417a-a67f-0b7e6a294e3d
Nov 03 18:43:06 devstack sudo[106693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:06 devstack sudo[106693]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:06 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-491578e7-8e21-4810-8a2b-6ab82a099a58 tempest-VolumeDependencyTests-1180853825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-50f2588d-fbda-417a-a67f-0b7e6a294e3d" returned: 0 in 0.270s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:06 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-491578e7-8e21-4810-8a2b-6ab82a099a58 tempest-VolumeDependencyTests-1180853825 None] Lock "cinder-quobyte-50f2588d-fbda-417a-a67f-0b7e6a294e3d" released by "delete_volume" :: held 0.817s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:43:06 devstack sudo[106686]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:06 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-669ae632-bf6a-407b-aed4-b9ad573f7f58 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-08981357-ce62-4c51-b5d4-2eb176f096f3 1073741824" returned: 0 in 0.503s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:06 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-491578e7-8e21-4810-8a2b-6ab82a099a58 tempest-VolumeDependencyTests-1180853825 None] Created reservations ['4d4ced65-9abf-4046-b674-705eaab664ed', 'ba220e4d-16d1-41e9-9d13-e3310e708afc', '884f75fe-2b1c-4e79-8071-284f50aa4887', 'b2b2d7a0-8463-4505-ba6a-9001c58684c4'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:43:06 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-669ae632-bf6a-407b-aed4-b9ad573f7f58 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-08981357-ce62-4c51-b5d4-2eb176f096f3 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:06 devstack sudo[106699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-08981357-ce62-4c51-b5d4-2eb176f096f3
Nov 03 18:43:06 devstack sudo[106699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:06 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-491578e7-8e21-4810-8a2b-6ab82a099a58 tempest-VolumeDependencyTests-1180853825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:43:06 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-491578e7-8e21-4810-8a2b-6ab82a099a58 tempest-VolumeDependencyTests-1180853825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:43:06 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-491578e7-8e21-4810-8a2b-6ab82a099a58 tempest-VolumeDependencyTests-1180853825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:43:06 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-491578e7-8e21-4810-8a2b-6ab82a099a58 tempest-VolumeDependencyTests-1180853825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:43:06 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-491578e7-8e21-4810-8a2b-6ab82a099a58 tempest-VolumeDependencyTests-1180853825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:43:06 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-491578e7-8e21-4810-8a2b-6ab82a099a58 tempest-VolumeDependencyTests-1180853825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:06 devstack sudo[106701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:43:06 devstack sudo[106701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:06 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-1b0e74c6-2c59-422b-a6ce-7eb8662aead9 tempest-VolumeDependencyTests-1180853825 None] Acquiring lock "cinder-60fc7e60-2347-45e7-85b0-6ee397f40780-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:43:06 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-1b0e74c6-2c59-422b-a6ce-7eb8662aead9 tempest-VolumeDependencyTests-1180853825 None] Lock "cinder-60fc7e60-2347-45e7-85b0-6ee397f40780-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:43:06 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-1b0e74c6-2c59-422b-a6ce-7eb8662aead9 tempest-VolumeDependencyTests-1180853825 None] Acquiring lock "cinder-quobyte-60fc7e60-2347-45e7-85b0-6ee397f40780" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:43:06 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-1b0e74c6-2c59-422b-a6ce-7eb8662aead9 tempest-VolumeDependencyTests-1180853825 None] Lock "cinder-quobyte-60fc7e60-2347-45e7-85b0-6ee397f40780" acquired by "delete_volume" :: waited 0.023s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:43:06 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[8252f878-1e37-42ff-9e5d-003dc89f995e]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:43:06 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-1b0e74c6-2c59-422b-a6ce-7eb8662aead9 tempest-VolumeDependencyTests-1180853825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-60fc7e60-2347-45e7-85b0-6ee397f40780 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:06 devstack sudo[106699]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:06 devstack sudo[106701]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:06 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-669ae632-bf6a-407b-aed4-b9ad573f7f58 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-08981357-ce62-4c51-b5d4-2eb176f096f3" returned: 0 in 0.338s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:06 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-669ae632-bf6a-407b-aed4-b9ad573f7f58 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] <== create_volume: return (886ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:43:06 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-669ae632-bf6a-407b-aed4-b9ad573f7f58 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.888s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:43:06 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-7a0e218f-a5b5-4186-bbd9-5886a1a2335d tempest-ProjectReaderTests-964059183 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.726s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:43:06 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-7a0e218f-a5b5-4186-bbd9-5886a1a2335d tempest-ProjectReaderTests-964059183 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:43:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-945701603',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=baa0c688-01f3-46f7-90b5-52bef38970f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f24206f5f1e4ac19bde23d31d296883',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:43:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:43:06Z,use_quota=True,user_id='e6c9675a59f54b34b6743622a5b243b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:43:06 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-7a0e218f-a5b5-4186-bbd9-5886a1a2335d tempest-ProjectReaderTests-964059183 None] Creating volume baa0c688-01f3-46f7-90b5-52bef38970f1 {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:43:06 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-7a0e218f-a5b5-4186-bbd9-5886a1a2335d tempest-ProjectReaderTests-964059183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:43:06 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-7a0e218f-a5b5-4186-bbd9-5886a1a2335d tempest-ProjectReaderTests-964059183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:43:06 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-7a0e218f-a5b5-4186-bbd9-5886a1a2335d tempest-ProjectReaderTests-964059183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:43:06 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-7a0e218f-a5b5-4186-bbd9-5886a1a2335d tempest-ProjectReaderTests-964059183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:43:06 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-7a0e218f-a5b5-4186-bbd9-5886a1a2335d tempest-ProjectReaderTests-964059183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:43:06 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-7a0e218f-a5b5-4186-bbd9-5886a1a2335d tempest-ProjectReaderTests-964059183 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:43:06 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-7a0e218f-a5b5-4186-bbd9-5886a1a2335d tempest-ProjectReaderTests-964059183 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:43:06 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-7a0e218f-a5b5-4186-bbd9-5886a1a2335d tempest-ProjectReaderTests-964059183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-baa0c688-01f3-46f7-90b5-52bef38970f1 1073741824 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:06 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-491578e7-8e21-4810-8a2b-6ab82a099a58 tempest-VolumeDependencyTests-1180853825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.311s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:06 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-491578e7-8e21-4810-8a2b-6ab82a099a58 tempest-VolumeDependencyTests-1180853825 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:43:06 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-491578e7-8e21-4810-8a2b-6ab82a099a58 tempest-VolumeDependencyTests-1180853825 None] Deleted volume successfully.
Nov 03 18:43:06 devstack sudo[106706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-baa0c688-01f3-46f7-90b5-52bef38970f1 1073741824
Nov 03 18:43:06 devstack sudo[106706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:06 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-669ae632-bf6a-407b-aed4-b9ad573f7f58 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46fca3c1-19bd-40a6-be78-0ed613ea5446) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08981357-ce62-4c51-b5d4-2eb176f096f3', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:43:06 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-669ae632-bf6a-407b-aed4-b9ad573f7f58 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70acedae-f38c-4fa7-ac8f-9f1ee805900d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:43:06 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-669ae632-bf6a-407b-aed4-b9ad573f7f58 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Volume volume-08981357-ce62-4c51-b5d4-2eb176f096f3 (08981357-ce62-4c51-b5d4-2eb176f096f3): created successfully
Nov 03 18:43:06 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-669ae632-bf6a-407b-aed4-b9ad573f7f58 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70acedae-f38c-4fa7-ac8f-9f1ee805900d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:43:06 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-669ae632-bf6a-407b-aed4-b9ad573f7f58 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Flow 'volume_create_manager' (3d12b9b0-bebe-4ee5-bb71-234fea30bd30) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:43:06 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-491578e7-8e21-4810-8a2b-6ab82a099a58 tempest-VolumeDependencyTests-1180853825 None] Lock "cinder-50f2588d-fbda-417a-a67f-0b7e6a294e3d-delete_volume" released by "delete_volume" :: held 1.397s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:43:06 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-669ae632-bf6a-407b-aed4-b9ad573f7f58 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Created volume successfully.
Nov 03 18:43:06 devstack sudo[106705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-60fc7e60-2347-45e7-85b0-6ee397f40780
Nov 03 18:43:06 devstack sudo[106705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:07 devstack sudo[106705]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:07 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-1b0e74c6-2c59-422b-a6ce-7eb8662aead9 tempest-VolumeDependencyTests-1180853825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-60fc7e60-2347-45e7-85b0-6ee397f40780" returned: 0 in 0.397s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:07 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-1b0e74c6-2c59-422b-a6ce-7eb8662aead9 tempest-VolumeDependencyTests-1180853825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-60fc7e60-2347-45e7-85b0-6ee397f40780 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:07 devstack sudo[106715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-60fc7e60-2347-45e7-85b0-6ee397f40780
Nov 03 18:43:07 devstack sudo[106715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:07 devstack sudo[106706]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:07 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-7a0e218f-a5b5-4186-bbd9-5886a1a2335d tempest-ProjectReaderTests-964059183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-baa0c688-01f3-46f7-90b5-52bef38970f1 1073741824" returned: 0 in 0.474s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:07 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-7a0e218f-a5b5-4186-bbd9-5886a1a2335d tempest-ProjectReaderTests-964059183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-baa0c688-01f3-46f7-90b5-52bef38970f1 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:07 devstack sudo[106719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-baa0c688-01f3-46f7-90b5-52bef38970f1
Nov 03 18:43:07 devstack sudo[106719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:07 devstack sudo[106715]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:07 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-1b0e74c6-2c59-422b-a6ce-7eb8662aead9 tempest-VolumeDependencyTests-1180853825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-60fc7e60-2347-45e7-85b0-6ee397f40780" returned: 0 in 0.245s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:07 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-1b0e74c6-2c59-422b-a6ce-7eb8662aead9 tempest-VolumeDependencyTests-1180853825 None] Lock "cinder-quobyte-60fc7e60-2347-45e7-85b0-6ee397f40780" released by "delete_volume" :: held 0.685s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:43:07 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-1b0e74c6-2c59-422b-a6ce-7eb8662aead9 tempest-VolumeDependencyTests-1180853825 None] Created reservations ['c4ba7150-4a12-49c4-bc35-6045133b12b0', '0869211d-1976-48a1-9f6f-a2c6eb99c9f7', '0dbc1faa-8dca-43ce-b406-2e0cc5c918cb', 'c3b0a51e-73b1-4178-92ad-0664bb32099e'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:43:07 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-1b0e74c6-2c59-422b-a6ce-7eb8662aead9 tempest-VolumeDependencyTests-1180853825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:43:07 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-1b0e74c6-2c59-422b-a6ce-7eb8662aead9 tempest-VolumeDependencyTests-1180853825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:43:07 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-1b0e74c6-2c59-422b-a6ce-7eb8662aead9 tempest-VolumeDependencyTests-1180853825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:43:07 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-1b0e74c6-2c59-422b-a6ce-7eb8662aead9 tempest-VolumeDependencyTests-1180853825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:43:07 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-1b0e74c6-2c59-422b-a6ce-7eb8662aead9 tempest-VolumeDependencyTests-1180853825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:43:07 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-1b0e74c6-2c59-422b-a6ce-7eb8662aead9 tempest-VolumeDependencyTests-1180853825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:07 devstack sudo[106723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:43:07 devstack sudo[106723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:07 devstack sudo[106719]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:07 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-7a0e218f-a5b5-4186-bbd9-5886a1a2335d tempest-ProjectReaderTests-964059183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-baa0c688-01f3-46f7-90b5-52bef38970f1" returned: 0 in 0.278s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:07 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-7a0e218f-a5b5-4186-bbd9-5886a1a2335d tempest-ProjectReaderTests-964059183 None] <== create_volume: return (798ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:43:07 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-7a0e218f-a5b5-4186-bbd9-5886a1a2335d tempest-ProjectReaderTests-964059183 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.802s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:43:07 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-8dc462e0-3894-4e6e-a952-586d23a7aefa tempest-CreateVolumesFromSnapshotTest-853708760 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.509s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:43:07 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-7a0e218f-a5b5-4186-bbd9-5886a1a2335d tempest-ProjectReaderTests-964059183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eeb98981-2979-4fc1-80ea-8d30a7b155bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-baa0c688-01f3-46f7-90b5-52bef38970f1', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:43:07 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-7a0e218f-a5b5-4186-bbd9-5886a1a2335d tempest-ProjectReaderTests-964059183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93c09a8d-1cd0-434c-a6ef-1dd078388064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:43:07 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-8dc462e0-3894-4e6e-a952-586d23a7aefa tempest-CreateVolumesFromSnapshotTest-853708760 None] Creating offline snapshot a76efa5e-863c-4db7-8577-0a8242cc4216 of volume f9db187f-e9b2-43db-973d-03dbca2d38c0 {{(pid=86120) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 18:43:07 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-7a0e218f-a5b5-4186-bbd9-5886a1a2335d tempest-ProjectReaderTests-964059183 None] Volume volume-baa0c688-01f3-46f7-90b5-52bef38970f1 (baa0c688-01f3-46f7-90b5-52bef38970f1): created successfully
Nov 03 18:43:07 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-7a0e218f-a5b5-4186-bbd9-5886a1a2335d tempest-ProjectReaderTests-964059183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93c09a8d-1cd0-434c-a6ef-1dd078388064) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:43:07 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-7a0e218f-a5b5-4186-bbd9-5886a1a2335d tempest-ProjectReaderTests-964059183 None] Flow 'volume_create_manager' (b8ba6dda-941a-4108-9bc3-f48fec4a4865) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:43:07 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[222b0cc1-86dd-45a5-b9fc-3ef79ca0e190]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:43:07 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-8dc462e0-3894-4e6e-a952-586d23a7aefa tempest-CreateVolumesFromSnapshotTest-853708760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f9db187f-e9b2-43db-973d-03dbca2d38c0 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:07 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-7a0e218f-a5b5-4186-bbd9-5886a1a2335d tempest-ProjectReaderTests-964059183 None] Created volume successfully.
Nov 03 18:43:07 devstack sudo[106725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f9db187f-e9b2-43db-973d-03dbca2d38c0
Nov 03 18:43:07 devstack sudo[106725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:07 devstack sudo[106723]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:07 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-1b0e74c6-2c59-422b-a6ce-7eb8662aead9 tempest-VolumeDependencyTests-1180853825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.299s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:07 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-1b0e74c6-2c59-422b-a6ce-7eb8662aead9 tempest-VolumeDependencyTests-1180853825 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:43:07 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-1b0e74c6-2c59-422b-a6ce-7eb8662aead9 tempest-VolumeDependencyTests-1180853825 None] Deleted volume successfully.
Nov 03 18:43:07 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-1b0e74c6-2c59-422b-a6ce-7eb8662aead9 tempest-VolumeDependencyTests-1180853825 None] Lock "cinder-60fc7e60-2347-45e7-85b0-6ee397f40780-delete_volume" released by "delete_volume" :: held 1.221s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:43:08 devstack sudo[106725]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:08 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-8dc462e0-3894-4e6e-a952-586d23a7aefa tempest-CreateVolumesFromSnapshotTest-853708760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f9db187f-e9b2-43db-973d-03dbca2d38c0" returned: 0 in 0.452s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:08 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-8dc462e0-3894-4e6e-a952-586d23a7aefa tempest-CreateVolumesFromSnapshotTest-853708760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f9db187f-e9b2-43db-973d-03dbca2d38c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f9db187f-e9b2-43db-973d-03dbca2d38c0.a76efa5e-863c-4db7-8577-0a8242cc4216 1G {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:08 devstack sudo[106732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f9db187f-e9b2-43db-973d-03dbca2d38c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f9db187f-e9b2-43db-973d-03dbca2d38c0.a76efa5e-863c-4db7-8577-0a8242cc4216 1G
Nov 03 18:43:08 devstack sudo[106732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:08 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad7a576c-9f1a-4f43-af42-b5e716a67537 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:43:08 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-ad7a576c-9f1a-4f43-af42-b5e716a67537 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Flow 'volume_create_manager' (da5f43cf-c25b-4839-8535-fe69f959b866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:43:08 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-ad7a576c-9f1a-4f43-af42-b5e716a67537 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6dece650-799b-4f1a-b667-f90d94ff78ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:43:08 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-ad7a576c-9f1a-4f43-af42-b5e716a67537 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6dece650-799b-4f1a-b667-f90d94ff78ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:43:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1565043480',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73fca24e-e487-4569-9b45-89184efa0042,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b20ba539b6054041bece3cb278c0f45e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:43:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:43:08Z,use_quota=True,user_id='242d6128218647498d97b4fda5b559e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:43:08 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-ad7a576c-9f1a-4f43-af42-b5e716a67537 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06ee6bc2-a01c-4c87-af02-4a1220554f13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:43:08 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-ad7a576c-9f1a-4f43-af42-b5e716a67537 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06ee6bc2-a01c-4c87-af02-4a1220554f13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:43:08 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-ad7a576c-9f1a-4f43-af42-b5e716a67537 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0459acc-0e36-416d-8d97-00190ea59f69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:43:08 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-ad7a576c-9f1a-4f43-af42-b5e716a67537 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0459acc-0e36-416d-8d97-00190ea59f69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73fca24e-e487-4569-9b45-89184efa0042', 'volume_name': 'volume-73fca24e-e487-4569-9b45-89184efa0042', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:43:08 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-ad7a576c-9f1a-4f43-af42-b5e716a67537 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc49fa60-5fb9-4275-be0f-aedc1043c73e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:43:08 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-ad7a576c-9f1a-4f43-af42-b5e716a67537 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc49fa60-5fb9-4275-be0f-aedc1043c73e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:43:08 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-ad7a576c-9f1a-4f43-af42-b5e716a67537 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4da6bd67-5007-479f-ac28-e397d9531b73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:43:08 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-ad7a576c-9f1a-4f43-af42-b5e716a67537 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Volume 73fca24e-e487-4569-9b45-89184efa0042: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73fca24e-e487-4569-9b45-89184efa0042', 'volume_size': 1}
Nov 03 18:43:08 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-ad7a576c-9f1a-4f43-af42-b5e716a67537 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:43:08 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-b20c7b20-bdd4-4a13-9fd6-4e9f2cfd5acd tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:43:08 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-b20c7b20-bdd4-4a13-9fd6-4e9f2cfd5acd tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Flow 'volume_create_manager' (f2c023ee-8119-4e82-ae18-4c2f7a73b2be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:43:08 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-b20c7b20-bdd4-4a13-9fd6-4e9f2cfd5acd tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (396294de-a62c-416e-bf10-ef70c31e97f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:43:08 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-b20c7b20-bdd4-4a13-9fd6-4e9f2cfd5acd tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (396294de-a62c-416e-bf10-ef70c31e97f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:43:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-315150168',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0eaef93d-895f-465b-bbf1-fa91ced458b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b20ba539b6054041bece3cb278c0f45e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:43:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:43:09Z,use_quota=True,user_id='242d6128218647498d97b4fda5b559e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:43:08 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-b20c7b20-bdd4-4a13-9fd6-4e9f2cfd5acd tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb5b864f-8b60-454d-b6a9-55cc196c1c1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:43:08 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-b20c7b20-bdd4-4a13-9fd6-4e9f2cfd5acd tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb5b864f-8b60-454d-b6a9-55cc196c1c1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:43:08 devstack sudo[106732]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:08 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-b20c7b20-bdd4-4a13-9fd6-4e9f2cfd5acd tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1983bc6-1e01-4778-9242-c16127b60724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:43:08 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-b20c7b20-bdd4-4a13-9fd6-4e9f2cfd5acd tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1983bc6-1e01-4778-9242-c16127b60724) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0eaef93d-895f-465b-bbf1-fa91ced458b5', 'volume_name': 'volume-0eaef93d-895f-465b-bbf1-fa91ced458b5', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:43:08 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-b20c7b20-bdd4-4a13-9fd6-4e9f2cfd5acd tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c09465a-68f7-4139-abb2-692991e709f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:43:08 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-b20c7b20-bdd4-4a13-9fd6-4e9f2cfd5acd tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c09465a-68f7-4139-abb2-692991e709f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:43:08 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-b20c7b20-bdd4-4a13-9fd6-4e9f2cfd5acd tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (677882d5-a04f-41d6-9c2e-ef25dadd0de4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:43:08 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-b20c7b20-bdd4-4a13-9fd6-4e9f2cfd5acd tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Volume 0eaef93d-895f-465b-bbf1-fa91ced458b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0eaef93d-895f-465b-bbf1-fa91ced458b5', 'volume_size': 1}
Nov 03 18:43:08 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-b20c7b20-bdd4-4a13-9fd6-4e9f2cfd5acd tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:43:08 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-8dc462e0-3894-4e6e-a952-586d23a7aefa tempest-CreateVolumesFromSnapshotTest-853708760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f9db187f-e9b2-43db-973d-03dbca2d38c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f9db187f-e9b2-43db-973d-03dbca2d38c0.a76efa5e-863c-4db7-8577-0a8242cc4216 1G" returned: 0 in 0.621s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:08 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-8dc462e0-3894-4e6e-a952-586d23a7aefa tempest-CreateVolumesFromSnapshotTest-853708760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9db187f-e9b2-43db-973d-03dbca2d38c0 -F qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f9db187f-e9b2-43db-973d-03dbca2d38c0.a76efa5e-863c-4db7-8577-0a8242cc4216 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:08 devstack sudo[106738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9db187f-e9b2-43db-973d-03dbca2d38c0 -F qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f9db187f-e9b2-43db-973d-03dbca2d38c0.a76efa5e-863c-4db7-8577-0a8242cc4216
Nov 03 18:43:08 devstack sudo[106738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:09 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-69a84063-6964-4e1e-993a-480de9ec61b7 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:43:09 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-69a84063-6964-4e1e-993a-480de9ec61b7 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Flow 'volume_create_manager' (d20959e6-fe3f-42ed-8144-289f132ea92a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:43:09 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-69a84063-6964-4e1e-993a-480de9ec61b7 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e8d096e-588c-44da-99ad-a20316026790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:43:09 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-69a84063-6964-4e1e-993a-480de9ec61b7 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e8d096e-588c-44da-99ad-a20316026790) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:43:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-744685659',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80867d5f-bcde-44dd-8c11-ccdaec90e64f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b20ba539b6054041bece3cb278c0f45e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:43:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:43:09Z,use_quota=True,user_id='242d6128218647498d97b4fda5b559e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:43:09 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-69a84063-6964-4e1e-993a-480de9ec61b7 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a8d65f8-1658-4741-83f5-2133fe446f93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:43:09 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-69a84063-6964-4e1e-993a-480de9ec61b7 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a8d65f8-1658-4741-83f5-2133fe446f93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:43:09 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-69a84063-6964-4e1e-993a-480de9ec61b7 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fee1215c-15fa-422f-a2be-bfd22d2c0fe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:43:09 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-69a84063-6964-4e1e-993a-480de9ec61b7 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fee1215c-15fa-422f-a2be-bfd22d2c0fe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80867d5f-bcde-44dd-8c11-ccdaec90e64f', 'volume_name': 'volume-80867d5f-bcde-44dd-8c11-ccdaec90e64f', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:43:09 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-69a84063-6964-4e1e-993a-480de9ec61b7 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb2a087f-9e18-4eaf-8eaa-30f2c0a2e085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:43:09 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-69a84063-6964-4e1e-993a-480de9ec61b7 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb2a087f-9e18-4eaf-8eaa-30f2c0a2e085) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:43:09 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-69a84063-6964-4e1e-993a-480de9ec61b7 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5b0ca57-5483-49cf-b577-6b44049c1011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:43:09 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-69a84063-6964-4e1e-993a-480de9ec61b7 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Volume 80867d5f-bcde-44dd-8c11-ccdaec90e64f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80867d5f-bcde-44dd-8c11-ccdaec90e64f', 'volume_size': 1}
Nov 03 18:43:09 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-69a84063-6964-4e1e-993a-480de9ec61b7 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:43:09 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-4017a8ab-0a07-4073-84ab-e7bacf694d88 tempest-ProjectReaderTests-964059183 None] Acquiring lock "cinder-baa0c688-01f3-46f7-90b5-52bef38970f1-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:43:09 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-4017a8ab-0a07-4073-84ab-e7bacf694d88 tempest-ProjectReaderTests-964059183 None] Lock "cinder-baa0c688-01f3-46f7-90b5-52bef38970f1-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:43:09 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-4017a8ab-0a07-4073-84ab-e7bacf694d88 tempest-ProjectReaderTests-964059183 None] Acquiring lock "cinder-quobyte-baa0c688-01f3-46f7-90b5-52bef38970f1" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:43:09 devstack sudo[106738]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:09 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-8dc462e0-3894-4e6e-a952-586d23a7aefa tempest-CreateVolumesFromSnapshotTest-853708760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9db187f-e9b2-43db-973d-03dbca2d38c0 -F qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f9db187f-e9b2-43db-973d-03dbca2d38c0.a76efa5e-863c-4db7-8577-0a8242cc4216" returned: 0 in 0.673s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:09 devstack cinder-volume[86120]: WARNING cinder.volume.drivers.remotefs [None req-8dc462e0-3894-4e6e-a952-586d23a7aefa tempest-CreateVolumesFromSnapshotTest-853708760 None] /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f9db187f-e9b2-43db-973d-03dbca2d38c0.a76efa5e-863c-4db7-8577-0a8242cc4216 is being set with open permissions: ugo+rw
Nov 03 18:43:09 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-8dc462e0-3894-4e6e-a952-586d23a7aefa tempest-CreateVolumesFromSnapshotTest-853708760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f9db187f-e9b2-43db-973d-03dbca2d38c0.a76efa5e-863c-4db7-8577-0a8242cc4216 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:09 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-4017a8ab-0a07-4073-84ab-e7bacf694d88 tempest-ProjectReaderTests-964059183 None] Lock "cinder-quobyte-baa0c688-01f3-46f7-90b5-52bef38970f1" acquired by "delete_volume" :: waited 0.035s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:43:09 devstack sudo[106744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f9db187f-e9b2-43db-973d-03dbca2d38c0.a76efa5e-863c-4db7-8577-0a8242cc4216
Nov 03 18:43:09 devstack sudo[106744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:09 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[525fd11f-bb71-4bb6-a00c-923df4b863ec]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:43:09 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-4017a8ab-0a07-4073-84ab-e7bacf694d88 tempest-ProjectReaderTests-964059183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-baa0c688-01f3-46f7-90b5-52bef38970f1 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:09 devstack sudo[106746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-baa0c688-01f3-46f7-90b5-52bef38970f1
Nov 03 18:43:09 devstack sudo[106746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:09 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-27a0545c-cec4-48b8-ada7-26a95fb4fb9f tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:43:09 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-27a0545c-cec4-48b8-ada7-26a95fb4fb9f tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Flow 'volume_create_manager' (a5f535ad-3dd1-46f4-ac50-00d0937dded6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:43:09 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-27a0545c-cec4-48b8-ada7-26a95fb4fb9f tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9642253-23cc-4319-a74c-46a1a3cd2c22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:43:09 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-27a0545c-cec4-48b8-ada7-26a95fb4fb9f tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9642253-23cc-4319-a74c-46a1a3cd2c22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:43:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1244442987',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd1f36d1-59b2-45cd-9ec4-c677783860a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b20ba539b6054041bece3cb278c0f45e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:43:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:43:10Z,use_quota=True,user_id='242d6128218647498d97b4fda5b559e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:43:09 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-27a0545c-cec4-48b8-ada7-26a95fb4fb9f tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (220d74e5-f4d4-4744-9ad3-7b6bfa5dbb5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:43:09 devstack sudo[106744]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:09 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-27a0545c-cec4-48b8-ada7-26a95fb4fb9f tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (220d74e5-f4d4-4744-9ad3-7b6bfa5dbb5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:43:09 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-27a0545c-cec4-48b8-ada7-26a95fb4fb9f tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4401d84-e977-4b1d-844c-193fc4a5007c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:43:09 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-27a0545c-cec4-48b8-ada7-26a95fb4fb9f tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4401d84-e977-4b1d-844c-193fc4a5007c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd1f36d1-59b2-45cd-9ec4-c677783860a4', 'volume_name': 'volume-dd1f36d1-59b2-45cd-9ec4-c677783860a4', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:43:09 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-27a0545c-cec4-48b8-ada7-26a95fb4fb9f tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2434eebc-68f0-461b-8ce7-203372813a08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:43:09 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-27a0545c-cec4-48b8-ada7-26a95fb4fb9f tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2434eebc-68f0-461b-8ce7-203372813a08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:43:09 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-27a0545c-cec4-48b8-ada7-26a95fb4fb9f tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15725568-f67d-4624-9bf3-1745ddf1f390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:43:09 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-27a0545c-cec4-48b8-ada7-26a95fb4fb9f tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Volume dd1f36d1-59b2-45cd-9ec4-c677783860a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd1f36d1-59b2-45cd-9ec4-c677783860a4', 'volume_size': 1}
Nov 03 18:43:09 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-27a0545c-cec4-48b8-ada7-26a95fb4fb9f tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:43:09 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-8dc462e0-3894-4e6e-a952-586d23a7aefa tempest-CreateVolumesFromSnapshotTest-853708760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f9db187f-e9b2-43db-973d-03dbca2d38c0.a76efa5e-863c-4db7-8577-0a8242cc4216" returned: 0 in 0.494s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:10 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-8dc462e0-3894-4e6e-a952-586d23a7aefa tempest-CreateVolumesFromSnapshotTest-853708760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f9db187f-e9b2-43db-973d-03dbca2d38c0.info {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:10 devstack sudo[106753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f9db187f-e9b2-43db-973d-03dbca2d38c0.info
Nov 03 18:43:10 devstack sudo[106753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:10 devstack sudo[106746]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:10 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-4017a8ab-0a07-4073-84ab-e7bacf694d88 tempest-ProjectReaderTests-964059183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-baa0c688-01f3-46f7-90b5-52bef38970f1" returned: 0 in 0.502s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:10 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-4017a8ab-0a07-4073-84ab-e7bacf694d88 tempest-ProjectReaderTests-964059183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-baa0c688-01f3-46f7-90b5-52bef38970f1 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:10 devstack sudo[106755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-baa0c688-01f3-46f7-90b5-52bef38970f1
Nov 03 18:43:10 devstack sudo[106755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:10 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d548b76-5294-4172-9616-f8688b2347dd tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:43:10 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-3d548b76-5294-4172-9616-f8688b2347dd tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Flow 'volume_create_manager' (b7929302-2f09-4849-a53a-ef704f54959a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:43:10 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-3d548b76-5294-4172-9616-f8688b2347dd tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d860b321-b32d-4535-aa39-56148a85609f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:43:10 devstack sudo[106753]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:10 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-8dc462e0-3894-4e6e-a952-586d23a7aefa tempest-CreateVolumesFromSnapshotTest-853708760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f9db187f-e9b2-43db-973d-03dbca2d38c0.info" returned: 0 in 0.379s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:10 devstack cinder-volume[86120]: WARNING cinder.volume.drivers.remotefs [None req-8dc462e0-3894-4e6e-a952-586d23a7aefa tempest-CreateVolumesFromSnapshotTest-853708760 None] /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f9db187f-e9b2-43db-973d-03dbca2d38c0.info is being set with open permissions: ugo+rw
Nov 03 18:43:10 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-8dc462e0-3894-4e6e-a952-586d23a7aefa tempest-CreateVolumesFromSnapshotTest-853708760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f9db187f-e9b2-43db-973d-03dbca2d38c0.info {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:10 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-3d548b76-5294-4172-9616-f8688b2347dd tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d860b321-b32d-4535-aa39-56148a85609f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:43:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-691105963',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca13478c-0cf9-4baa-b6f6-50829c73b8aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b20ba539b6054041bece3cb278c0f45e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:43:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:43:10Z,use_quota=True,user_id='242d6128218647498d97b4fda5b559e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:43:10 devstack sudo[106759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f9db187f-e9b2-43db-973d-03dbca2d38c0.info
Nov 03 18:43:10 devstack sudo[106759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:10 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-3d548b76-5294-4172-9616-f8688b2347dd tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3242aae6-02d1-4aaf-a5e3-cef529c48bbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:43:10 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-3d548b76-5294-4172-9616-f8688b2347dd tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3242aae6-02d1-4aaf-a5e3-cef529c48bbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:43:10 devstack sudo[106755]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:10 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-3d548b76-5294-4172-9616-f8688b2347dd tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (208172f7-52dc-49d1-ab12-038e308ca24b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:43:10 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-3d548b76-5294-4172-9616-f8688b2347dd tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (208172f7-52dc-49d1-ab12-038e308ca24b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca13478c-0cf9-4baa-b6f6-50829c73b8aa', 'volume_name': 'volume-ca13478c-0cf9-4baa-b6f6-50829c73b8aa', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:43:10 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-3d548b76-5294-4172-9616-f8688b2347dd tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6465b10b-2f88-4806-a638-4dd54308c041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:43:10 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-3d548b76-5294-4172-9616-f8688b2347dd tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6465b10b-2f88-4806-a638-4dd54308c041) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:43:10 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-3d548b76-5294-4172-9616-f8688b2347dd tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14bac711-d519-4215-9073-f17a577d08f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:43:10 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-3d548b76-5294-4172-9616-f8688b2347dd tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Volume ca13478c-0cf9-4baa-b6f6-50829c73b8aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca13478c-0cf9-4baa-b6f6-50829c73b8aa', 'volume_size': 1}
Nov 03 18:43:10 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-3d548b76-5294-4172-9616-f8688b2347dd tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:43:10 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-4017a8ab-0a07-4073-84ab-e7bacf694d88 tempest-ProjectReaderTests-964059183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-baa0c688-01f3-46f7-90b5-52bef38970f1" returned: 0 in 0.374s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:10 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-4017a8ab-0a07-4073-84ab-e7bacf694d88 tempest-ProjectReaderTests-964059183 None] Lock "cinder-quobyte-baa0c688-01f3-46f7-90b5-52bef38970f1" released by "delete_volume" :: held 1.002s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:43:10 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-4017a8ab-0a07-4073-84ab-e7bacf694d88 tempest-ProjectReaderTests-964059183 None] Created reservations ['c973d6ca-cfef-4bee-9fc9-af62f05f3a08', 'eee369b9-4dc1-4b2c-bdf6-e40b18155dbf', '61cec653-4371-4cf7-963b-622e1ae41eac', '4a8deda1-3cea-423b-a6bf-75a17c84f005'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:43:10 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-4017a8ab-0a07-4073-84ab-e7bacf694d88 tempest-ProjectReaderTests-964059183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:43:10 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-4017a8ab-0a07-4073-84ab-e7bacf694d88 tempest-ProjectReaderTests-964059183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:43:10 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-4017a8ab-0a07-4073-84ab-e7bacf694d88 tempest-ProjectReaderTests-964059183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:43:10 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-4017a8ab-0a07-4073-84ab-e7bacf694d88 tempest-ProjectReaderTests-964059183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:43:10 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-4017a8ab-0a07-4073-84ab-e7bacf694d88 tempest-ProjectReaderTests-964059183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:43:10 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-4017a8ab-0a07-4073-84ab-e7bacf694d88 tempest-ProjectReaderTests-964059183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:10 devstack sudo[106762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:43:10 devstack sudo[106762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:10 devstack sudo[106759]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:10 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-8dc462e0-3894-4e6e-a952-586d23a7aefa tempest-CreateVolumesFromSnapshotTest-853708760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f9db187f-e9b2-43db-973d-03dbca2d38c0.info" returned: 0 in 0.275s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:10 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-8dc462e0-3894-4e6e-a952-586d23a7aefa tempest-CreateVolumesFromSnapshotTest-853708760 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.052s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:43:10 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-ad7a576c-9f1a-4f43-af42-b5e716a67537 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.336s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:43:10 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-ad7a576c-9f1a-4f43-af42-b5e716a67537 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:43:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1565043480',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73fca24e-e487-4569-9b45-89184efa0042,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b20ba539b6054041bece3cb278c0f45e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:43:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:43:08Z,use_quota=True,user_id='242d6128218647498d97b4fda5b559e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:43:10 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-ad7a576c-9f1a-4f43-af42-b5e716a67537 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Creating volume 73fca24e-e487-4569-9b45-89184efa0042 {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:43:10 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-ad7a576c-9f1a-4f43-af42-b5e716a67537 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:43:10 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-ad7a576c-9f1a-4f43-af42-b5e716a67537 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:43:10 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-ad7a576c-9f1a-4f43-af42-b5e716a67537 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:43:10 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-ad7a576c-9f1a-4f43-af42-b5e716a67537 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:43:10 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-ad7a576c-9f1a-4f43-af42-b5e716a67537 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:43:10 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-ad7a576c-9f1a-4f43-af42-b5e716a67537 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:43:10 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-ad7a576c-9f1a-4f43-af42-b5e716a67537 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:43:10 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-ad7a576c-9f1a-4f43-af42-b5e716a67537 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-73fca24e-e487-4569-9b45-89184efa0042 1073741824 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:10 devstack sudo[106764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-73fca24e-e487-4569-9b45-89184efa0042 1073741824
Nov 03 18:43:10 devstack sudo[106764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:10 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-8dc462e0-3894-4e6e-a952-586d23a7aefa tempest-CreateVolumesFromSnapshotTest-853708760 None] Create snapshot completed successfully
Nov 03 18:43:10 devstack sudo[106762]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:10 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-4017a8ab-0a07-4073-84ab-e7bacf694d88 tempest-ProjectReaderTests-964059183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.281s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:10 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-4017a8ab-0a07-4073-84ab-e7bacf694d88 tempest-ProjectReaderTests-964059183 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:43:10 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-4017a8ab-0a07-4073-84ab-e7bacf694d88 tempest-ProjectReaderTests-964059183 None] Deleted volume successfully.
Nov 03 18:43:10 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-4017a8ab-0a07-4073-84ab-e7bacf694d88 tempest-ProjectReaderTests-964059183 None] Lock "cinder-baa0c688-01f3-46f7-90b5-52bef38970f1-delete_volume" released by "delete_volume" :: held 1.557s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:43:11 devstack sudo[106764]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:11 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-ad7a576c-9f1a-4f43-af42-b5e716a67537 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-73fca24e-e487-4569-9b45-89184efa0042 1073741824" returned: 0 in 0.480s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:11 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-ad7a576c-9f1a-4f43-af42-b5e716a67537 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-73fca24e-e487-4569-9b45-89184efa0042 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:11 devstack sudo[106771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-73fca24e-e487-4569-9b45-89184efa0042
Nov 03 18:43:11 devstack sudo[106771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:11 devstack sudo[106771]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:11 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-ad7a576c-9f1a-4f43-af42-b5e716a67537 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-73fca24e-e487-4569-9b45-89184efa0042" returned: 0 in 0.274s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:11 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-ad7a576c-9f1a-4f43-af42-b5e716a67537 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] <== create_volume: return (796ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:43:11 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-ad7a576c-9f1a-4f43-af42-b5e716a67537 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.800s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:43:11 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-b20c7b20-bdd4-4a13-9fd6-4e9f2cfd5acd tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.703s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:43:11 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-b20c7b20-bdd4-4a13-9fd6-4e9f2cfd5acd tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:43:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-315150168',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0eaef93d-895f-465b-bbf1-fa91ced458b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b20ba539b6054041bece3cb278c0f45e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:43:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:43:09Z,use_quota=True,user_id='242d6128218647498d97b4fda5b559e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:43:11 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-b20c7b20-bdd4-4a13-9fd6-4e9f2cfd5acd tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Creating volume 0eaef93d-895f-465b-bbf1-fa91ced458b5 {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:43:11 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-b20c7b20-bdd4-4a13-9fd6-4e9f2cfd5acd tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:43:11 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-b20c7b20-bdd4-4a13-9fd6-4e9f2cfd5acd tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:43:11 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-b20c7b20-bdd4-4a13-9fd6-4e9f2cfd5acd tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:43:11 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-b20c7b20-bdd4-4a13-9fd6-4e9f2cfd5acd tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:43:11 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-b20c7b20-bdd4-4a13-9fd6-4e9f2cfd5acd tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:43:11 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-b20c7b20-bdd4-4a13-9fd6-4e9f2cfd5acd tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:43:11 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-b20c7b20-bdd4-4a13-9fd6-4e9f2cfd5acd tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:43:11 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b20c7b20-bdd4-4a13-9fd6-4e9f2cfd5acd tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-0eaef93d-895f-465b-bbf1-fa91ced458b5 1073741824 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:11 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-ad7a576c-9f1a-4f43-af42-b5e716a67537 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4da6bd67-5007-479f-ac28-e397d9531b73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73fca24e-e487-4569-9b45-89184efa0042', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:43:11 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-ad7a576c-9f1a-4f43-af42-b5e716a67537 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a96965c-88e2-4ad0-9b9a-fc8022c39621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:43:11 devstack sudo[106774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-0eaef93d-895f-465b-bbf1-fa91ced458b5 1073741824
Nov 03 18:43:11 devstack sudo[106774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:11 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-ad7a576c-9f1a-4f43-af42-b5e716a67537 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Volume volume-73fca24e-e487-4569-9b45-89184efa0042 (73fca24e-e487-4569-9b45-89184efa0042): created successfully
Nov 03 18:43:11 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-ad7a576c-9f1a-4f43-af42-b5e716a67537 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a96965c-88e2-4ad0-9b9a-fc8022c39621) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:43:11 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-ad7a576c-9f1a-4f43-af42-b5e716a67537 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Flow 'volume_create_manager' (da5f43cf-c25b-4839-8535-fe69f959b866) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:43:11 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-ad7a576c-9f1a-4f43-af42-b5e716a67537 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Created volume successfully.
Nov 03 18:43:12 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3cdc8fd-3417-4c8b-8ec9-ae480d409cac tempest-CreateVolumesFromSnapshotTest-853708760 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:43:12 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-d3cdc8fd-3417-4c8b-8ec9-ae480d409cac tempest-CreateVolumesFromSnapshotTest-853708760 None] Flow 'volume_create_manager' (1888f2c9-50d7-4f7f-b0b7-c2fd08f3c62e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:43:12 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-d3cdc8fd-3417-4c8b-8ec9-ae480d409cac tempest-CreateVolumesFromSnapshotTest-853708760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de8df21a-8181-49b9-b10d-96bb6630f8f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:43:12 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-d3cdc8fd-3417-4c8b-8ec9-ae480d409cac tempest-CreateVolumesFromSnapshotTest-853708760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de8df21a-8181-49b9-b10d-96bb6630f8f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:43:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2114794893',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1dcddcb7-58e5-4611-b995-d4bacf111d51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d47f25975e39410f88fd40a8e64746a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:43:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:43:12Z,use_quota=True,user_id='6365179a55154fcea6e31f1fb7949df3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:43:12 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-d3cdc8fd-3417-4c8b-8ec9-ae480d409cac tempest-CreateVolumesFromSnapshotTest-853708760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e96b2521-3924-4259-88e9-0afe781c2dd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:43:12 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-d3cdc8fd-3417-4c8b-8ec9-ae480d409cac tempest-CreateVolumesFromSnapshotTest-853708760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e96b2521-3924-4259-88e9-0afe781c2dd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:43:12 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-d3cdc8fd-3417-4c8b-8ec9-ae480d409cac tempest-CreateVolumesFromSnapshotTest-853708760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2fd568d-b5f0-4f10-85a2-7a09e4ab87b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:43:12 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-d3cdc8fd-3417-4c8b-8ec9-ae480d409cac tempest-CreateVolumesFromSnapshotTest-853708760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2fd568d-b5f0-4f10-85a2-7a09e4ab87b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1dcddcb7-58e5-4611-b995-d4bacf111d51', 'volume_name': 'volume-1dcddcb7-58e5-4611-b995-d4bacf111d51', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:43:12 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-d3cdc8fd-3417-4c8b-8ec9-ae480d409cac tempest-CreateVolumesFromSnapshotTest-853708760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30171edc-964e-40b9-b801-f505e74e8f64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:43:12 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-d3cdc8fd-3417-4c8b-8ec9-ae480d409cac tempest-CreateVolumesFromSnapshotTest-853708760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30171edc-964e-40b9-b801-f505e74e8f64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:43:12 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-d3cdc8fd-3417-4c8b-8ec9-ae480d409cac tempest-CreateVolumesFromSnapshotTest-853708760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32cb6946-ecc7-4317-b376-4e7cb7ea8a23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:43:12 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-d3cdc8fd-3417-4c8b-8ec9-ae480d409cac tempest-CreateVolumesFromSnapshotTest-853708760 None] Volume 1dcddcb7-58e5-4611-b995-d4bacf111d51: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1dcddcb7-58e5-4611-b995-d4bacf111d51', 'volume_size': 1}
Nov 03 18:43:12 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-d3cdc8fd-3417-4c8b-8ec9-ae480d409cac tempest-CreateVolumesFromSnapshotTest-853708760 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:43:12 devstack sudo[106774]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:12 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b20c7b20-bdd4-4a13-9fd6-4e9f2cfd5acd tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-0eaef93d-895f-465b-bbf1-fa91ced458b5 1073741824" returned: 0 in 0.768s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:12 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b20c7b20-bdd4-4a13-9fd6-4e9f2cfd5acd tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-0eaef93d-895f-465b-bbf1-fa91ced458b5 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:12 devstack sudo[106779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-0eaef93d-895f-465b-bbf1-fa91ced458b5
Nov 03 18:43:12 devstack sudo[106779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:12 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-7eb0ef70-2d5b-4307-853f-effcc67dae9a tempest-ProjectReaderTests-964059183 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:43:12 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-7eb0ef70-2d5b-4307-853f-effcc67dae9a tempest-ProjectReaderTests-964059183 None] Flow 'volume_create_manager' (1e5b8896-f89a-49f7-96b4-4667efc47b2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:43:12 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-7eb0ef70-2d5b-4307-853f-effcc67dae9a tempest-ProjectReaderTests-964059183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b830fa34-28d0-40a1-8484-23c30431bb00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:43:12 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-7eb0ef70-2d5b-4307-853f-effcc67dae9a tempest-ProjectReaderTests-964059183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b830fa34-28d0-40a1-8484-23c30431bb00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:43:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-881415897',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73a0843d-c640-4d46-acd1-d87a954d4a50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f24206f5f1e4ac19bde23d31d296883',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:43:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:43:13Z,use_quota=True,user_id='e6c9675a59f54b34b6743622a5b243b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:43:12 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-7eb0ef70-2d5b-4307-853f-effcc67dae9a tempest-ProjectReaderTests-964059183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9cfaf69-0a42-4aef-a65b-d3ee44442958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:43:12 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-7eb0ef70-2d5b-4307-853f-effcc67dae9a tempest-ProjectReaderTests-964059183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9cfaf69-0a42-4aef-a65b-d3ee44442958) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:43:12 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-7eb0ef70-2d5b-4307-853f-effcc67dae9a tempest-ProjectReaderTests-964059183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df1d4155-9646-4c93-b0fc-354d45b1f65e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:43:12 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-7eb0ef70-2d5b-4307-853f-effcc67dae9a tempest-ProjectReaderTests-964059183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df1d4155-9646-4c93-b0fc-354d45b1f65e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73a0843d-c640-4d46-acd1-d87a954d4a50', 'volume_name': 'volume-73a0843d-c640-4d46-acd1-d87a954d4a50', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:43:12 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-7eb0ef70-2d5b-4307-853f-effcc67dae9a tempest-ProjectReaderTests-964059183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5813c76-4377-418a-a78b-fa1c6b4229f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:43:12 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-7eb0ef70-2d5b-4307-853f-effcc67dae9a tempest-ProjectReaderTests-964059183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5813c76-4377-418a-a78b-fa1c6b4229f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:43:12 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-7eb0ef70-2d5b-4307-853f-effcc67dae9a tempest-ProjectReaderTests-964059183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28acb878-6457-4047-8780-aa20609f84d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:43:12 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-7eb0ef70-2d5b-4307-853f-effcc67dae9a tempest-ProjectReaderTests-964059183 None] Volume 73a0843d-c640-4d46-acd1-d87a954d4a50: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73a0843d-c640-4d46-acd1-d87a954d4a50', 'volume_size': 1}
Nov 03 18:43:12 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-7eb0ef70-2d5b-4307-853f-effcc67dae9a tempest-ProjectReaderTests-964059183 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:43:12 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-29c5085d-36b3-4ad6-b5c7-88ccaaac14cd tempest-CreateVolumesFromSnapshotTest-853708760 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:43:12 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-29c5085d-36b3-4ad6-b5c7-88ccaaac14cd tempest-CreateVolumesFromSnapshotTest-853708760 None] Flow 'volume_create_manager' (b9032ab2-538b-4d62-ab8d-d7506f35f0c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:43:12 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-29c5085d-36b3-4ad6-b5c7-88ccaaac14cd tempest-CreateVolumesFromSnapshotTest-853708760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c801fe9-a79b-4b5d-b928-a18f17620612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:43:12 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-29c5085d-36b3-4ad6-b5c7-88ccaaac14cd tempest-CreateVolumesFromSnapshotTest-853708760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c801fe9-a79b-4b5d-b928-a18f17620612) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:43:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2147253163',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36587014-f68e-44a0-aeb7-a20bef182609,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d47f25975e39410f88fd40a8e64746a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:43:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:43:13Z,use_quota=True,user_id='6365179a55154fcea6e31f1fb7949df3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:43:12 devstack sudo[106779]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:12 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-29c5085d-36b3-4ad6-b5c7-88ccaaac14cd tempest-CreateVolumesFromSnapshotTest-853708760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d494acee-1af4-4bae-9b56-61290d1a5dfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:43:12 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-29c5085d-36b3-4ad6-b5c7-88ccaaac14cd tempest-CreateVolumesFromSnapshotTest-853708760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d494acee-1af4-4bae-9b56-61290d1a5dfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:43:12 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-29c5085d-36b3-4ad6-b5c7-88ccaaac14cd tempest-CreateVolumesFromSnapshotTest-853708760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f609c27-ad2c-4f6a-9425-acbc1a6fa937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:43:12 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-29c5085d-36b3-4ad6-b5c7-88ccaaac14cd tempest-CreateVolumesFromSnapshotTest-853708760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f609c27-ad2c-4f6a-9425-acbc1a6fa937) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36587014-f68e-44a0-aeb7-a20bef182609', 'volume_name': 'volume-36587014-f68e-44a0-aeb7-a20bef182609', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:43:12 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-29c5085d-36b3-4ad6-b5c7-88ccaaac14cd tempest-CreateVolumesFromSnapshotTest-853708760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44a56106-4cd4-4669-9f38-fe7f2d501bf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:43:12 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-29c5085d-36b3-4ad6-b5c7-88ccaaac14cd tempest-CreateVolumesFromSnapshotTest-853708760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44a56106-4cd4-4669-9f38-fe7f2d501bf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:43:12 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-29c5085d-36b3-4ad6-b5c7-88ccaaac14cd tempest-CreateVolumesFromSnapshotTest-853708760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da8bbd4f-0f44-4e2a-9da4-5ee653942c8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:43:12 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-29c5085d-36b3-4ad6-b5c7-88ccaaac14cd tempest-CreateVolumesFromSnapshotTest-853708760 None] Volume 36587014-f68e-44a0-aeb7-a20bef182609: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36587014-f68e-44a0-aeb7-a20bef182609', 'volume_size': 1}
Nov 03 18:43:12 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-29c5085d-36b3-4ad6-b5c7-88ccaaac14cd tempest-CreateVolumesFromSnapshotTest-853708760 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:43:12 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b20c7b20-bdd4-4a13-9fd6-4e9f2cfd5acd tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-0eaef93d-895f-465b-bbf1-fa91ced458b5" returned: 0 in 0.540s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:12 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-b20c7b20-bdd4-4a13-9fd6-4e9f2cfd5acd tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] <== create_volume: return (1373ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:43:12 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-b20c7b20-bdd4-4a13-9fd6-4e9f2cfd5acd tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.376s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:43:12 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-69a84063-6964-4e1e-993a-480de9ec61b7 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.581s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:43:12 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-69a84063-6964-4e1e-993a-480de9ec61b7 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:43:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-744685659',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80867d5f-bcde-44dd-8c11-ccdaec90e64f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b20ba539b6054041bece3cb278c0f45e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:43:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:43:09Z,use_quota=True,user_id='242d6128218647498d97b4fda5b559e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:43:12 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-69a84063-6964-4e1e-993a-480de9ec61b7 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Creating volume 80867d5f-bcde-44dd-8c11-ccdaec90e64f {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:43:12 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-69a84063-6964-4e1e-993a-480de9ec61b7 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:43:12 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-69a84063-6964-4e1e-993a-480de9ec61b7 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:43:12 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-69a84063-6964-4e1e-993a-480de9ec61b7 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:43:12 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-69a84063-6964-4e1e-993a-480de9ec61b7 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:43:12 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-69a84063-6964-4e1e-993a-480de9ec61b7 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:43:12 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-69a84063-6964-4e1e-993a-480de9ec61b7 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:43:12 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-69a84063-6964-4e1e-993a-480de9ec61b7 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:43:12 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-69a84063-6964-4e1e-993a-480de9ec61b7 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-80867d5f-bcde-44dd-8c11-ccdaec90e64f 1073741824 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:12 devstack sudo[106782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-80867d5f-bcde-44dd-8c11-ccdaec90e64f 1073741824
Nov 03 18:43:12 devstack sudo[106782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:12 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-b20c7b20-bdd4-4a13-9fd6-4e9f2cfd5acd tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (677882d5-a04f-41d6-9c2e-ef25dadd0de4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0eaef93d-895f-465b-bbf1-fa91ced458b5', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:43:12 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-b20c7b20-bdd4-4a13-9fd6-4e9f2cfd5acd tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22fbe0b0-776a-4034-ba8a-c8f3b573f745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:43:13 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-b20c7b20-bdd4-4a13-9fd6-4e9f2cfd5acd tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Volume volume-0eaef93d-895f-465b-bbf1-fa91ced458b5 (0eaef93d-895f-465b-bbf1-fa91ced458b5): created successfully
Nov 03 18:43:13 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-b20c7b20-bdd4-4a13-9fd6-4e9f2cfd5acd tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22fbe0b0-776a-4034-ba8a-c8f3b573f745) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:43:13 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-b20c7b20-bdd4-4a13-9fd6-4e9f2cfd5acd tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Flow 'volume_create_manager' (f2c023ee-8119-4e82-ae18-4c2f7a73b2be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:43:13 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-b537612e-e1f2-4cbd-90cc-282df18679cd tempest-CreateVolumesFromSnapshotTest-853708760 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:43:13 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-b537612e-e1f2-4cbd-90cc-282df18679cd tempest-CreateVolumesFromSnapshotTest-853708760 None] Flow 'volume_create_manager' (830410a4-bf58-411a-b17d-326fcc46d13b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:43:13 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-b537612e-e1f2-4cbd-90cc-282df18679cd tempest-CreateVolumesFromSnapshotTest-853708760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (678759aa-8d13-4311-bb5d-dd87f3821407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:43:13 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-b20c7b20-bdd4-4a13-9fd6-4e9f2cfd5acd tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Created volume successfully.
Nov 03 18:43:13 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-b537612e-e1f2-4cbd-90cc-282df18679cd tempest-CreateVolumesFromSnapshotTest-853708760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (678759aa-8d13-4311-bb5d-dd87f3821407) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:43:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-330786227',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afc00e02-2f86-432d-b1e5-abf17c4c8648,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d47f25975e39410f88fd40a8e64746a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:43:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:43:13Z,use_quota=True,user_id='6365179a55154fcea6e31f1fb7949df3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:43:13 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-b537612e-e1f2-4cbd-90cc-282df18679cd tempest-CreateVolumesFromSnapshotTest-853708760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (036919e3-3fed-485e-82b0-6422f55580a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:43:13 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-b537612e-e1f2-4cbd-90cc-282df18679cd tempest-CreateVolumesFromSnapshotTest-853708760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (036919e3-3fed-485e-82b0-6422f55580a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:43:13 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-b537612e-e1f2-4cbd-90cc-282df18679cd tempest-CreateVolumesFromSnapshotTest-853708760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3f95df6-ef21-4396-b851-4c1c233b01ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:43:13 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-b537612e-e1f2-4cbd-90cc-282df18679cd tempest-CreateVolumesFromSnapshotTest-853708760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3f95df6-ef21-4396-b851-4c1c233b01ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'afc00e02-2f86-432d-b1e5-abf17c4c8648', 'volume_name': 'volume-afc00e02-2f86-432d-b1e5-abf17c4c8648', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:43:13 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-b537612e-e1f2-4cbd-90cc-282df18679cd tempest-CreateVolumesFromSnapshotTest-853708760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aacd0e86-d8d2-476e-8736-d484382c82cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:43:13 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-b537612e-e1f2-4cbd-90cc-282df18679cd tempest-CreateVolumesFromSnapshotTest-853708760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aacd0e86-d8d2-476e-8736-d484382c82cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:43:13 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-b537612e-e1f2-4cbd-90cc-282df18679cd tempest-CreateVolumesFromSnapshotTest-853708760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a0473b3-95c9-4544-85ae-289df525cc27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:43:13 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-b537612e-e1f2-4cbd-90cc-282df18679cd tempest-CreateVolumesFromSnapshotTest-853708760 None] Volume afc00e02-2f86-432d-b1e5-abf17c4c8648: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-afc00e02-2f86-432d-b1e5-abf17c4c8648', 'volume_size': 1}
Nov 03 18:43:13 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-b537612e-e1f2-4cbd-90cc-282df18679cd tempest-CreateVolumesFromSnapshotTest-853708760 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:43:13 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e29a976-a76d-48c7-a70c-954af0ff8244 tempest-CreateVolumesFromSnapshotTest-853708760 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:43:13 devstack sudo[106782]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:13 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-4e29a976-a76d-48c7-a70c-954af0ff8244 tempest-CreateVolumesFromSnapshotTest-853708760 None] Flow 'volume_create_manager' (0c772199-27be-46fc-b52a-298b82000c0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:43:13 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-4e29a976-a76d-48c7-a70c-954af0ff8244 tempest-CreateVolumesFromSnapshotTest-853708760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad8855cc-6edc-4060-a9f3-290f7af18268) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:43:13 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-69a84063-6964-4e1e-993a-480de9ec61b7 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-80867d5f-bcde-44dd-8c11-ccdaec90e64f 1073741824" returned: 0 in 0.637s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:13 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-4e29a976-a76d-48c7-a70c-954af0ff8244 tempest-CreateVolumesFromSnapshotTest-853708760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad8855cc-6edc-4060-a9f3-290f7af18268) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:43:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1310899055',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3635bf61-6592-4c86-a809-d9b73e029ba3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d47f25975e39410f88fd40a8e64746a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:43:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:43:13Z,use_quota=True,user_id='6365179a55154fcea6e31f1fb7949df3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:43:13 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-4e29a976-a76d-48c7-a70c-954af0ff8244 tempest-CreateVolumesFromSnapshotTest-853708760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8990230-d8d4-4e8c-81a8-8edeb4ba8909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:43:13 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-4e29a976-a76d-48c7-a70c-954af0ff8244 tempest-CreateVolumesFromSnapshotTest-853708760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8990230-d8d4-4e8c-81a8-8edeb4ba8909) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:43:13 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-4e29a976-a76d-48c7-a70c-954af0ff8244 tempest-CreateVolumesFromSnapshotTest-853708760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26610055-d7b6-4678-bbd2-2c8147468f64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:43:13 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-4e29a976-a76d-48c7-a70c-954af0ff8244 tempest-CreateVolumesFromSnapshotTest-853708760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26610055-d7b6-4678-bbd2-2c8147468f64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3635bf61-6592-4c86-a809-d9b73e029ba3', 'volume_name': 'volume-3635bf61-6592-4c86-a809-d9b73e029ba3', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:43:13 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-4e29a976-a76d-48c7-a70c-954af0ff8244 tempest-CreateVolumesFromSnapshotTest-853708760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25b35b6f-06f4-4018-8a3b-0868eb740d66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:43:13 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-4e29a976-a76d-48c7-a70c-954af0ff8244 tempest-CreateVolumesFromSnapshotTest-853708760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25b35b6f-06f4-4018-8a3b-0868eb740d66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:43:13 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-4e29a976-a76d-48c7-a70c-954af0ff8244 tempest-CreateVolumesFromSnapshotTest-853708760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6a03475-b528-4aa6-8d3f-d4aba073c386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:43:13 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-4e29a976-a76d-48c7-a70c-954af0ff8244 tempest-CreateVolumesFromSnapshotTest-853708760 None] Volume 3635bf61-6592-4c86-a809-d9b73e029ba3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3635bf61-6592-4c86-a809-d9b73e029ba3', 'volume_size': 1}
Nov 03 18:43:13 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-4e29a976-a76d-48c7-a70c-954af0ff8244 tempest-CreateVolumesFromSnapshotTest-853708760 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:43:13 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-69a84063-6964-4e1e-993a-480de9ec61b7 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-80867d5f-bcde-44dd-8c11-ccdaec90e64f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:13 devstack sudo[106788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-80867d5f-bcde-44dd-8c11-ccdaec90e64f
Nov 03 18:43:13 devstack sudo[106788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:13 devstack sudo[106788]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:13 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-69a84063-6964-4e1e-993a-480de9ec61b7 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-80867d5f-bcde-44dd-8c11-ccdaec90e64f" returned: 0 in 0.306s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:13 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-69a84063-6964-4e1e-993a-480de9ec61b7 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] <== create_volume: return (1049ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:43:13 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-69a84063-6964-4e1e-993a-480de9ec61b7 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.052s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:43:13 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-27a0545c-cec4-48b8-ada7-26a95fb4fb9f tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.968s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:43:13 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-27a0545c-cec4-48b8-ada7-26a95fb4fb9f tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:43:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1244442987',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd1f36d1-59b2-45cd-9ec4-c677783860a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b20ba539b6054041bece3cb278c0f45e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:43:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:43:10Z,use_quota=True,user_id='242d6128218647498d97b4fda5b559e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:43:13 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-27a0545c-cec4-48b8-ada7-26a95fb4fb9f tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Creating volume dd1f36d1-59b2-45cd-9ec4-c677783860a4 {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:43:13 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-27a0545c-cec4-48b8-ada7-26a95fb4fb9f tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:43:13 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-27a0545c-cec4-48b8-ada7-26a95fb4fb9f tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:43:13 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-27a0545c-cec4-48b8-ada7-26a95fb4fb9f tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:43:13 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-27a0545c-cec4-48b8-ada7-26a95fb4fb9f tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:43:13 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-27a0545c-cec4-48b8-ada7-26a95fb4fb9f tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:43:13 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-27a0545c-cec4-48b8-ada7-26a95fb4fb9f tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:43:13 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-27a0545c-cec4-48b8-ada7-26a95fb4fb9f tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:43:13 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-27a0545c-cec4-48b8-ada7-26a95fb4fb9f tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dd1f36d1-59b2-45cd-9ec4-c677783860a4 1073741824 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:13 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-69a84063-6964-4e1e-993a-480de9ec61b7 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5b0ca57-5483-49cf-b577-6b44049c1011) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80867d5f-bcde-44dd-8c11-ccdaec90e64f', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:43:13 devstack sudo[106791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dd1f36d1-59b2-45cd-9ec4-c677783860a4 1073741824
Nov 03 18:43:13 devstack sudo[106791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:13 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-69a84063-6964-4e1e-993a-480de9ec61b7 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ad22b18-41aa-43db-9d4b-5d6071083f3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:43:13 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1a41759-738a-4124-a0cb-a2b9699f31ff tempest-CreateVolumesFromSnapshotTest-853708760 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:43:14 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-e1a41759-738a-4124-a0cb-a2b9699f31ff tempest-CreateVolumesFromSnapshotTest-853708760 None] Flow 'volume_create_manager' (2df894cb-c08a-44a9-8159-500c760c5d75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:43:14 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-e1a41759-738a-4124-a0cb-a2b9699f31ff tempest-CreateVolumesFromSnapshotTest-853708760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4876c9e8-e7f8-45bc-ad85-e87321665f2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:43:14 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-69a84063-6964-4e1e-993a-480de9ec61b7 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Volume volume-80867d5f-bcde-44dd-8c11-ccdaec90e64f (80867d5f-bcde-44dd-8c11-ccdaec90e64f): created successfully
Nov 03 18:43:14 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-69a84063-6964-4e1e-993a-480de9ec61b7 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ad22b18-41aa-43db-9d4b-5d6071083f3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:43:14 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-69a84063-6964-4e1e-993a-480de9ec61b7 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Flow 'volume_create_manager' (d20959e6-fe3f-42ed-8144-289f132ea92a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:43:14 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-e1a41759-738a-4124-a0cb-a2b9699f31ff tempest-CreateVolumesFromSnapshotTest-853708760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4876c9e8-e7f8-45bc-ad85-e87321665f2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:43:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1053521586',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34eaab66-1d1f-4f1b-8f2e-6b438ee10779,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d47f25975e39410f88fd40a8e64746a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:43:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:43:14Z,use_quota=True,user_id='6365179a55154fcea6e31f1fb7949df3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:43:14 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-e1a41759-738a-4124-a0cb-a2b9699f31ff tempest-CreateVolumesFromSnapshotTest-853708760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df85aa78-a66e-4dd7-a6bd-638035aad896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:43:14 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-e1a41759-738a-4124-a0cb-a2b9699f31ff tempest-CreateVolumesFromSnapshotTest-853708760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df85aa78-a66e-4dd7-a6bd-638035aad896) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:43:14 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-e1a41759-738a-4124-a0cb-a2b9699f31ff tempest-CreateVolumesFromSnapshotTest-853708760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f52a719a-b8e1-44bb-9010-f72c85e2aa6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:43:14 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-e1a41759-738a-4124-a0cb-a2b9699f31ff tempest-CreateVolumesFromSnapshotTest-853708760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f52a719a-b8e1-44bb-9010-f72c85e2aa6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34eaab66-1d1f-4f1b-8f2e-6b438ee10779', 'volume_name': 'volume-34eaab66-1d1f-4f1b-8f2e-6b438ee10779', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:43:14 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-e1a41759-738a-4124-a0cb-a2b9699f31ff tempest-CreateVolumesFromSnapshotTest-853708760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6930ff8-ca0f-436e-b770-91b98d41e422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:43:14 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-e1a41759-738a-4124-a0cb-a2b9699f31ff tempest-CreateVolumesFromSnapshotTest-853708760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6930ff8-ca0f-436e-b770-91b98d41e422) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:43:14 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-e1a41759-738a-4124-a0cb-a2b9699f31ff tempest-CreateVolumesFromSnapshotTest-853708760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (658a4b15-dcec-406e-bde6-5ba62684e568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:43:14 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-e1a41759-738a-4124-a0cb-a2b9699f31ff tempest-CreateVolumesFromSnapshotTest-853708760 None] Volume 34eaab66-1d1f-4f1b-8f2e-6b438ee10779: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34eaab66-1d1f-4f1b-8f2e-6b438ee10779', 'volume_size': 1}
Nov 03 18:43:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-e1a41759-738a-4124-a0cb-a2b9699f31ff tempest-CreateVolumesFromSnapshotTest-853708760 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:43:14 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-69a84063-6964-4e1e-993a-480de9ec61b7 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Created volume successfully.
Nov 03 18:43:14 devstack sudo[106791]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-27a0545c-cec4-48b8-ada7-26a95fb4fb9f tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dd1f36d1-59b2-45cd-9ec4-c677783860a4 1073741824" returned: 0 in 0.479s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-27a0545c-cec4-48b8-ada7-26a95fb4fb9f tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dd1f36d1-59b2-45cd-9ec4-c677783860a4 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:14 devstack sudo[106797]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dd1f36d1-59b2-45cd-9ec4-c677783860a4
Nov 03 18:43:14 devstack sudo[106797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:14 devstack sudo[106797]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-27a0545c-cec4-48b8-ada7-26a95fb4fb9f tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dd1f36d1-59b2-45cd-9ec4-c677783860a4" returned: 0 in 0.268s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:14 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-27a0545c-cec4-48b8-ada7-26a95fb4fb9f tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] <== create_volume: return (792ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:43:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-27a0545c-cec4-48b8-ada7-26a95fb4fb9f tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.795s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:43:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-3d548b76-5294-4172-9616-f8688b2347dd tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.269s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:43:14 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-3d548b76-5294-4172-9616-f8688b2347dd tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:43:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-691105963',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca13478c-0cf9-4baa-b6f6-50829c73b8aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b20ba539b6054041bece3cb278c0f45e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:43:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:43:10Z,use_quota=True,user_id='242d6128218647498d97b4fda5b559e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:43:14 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-3d548b76-5294-4172-9616-f8688b2347dd tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Creating volume ca13478c-0cf9-4baa-b6f6-50829c73b8aa {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:43:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-3d548b76-5294-4172-9616-f8688b2347dd tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:43:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-3d548b76-5294-4172-9616-f8688b2347dd tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:43:14 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-3d548b76-5294-4172-9616-f8688b2347dd tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:43:14 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-3d548b76-5294-4172-9616-f8688b2347dd tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:43:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-3d548b76-5294-4172-9616-f8688b2347dd tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:43:14 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-3d548b76-5294-4172-9616-f8688b2347dd tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:43:14 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-3d548b76-5294-4172-9616-f8688b2347dd tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:43:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-3d548b76-5294-4172-9616-f8688b2347dd tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ca13478c-0cf9-4baa-b6f6-50829c73b8aa 1073741824 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:14 devstack sudo[106803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ca13478c-0cf9-4baa-b6f6-50829c73b8aa 1073741824
Nov 03 18:43:14 devstack sudo[106803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:14 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-27a0545c-cec4-48b8-ada7-26a95fb4fb9f tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15725568-f67d-4624-9bf3-1745ddf1f390) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd1f36d1-59b2-45cd-9ec4-c677783860a4', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:43:14 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-27a0545c-cec4-48b8-ada7-26a95fb4fb9f tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9287074-ac3e-4aca-bf27-fa2a0af6d844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:43:14 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-27a0545c-cec4-48b8-ada7-26a95fb4fb9f tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Volume volume-dd1f36d1-59b2-45cd-9ec4-c677783860a4 (dd1f36d1-59b2-45cd-9ec4-c677783860a4): created successfully
Nov 03 18:43:14 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-27a0545c-cec4-48b8-ada7-26a95fb4fb9f tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9287074-ac3e-4aca-bf27-fa2a0af6d844) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:43:14 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-27a0545c-cec4-48b8-ada7-26a95fb4fb9f tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Flow 'volume_create_manager' (a5f535ad-3dd1-46f4-ac50-00d0937dded6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:43:14 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5d76385-6097-4532-976f-4a9e909b3638 tempest-VolumeImageDependencyTests-511992875 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:43:14 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-b5d76385-6097-4532-976f-4a9e909b3638 tempest-VolumeImageDependencyTests-511992875 None] Flow 'volume_create_manager' (487f2fdd-726c-4e33-9c62-13c5ef9b230b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:43:14 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-b5d76385-6097-4532-976f-4a9e909b3638 tempest-VolumeImageDependencyTests-511992875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9eda1277-357e-4f3a-bf39-14edabe2b028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:43:14 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-27a0545c-cec4-48b8-ada7-26a95fb4fb9f tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Created volume successfully.
Nov 03 18:43:14 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-b5d76385-6097-4532-976f-4a9e909b3638 tempest-VolumeImageDependencyTests-511992875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9eda1277-357e-4f3a-bf39-14edabe2b028) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:43:14Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=903e0b67-2f52-429e-ac17-b4391d653e0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='472b047b03f54ce885be1e0c7d438102',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:43:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:43:15Z,use_quota=True,user_id='eacb443a4cc740929fe82aa7ed92dde3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:43:14 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-b5d76385-6097-4532-976f-4a9e909b3638 tempest-VolumeImageDependencyTests-511992875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f17bc4d7-e2f4-4d95-a7f6-a0ea00dbb769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:43:14 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-b5d76385-6097-4532-976f-4a9e909b3638 tempest-VolumeImageDependencyTests-511992875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f17bc4d7-e2f4-4d95-a7f6-a0ea00dbb769) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:43:14 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-b5d76385-6097-4532-976f-4a9e909b3638 tempest-VolumeImageDependencyTests-511992875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee8fb66b-7f5e-45c6-bf1f-9715a583239f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:43:14 devstack cinder-volume[86120]: DEBUG cinder.image.glance [None req-b5d76385-6097-4532-976f-4a9e909b3638 tempest-VolumeImageDependencyTests-511992875 None] Creating Keystone auth plugin from conf {{(pid=86120) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 03 18:43:14 devstack cinder-volume[86120]: DEBUG oslo_service.periodic_task [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86120) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 18:43:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:43:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:43:14 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:43:14 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:43:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:43:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:15 devstack sudo[106809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:43:15 devstack sudo[106809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:15 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-b5d76385-6097-4532-976f-4a9e909b3638 tempest-VolumeImageDependencyTests-511992875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee8fb66b-7f5e-45c6-bf1f-9715a583239f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '903e0b67-2f52-429e-ac17-b4391d653e0b', 'volume_name': 'volume-903e0b67-2f52-429e-ac17-b4391d653e0b', 'volume_size': 1, 'image_id': '793130b1-29e6-4cc7-9c66-e4d41ac4e392', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/793130b1-29e6-4cc7-9c66-e4d41ac4e392', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9989f4b7c12fe1c954e1ad659a17c4fc', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '472b047b03f54ce885be1e0c7d438102', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'af1528bbb0f7754ed7a8f6fe61cf4b279854b90a653d8cf78a077dd9a59c0ddce25848ca36418ea960a583bb12914cb30efe9d868104591ee90e41df9f2bb3e8', 'id': '793130b1-29e6-4cc7-9c66-e4d41ac4e392', 'created_at': datetime.datetime(2026, 11, 3, 17, 43, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 17, 43, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/793130b1-29e6-4cc7-9c66-e4d41ac4e392/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7a8d3cbe20f0>}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:43:15 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-b5d76385-6097-4532-976f-4a9e909b3638 tempest-VolumeImageDependencyTests-511992875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04c7c788-6973-4095-a7d8-7a978bf26a24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:43:15 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-b5d76385-6097-4532-976f-4a9e909b3638 tempest-VolumeImageDependencyTests-511992875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04c7c788-6973-4095-a7d8-7a978bf26a24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:43:15 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-b5d76385-6097-4532-976f-4a9e909b3638 tempest-VolumeImageDependencyTests-511992875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18092080-e0d8-435e-8142-ae3b1ba97e9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:43:15 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-b5d76385-6097-4532-976f-4a9e909b3638 tempest-VolumeImageDependencyTests-511992875 None] Volume 903e0b67-2f52-429e-ac17-b4391d653e0b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-903e0b67-2f52-429e-ac17-b4391d653e0b', 'volume_size': 1, 'image_id': '793130b1-29e6-4cc7-9c66-e4d41ac4e392', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/793130b1-29e6-4cc7-9c66-e4d41ac4e392', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9989f4b7c12fe1c954e1ad659a17c4fc', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '472b047b03f54ce885be1e0c7d438102', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'af1528bbb0f7754ed7a8f6fe61cf4b279854b90a653d8cf78a077dd9a59c0ddce25848ca36418ea960a583bb12914cb30efe9d868104591ee90e41df9f2bb3e8', 'id': '793130b1-29e6-4cc7-9c66-e4d41ac4e392', 'created_at': datetime.datetime(2026, 11, 3, 17, 43, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 17, 43, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/793130b1-29e6-4cc7-9c66-e4d41ac4e392/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7a8d3cbe20f0>}
Nov 03 18:43:15 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5d76385-6097-4532-976f-4a9e909b3638 tempest-VolumeImageDependencyTests-511992875 None] Trying to clone 903e0b67-2f52-429e-ac17-b4391d653e0b from image 793130b1-29e6-4cc7-9c66-e4d41ac4e392 at location (None, [{'url': 'file:///opt/stack/data/glance/images/793130b1-29e6-4cc7-9c66-e4d41ac4e392', 'metadata': {}}]). {{(pid=86120) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 03 18:43:15 devstack sudo[106803]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:15 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-3d548b76-5294-4172-9616-f8688b2347dd tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ca13478c-0cf9-4baa-b6f6-50829c73b8aa 1073741824" returned: 0 in 0.503s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:15 devstack sudo[106809]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:15 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.307s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:15 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:43:15 devstack cinder-volume[86120]: DEBUG oslo_service.periodic_task [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Running periodic task VolumeManager._thread_info {{(pid=86120) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 18:43:15 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] thread count: 28 {{(pid=86120) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 03 18:43:15 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] thread info: [<_MainThread(MainThread, started 134747145822336)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134747033686336)>, <Thread(Thread-3 (stat_writer), started daemon 134747030828736)>, <Thread(Rabbit-heartbeat, started daemon 134747035433408)>, <Thread(Thread-5 (_runner), started daemon 134747029587392)>, <Thread(Thread-7 (_runner), started daemon 134747029784256)>, <Thread(fd_logger, started daemon 134747027909120)>, <Thread(privsep_reader, started daemon 134747027006592)>, <Thread(tpool_thread_0, started daemon 134747018950336)>, <Thread(tpool_thread_1, started daemon 134747010541248)>, <Thread(tpool_thread_2, started daemon 134747002132160)>, <Thread(tpool_thread_3, started daemon 134746993723072)>, <Thread(tpool_thread_4, started daemon 134746985313984)>, <Thread(tpool_thread_5, started daemon 134746976904896)>, <Thread(tpool_thread_6, started daemon 134746968495808)>, <Thread(tpool_thread_7, started daemon 134746960086720)>, <Thread(tpool_thread_8, started daemon 134746951677632)>, <Thread(tpool_thread_9, started daemon 134746943268544)>, <Thread(tpool_thread_10, started daemon 134746934859456)>, <Thread(tpool_thread_11, started daemon 134746926450368)>, <Thread(tpool_thread_12, started daemon 134746918041280)>, <Thread(tpool_thread_13, started daemon 134746909632192)>, <Thread(tpool_thread_14, started daemon 134746901223104)>, <Thread(tpool_thread_15, started daemon 134746892814016)>, <Thread(tpool_thread_16, started daemon 134746884404928)>, <Thread(tpool_thread_17, started daemon 134746875995840)>, <Thread(tpool_thread_18, started daemon 134746867586752)>, <Thread(tpool_thread_19, started daemon 134746859177664)>] {{(pid=86120) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 03 18:43:15 devstack cinder-volume[86120]: DEBUG cinder.image.image_utils [None req-b5d76385-6097-4532-976f-4a9e909b3638 tempest-VolumeImageDependencyTests-511992875 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_793130b1-29e6-4cc7-9c66-e4d41ac4e392_vao5nz_tdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86120) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 03 18:43:15 devstack cinder-volume[86120]: INFO cinder.image.image_utils [None req-b5d76385-6097-4532-976f-4a9e909b3638 tempest-VolumeImageDependencyTests-511992875 None] Image download 0.00 MB at 0.00 MB/s
Nov 03 18:43:15 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-3d548b76-5294-4172-9616-f8688b2347dd tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ca13478c-0cf9-4baa-b6f6-50829c73b8aa {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:15 devstack sudo[106815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ca13478c-0cf9-4baa-b6f6-50829c73b8aa
Nov 03 18:43:15 devstack sudo[106815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:15 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5e28504-7b19-4cbd-bc7b-7a56b173501b]: (4, 'raw') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:43:15 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b5d76385-6097-4532-976f-4a9e909b3638 tempest-VolumeImageDependencyTests-511992875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_793130b1-29e6-4cc7-9c66-e4d41ac4e392_vao5nz_tdevstack@QuobyteHD {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:15 devstack sudo[106817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_793130b1-29e6-4cc7-9c66-e4d41ac4e392_vao5nz_tdevstack@QuobyteHD
Nov 03 18:43:15 devstack sudo[106817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:15 devstack sudo[106815]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:15 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-3d548b76-5294-4172-9616-f8688b2347dd tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ca13478c-0cf9-4baa-b6f6-50829c73b8aa" returned: 0 in 0.245s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:15 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-3d548b76-5294-4172-9616-f8688b2347dd tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] <== create_volume: return (811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:43:15 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-3d548b76-5294-4172-9616-f8688b2347dd tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.815s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:43:15 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-d3cdc8fd-3417-4c8b-8ec9-ae480d409cac tempest-CreateVolumesFromSnapshotTest-853708760 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.358s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:43:15 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-d3cdc8fd-3417-4c8b-8ec9-ae480d409cac tempest-CreateVolumesFromSnapshotTest-853708760 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:43:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2114794893',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1dcddcb7-58e5-4611-b995-d4bacf111d51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d47f25975e39410f88fd40a8e64746a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:43:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:43:12Z,use_quota=True,user_id='6365179a55154fcea6e31f1fb7949df3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:43:15 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-d3cdc8fd-3417-4c8b-8ec9-ae480d409cac tempest-CreateVolumesFromSnapshotTest-853708760 None] Creating volume 1dcddcb7-58e5-4611-b995-d4bacf111d51 {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:43:15 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-d3cdc8fd-3417-4c8b-8ec9-ae480d409cac tempest-CreateVolumesFromSnapshotTest-853708760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:43:15 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-d3cdc8fd-3417-4c8b-8ec9-ae480d409cac tempest-CreateVolumesFromSnapshotTest-853708760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:43:15 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-d3cdc8fd-3417-4c8b-8ec9-ae480d409cac tempest-CreateVolumesFromSnapshotTest-853708760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:43:15 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-d3cdc8fd-3417-4c8b-8ec9-ae480d409cac tempest-CreateVolumesFromSnapshotTest-853708760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:43:15 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-d3cdc8fd-3417-4c8b-8ec9-ae480d409cac tempest-CreateVolumesFromSnapshotTest-853708760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:43:15 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-d3cdc8fd-3417-4c8b-8ec9-ae480d409cac tempest-CreateVolumesFromSnapshotTest-853708760 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:43:15 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-d3cdc8fd-3417-4c8b-8ec9-ae480d409cac tempest-CreateVolumesFromSnapshotTest-853708760 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:43:15 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-d3cdc8fd-3417-4c8b-8ec9-ae480d409cac tempest-CreateVolumesFromSnapshotTest-853708760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-1dcddcb7-58e5-4611-b995-d4bacf111d51 1073741824 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:15 devstack sudo[106820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-1dcddcb7-58e5-4611-b995-d4bacf111d51 1073741824
Nov 03 18:43:15 devstack sudo[106820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:15 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-3d548b76-5294-4172-9616-f8688b2347dd tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14bac711-d519-4215-9073-f17a577d08f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca13478c-0cf9-4baa-b6f6-50829c73b8aa', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:43:15 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-3d548b76-5294-4172-9616-f8688b2347dd tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19668486-afb1-4cd1-90ae-c971dbd5d2f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:43:15 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-3d548b76-5294-4172-9616-f8688b2347dd tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Volume volume-ca13478c-0cf9-4baa-b6f6-50829c73b8aa (ca13478c-0cf9-4baa-b6f6-50829c73b8aa): created successfully
Nov 03 18:43:15 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-3d548b76-5294-4172-9616-f8688b2347dd tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19668486-afb1-4cd1-90ae-c971dbd5d2f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:43:15 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-3d548b76-5294-4172-9616-f8688b2347dd tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Flow 'volume_create_manager' (b7929302-2f09-4849-a53a-ef704f54959a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:43:15 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-3d548b76-5294-4172-9616-f8688b2347dd tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Created volume successfully.
Nov 03 18:43:15 devstack sudo[106817]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:15 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b5d76385-6097-4532-976f-4a9e909b3638 tempest-VolumeImageDependencyTests-511992875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_793130b1-29e6-4cc7-9c66-e4d41ac4e392_vao5nz_tdevstack@QuobyteHD" returned: 0 in 0.329s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:15 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b5d76385-6097-4532-976f-4a9e909b3638 tempest-VolumeImageDependencyTests-511992875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_793130b1-29e6-4cc7-9c66-e4d41ac4e392_vao5nz_tdevstack@QuobyteHD {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:15 devstack sudo[106824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_793130b1-29e6-4cc7-9c66-e4d41ac4e392_vao5nz_tdevstack@QuobyteHD
Nov 03 18:43:15 devstack sudo[106824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:16 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-b75bbc61-77c8-4bab-92b3-e56e48812fc0 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Acquiring lock "cinder-ca13478c-0cf9-4baa-b6f6-50829c73b8aa-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:43:16 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-b75bbc61-77c8-4bab-92b3-e56e48812fc0 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Lock "cinder-ca13478c-0cf9-4baa-b6f6-50829c73b8aa-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:43:16 devstack sudo[106824]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:16 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b5d76385-6097-4532-976f-4a9e909b3638 tempest-VolumeImageDependencyTests-511992875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_793130b1-29e6-4cc7-9c66-e4d41ac4e392_vao5nz_tdevstack@QuobyteHD" returned: 1 in 0.379s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:16 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b5d76385-6097-4532-976f-4a9e909b3638 tempest-VolumeImageDependencyTests-511992875 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_793130b1-29e6-4cc7-9c66-e4d41ac4e392_vao5nz_tdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 03 18:43:16 devstack cinder-volume[86120]: DEBUG cinder.image.image_utils [None req-b5d76385-6097-4532-976f-4a9e909b3638 tempest-VolumeImageDependencyTests-511992875 None] Temporary image 793130b1-29e6-4cc7-9c66-e4d41ac4e392 is fetched for user eacb443a4cc740929fe82aa7ed92dde3. {{(pid=86120) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 03 18:43:16 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-b75bbc61-77c8-4bab-92b3-e56e48812fc0 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Acquiring lock "cinder-quobyte-ca13478c-0cf9-4baa-b6f6-50829c73b8aa" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:43:16 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-b75bbc61-77c8-4bab-92b3-e56e48812fc0 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Lock "cinder-quobyte-ca13478c-0cf9-4baa-b6f6-50829c73b8aa" acquired by "delete_volume" :: waited 0.018s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:43:16 devstack sudo[106820]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:16 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-d3cdc8fd-3417-4c8b-8ec9-ae480d409cac tempest-CreateVolumesFromSnapshotTest-853708760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-1dcddcb7-58e5-4611-b995-d4bacf111d51 1073741824" returned: 0 in 0.549s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:16 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[356b266f-721f-4e15-918d-ee49c47d6afb]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:43:16 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b75bbc61-77c8-4bab-92b3-e56e48812fc0 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ca13478c-0cf9-4baa-b6f6-50829c73b8aa {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:16 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d6a006e-cd66-4c46-96fd-5e0bc6d0bc24]: (4, 'raw') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:43:16 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b5d76385-6097-4532-976f-4a9e909b3638 tempest-VolumeImageDependencyTests-511992875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_793130b1-29e6-4cc7-9c66-e4d41ac4e392_vao5nz_tdevstack@QuobyteHD {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:16 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-d3cdc8fd-3417-4c8b-8ec9-ae480d409cac tempest-CreateVolumesFromSnapshotTest-853708760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-1dcddcb7-58e5-4611-b995-d4bacf111d51 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:16 devstack sudo[106836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-1dcddcb7-58e5-4611-b995-d4bacf111d51
Nov 03 18:43:16 devstack sudo[106836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:16 devstack sudo[106834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ca13478c-0cf9-4baa-b6f6-50829c73b8aa
Nov 03 18:43:16 devstack sudo[106834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:16 devstack sudo[106835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_793130b1-29e6-4cc7-9c66-e4d41ac4e392_vao5nz_tdevstack@QuobyteHD
Nov 03 18:43:16 devstack sudo[106835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:16 devstack sudo[106836]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:16 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-d3cdc8fd-3417-4c8b-8ec9-ae480d409cac tempest-CreateVolumesFromSnapshotTest-853708760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-1dcddcb7-58e5-4611-b995-d4bacf111d51" returned: 0 in 0.262s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:16 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-d3cdc8fd-3417-4c8b-8ec9-ae480d409cac tempest-CreateVolumesFromSnapshotTest-853708760 None] <== create_volume: return (886ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:43:16 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-d3cdc8fd-3417-4c8b-8ec9-ae480d409cac tempest-CreateVolumesFromSnapshotTest-853708760 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.891s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:43:16 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-7eb0ef70-2d5b-4307-853f-effcc67dae9a tempest-ProjectReaderTests-964059183 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.753s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:43:16 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-7eb0ef70-2d5b-4307-853f-effcc67dae9a tempest-ProjectReaderTests-964059183 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:43:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-881415897',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73a0843d-c640-4d46-acd1-d87a954d4a50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f24206f5f1e4ac19bde23d31d296883',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:43:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:43:13Z,use_quota=True,user_id='e6c9675a59f54b34b6743622a5b243b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:43:16 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-7eb0ef70-2d5b-4307-853f-effcc67dae9a tempest-ProjectReaderTests-964059183 None] Creating volume 73a0843d-c640-4d46-acd1-d87a954d4a50 {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:43:16 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-7eb0ef70-2d5b-4307-853f-effcc67dae9a tempest-ProjectReaderTests-964059183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:43:16 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-7eb0ef70-2d5b-4307-853f-effcc67dae9a tempest-ProjectReaderTests-964059183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:43:16 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-7eb0ef70-2d5b-4307-853f-effcc67dae9a tempest-ProjectReaderTests-964059183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:43:16 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-7eb0ef70-2d5b-4307-853f-effcc67dae9a tempest-ProjectReaderTests-964059183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:43:16 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-7eb0ef70-2d5b-4307-853f-effcc67dae9a tempest-ProjectReaderTests-964059183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:43:16 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-7eb0ef70-2d5b-4307-853f-effcc67dae9a tempest-ProjectReaderTests-964059183 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:43:16 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-7eb0ef70-2d5b-4307-853f-effcc67dae9a tempest-ProjectReaderTests-964059183 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:43:16 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-7eb0ef70-2d5b-4307-853f-effcc67dae9a tempest-ProjectReaderTests-964059183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-73a0843d-c640-4d46-acd1-d87a954d4a50 1073741824 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:16 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-d3cdc8fd-3417-4c8b-8ec9-ae480d409cac tempest-CreateVolumesFromSnapshotTest-853708760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32cb6946-ecc7-4317-b376-4e7cb7ea8a23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1dcddcb7-58e5-4611-b995-d4bacf111d51', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:43:16 devstack sudo[106845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-73a0843d-c640-4d46-acd1-d87a954d4a50 1073741824
Nov 03 18:43:16 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-d3cdc8fd-3417-4c8b-8ec9-ae480d409cac tempest-CreateVolumesFromSnapshotTest-853708760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (619fdc8c-374d-4506-8257-3d6cafc79f66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:43:16 devstack sudo[106835]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:16 devstack sudo[106845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:16 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b5d76385-6097-4532-976f-4a9e909b3638 tempest-VolumeImageDependencyTests-511992875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_793130b1-29e6-4cc7-9c66-e4d41ac4e392_vao5nz_tdevstack@QuobyteHD" returned: 0 in 0.341s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:16 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b5d76385-6097-4532-976f-4a9e909b3638 tempest-VolumeImageDependencyTests-511992875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_793130b1-29e6-4cc7-9c66-e4d41ac4e392_vao5nz_tdevstack@QuobyteHD {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:16 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-d3cdc8fd-3417-4c8b-8ec9-ae480d409cac tempest-CreateVolumesFromSnapshotTest-853708760 None] Volume volume-1dcddcb7-58e5-4611-b995-d4bacf111d51 (1dcddcb7-58e5-4611-b995-d4bacf111d51): created successfully
Nov 03 18:43:16 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-d3cdc8fd-3417-4c8b-8ec9-ae480d409cac tempest-CreateVolumesFromSnapshotTest-853708760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (619fdc8c-374d-4506-8257-3d6cafc79f66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:43:16 devstack sudo[106834]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:16 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-d3cdc8fd-3417-4c8b-8ec9-ae480d409cac tempest-CreateVolumesFromSnapshotTest-853708760 None] Flow 'volume_create_manager' (1888f2c9-50d7-4f7f-b0b7-c2fd08f3c62e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:43:16 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b75bbc61-77c8-4bab-92b3-e56e48812fc0 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ca13478c-0cf9-4baa-b6f6-50829c73b8aa" returned: 0 in 0.416s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:16 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b75bbc61-77c8-4bab-92b3-e56e48812fc0 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ca13478c-0cf9-4baa-b6f6-50829c73b8aa {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:16 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-d3cdc8fd-3417-4c8b-8ec9-ae480d409cac tempest-CreateVolumesFromSnapshotTest-853708760 None] Created volume successfully.
Nov 03 18:43:16 devstack sudo[106849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ca13478c-0cf9-4baa-b6f6-50829c73b8aa
Nov 03 18:43:16 devstack sudo[106849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:16 devstack sudo[106848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_793130b1-29e6-4cc7-9c66-e4d41ac4e392_vao5nz_tdevstack@QuobyteHD
Nov 03 18:43:16 devstack sudo[106848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:16 devstack sudo[106849]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:16 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b75bbc61-77c8-4bab-92b3-e56e48812fc0 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ca13478c-0cf9-4baa-b6f6-50829c73b8aa" returned: 0 in 0.293s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:16 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-b75bbc61-77c8-4bab-92b3-e56e48812fc0 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Lock "cinder-quobyte-ca13478c-0cf9-4baa-b6f6-50829c73b8aa" released by "delete_volume" :: held 0.759s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:43:16 devstack sudo[106848]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:16 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b5d76385-6097-4532-976f-4a9e909b3638 tempest-VolumeImageDependencyTests-511992875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_793130b1-29e6-4cc7-9c66-e4d41ac4e392_vao5nz_tdevstack@QuobyteHD" returned: 1 in 0.370s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:16 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b5d76385-6097-4532-976f-4a9e909b3638 tempest-VolumeImageDependencyTests-511992875 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_793130b1-29e6-4cc7-9c66-e4d41ac4e392_vao5nz_tdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 03 18:43:16 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-b5d76385-6097-4532-976f-4a9e909b3638 tempest-VolumeImageDependencyTests-511992875 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:43:16 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-b75bbc61-77c8-4bab-92b3-e56e48812fc0 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Created reservations ['3e788e1b-eb92-440a-9a05-e6288bda03f6', '8fe63bba-960d-4fd1-aa2f-897e9f631bf6', '5f240cb6-a1c5-4f89-aa06-967bbc075a00', '7155da0b-8381-4c44-b9c0-46eae05143c9'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:43:16 devstack sudo[106845]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:16 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-7eb0ef70-2d5b-4307-853f-effcc67dae9a tempest-ProjectReaderTests-964059183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-73a0843d-c640-4d46-acd1-d87a954d4a50 1073741824" returned: 0 in 0.484s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:16 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-b75bbc61-77c8-4bab-92b3-e56e48812fc0 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:43:16 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-b75bbc61-77c8-4bab-92b3-e56e48812fc0 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:43:16 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-b75bbc61-77c8-4bab-92b3-e56e48812fc0 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:43:16 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-b75bbc61-77c8-4bab-92b3-e56e48812fc0 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:43:16 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-b75bbc61-77c8-4bab-92b3-e56e48812fc0 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:43:16 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b75bbc61-77c8-4bab-92b3-e56e48812fc0 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:17 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-7eb0ef70-2d5b-4307-853f-effcc67dae9a tempest-ProjectReaderTests-964059183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-73a0843d-c640-4d46-acd1-d87a954d4a50 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:17 devstack sudo[106860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:43:17 devstack sudo[106860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:17 devstack sudo[106861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-73a0843d-c640-4d46-acd1-d87a954d4a50
Nov 03 18:43:17 devstack sudo[106861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:17 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-4bacc895-914a-4fc3-8553-6d2266011260 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Acquiring lock "cinder-dd1f36d1-59b2-45cd-9ec4-c677783860a4-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:43:17 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-4bacc895-914a-4fc3-8553-6d2266011260 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Lock "cinder-dd1f36d1-59b2-45cd-9ec4-c677783860a4-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:43:17 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-4bacc895-914a-4fc3-8553-6d2266011260 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Acquiring lock "cinder-quobyte-dd1f36d1-59b2-45cd-9ec4-c677783860a4" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:43:17 devstack sudo[106860]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:17 devstack sudo[106861]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:17 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b75bbc61-77c8-4bab-92b3-e56e48812fc0 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.287s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:17 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-b75bbc61-77c8-4bab-92b3-e56e48812fc0 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:43:17 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-4bacc895-914a-4fc3-8553-6d2266011260 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Lock "cinder-quobyte-dd1f36d1-59b2-45cd-9ec4-c677783860a4" acquired by "delete_volume" :: waited 0.018s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:43:17 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-7eb0ef70-2d5b-4307-853f-effcc67dae9a tempest-ProjectReaderTests-964059183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-73a0843d-c640-4d46-acd1-d87a954d4a50" returned: 0 in 0.293s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:17 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-7eb0ef70-2d5b-4307-853f-effcc67dae9a tempest-ProjectReaderTests-964059183 None] <== create_volume: return (845ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:43:17 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-7eb0ef70-2d5b-4307-853f-effcc67dae9a tempest-ProjectReaderTests-964059183 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.848s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:43:17 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-b75bbc61-77c8-4bab-92b3-e56e48812fc0 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Deleted volume successfully.
Nov 03 18:43:17 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-29c5085d-36b3-4ad6-b5c7-88ccaaac14cd tempest-CreateVolumesFromSnapshotTest-853708760 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.432s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:43:17 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-29c5085d-36b3-4ad6-b5c7-88ccaaac14cd tempest-CreateVolumesFromSnapshotTest-853708760 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:43:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2147253163',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36587014-f68e-44a0-aeb7-a20bef182609,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d47f25975e39410f88fd40a8e64746a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:43:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:43:13Z,use_quota=True,user_id='6365179a55154fcea6e31f1fb7949df3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:43:17 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-29c5085d-36b3-4ad6-b5c7-88ccaaac14cd tempest-CreateVolumesFromSnapshotTest-853708760 None] Creating volume 36587014-f68e-44a0-aeb7-a20bef182609 {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:43:17 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-29c5085d-36b3-4ad6-b5c7-88ccaaac14cd tempest-CreateVolumesFromSnapshotTest-853708760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:43:17 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-29c5085d-36b3-4ad6-b5c7-88ccaaac14cd tempest-CreateVolumesFromSnapshotTest-853708760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:43:17 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-29c5085d-36b3-4ad6-b5c7-88ccaaac14cd tempest-CreateVolumesFromSnapshotTest-853708760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:43:17 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-29c5085d-36b3-4ad6-b5c7-88ccaaac14cd tempest-CreateVolumesFromSnapshotTest-853708760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:43:17 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-29c5085d-36b3-4ad6-b5c7-88ccaaac14cd tempest-CreateVolumesFromSnapshotTest-853708760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:43:17 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-29c5085d-36b3-4ad6-b5c7-88ccaaac14cd tempest-CreateVolumesFromSnapshotTest-853708760 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:43:17 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-29c5085d-36b3-4ad6-b5c7-88ccaaac14cd tempest-CreateVolumesFromSnapshotTest-853708760 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:43:17 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-29c5085d-36b3-4ad6-b5c7-88ccaaac14cd tempest-CreateVolumesFromSnapshotTest-853708760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-36587014-f68e-44a0-aeb7-a20bef182609 1073741824 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:17 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bfc0631-0d6a-44d8-9052-456137e2d887]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:43:17 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-4bacc895-914a-4fc3-8553-6d2266011260 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dd1f36d1-59b2-45cd-9ec4-c677783860a4 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:17 devstack sudo[106866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-36587014-f68e-44a0-aeb7-a20bef182609 1073741824
Nov 03 18:43:17 devstack sudo[106866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:17 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-7eb0ef70-2d5b-4307-853f-effcc67dae9a tempest-ProjectReaderTests-964059183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28acb878-6457-4047-8780-aa20609f84d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73a0843d-c640-4d46-acd1-d87a954d4a50', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:43:17 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-7eb0ef70-2d5b-4307-853f-effcc67dae9a tempest-ProjectReaderTests-964059183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e0276c4-5001-402a-8655-450569dfb98a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:43:17 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-b75bbc61-77c8-4bab-92b3-e56e48812fc0 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Lock "cinder-ca13478c-0cf9-4baa-b6f6-50829c73b8aa-delete_volume" released by "delete_volume" :: held 1.352s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:43:17 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-7eb0ef70-2d5b-4307-853f-effcc67dae9a tempest-ProjectReaderTests-964059183 None] Volume volume-73a0843d-c640-4d46-acd1-d87a954d4a50 (73a0843d-c640-4d46-acd1-d87a954d4a50): created successfully
Nov 03 18:43:17 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-7eb0ef70-2d5b-4307-853f-effcc67dae9a tempest-ProjectReaderTests-964059183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e0276c4-5001-402a-8655-450569dfb98a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:43:17 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-7eb0ef70-2d5b-4307-853f-effcc67dae9a tempest-ProjectReaderTests-964059183 None] Flow 'volume_create_manager' (1e5b8896-f89a-49f7-96b4-4667efc47b2e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:43:17 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-7eb0ef70-2d5b-4307-853f-effcc67dae9a tempest-ProjectReaderTests-964059183 None] Created volume successfully.
Nov 03 18:43:17 devstack sudo[106867]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dd1f36d1-59b2-45cd-9ec4-c677783860a4
Nov 03 18:43:17 devstack sudo[106867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:17 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-ff72f6a1-f0c3-470c-b5a5-9377076b1766 tempest-ProjectReaderTests-964059183 None] Acquiring lock "cinder-73a0843d-c640-4d46-acd1-d87a954d4a50-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:43:17 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-ff72f6a1-f0c3-470c-b5a5-9377076b1766 tempest-ProjectReaderTests-964059183 None] Lock "cinder-73a0843d-c640-4d46-acd1-d87a954d4a50-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:43:17 devstack sudo[106867]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:17 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-4bacc895-914a-4fc3-8553-6d2266011260 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dd1f36d1-59b2-45cd-9ec4-c677783860a4" returned: 0 in 0.419s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:17 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-4bacc895-914a-4fc3-8553-6d2266011260 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dd1f36d1-59b2-45cd-9ec4-c677783860a4 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:17 devstack sudo[106876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dd1f36d1-59b2-45cd-9ec4-c677783860a4
Nov 03 18:43:17 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-ff72f6a1-f0c3-470c-b5a5-9377076b1766 tempest-ProjectReaderTests-964059183 None] Acquiring lock "cinder-quobyte-73a0843d-c640-4d46-acd1-d87a954d4a50" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:43:17 devstack sudo[106876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:17 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-ff72f6a1-f0c3-470c-b5a5-9377076b1766 tempest-ProjectReaderTests-964059183 None] Lock "cinder-quobyte-73a0843d-c640-4d46-acd1-d87a954d4a50" acquired by "delete_volume" :: waited 0.017s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:43:17 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4d473f0-081e-4426-9af9-a62e44caf50b]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:43:17 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-ff72f6a1-f0c3-470c-b5a5-9377076b1766 tempest-ProjectReaderTests-964059183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-73a0843d-c640-4d46-acd1-d87a954d4a50 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:17 devstack sudo[106866]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:17 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-29c5085d-36b3-4ad6-b5c7-88ccaaac14cd tempest-CreateVolumesFromSnapshotTest-853708760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-36587014-f68e-44a0-aeb7-a20bef182609 1073741824" returned: 0 in 0.548s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:17 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-29c5085d-36b3-4ad6-b5c7-88ccaaac14cd tempest-CreateVolumesFromSnapshotTest-853708760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-36587014-f68e-44a0-aeb7-a20bef182609 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:17 devstack sudo[106879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-36587014-f68e-44a0-aeb7-a20bef182609
Nov 03 18:43:17 devstack sudo[106879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:17 devstack sudo[106878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-73a0843d-c640-4d46-acd1-d87a954d4a50
Nov 03 18:43:17 devstack sudo[106878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:18 devstack sudo[106876]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:18 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-4bacc895-914a-4fc3-8553-6d2266011260 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-dd1f36d1-59b2-45cd-9ec4-c677783860a4" returned: 0 in 0.298s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:18 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-4bacc895-914a-4fc3-8553-6d2266011260 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Lock "cinder-quobyte-dd1f36d1-59b2-45cd-9ec4-c677783860a4" released by "delete_volume" :: held 0.782s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:43:18 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-4bacc895-914a-4fc3-8553-6d2266011260 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Created reservations ['431b8c40-3aa5-41c9-938e-1086f449f9c8', 'fb9f9401-9595-4664-9ffb-784f207c5514', 'b80ada12-de98-4757-ba3c-2ae524616c88', 'adb5a493-392d-4481-90f1-08f5239672b4'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:43:18 devstack sudo[106879]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:18 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-29c5085d-36b3-4ad6-b5c7-88ccaaac14cd tempest-CreateVolumesFromSnapshotTest-853708760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-36587014-f68e-44a0-aeb7-a20bef182609" returned: 0 in 0.285s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:18 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-29c5085d-36b3-4ad6-b5c7-88ccaaac14cd tempest-CreateVolumesFromSnapshotTest-853708760 None] <== create_volume: return (879ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:43:18 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-29c5085d-36b3-4ad6-b5c7-88ccaaac14cd tempest-CreateVolumesFromSnapshotTest-853708760 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.883s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:43:18 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-b537612e-e1f2-4cbd-90cc-282df18679cd tempest-CreateVolumesFromSnapshotTest-853708760 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.044s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:43:18 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-b537612e-e1f2-4cbd-90cc-282df18679cd tempest-CreateVolumesFromSnapshotTest-853708760 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:43:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-330786227',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afc00e02-2f86-432d-b1e5-abf17c4c8648,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d47f25975e39410f88fd40a8e64746a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:43:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:43:13Z,use_quota=True,user_id='6365179a55154fcea6e31f1fb7949df3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:43:18 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-b537612e-e1f2-4cbd-90cc-282df18679cd tempest-CreateVolumesFromSnapshotTest-853708760 None] Creating volume afc00e02-2f86-432d-b1e5-abf17c4c8648 {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:43:18 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-b537612e-e1f2-4cbd-90cc-282df18679cd tempest-CreateVolumesFromSnapshotTest-853708760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:43:18 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-b537612e-e1f2-4cbd-90cc-282df18679cd tempest-CreateVolumesFromSnapshotTest-853708760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:43:18 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-b537612e-e1f2-4cbd-90cc-282df18679cd tempest-CreateVolumesFromSnapshotTest-853708760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:43:18 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-b537612e-e1f2-4cbd-90cc-282df18679cd tempest-CreateVolumesFromSnapshotTest-853708760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:43:18 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-b537612e-e1f2-4cbd-90cc-282df18679cd tempest-CreateVolumesFromSnapshotTest-853708760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:43:18 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-b537612e-e1f2-4cbd-90cc-282df18679cd tempest-CreateVolumesFromSnapshotTest-853708760 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:43:18 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-b537612e-e1f2-4cbd-90cc-282df18679cd tempest-CreateVolumesFromSnapshotTest-853708760 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:43:18 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b537612e-e1f2-4cbd-90cc-282df18679cd tempest-CreateVolumesFromSnapshotTest-853708760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-afc00e02-2f86-432d-b1e5-abf17c4c8648 1073741824 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:18 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-29c5085d-36b3-4ad6-b5c7-88ccaaac14cd tempest-CreateVolumesFromSnapshotTest-853708760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da8bbd4f-0f44-4e2a-9da4-5ee653942c8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36587014-f68e-44a0-aeb7-a20bef182609', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:43:18 devstack sudo[106887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-afc00e02-2f86-432d-b1e5-abf17c4c8648 1073741824
Nov 03 18:43:18 devstack sudo[106887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:18 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-29c5085d-36b3-4ad6-b5c7-88ccaaac14cd tempest-CreateVolumesFromSnapshotTest-853708760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a14b492-b3b9-4c53-8c56-9b820599c708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:43:18 devstack sudo[106878]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:18 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-29c5085d-36b3-4ad6-b5c7-88ccaaac14cd tempest-CreateVolumesFromSnapshotTest-853708760 None] Volume volume-36587014-f68e-44a0-aeb7-a20bef182609 (36587014-f68e-44a0-aeb7-a20bef182609): created successfully
Nov 03 18:43:18 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-29c5085d-36b3-4ad6-b5c7-88ccaaac14cd tempest-CreateVolumesFromSnapshotTest-853708760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a14b492-b3b9-4c53-8c56-9b820599c708) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:43:18 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-29c5085d-36b3-4ad6-b5c7-88ccaaac14cd tempest-CreateVolumesFromSnapshotTest-853708760 None] Flow 'volume_create_manager' (b9032ab2-538b-4d62-ab8d-d7506f35f0c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:43:18 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-4bacc895-914a-4fc3-8553-6d2266011260 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:43:18 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-4bacc895-914a-4fc3-8553-6d2266011260 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:43:18 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-4bacc895-914a-4fc3-8553-6d2266011260 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:43:18 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-4bacc895-914a-4fc3-8553-6d2266011260 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:43:18 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-4bacc895-914a-4fc3-8553-6d2266011260 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:43:18 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-4bacc895-914a-4fc3-8553-6d2266011260 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:18 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-ff72f6a1-f0c3-470c-b5a5-9377076b1766 tempest-ProjectReaderTests-964059183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-73a0843d-c640-4d46-acd1-d87a954d4a50" returned: 0 in 0.469s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:18 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-ff72f6a1-f0c3-470c-b5a5-9377076b1766 tempest-ProjectReaderTests-964059183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-73a0843d-c640-4d46-acd1-d87a954d4a50 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:18 devstack sudo[106889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:43:18 devstack sudo[106889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:18 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-29c5085d-36b3-4ad6-b5c7-88ccaaac14cd tempest-CreateVolumesFromSnapshotTest-853708760 None] Created volume successfully.
Nov 03 18:43:18 devstack sudo[106890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-73a0843d-c640-4d46-acd1-d87a954d4a50
Nov 03 18:43:18 devstack sudo[106890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:18 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-0efafc4d-aaec-4368-bbec-ff9c89260d28 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Acquiring lock "cinder-80867d5f-bcde-44dd-8c11-ccdaec90e64f-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:43:18 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-0efafc4d-aaec-4368-bbec-ff9c89260d28 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Lock "cinder-80867d5f-bcde-44dd-8c11-ccdaec90e64f-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:43:18 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-0efafc4d-aaec-4368-bbec-ff9c89260d28 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Acquiring lock "cinder-quobyte-80867d5f-bcde-44dd-8c11-ccdaec90e64f" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:43:18 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-0efafc4d-aaec-4368-bbec-ff9c89260d28 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Lock "cinder-quobyte-80867d5f-bcde-44dd-8c11-ccdaec90e64f" acquired by "delete_volume" :: waited 0.031s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:43:18 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc5d67ce-d003-47f5-b74f-b281176265e9]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:43:18 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-0efafc4d-aaec-4368-bbec-ff9c89260d28 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-80867d5f-bcde-44dd-8c11-ccdaec90e64f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:18 devstack sudo[106890]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:18 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-ff72f6a1-f0c3-470c-b5a5-9377076b1766 tempest-ProjectReaderTests-964059183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-73a0843d-c640-4d46-acd1-d87a954d4a50" returned: 0 in 0.326s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:18 devstack sudo[106889]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:18 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-4bacc895-914a-4fc3-8553-6d2266011260 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.361s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:18 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-4bacc895-914a-4fc3-8553-6d2266011260 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:43:18 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-ff72f6a1-f0c3-470c-b5a5-9377076b1766 tempest-ProjectReaderTests-964059183 None] Lock "cinder-quobyte-73a0843d-c640-4d46-acd1-d87a954d4a50" released by "delete_volume" :: held 0.854s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:43:18 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-4bacc895-914a-4fc3-8553-6d2266011260 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Deleted volume successfully.
Nov 03 18:43:18 devstack sudo[106896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-80867d5f-bcde-44dd-8c11-ccdaec90e64f
Nov 03 18:43:18 devstack sudo[106896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:18 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-4bacc895-914a-4fc3-8553-6d2266011260 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Lock "cinder-dd1f36d1-59b2-45cd-9ec4-c677783860a4-delete_volume" released by "delete_volume" :: held 1.487s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:43:18 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-ff72f6a1-f0c3-470c-b5a5-9377076b1766 tempest-ProjectReaderTests-964059183 None] Created reservations ['5a72c477-7807-4cc7-9f48-3468a6bacb75', '72bc8996-89df-4dd7-a92f-0eb1f580cae3', '5b466786-e631-4d27-afa5-27df4f1fd9dd', 'abbfa19c-18fb-4eff-9619-18f636f4fd4b'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:43:18 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-ff72f6a1-f0c3-470c-b5a5-9377076b1766 tempest-ProjectReaderTests-964059183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:43:18 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-ff72f6a1-f0c3-470c-b5a5-9377076b1766 tempest-ProjectReaderTests-964059183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:43:18 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-ff72f6a1-f0c3-470c-b5a5-9377076b1766 tempest-ProjectReaderTests-964059183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:43:18 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-ff72f6a1-f0c3-470c-b5a5-9377076b1766 tempest-ProjectReaderTests-964059183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:43:18 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-ff72f6a1-f0c3-470c-b5a5-9377076b1766 tempest-ProjectReaderTests-964059183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:43:18 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-ff72f6a1-f0c3-470c-b5a5-9377076b1766 tempest-ProjectReaderTests-964059183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:18 devstack sudo[106887]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:18 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b537612e-e1f2-4cbd-90cc-282df18679cd tempest-CreateVolumesFromSnapshotTest-853708760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-afc00e02-2f86-432d-b1e5-abf17c4c8648 1073741824" returned: 0 in 0.633s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:18 devstack sudo[106901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:43:18 devstack sudo[106901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:18 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b537612e-e1f2-4cbd-90cc-282df18679cd tempest-CreateVolumesFromSnapshotTest-853708760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-afc00e02-2f86-432d-b1e5-abf17c4c8648 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:18 devstack sudo[106903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-afc00e02-2f86-432d-b1e5-abf17c4c8648
Nov 03 18:43:18 devstack sudo[106903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:19 devstack sudo[106896]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:19 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-0efafc4d-aaec-4368-bbec-ff9c89260d28 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-80867d5f-bcde-44dd-8c11-ccdaec90e64f" returned: 0 in 0.531s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:19 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-0efafc4d-aaec-4368-bbec-ff9c89260d28 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-80867d5f-bcde-44dd-8c11-ccdaec90e64f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:19 devstack sudo[106911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-80867d5f-bcde-44dd-8c11-ccdaec90e64f
Nov 03 18:43:19 devstack sudo[106901]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:19 devstack sudo[106911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:19 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-ff72f6a1-f0c3-470c-b5a5-9377076b1766 tempest-ProjectReaderTests-964059183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.295s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:19 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-ff72f6a1-f0c3-470c-b5a5-9377076b1766 tempest-ProjectReaderTests-964059183 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:43:19 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-ff72f6a1-f0c3-470c-b5a5-9377076b1766 tempest-ProjectReaderTests-964059183 None] Deleted volume successfully.
Nov 03 18:43:19 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-ff72f6a1-f0c3-470c-b5a5-9377076b1766 tempest-ProjectReaderTests-964059183 None] Lock "cinder-73a0843d-c640-4d46-acd1-d87a954d4a50-delete_volume" released by "delete_volume" :: held 1.447s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:43:19 devstack sudo[106903]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:19 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b537612e-e1f2-4cbd-90cc-282df18679cd tempest-CreateVolumesFromSnapshotTest-853708760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-afc00e02-2f86-432d-b1e5-abf17c4c8648" returned: 0 in 0.325s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:19 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-b537612e-e1f2-4cbd-90cc-282df18679cd tempest-CreateVolumesFromSnapshotTest-853708760 None] <== create_volume: return (1033ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:43:19 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-b537612e-e1f2-4cbd-90cc-282df18679cd tempest-CreateVolumesFromSnapshotTest-853708760 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.037s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:43:19 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-4e29a976-a76d-48c7-a70c-954af0ff8244 tempest-CreateVolumesFromSnapshotTest-853708760 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.644s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:43:19 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-4e29a976-a76d-48c7-a70c-954af0ff8244 tempest-CreateVolumesFromSnapshotTest-853708760 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:43:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1310899055',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3635bf61-6592-4c86-a809-d9b73e029ba3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d47f25975e39410f88fd40a8e64746a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:43:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:43:13Z,use_quota=True,user_id='6365179a55154fcea6e31f1fb7949df3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:43:19 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-4e29a976-a76d-48c7-a70c-954af0ff8244 tempest-CreateVolumesFromSnapshotTest-853708760 None] Creating volume 3635bf61-6592-4c86-a809-d9b73e029ba3 {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:43:19 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-4e29a976-a76d-48c7-a70c-954af0ff8244 tempest-CreateVolumesFromSnapshotTest-853708760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:43:19 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-4e29a976-a76d-48c7-a70c-954af0ff8244 tempest-CreateVolumesFromSnapshotTest-853708760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:43:19 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-4e29a976-a76d-48c7-a70c-954af0ff8244 tempest-CreateVolumesFromSnapshotTest-853708760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:43:19 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-4e29a976-a76d-48c7-a70c-954af0ff8244 tempest-CreateVolumesFromSnapshotTest-853708760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:43:19 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-4e29a976-a76d-48c7-a70c-954af0ff8244 tempest-CreateVolumesFromSnapshotTest-853708760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:43:19 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-4e29a976-a76d-48c7-a70c-954af0ff8244 tempest-CreateVolumesFromSnapshotTest-853708760 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:43:19 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-4e29a976-a76d-48c7-a70c-954af0ff8244 tempest-CreateVolumesFromSnapshotTest-853708760 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:43:19 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-4e29a976-a76d-48c7-a70c-954af0ff8244 tempest-CreateVolumesFromSnapshotTest-853708760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3635bf61-6592-4c86-a809-d9b73e029ba3 1073741824 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:19 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-b537612e-e1f2-4cbd-90cc-282df18679cd tempest-CreateVolumesFromSnapshotTest-853708760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a0473b3-95c9-4544-85ae-289df525cc27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-afc00e02-2f86-432d-b1e5-abf17c4c8648', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:43:19 devstack sudo[106914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3635bf61-6592-4c86-a809-d9b73e029ba3 1073741824
Nov 03 18:43:19 devstack sudo[106914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:19 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-b537612e-e1f2-4cbd-90cc-282df18679cd tempest-CreateVolumesFromSnapshotTest-853708760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ba8743c-feaa-4822-9280-6146d97c91b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:43:19 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-b537612e-e1f2-4cbd-90cc-282df18679cd tempest-CreateVolumesFromSnapshotTest-853708760 None] Volume volume-afc00e02-2f86-432d-b1e5-abf17c4c8648 (afc00e02-2f86-432d-b1e5-abf17c4c8648): created successfully
Nov 03 18:43:19 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-b537612e-e1f2-4cbd-90cc-282df18679cd tempest-CreateVolumesFromSnapshotTest-853708760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ba8743c-feaa-4822-9280-6146d97c91b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:43:19 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-b537612e-e1f2-4cbd-90cc-282df18679cd tempest-CreateVolumesFromSnapshotTest-853708760 None] Flow 'volume_create_manager' (830410a4-bf58-411a-b17d-326fcc46d13b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:43:19 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-b537612e-e1f2-4cbd-90cc-282df18679cd tempest-CreateVolumesFromSnapshotTest-853708760 None] Created volume successfully.
Nov 03 18:43:19 devstack sudo[106911]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:19 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-0efafc4d-aaec-4368-bbec-ff9c89260d28 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-80867d5f-bcde-44dd-8c11-ccdaec90e64f" returned: 0 in 0.325s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:19 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-0efafc4d-aaec-4368-bbec-ff9c89260d28 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Lock "cinder-quobyte-80867d5f-bcde-44dd-8c11-ccdaec90e64f" released by "delete_volume" :: held 0.909s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:43:19 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-0efafc4d-aaec-4368-bbec-ff9c89260d28 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Created reservations ['770e9899-109f-4272-901c-ab6c0fa9bd43', 'abf64e61-e90b-4375-aadf-e2e2518ec612', '2175f230-2791-4b4a-bf34-7953be779f25', 'ef3fec5d-abb1-4b54-8b60-70cd75d22e8b'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:43:19 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-0efafc4d-aaec-4368-bbec-ff9c89260d28 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:43:19 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-0efafc4d-aaec-4368-bbec-ff9c89260d28 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:43:19 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-0efafc4d-aaec-4368-bbec-ff9c89260d28 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:43:19 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-0efafc4d-aaec-4368-bbec-ff9c89260d28 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:43:19 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-0efafc4d-aaec-4368-bbec-ff9c89260d28 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:43:19 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-0efafc4d-aaec-4368-bbec-ff9c89260d28 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:19 devstack sudo[106920]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:43:19 devstack sudo[106920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:19 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-8e5d9e14-5901-46ce-8d62-8ac943b16a68 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Acquiring lock "cinder-0eaef93d-895f-465b-bbf1-fa91ced458b5-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:43:19 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-8e5d9e14-5901-46ce-8d62-8ac943b16a68 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Lock "cinder-0eaef93d-895f-465b-bbf1-fa91ced458b5-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:43:19 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-8e5d9e14-5901-46ce-8d62-8ac943b16a68 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Acquiring lock "cinder-quobyte-0eaef93d-895f-465b-bbf1-fa91ced458b5" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:43:19 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-8e5d9e14-5901-46ce-8d62-8ac943b16a68 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Lock "cinder-quobyte-0eaef93d-895f-465b-bbf1-fa91ced458b5" acquired by "delete_volume" :: waited 0.022s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:43:19 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b7367f3-5e2f-4091-9d21-985717e122d0]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:43:19 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-8e5d9e14-5901-46ce-8d62-8ac943b16a68 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-0eaef93d-895f-465b-bbf1-fa91ced458b5 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:19 devstack sudo[106920]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:19 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-0efafc4d-aaec-4368-bbec-ff9c89260d28 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.293s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:19 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-0efafc4d-aaec-4368-bbec-ff9c89260d28 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:43:19 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-0efafc4d-aaec-4368-bbec-ff9c89260d28 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Deleted volume successfully.
Nov 03 18:43:19 devstack sudo[106914]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:19 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-4e29a976-a76d-48c7-a70c-954af0ff8244 tempest-CreateVolumesFromSnapshotTest-853708760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3635bf61-6592-4c86-a809-d9b73e029ba3 1073741824" returned: 0 in 0.617s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:19 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-0efafc4d-aaec-4368-bbec-ff9c89260d28 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Lock "cinder-80867d5f-bcde-44dd-8c11-ccdaec90e64f-delete_volume" released by "delete_volume" :: held 1.467s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:43:19 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-4e29a976-a76d-48c7-a70c-954af0ff8244 tempest-CreateVolumesFromSnapshotTest-853708760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3635bf61-6592-4c86-a809-d9b73e029ba3 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:19 devstack sudo[106924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-0eaef93d-895f-465b-bbf1-fa91ced458b5
Nov 03 18:43:19 devstack sudo[106924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:19 devstack sudo[106926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3635bf61-6592-4c86-a809-d9b73e029ba3
Nov 03 18:43:19 devstack sudo[106926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:20 devstack sudo[106926]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:20 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-4e29a976-a76d-48c7-a70c-954af0ff8244 tempest-CreateVolumesFromSnapshotTest-853708760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3635bf61-6592-4c86-a809-d9b73e029ba3" returned: 0 in 0.310s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:20 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-4e29a976-a76d-48c7-a70c-954af0ff8244 tempest-CreateVolumesFromSnapshotTest-853708760 None] <== create_volume: return (981ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:43:20 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-4e29a976-a76d-48c7-a70c-954af0ff8244 tempest-CreateVolumesFromSnapshotTest-853708760 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.985s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:43:20 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-e1a41759-738a-4124-a0cb-a2b9699f31ff tempest-CreateVolumesFromSnapshotTest-853708760 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.134s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:43:20 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-e1a41759-738a-4124-a0cb-a2b9699f31ff tempest-CreateVolumesFromSnapshotTest-853708760 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:43:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1053521586',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34eaab66-1d1f-4f1b-8f2e-6b438ee10779,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d47f25975e39410f88fd40a8e64746a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:43:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:43:14Z,use_quota=True,user_id='6365179a55154fcea6e31f1fb7949df3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:43:20 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-e1a41759-738a-4124-a0cb-a2b9699f31ff tempest-CreateVolumesFromSnapshotTest-853708760 None] Creating volume 34eaab66-1d1f-4f1b-8f2e-6b438ee10779 {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:43:20 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-e1a41759-738a-4124-a0cb-a2b9699f31ff tempest-CreateVolumesFromSnapshotTest-853708760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:43:20 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-e1a41759-738a-4124-a0cb-a2b9699f31ff tempest-CreateVolumesFromSnapshotTest-853708760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:43:20 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-e1a41759-738a-4124-a0cb-a2b9699f31ff tempest-CreateVolumesFromSnapshotTest-853708760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:43:20 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-e1a41759-738a-4124-a0cb-a2b9699f31ff tempest-CreateVolumesFromSnapshotTest-853708760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:43:20 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-e1a41759-738a-4124-a0cb-a2b9699f31ff tempest-CreateVolumesFromSnapshotTest-853708760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:43:20 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-e1a41759-738a-4124-a0cb-a2b9699f31ff tempest-CreateVolumesFromSnapshotTest-853708760 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:43:20 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-e1a41759-738a-4124-a0cb-a2b9699f31ff tempest-CreateVolumesFromSnapshotTest-853708760 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:43:20 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-e1a41759-738a-4124-a0cb-a2b9699f31ff tempest-CreateVolumesFromSnapshotTest-853708760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-34eaab66-1d1f-4f1b-8f2e-6b438ee10779 1073741824 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:20 devstack sudo[106924]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:20 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-8e5d9e14-5901-46ce-8d62-8ac943b16a68 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-0eaef93d-895f-465b-bbf1-fa91ced458b5" returned: 0 in 0.464s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:20 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-8e5d9e14-5901-46ce-8d62-8ac943b16a68 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-0eaef93d-895f-465b-bbf1-fa91ced458b5 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:20 devstack sudo[106933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-34eaab66-1d1f-4f1b-8f2e-6b438ee10779 1073741824
Nov 03 18:43:20 devstack sudo[106933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:20 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-4e29a976-a76d-48c7-a70c-954af0ff8244 tempest-CreateVolumesFromSnapshotTest-853708760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6a03475-b528-4aa6-8d3f-d4aba073c386) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3635bf61-6592-4c86-a809-d9b73e029ba3', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:43:20 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-4e29a976-a76d-48c7-a70c-954af0ff8244 tempest-CreateVolumesFromSnapshotTest-853708760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9005b649-0b06-433f-9365-a5b04f027e51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:43:20 devstack sudo[106934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-0eaef93d-895f-465b-bbf1-fa91ced458b5
Nov 03 18:43:20 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-4e29a976-a76d-48c7-a70c-954af0ff8244 tempest-CreateVolumesFromSnapshotTest-853708760 None] Volume volume-3635bf61-6592-4c86-a809-d9b73e029ba3 (3635bf61-6592-4c86-a809-d9b73e029ba3): created successfully
Nov 03 18:43:20 devstack sudo[106934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:20 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-4e29a976-a76d-48c7-a70c-954af0ff8244 tempest-CreateVolumesFromSnapshotTest-853708760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9005b649-0b06-433f-9365-a5b04f027e51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:43:20 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-4e29a976-a76d-48c7-a70c-954af0ff8244 tempest-CreateVolumesFromSnapshotTest-853708760 None] Flow 'volume_create_manager' (0c772199-27be-46fc-b52a-298b82000c0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:43:20 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-4e29a976-a76d-48c7-a70c-954af0ff8244 tempest-CreateVolumesFromSnapshotTest-853708760 None] Created volume successfully.
Nov 03 18:43:20 devstack sudo[106934]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:20 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-8e5d9e14-5901-46ce-8d62-8ac943b16a68 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-0eaef93d-895f-465b-bbf1-fa91ced458b5" returned: 0 in 0.348s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:20 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-8e5d9e14-5901-46ce-8d62-8ac943b16a68 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Lock "cinder-quobyte-0eaef93d-895f-465b-bbf1-fa91ced458b5" released by "delete_volume" :: held 0.887s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:43:20 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-8e5d9e14-5901-46ce-8d62-8ac943b16a68 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Created reservations ['65749447-7bec-4bad-a7e6-67bc4e1cd596', '1f808714-3736-4ab8-9279-c5d879bd17f5', '0fb64dac-b831-41fd-aa71-9de193c13ec5', '420ff27d-bfba-4f4e-aa49-74ba0772edbd'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:43:20 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-8e5d9e14-5901-46ce-8d62-8ac943b16a68 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:43:20 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-8e5d9e14-5901-46ce-8d62-8ac943b16a68 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:43:20 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-8e5d9e14-5901-46ce-8d62-8ac943b16a68 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:43:20 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-8e5d9e14-5901-46ce-8d62-8ac943b16a68 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:43:20 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-8e5d9e14-5901-46ce-8d62-8ac943b16a68 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:43:20 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-8e5d9e14-5901-46ce-8d62-8ac943b16a68 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:20 devstack sudo[106933]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:20 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-e1a41759-738a-4124-a0cb-a2b9699f31ff tempest-CreateVolumesFromSnapshotTest-853708760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-34eaab66-1d1f-4f1b-8f2e-6b438ee10779 1073741824" returned: 0 in 0.579s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:20 devstack sudo[106942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:43:20 devstack sudo[106942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:20 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-e1a41759-738a-4124-a0cb-a2b9699f31ff tempest-CreateVolumesFromSnapshotTest-853708760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-34eaab66-1d1f-4f1b-8f2e-6b438ee10779 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:20 devstack sudo[106944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-34eaab66-1d1f-4f1b-8f2e-6b438ee10779
Nov 03 18:43:20 devstack sudo[106944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:20 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-0b393377-448f-40d0-9f78-a2faa28f9294 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Acquiring lock "cinder-73fca24e-e487-4569-9b45-89184efa0042-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:43:20 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-0b393377-448f-40d0-9f78-a2faa28f9294 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Lock "cinder-73fca24e-e487-4569-9b45-89184efa0042-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:43:20 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-0b393377-448f-40d0-9f78-a2faa28f9294 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Acquiring lock "cinder-quobyte-73fca24e-e487-4569-9b45-89184efa0042" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:43:21 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-0b393377-448f-40d0-9f78-a2faa28f9294 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Lock "cinder-quobyte-73fca24e-e487-4569-9b45-89184efa0042" acquired by "delete_volume" :: waited 0.024s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:43:21 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaa9d35d-83ce-434b-b99b-d17bcfb6fd17]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:43:21 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-0b393377-448f-40d0-9f78-a2faa28f9294 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-73fca24e-e487-4569-9b45-89184efa0042 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:21 devstack sudo[106942]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:21 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-8e5d9e14-5901-46ce-8d62-8ac943b16a68 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.361s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:21 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-8e5d9e14-5901-46ce-8d62-8ac943b16a68 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:43:21 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-8e5d9e14-5901-46ce-8d62-8ac943b16a68 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Deleted volume successfully.
Nov 03 18:43:21 devstack sudo[106946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-73fca24e-e487-4569-9b45-89184efa0042
Nov 03 18:43:21 devstack sudo[106946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:21 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-8e5d9e14-5901-46ce-8d62-8ac943b16a68 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Lock "cinder-0eaef93d-895f-465b-bbf1-fa91ced458b5-delete_volume" released by "delete_volume" :: held 1.527s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:43:21 devstack sudo[106944]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:21 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-e1a41759-738a-4124-a0cb-a2b9699f31ff tempest-CreateVolumesFromSnapshotTest-853708760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-34eaab66-1d1f-4f1b-8f2e-6b438ee10779" returned: 0 in 0.354s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:21 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-e1a41759-738a-4124-a0cb-a2b9699f31ff tempest-CreateVolumesFromSnapshotTest-853708760 None] <== create_volume: return (994ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:43:21 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-e1a41759-738a-4124-a0cb-a2b9699f31ff tempest-CreateVolumesFromSnapshotTest-853708760 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.996s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:43:21 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-b5d76385-6097-4532-976f-4a9e909b3638 tempest-VolumeImageDependencyTests-511992875 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.353s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:43:21 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-b5d76385-6097-4532-976f-4a9e909b3638 tempest-VolumeImageDependencyTests-511992875 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:43:14Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=903e0b67-2f52-429e-ac17-b4391d653e0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='472b047b03f54ce885be1e0c7d438102',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:43:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:43:15Z,use_quota=True,user_id='eacb443a4cc740929fe82aa7ed92dde3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:43:21 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-b5d76385-6097-4532-976f-4a9e909b3638 tempest-VolumeImageDependencyTests-511992875 None] Creating volume 903e0b67-2f52-429e-ac17-b4391d653e0b {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:43:21 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-b5d76385-6097-4532-976f-4a9e909b3638 tempest-VolumeImageDependencyTests-511992875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:43:21 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-b5d76385-6097-4532-976f-4a9e909b3638 tempest-VolumeImageDependencyTests-511992875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:43:21 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-b5d76385-6097-4532-976f-4a9e909b3638 tempest-VolumeImageDependencyTests-511992875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:43:21 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-b5d76385-6097-4532-976f-4a9e909b3638 tempest-VolumeImageDependencyTests-511992875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:43:21 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-b5d76385-6097-4532-976f-4a9e909b3638 tempest-VolumeImageDependencyTests-511992875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:43:21 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-b5d76385-6097-4532-976f-4a9e909b3638 tempest-VolumeImageDependencyTests-511992875 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:43:21 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-b5d76385-6097-4532-976f-4a9e909b3638 tempest-VolumeImageDependencyTests-511992875 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:43:21 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b5d76385-6097-4532-976f-4a9e909b3638 tempest-VolumeImageDependencyTests-511992875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-903e0b67-2f52-429e-ac17-b4391d653e0b 1073741824 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:21 devstack sudo[106950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-903e0b67-2f52-429e-ac17-b4391d653e0b 1073741824
Nov 03 18:43:21 devstack sudo[106950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:21 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-e1a41759-738a-4124-a0cb-a2b9699f31ff tempest-CreateVolumesFromSnapshotTest-853708760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (658a4b15-dcec-406e-bde6-5ba62684e568) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34eaab66-1d1f-4f1b-8f2e-6b438ee10779', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:43:21 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-e1a41759-738a-4124-a0cb-a2b9699f31ff tempest-CreateVolumesFromSnapshotTest-853708760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8cbc727-779b-4990-b7bc-64523056f6b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:43:21 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-e1a41759-738a-4124-a0cb-a2b9699f31ff tempest-CreateVolumesFromSnapshotTest-853708760 None] Volume volume-34eaab66-1d1f-4f1b-8f2e-6b438ee10779 (34eaab66-1d1f-4f1b-8f2e-6b438ee10779): created successfully
Nov 03 18:43:21 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-e1a41759-738a-4124-a0cb-a2b9699f31ff tempest-CreateVolumesFromSnapshotTest-853708760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8cbc727-779b-4990-b7bc-64523056f6b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:43:21 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-e1a41759-738a-4124-a0cb-a2b9699f31ff tempest-CreateVolumesFromSnapshotTest-853708760 None] Flow 'volume_create_manager' (2df894cb-c08a-44a9-8159-500c760c5d75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:43:21 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-e1a41759-738a-4124-a0cb-a2b9699f31ff tempest-CreateVolumesFromSnapshotTest-853708760 None] Created volume successfully.
Nov 03 18:43:21 devstack sudo[106946]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:21 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-0b393377-448f-40d0-9f78-a2faa28f9294 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-73fca24e-e487-4569-9b45-89184efa0042" returned: 0 in 0.415s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:21 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-0b393377-448f-40d0-9f78-a2faa28f9294 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-73fca24e-e487-4569-9b45-89184efa0042 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:21 devstack sudo[106956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-73fca24e-e487-4569-9b45-89184efa0042
Nov 03 18:43:21 devstack sudo[106956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:21 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-5a4d8393-9c0e-49ff-8f24-dc01c0bcbfbd tempest-CreateVolumesFromSnapshotTest-853708760 None] Acquiring lock "cinder-34eaab66-1d1f-4f1b-8f2e-6b438ee10779-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:43:21 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-5a4d8393-9c0e-49ff-8f24-dc01c0bcbfbd tempest-CreateVolumesFromSnapshotTest-853708760 None] Lock "cinder-34eaab66-1d1f-4f1b-8f2e-6b438ee10779-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:43:21 devstack sudo[106950]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:21 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-5a4d8393-9c0e-49ff-8f24-dc01c0bcbfbd tempest-CreateVolumesFromSnapshotTest-853708760 None] Acquiring lock "cinder-quobyte-34eaab66-1d1f-4f1b-8f2e-6b438ee10779" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:43:21 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b5d76385-6097-4532-976f-4a9e909b3638 tempest-VolumeImageDependencyTests-511992875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-903e0b67-2f52-429e-ac17-b4391d653e0b 1073741824" returned: 0 in 0.573s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:21 devstack sudo[106956]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:21 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-5a4d8393-9c0e-49ff-8f24-dc01c0bcbfbd tempest-CreateVolumesFromSnapshotTest-853708760 None] Lock "cinder-quobyte-34eaab66-1d1f-4f1b-8f2e-6b438ee10779" acquired by "delete_volume" :: waited 0.022s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:43:21 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-0b393377-448f-40d0-9f78-a2faa28f9294 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-73fca24e-e487-4569-9b45-89184efa0042" returned: 0 in 0.380s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:21 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8b05f14-7cb8-4785-bb88-95563d8bb00f]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:43:21 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-0b393377-448f-40d0-9f78-a2faa28f9294 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Lock "cinder-quobyte-73fca24e-e487-4569-9b45-89184efa0042" released by "delete_volume" :: held 0.865s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:43:21 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-5a4d8393-9c0e-49ff-8f24-dc01c0bcbfbd tempest-CreateVolumesFromSnapshotTest-853708760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-34eaab66-1d1f-4f1b-8f2e-6b438ee10779 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:21 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b5d76385-6097-4532-976f-4a9e909b3638 tempest-VolumeImageDependencyTests-511992875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-903e0b67-2f52-429e-ac17-b4391d653e0b {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:21 devstack sudo[106962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-903e0b67-2f52-429e-ac17-b4391d653e0b
Nov 03 18:43:21 devstack sudo[106962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:21 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-0b393377-448f-40d0-9f78-a2faa28f9294 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Created reservations ['2accbf72-82bf-486a-8cdd-4e11e5bf0a19', '270f2f65-f449-48e5-bc41-e93956b792ad', '89b37573-edb3-46ae-b900-b7ee688d992d', '25636fb3-97c3-4835-b59b-5f954f4232c4'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:43:22 devstack sudo[106961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-34eaab66-1d1f-4f1b-8f2e-6b438ee10779
Nov 03 18:43:22 devstack sudo[106961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:22 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-0b393377-448f-40d0-9f78-a2faa28f9294 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:43:22 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-0b393377-448f-40d0-9f78-a2faa28f9294 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:43:22 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-0b393377-448f-40d0-9f78-a2faa28f9294 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:43:22 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-0b393377-448f-40d0-9f78-a2faa28f9294 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:43:22 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-0b393377-448f-40d0-9f78-a2faa28f9294 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:43:22 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-0b393377-448f-40d0-9f78-a2faa28f9294 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:22 devstack sudo[106965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:43:22 devstack sudo[106965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:22 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-39fff5a7-f55e-4c69-b610-23dab61737fa tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Acquiring lock "cinder-08981357-ce62-4c51-b5d4-2eb176f096f3-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:43:22 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-39fff5a7-f55e-4c69-b610-23dab61737fa tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Lock "cinder-08981357-ce62-4c51-b5d4-2eb176f096f3-delete_volume" acquired by "delete_volume" :: waited 0.085s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:43:22 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-39fff5a7-f55e-4c69-b610-23dab61737fa tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Acquiring lock "cinder-quobyte-08981357-ce62-4c51-b5d4-2eb176f096f3" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:43:22 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-39fff5a7-f55e-4c69-b610-23dab61737fa tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Lock "cinder-quobyte-08981357-ce62-4c51-b5d4-2eb176f096f3" acquired by "delete_volume" :: waited 0.022s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:43:22 devstack sudo[106962]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:22 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b5d76385-6097-4532-976f-4a9e909b3638 tempest-VolumeImageDependencyTests-511992875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-903e0b67-2f52-429e-ac17-b4391d653e0b" returned: 0 in 0.491s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:22 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-b5d76385-6097-4532-976f-4a9e909b3638 tempest-VolumeImageDependencyTests-511992875 None] <== create_volume: return (1159ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:43:22 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-b5d76385-6097-4532-976f-4a9e909b3638 tempest-VolumeImageDependencyTests-511992875 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.164s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:43:22 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[e30e9540-c947-4203-bb38-718d1ef2bbdc]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:43:22 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-39fff5a7-f55e-4c69-b610-23dab61737fa tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-08981357-ce62-4c51-b5d4-2eb176f096f3 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:22 devstack sudo[106965]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:22 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-0b393377-448f-40d0-9f78-a2faa28f9294 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.344s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:22 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-0b393377-448f-40d0-9f78-a2faa28f9294 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:43:22 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-0b393377-448f-40d0-9f78-a2faa28f9294 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Deleted volume successfully.
Nov 03 18:43:22 devstack sudo[106961]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:22 devstack cinder-volume[86120]: DEBUG cinder.volume.volume_utils [None req-b5d76385-6097-4532-976f-4a9e909b3638 tempest-VolumeImageDependencyTests-511992875 None] Attempting download of 793130b1-29e6-4cc7-9c66-e4d41ac4e392 ((None, [{'url': 'file:///opt/stack/data/glance/images/793130b1-29e6-4cc7-9c66-e4d41ac4e392', 'metadata': {}}])) to volume 903e0b67-2f52-429e-ac17-b4391d653e0b. {{(pid=86120) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 03 18:43:22 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-5a4d8393-9c0e-49ff-8f24-dc01c0bcbfbd tempest-CreateVolumesFromSnapshotTest-853708760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-34eaab66-1d1f-4f1b-8f2e-6b438ee10779" returned: 0 in 0.583s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:22 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-5a4d8393-9c0e-49ff-8f24-dc01c0bcbfbd tempest-CreateVolumesFromSnapshotTest-853708760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-34eaab66-1d1f-4f1b-8f2e-6b438ee10779 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:22 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-0b393377-448f-40d0-9f78-a2faa28f9294 tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Lock "cinder-73fca24e-e487-4569-9b45-89184efa0042-delete_volume" released by "delete_volume" :: held 1.546s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:43:22 devstack sudo[106973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-34eaab66-1d1f-4f1b-8f2e-6b438ee10779
Nov 03 18:43:22 devstack sudo[106973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:22 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6da8935-1ae1-4088-89b7-487394da3b8a]: (4, 'raw') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:43:22 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b5d76385-6097-4532-976f-4a9e909b3638 tempest-VolumeImageDependencyTests-511992875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_793130b1-29e6-4cc7-9c66-e4d41ac4e392_sbasqbhd {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:22 devstack sudo[106972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-08981357-ce62-4c51-b5d4-2eb176f096f3
Nov 03 18:43:22 devstack sudo[106972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:22 devstack sudo[106975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_793130b1-29e6-4cc7-9c66-e4d41ac4e392_sbasqbhd
Nov 03 18:43:22 devstack sudo[106975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:22 devstack sudo[106973]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:22 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-5a4d8393-9c0e-49ff-8f24-dc01c0bcbfbd tempest-CreateVolumesFromSnapshotTest-853708760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-34eaab66-1d1f-4f1b-8f2e-6b438ee10779" returned: 0 in 0.378s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:22 devstack sudo[106972]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:22 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-39fff5a7-f55e-4c69-b610-23dab61737fa tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-08981357-ce62-4c51-b5d4-2eb176f096f3" returned: 0 in 0.457s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:22 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-39fff5a7-f55e-4c69-b610-23dab61737fa tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-08981357-ce62-4c51-b5d4-2eb176f096f3 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:22 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-5a4d8393-9c0e-49ff-8f24-dc01c0bcbfbd tempest-CreateVolumesFromSnapshotTest-853708760 None] Lock "cinder-quobyte-34eaab66-1d1f-4f1b-8f2e-6b438ee10779" released by "delete_volume" :: held 1.051s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:43:22 devstack sudo[106983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-08981357-ce62-4c51-b5d4-2eb176f096f3
Nov 03 18:43:22 devstack sudo[106983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:22 devstack sudo[106975]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:22 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b5d76385-6097-4532-976f-4a9e909b3638 tempest-VolumeImageDependencyTests-511992875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_793130b1-29e6-4cc7-9c66-e4d41ac4e392_sbasqbhd" returned: 0 in 0.442s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:22 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b5d76385-6097-4532-976f-4a9e909b3638 tempest-VolumeImageDependencyTests-511992875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_793130b1-29e6-4cc7-9c66-e4d41ac4e392_sbasqbhd {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:22 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-5a4d8393-9c0e-49ff-8f24-dc01c0bcbfbd tempest-CreateVolumesFromSnapshotTest-853708760 None] Created reservations ['718fd015-8844-4d0e-9352-3881880c94e3', 'b7f22abe-5489-463d-9926-90228e8b5bce', '66f7e5e7-d5ac-42d5-9c36-9048ce0d931b', '9f64cfab-6212-4ecf-a4e0-8b619448bf73'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:43:23 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-5a4d8393-9c0e-49ff-8f24-dc01c0bcbfbd tempest-CreateVolumesFromSnapshotTest-853708760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:43:23 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-5a4d8393-9c0e-49ff-8f24-dc01c0bcbfbd tempest-CreateVolumesFromSnapshotTest-853708760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:43:23 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-5a4d8393-9c0e-49ff-8f24-dc01c0bcbfbd tempest-CreateVolumesFromSnapshotTest-853708760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:43:23 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-5a4d8393-9c0e-49ff-8f24-dc01c0bcbfbd tempest-CreateVolumesFromSnapshotTest-853708760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:43:23 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-5a4d8393-9c0e-49ff-8f24-dc01c0bcbfbd tempest-CreateVolumesFromSnapshotTest-853708760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:43:23 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-5a4d8393-9c0e-49ff-8f24-dc01c0bcbfbd tempest-CreateVolumesFromSnapshotTest-853708760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:23 devstack sudo[106987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_793130b1-29e6-4cc7-9c66-e4d41ac4e392_sbasqbhd
Nov 03 18:43:23 devstack sudo[106987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:23 devstack sudo[106988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:43:23 devstack sudo[106988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:23 devstack sudo[106983]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:23 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-39fff5a7-f55e-4c69-b610-23dab61737fa tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-08981357-ce62-4c51-b5d4-2eb176f096f3" returned: 0 in 0.351s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:23 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-39fff5a7-f55e-4c69-b610-23dab61737fa tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Lock "cinder-quobyte-08981357-ce62-4c51-b5d4-2eb176f096f3" released by "delete_volume" :: held 0.869s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:43:23 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-39fff5a7-f55e-4c69-b610-23dab61737fa tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Created reservations ['98bf6ff9-db09-478b-a026-70bc7819a754', 'da949d97-998f-42b0-9137-0616dc99d345', '03697cdd-d996-461a-a6e1-2c516c9ef0a3', 'ac27facf-bd39-4a43-8d56-43626a6cdb87'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:43:23 devstack sudo[106987]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:23 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b5d76385-6097-4532-976f-4a9e909b3638 tempest-VolumeImageDependencyTests-511992875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_793130b1-29e6-4cc7-9c66-e4d41ac4e392_sbasqbhd" returned: 1 in 0.378s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:23 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b5d76385-6097-4532-976f-4a9e909b3638 tempest-VolumeImageDependencyTests-511992875 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_793130b1-29e6-4cc7-9c66-e4d41ac4e392_sbasqbhd' failed. Not Retrying. {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 03 18:43:23 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b7184e9-6e47-425d-8b58-9438b06461ae]: (4, 'raw') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:43:23 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b5d76385-6097-4532-976f-4a9e909b3638 tempest-VolumeImageDependencyTests-511992875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_793130b1-29e6-4cc7-9c66-e4d41ac4e392_vao5nz_tdevstack@QuobyteHD {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:23 devstack sudo[106988]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:23 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-5a4d8393-9c0e-49ff-8f24-dc01c0bcbfbd tempest-CreateVolumesFromSnapshotTest-853708760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.312s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:23 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-5a4d8393-9c0e-49ff-8f24-dc01c0bcbfbd tempest-CreateVolumesFromSnapshotTest-853708760 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:43:23 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-5a4d8393-9c0e-49ff-8f24-dc01c0bcbfbd tempest-CreateVolumesFromSnapshotTest-853708760 None] Deleted volume successfully.
Nov 03 18:43:23 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-5a4d8393-9c0e-49ff-8f24-dc01c0bcbfbd tempest-CreateVolumesFromSnapshotTest-853708760 None] Lock "cinder-34eaab66-1d1f-4f1b-8f2e-6b438ee10779-delete_volume" released by "delete_volume" :: held 1.695s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:43:23 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-39fff5a7-f55e-4c69-b610-23dab61737fa tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:43:23 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-39fff5a7-f55e-4c69-b610-23dab61737fa tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:43:23 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-39fff5a7-f55e-4c69-b610-23dab61737fa tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:43:23 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-39fff5a7-f55e-4c69-b610-23dab61737fa tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:43:23 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-39fff5a7-f55e-4c69-b610-23dab61737fa tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:43:23 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-39fff5a7-f55e-4c69-b610-23dab61737fa tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:23 devstack sudo[106996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:43:23 devstack sudo[106996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:23 devstack sudo[106995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_793130b1-29e6-4cc7-9c66-e4d41ac4e392_vao5nz_tdevstack@QuobyteHD
Nov 03 18:43:23 devstack sudo[106995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:23 devstack sudo[106996]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:23 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-39fff5a7-f55e-4c69-b610-23dab61737fa tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.314s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:23 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-39fff5a7-f55e-4c69-b610-23dab61737fa tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:43:23 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-39fff5a7-f55e-4c69-b610-23dab61737fa tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Deleted volume successfully.
Nov 03 18:43:23 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-39fff5a7-f55e-4c69-b610-23dab61737fa tempest-CreateVolumesFromSourceVolumeTest-1505467884 None] Lock "cinder-08981357-ce62-4c51-b5d4-2eb176f096f3-delete_volume" released by "delete_volume" :: held 1.536s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:43:23 devstack sudo[106995]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:23 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b5d76385-6097-4532-976f-4a9e909b3638 tempest-VolumeImageDependencyTests-511992875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_793130b1-29e6-4cc7-9c66-e4d41ac4e392_vao5nz_tdevstack@QuobyteHD" returned: 0 in 0.462s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:23 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b5d76385-6097-4532-976f-4a9e909b3638 tempest-VolumeImageDependencyTests-511992875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_793130b1-29e6-4cc7-9c66-e4d41ac4e392_vao5nz_tdevstack@QuobyteHD {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:23 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-db1f1e74-594c-4cd8-81ad-950730072e02 tempest-ProjectReaderTests-1564423168 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:43:23 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-db1f1e74-594c-4cd8-81ad-950730072e02 tempest-ProjectReaderTests-1564423168 None] Flow 'volume_create_manager' (48c4dff3-c684-457c-9bf2-9286064191c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:43:23 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-db1f1e74-594c-4cd8-81ad-950730072e02 tempest-ProjectReaderTests-1564423168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13622141-0278-4c0b-88fb-25fa626ee391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:43:23 devstack sudo[107002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_793130b1-29e6-4cc7-9c66-e4d41ac4e392_vao5nz_tdevstack@QuobyteHD
Nov 03 18:43:23 devstack sudo[107002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:23 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-db1f1e74-594c-4cd8-81ad-950730072e02 tempest-ProjectReaderTests-1564423168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13622141-0278-4c0b-88fb-25fa626ee391) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:43:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-424432719',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a23cbcec-cf68-4d54-aad6-85a1351c6f42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63a008ea0c74489988e6e4d4fc9092fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:43:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:43:24Z,use_quota=True,user_id='cadcf4bf50674e62a89c06c21eb152fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:43:23 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-db1f1e74-594c-4cd8-81ad-950730072e02 tempest-ProjectReaderTests-1564423168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81b36ac7-96ec-4939-8d63-ddaa37778c9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:43:23 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-db1f1e74-594c-4cd8-81ad-950730072e02 tempest-ProjectReaderTests-1564423168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81b36ac7-96ec-4939-8d63-ddaa37778c9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:43:23 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-db1f1e74-594c-4cd8-81ad-950730072e02 tempest-ProjectReaderTests-1564423168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0baaecf5-2e8b-42f2-af08-45b854678387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:43:23 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-db1f1e74-594c-4cd8-81ad-950730072e02 tempest-ProjectReaderTests-1564423168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0baaecf5-2e8b-42f2-af08-45b854678387) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a23cbcec-cf68-4d54-aad6-85a1351c6f42', 'volume_name': 'volume-a23cbcec-cf68-4d54-aad6-85a1351c6f42', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:43:23 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-db1f1e74-594c-4cd8-81ad-950730072e02 tempest-ProjectReaderTests-1564423168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec07d091-4c26-4f93-9013-4e8b76f2afda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:43:23 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-db1f1e74-594c-4cd8-81ad-950730072e02 tempest-ProjectReaderTests-1564423168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec07d091-4c26-4f93-9013-4e8b76f2afda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:43:24 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-db1f1e74-594c-4cd8-81ad-950730072e02 tempest-ProjectReaderTests-1564423168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5336078-be34-4878-bb52-ca0569e8dbd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:43:24 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-db1f1e74-594c-4cd8-81ad-950730072e02 tempest-ProjectReaderTests-1564423168 None] Volume a23cbcec-cf68-4d54-aad6-85a1351c6f42: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a23cbcec-cf68-4d54-aad6-85a1351c6f42', 'volume_size': 1}
Nov 03 18:43:24 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-db1f1e74-594c-4cd8-81ad-950730072e02 tempest-ProjectReaderTests-1564423168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:43:24 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-db1f1e74-594c-4cd8-81ad-950730072e02 tempest-ProjectReaderTests-1564423168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:43:24 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-db1f1e74-594c-4cd8-81ad-950730072e02 tempest-ProjectReaderTests-1564423168 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:43:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-424432719',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a23cbcec-cf68-4d54-aad6-85a1351c6f42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63a008ea0c74489988e6e4d4fc9092fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:43:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:43:24Z,use_quota=True,user_id='cadcf4bf50674e62a89c06c21eb152fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:43:24 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-db1f1e74-594c-4cd8-81ad-950730072e02 tempest-ProjectReaderTests-1564423168 None] Creating volume a23cbcec-cf68-4d54-aad6-85a1351c6f42 {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:43:24 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-db1f1e74-594c-4cd8-81ad-950730072e02 tempest-ProjectReaderTests-1564423168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:43:24 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-db1f1e74-594c-4cd8-81ad-950730072e02 tempest-ProjectReaderTests-1564423168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:43:24 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-db1f1e74-594c-4cd8-81ad-950730072e02 tempest-ProjectReaderTests-1564423168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:43:24 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-db1f1e74-594c-4cd8-81ad-950730072e02 tempest-ProjectReaderTests-1564423168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:43:24 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-db1f1e74-594c-4cd8-81ad-950730072e02 tempest-ProjectReaderTests-1564423168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:43:24 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-db1f1e74-594c-4cd8-81ad-950730072e02 tempest-ProjectReaderTests-1564423168 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:43:24 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-db1f1e74-594c-4cd8-81ad-950730072e02 tempest-ProjectReaderTests-1564423168 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:43:24 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-db1f1e74-594c-4cd8-81ad-950730072e02 tempest-ProjectReaderTests-1564423168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-a23cbcec-cf68-4d54-aad6-85a1351c6f42 1073741824 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:24 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-23a0b0e4-5eac-4c3a-b56c-5d109d141965 tempest-CreateVolumesFromSnapshotTest-853708760 None] Acquiring lock "cinder-3635bf61-6592-4c86-a809-d9b73e029ba3-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:43:24 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-23a0b0e4-5eac-4c3a-b56c-5d109d141965 tempest-CreateVolumesFromSnapshotTest-853708760 None] Lock "cinder-3635bf61-6592-4c86-a809-d9b73e029ba3-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:43:24 devstack sudo[107004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-a23cbcec-cf68-4d54-aad6-85a1351c6f42 1073741824
Nov 03 18:43:24 devstack sudo[107004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:24 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-23a0b0e4-5eac-4c3a-b56c-5d109d141965 tempest-CreateVolumesFromSnapshotTest-853708760 None] Acquiring lock "cinder-quobyte-3635bf61-6592-4c86-a809-d9b73e029ba3" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:43:24 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-23a0b0e4-5eac-4c3a-b56c-5d109d141965 tempest-CreateVolumesFromSnapshotTest-853708760 None] Lock "cinder-quobyte-3635bf61-6592-4c86-a809-d9b73e029ba3" acquired by "delete_volume" :: waited 0.026s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:43:24 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[995ccae4-01b1-4d5c-9ee5-d72da22d3077]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:43:24 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-23a0b0e4-5eac-4c3a-b56c-5d109d141965 tempest-CreateVolumesFromSnapshotTest-853708760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3635bf61-6592-4c86-a809-d9b73e029ba3 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:24 devstack sudo[107002]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:24 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b5d76385-6097-4532-976f-4a9e909b3638 tempest-VolumeImageDependencyTests-511992875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_793130b1-29e6-4cc7-9c66-e4d41ac4e392_vao5nz_tdevstack@QuobyteHD" returned: 1 in 0.413s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:24 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b5d76385-6097-4532-976f-4a9e909b3638 tempest-VolumeImageDependencyTests-511992875 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_793130b1-29e6-4cc7-9c66-e4d41ac4e392_vao5nz_tdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 03 18:43:24 devstack cinder-volume[86120]: DEBUG cinder.image.image_utils [None req-b5d76385-6097-4532-976f-4a9e909b3638 tempest-VolumeImageDependencyTests-511992875 None] 793130b1-29e6-4cc7-9c66-e4d41ac4e392 was raw, converting to qcow2 {{(pid=86120) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 03 18:43:24 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b5d76385-6097-4532-976f-4a9e909b3638 tempest-VolumeImageDependencyTests-511992875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_793130b1-29e6-4cc7-9c66-e4d41ac4e392_vao5nz_tdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-903e0b67-2f52-429e-ac17-b4391d653e0b {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:24 devstack sudo[107010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_793130b1-29e6-4cc7-9c66-e4d41ac4e392_vao5nz_tdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-903e0b67-2f52-429e-ac17-b4391d653e0b
Nov 03 18:43:24 devstack sudo[107010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:24 devstack sudo[107007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3635bf61-6592-4c86-a809-d9b73e029ba3
Nov 03 18:43:24 devstack sudo[107007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:24 devstack sudo[107007]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:24 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-23a0b0e4-5eac-4c3a-b56c-5d109d141965 tempest-CreateVolumesFromSnapshotTest-853708760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3635bf61-6592-4c86-a809-d9b73e029ba3" returned: 0 in 0.430s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:24 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-23a0b0e4-5eac-4c3a-b56c-5d109d141965 tempest-CreateVolumesFromSnapshotTest-853708760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3635bf61-6592-4c86-a809-d9b73e029ba3 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:24 devstack sudo[107027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3635bf61-6592-4c86-a809-d9b73e029ba3
Nov 03 18:43:24 devstack sudo[107027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:24 devstack sudo[107004]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:24 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-db1f1e74-594c-4cd8-81ad-950730072e02 tempest-ProjectReaderTests-1564423168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-a23cbcec-cf68-4d54-aad6-85a1351c6f42 1073741824" returned: 0 in 0.631s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:24 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-db1f1e74-594c-4cd8-81ad-950730072e02 tempest-ProjectReaderTests-1564423168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-a23cbcec-cf68-4d54-aad6-85a1351c6f42 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:24 devstack sudo[107029]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-a23cbcec-cf68-4d54-aad6-85a1351c6f42
Nov 03 18:43:24 devstack sudo[107029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:24 devstack sudo[107010]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:24 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b5d76385-6097-4532-976f-4a9e909b3638 tempest-VolumeImageDependencyTests-511992875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_793130b1-29e6-4cc7-9c66-e4d41ac4e392_vao5nz_tdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-903e0b67-2f52-429e-ac17-b4391d653e0b" returned: 0 in 0.660s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:24 devstack cinder-volume[86120]: DEBUG cinder.image.image_utils [None req-b5d76385-6097-4532-976f-4a9e909b3638 tempest-VolumeImageDependencyTests-511992875 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_793130b1-29e6-4cc7-9c66-e4d41ac4e392_vao5nz_tdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-903e0b67-2f52-429e-ac17-b4391d653e0b {{(pid=86120) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 03 18:43:24 devstack cinder-volume[86120]: INFO cinder.image.image_utils [None req-b5d76385-6097-4532-976f-4a9e909b3638 tempest-VolumeImageDependencyTests-511992875 None] Converted 0.00 MB image at 0.00 MB/s
Nov 03 18:43:24 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b5d76385-6097-4532-976f-4a9e909b3638 tempest-VolumeImageDependencyTests-511992875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-903e0b67-2f52-429e-ac17-b4391d653e0b 1G {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:24 devstack sudo[107027]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:24 devstack sudo[107033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-903e0b67-2f52-429e-ac17-b4391d653e0b 1G
Nov 03 18:43:24 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-23a0b0e4-5eac-4c3a-b56c-5d109d141965 tempest-CreateVolumesFromSnapshotTest-853708760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3635bf61-6592-4c86-a809-d9b73e029ba3" returned: 0 in 0.334s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:24 devstack sudo[107033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:24 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-23a0b0e4-5eac-4c3a-b56c-5d109d141965 tempest-CreateVolumesFromSnapshotTest-853708760 None] Lock "cinder-quobyte-3635bf61-6592-4c86-a809-d9b73e029ba3" released by "delete_volume" :: held 0.835s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:43:25 devstack sudo[107029]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:25 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-db1f1e74-594c-4cd8-81ad-950730072e02 tempest-ProjectReaderTests-1564423168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-a23cbcec-cf68-4d54-aad6-85a1351c6f42" returned: 0 in 0.340s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:25 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-db1f1e74-594c-4cd8-81ad-950730072e02 tempest-ProjectReaderTests-1564423168 None] <== create_volume: return (1032ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:43:25 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-db1f1e74-594c-4cd8-81ad-950730072e02 tempest-ProjectReaderTests-1564423168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.035s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:43:25 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-23a0b0e4-5eac-4c3a-b56c-5d109d141965 tempest-CreateVolumesFromSnapshotTest-853708760 None] Created reservations ['14b4da0d-1642-48ae-8e93-fe5df82484b4', '7d96b553-4005-439f-82aa-6ae5779cae1a', '39728b07-94ab-4460-9937-39a43d582fcd', '1f4b2e3d-e6af-425c-9cf4-4cd6bed0eb63'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:43:25 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-db1f1e74-594c-4cd8-81ad-950730072e02 tempest-ProjectReaderTests-1564423168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5336078-be34-4878-bb52-ca0569e8dbd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a23cbcec-cf68-4d54-aad6-85a1351c6f42', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:43:25 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-db1f1e74-594c-4cd8-81ad-950730072e02 tempest-ProjectReaderTests-1564423168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb203090-80f8-4621-8bef-94c9f8495e83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:43:25 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-db1f1e74-594c-4cd8-81ad-950730072e02 tempest-ProjectReaderTests-1564423168 None] Volume volume-a23cbcec-cf68-4d54-aad6-85a1351c6f42 (a23cbcec-cf68-4d54-aad6-85a1351c6f42): created successfully
Nov 03 18:43:25 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-db1f1e74-594c-4cd8-81ad-950730072e02 tempest-ProjectReaderTests-1564423168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb203090-80f8-4621-8bef-94c9f8495e83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:43:25 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-db1f1e74-594c-4cd8-81ad-950730072e02 tempest-ProjectReaderTests-1564423168 None] Flow 'volume_create_manager' (48c4dff3-c684-457c-9bf2-9286064191c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:43:25 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-db1f1e74-594c-4cd8-81ad-950730072e02 tempest-ProjectReaderTests-1564423168 None] Created volume successfully.
Nov 03 18:43:25 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-23a0b0e4-5eac-4c3a-b56c-5d109d141965 tempest-CreateVolumesFromSnapshotTest-853708760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:43:25 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-23a0b0e4-5eac-4c3a-b56c-5d109d141965 tempest-CreateVolumesFromSnapshotTest-853708760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:43:25 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-23a0b0e4-5eac-4c3a-b56c-5d109d141965 tempest-CreateVolumesFromSnapshotTest-853708760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:43:25 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-23a0b0e4-5eac-4c3a-b56c-5d109d141965 tempest-CreateVolumesFromSnapshotTest-853708760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:43:25 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-23a0b0e4-5eac-4c3a-b56c-5d109d141965 tempest-CreateVolumesFromSnapshotTest-853708760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:43:25 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-23a0b0e4-5eac-4c3a-b56c-5d109d141965 tempest-CreateVolumesFromSnapshotTest-853708760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:25 devstack sudo[107038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:43:25 devstack sudo[107038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:25 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-b136c7f6-dcad-4255-8587-b7abed332b07 tempest-CreateVolumesFromSnapshotTest-853708760 None] Acquiring lock "cinder-afc00e02-2f86-432d-b1e5-abf17c4c8648-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:43:25 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-b136c7f6-dcad-4255-8587-b7abed332b07 tempest-CreateVolumesFromSnapshotTest-853708760 None] Lock "cinder-afc00e02-2f86-432d-b1e5-abf17c4c8648-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:43:25 devstack sudo[107033]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:25 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b5d76385-6097-4532-976f-4a9e909b3638 tempest-VolumeImageDependencyTests-511992875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-903e0b67-2f52-429e-ac17-b4391d653e0b 1G" returned: 0 in 0.444s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:25 devstack cinder-volume[86120]: DEBUG cinder.volume.volume_utils [None req-b5d76385-6097-4532-976f-4a9e909b3638 tempest-VolumeImageDependencyTests-511992875 None] Downloaded image 793130b1-29e6-4cc7-9c66-e4d41ac4e392 ((None, [{'url': 'file:///opt/stack/data/glance/images/793130b1-29e6-4cc7-9c66-e4d41ac4e392', 'metadata': {}}])) to volume 903e0b67-2f52-429e-ac17-b4391d653e0b successfully. {{(pid=86120) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 03 18:43:25 devstack cinder-volume[86120]: DEBUG cinder.image.image_utils [None req-b5d76385-6097-4532-976f-4a9e909b3638 tempest-VolumeImageDependencyTests-511992875 None] Temporary image 793130b1-29e6-4cc7-9c66-e4d41ac4e392 for user eacb443a4cc740929fe82aa7ed92dde3 is deleted. {{(pid=86120) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 03 18:43:25 devstack cinder-volume[86120]: DEBUG cinder.volume.volume_utils [None req-b5d76385-6097-4532-976f-4a9e909b3638 tempest-VolumeImageDependencyTests-511992875 None] Marking volume 903e0b67-2f52-429e-ac17-b4391d653e0b as bootable. {{(pid=86120) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 03 18:43:25 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5d76385-6097-4532-976f-4a9e909b3638 tempest-VolumeImageDependencyTests-511992875 None] Copying metadata from image 793130b1-29e6-4cc7-9c66-e4d41ac4e392 to 903e0b67-2f52-429e-ac17-b4391d653e0b. {{(pid=86120) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 03 18:43:25 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5d76385-6097-4532-976f-4a9e909b3638 tempest-VolumeImageDependencyTests-511992875 None] Creating volume glance metadata for volume 903e0b67-2f52-429e-ac17-b4391d653e0b backed by image 793130b1-29e6-4cc7-9c66-e4d41ac4e392 with: {'image_id': '793130b1-29e6-4cc7-9c66-e4d41ac4e392', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '9989f4b7c12fe1c954e1ad659a17c4fc', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86120) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 03 18:43:25 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-b136c7f6-dcad-4255-8587-b7abed332b07 tempest-CreateVolumesFromSnapshotTest-853708760 None] Acquiring lock "cinder-quobyte-afc00e02-2f86-432d-b1e5-abf17c4c8648" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:43:25 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-b136c7f6-dcad-4255-8587-b7abed332b07 tempest-CreateVolumesFromSnapshotTest-853708760 None] Lock "cinder-quobyte-afc00e02-2f86-432d-b1e5-abf17c4c8648" acquired by "delete_volume" :: waited 0.028s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:43:25 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[93db3eef-41c7-4d24-baf5-024f85ede5a1]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:43:25 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b136c7f6-dcad-4255-8587-b7abed332b07 tempest-CreateVolumesFromSnapshotTest-853708760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-afc00e02-2f86-432d-b1e5-abf17c4c8648 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:25 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-b5d76385-6097-4532-976f-4a9e909b3638 tempest-VolumeImageDependencyTests-511992875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18092080-e0d8-435e-8142-ae3b1ba97e9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-903e0b67-2f52-429e-ac17-b4391d653e0b', 'volume_size': 1, 'image_id': '793130b1-29e6-4cc7-9c66-e4d41ac4e392', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/793130b1-29e6-4cc7-9c66-e4d41ac4e392', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9989f4b7c12fe1c954e1ad659a17c4fc', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '472b047b03f54ce885be1e0c7d438102', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'af1528bbb0f7754ed7a8f6fe61cf4b279854b90a653d8cf78a077dd9a59c0ddce25848ca36418ea960a583bb12914cb30efe9d868104591ee90e41df9f2bb3e8', 'id': '793130b1-29e6-4cc7-9c66-e4d41ac4e392', 'created_at': datetime.datetime(2026, 11, 3, 17, 43, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 17, 43, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/793130b1-29e6-4cc7-9c66-e4d41ac4e392/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7a8d3cbe20f0>}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:43:25 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-b5d76385-6097-4532-976f-4a9e909b3638 tempest-VolumeImageDependencyTests-511992875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbc5e277-1afa-41c8-bdcd-011b3e6960b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:43:25 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-b5d76385-6097-4532-976f-4a9e909b3638 tempest-VolumeImageDependencyTests-511992875 None] Volume volume-903e0b67-2f52-429e-ac17-b4391d653e0b (903e0b67-2f52-429e-ac17-b4391d653e0b): created successfully
Nov 03 18:43:25 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-b5d76385-6097-4532-976f-4a9e909b3638 tempest-VolumeImageDependencyTests-511992875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbc5e277-1afa-41c8-bdcd-011b3e6960b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:43:25 devstack sudo[107038]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:25 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-b5d76385-6097-4532-976f-4a9e909b3638 tempest-VolumeImageDependencyTests-511992875 None] Flow 'volume_create_manager' (487f2fdd-726c-4e33-9c62-13c5ef9b230b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:43:25 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-23a0b0e4-5eac-4c3a-b56c-5d109d141965 tempest-CreateVolumesFromSnapshotTest-853708760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.338s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:25 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-23a0b0e4-5eac-4c3a-b56c-5d109d141965 tempest-CreateVolumesFromSnapshotTest-853708760 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:43:25 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-23a0b0e4-5eac-4c3a-b56c-5d109d141965 tempest-CreateVolumesFromSnapshotTest-853708760 None] Deleted volume successfully.
Nov 03 18:43:25 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-b5d76385-6097-4532-976f-4a9e909b3638 tempest-VolumeImageDependencyTests-511992875 None] Created volume successfully.
Nov 03 18:43:25 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-23a0b0e4-5eac-4c3a-b56c-5d109d141965 tempest-CreateVolumesFromSnapshotTest-853708760 None] Lock "cinder-3635bf61-6592-4c86-a809-d9b73e029ba3-delete_volume" released by "delete_volume" :: held 1.516s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:43:25 devstack sudo[107042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-afc00e02-2f86-432d-b1e5-abf17c4c8648
Nov 03 18:43:25 devstack sudo[107042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:25 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-89b173e8-99c5-4411-bed8-4819accdcda2 tempest-VolumeImageDependencyTests-511992875 None] Acquiring lock "cinder-903e0b67-2f52-429e-ac17-b4391d653e0b-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:43:25 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-89b173e8-99c5-4411-bed8-4819accdcda2 tempest-VolumeImageDependencyTests-511992875 None] Lock "cinder-903e0b67-2f52-429e-ac17-b4391d653e0b-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:43:25 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-89b173e8-99c5-4411-bed8-4819accdcda2 tempest-VolumeImageDependencyTests-511992875 None] Acquiring lock "cinder-quobyte-903e0b67-2f52-429e-ac17-b4391d653e0b" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:43:25 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-89b173e8-99c5-4411-bed8-4819accdcda2 tempest-VolumeImageDependencyTests-511992875 None] Lock "cinder-quobyte-903e0b67-2f52-429e-ac17-b4391d653e0b" acquired by "delete_volume" :: waited 0.020s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:43:25 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[76bbe0c1-5be3-4eaa-b55f-f79adb0470e3]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:43:25 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-89b173e8-99c5-4411-bed8-4819accdcda2 tempest-VolumeImageDependencyTests-511992875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-903e0b67-2f52-429e-ac17-b4391d653e0b {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:25 devstack sudo[107042]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:25 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b136c7f6-dcad-4255-8587-b7abed332b07 tempest-CreateVolumesFromSnapshotTest-853708760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-afc00e02-2f86-432d-b1e5-abf17c4c8648" returned: 0 in 0.501s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:25 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b136c7f6-dcad-4255-8587-b7abed332b07 tempest-CreateVolumesFromSnapshotTest-853708760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-afc00e02-2f86-432d-b1e5-abf17c4c8648 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:25 devstack sudo[107049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-afc00e02-2f86-432d-b1e5-abf17c4c8648
Nov 03 18:43:25 devstack sudo[107049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:26 devstack sudo[107048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-903e0b67-2f52-429e-ac17-b4391d653e0b
Nov 03 18:43:26 devstack sudo[107048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:26 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-71096aa2-363d-4223-9316-10bf1558e4fa tempest-ProjectReaderTests-1564423168 None] Acquiring lock "cinder-a23cbcec-cf68-4d54-aad6-85a1351c6f42-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:43:26 devstack sudo[107049]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:26 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b136c7f6-dcad-4255-8587-b7abed332b07 tempest-CreateVolumesFromSnapshotTest-853708760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-afc00e02-2f86-432d-b1e5-abf17c4c8648" returned: 0 in 0.349s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:26 devstack sudo[107048]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:26 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-89b173e8-99c5-4411-bed8-4819accdcda2 tempest-VolumeImageDependencyTests-511992875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-903e0b67-2f52-429e-ac17-b4391d653e0b" returned: 0 in 0.437s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:26 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-89b173e8-99c5-4411-bed8-4819accdcda2 tempest-VolumeImageDependencyTests-511992875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-903e0b67-2f52-429e-ac17-b4391d653e0b {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:26 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-71096aa2-363d-4223-9316-10bf1558e4fa tempest-ProjectReaderTests-1564423168 None] Lock "cinder-a23cbcec-cf68-4d54-aad6-85a1351c6f42-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:43:26 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-b136c7f6-dcad-4255-8587-b7abed332b07 tempest-CreateVolumesFromSnapshotTest-853708760 None] Lock "cinder-quobyte-afc00e02-2f86-432d-b1e5-abf17c4c8648" released by "delete_volume" :: held 0.942s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:43:26 devstack sudo[107057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-903e0b67-2f52-429e-ac17-b4391d653e0b
Nov 03 18:43:26 devstack sudo[107057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:26 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-71096aa2-363d-4223-9316-10bf1558e4fa tempest-ProjectReaderTests-1564423168 None] Acquiring lock "cinder-quobyte-a23cbcec-cf68-4d54-aad6-85a1351c6f42" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:43:26 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-71096aa2-363d-4223-9316-10bf1558e4fa tempest-ProjectReaderTests-1564423168 None] Lock "cinder-quobyte-a23cbcec-cf68-4d54-aad6-85a1351c6f42" acquired by "delete_volume" :: waited 0.029s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:43:26 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-b136c7f6-dcad-4255-8587-b7abed332b07 tempest-CreateVolumesFromSnapshotTest-853708760 None] Created reservations ['64d38ae9-5598-4fac-bde6-a578b93f3c5e', 'fd4b0ff6-e91f-43eb-88a2-3ae6d0858cc3', 'cf269b6f-6bd2-4f1e-a019-b7920d62ed8b', 'b4c6b695-ed6e-49cf-ab38-0eac7a19e6ef'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:43:26 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[8881503a-b1d5-4267-aee2-6a18f118d9c9]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:43:26 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-71096aa2-363d-4223-9316-10bf1558e4fa tempest-ProjectReaderTests-1564423168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-a23cbcec-cf68-4d54-aad6-85a1351c6f42 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:26 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-b136c7f6-dcad-4255-8587-b7abed332b07 tempest-CreateVolumesFromSnapshotTest-853708760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:43:26 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-b136c7f6-dcad-4255-8587-b7abed332b07 tempest-CreateVolumesFromSnapshotTest-853708760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:43:26 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-b136c7f6-dcad-4255-8587-b7abed332b07 tempest-CreateVolumesFromSnapshotTest-853708760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:43:26 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-b136c7f6-dcad-4255-8587-b7abed332b07 tempest-CreateVolumesFromSnapshotTest-853708760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:43:26 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-b136c7f6-dcad-4255-8587-b7abed332b07 tempest-CreateVolumesFromSnapshotTest-853708760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:43:26 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b136c7f6-dcad-4255-8587-b7abed332b07 tempest-CreateVolumesFromSnapshotTest-853708760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:26 devstack sudo[107060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:43:26 devstack sudo[107060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:26 devstack sudo[107059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-a23cbcec-cf68-4d54-aad6-85a1351c6f42
Nov 03 18:43:26 devstack sudo[107059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:26 devstack sudo[107057]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:26 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-89b173e8-99c5-4411-bed8-4819accdcda2 tempest-VolumeImageDependencyTests-511992875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-903e0b67-2f52-429e-ac17-b4391d653e0b" returned: 0 in 0.376s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:26 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-89b173e8-99c5-4411-bed8-4819accdcda2 tempest-VolumeImageDependencyTests-511992875 None] Lock "cinder-quobyte-903e0b67-2f52-429e-ac17-b4391d653e0b" released by "delete_volume" :: held 0.868s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:43:26 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-89b173e8-99c5-4411-bed8-4819accdcda2 tempest-VolumeImageDependencyTests-511992875 None] Created reservations ['99d40462-d9e9-473f-ae8f-6b95b217f841', 'e0c5c2c0-55ac-4bae-90e4-dd27e63c64e3', 'b5bd7012-5bd3-4a38-9465-2ae290d80bf8', '83441ee1-7ebc-4681-a923-4b7db5b34bc8'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:43:26 devstack sudo[107060]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:26 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b136c7f6-dcad-4255-8587-b7abed332b07 tempest-CreateVolumesFromSnapshotTest-853708760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.302s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:26 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-b136c7f6-dcad-4255-8587-b7abed332b07 tempest-CreateVolumesFromSnapshotTest-853708760 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:43:26 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-b136c7f6-dcad-4255-8587-b7abed332b07 tempest-CreateVolumesFromSnapshotTest-853708760 None] Deleted volume successfully.
Nov 03 18:43:26 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-b136c7f6-dcad-4255-8587-b7abed332b07 tempest-CreateVolumesFromSnapshotTest-853708760 None] Lock "cinder-afc00e02-2f86-432d-b1e5-abf17c4c8648-delete_volume" released by "delete_volume" :: held 1.583s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:43:26 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-89b173e8-99c5-4411-bed8-4819accdcda2 tempest-VolumeImageDependencyTests-511992875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:43:26 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-89b173e8-99c5-4411-bed8-4819accdcda2 tempest-VolumeImageDependencyTests-511992875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:43:26 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-89b173e8-99c5-4411-bed8-4819accdcda2 tempest-VolumeImageDependencyTests-511992875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:43:26 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-89b173e8-99c5-4411-bed8-4819accdcda2 tempest-VolumeImageDependencyTests-511992875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:43:26 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-89b173e8-99c5-4411-bed8-4819accdcda2 tempest-VolumeImageDependencyTests-511992875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:43:26 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-89b173e8-99c5-4411-bed8-4819accdcda2 tempest-VolumeImageDependencyTests-511992875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:26 devstack sudo[107059]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:26 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-71096aa2-363d-4223-9316-10bf1558e4fa tempest-ProjectReaderTests-1564423168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-a23cbcec-cf68-4d54-aad6-85a1351c6f42" returned: 0 in 0.486s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:26 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-71096aa2-363d-4223-9316-10bf1558e4fa tempest-ProjectReaderTests-1564423168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-a23cbcec-cf68-4d54-aad6-85a1351c6f42 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:26 devstack sudo[107068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:43:26 devstack sudo[107068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:26 devstack sudo[107069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-a23cbcec-cf68-4d54-aad6-85a1351c6f42
Nov 03 18:43:26 devstack sudo[107069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:27 devstack sudo[107068]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:27 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-89b173e8-99c5-4411-bed8-4819accdcda2 tempest-VolumeImageDependencyTests-511992875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.325s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:27 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-89b173e8-99c5-4411-bed8-4819accdcda2 tempest-VolumeImageDependencyTests-511992875 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:43:27 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-89b173e8-99c5-4411-bed8-4819accdcda2 tempest-VolumeImageDependencyTests-511992875 None] Deleted volume successfully.
Nov 03 18:43:27 devstack sudo[107069]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:27 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-71096aa2-363d-4223-9316-10bf1558e4fa tempest-ProjectReaderTests-1564423168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-a23cbcec-cf68-4d54-aad6-85a1351c6f42" returned: 0 in 0.317s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:27 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-71096aa2-363d-4223-9316-10bf1558e4fa tempest-ProjectReaderTests-1564423168 None] Lock "cinder-quobyte-a23cbcec-cf68-4d54-aad6-85a1351c6f42" released by "delete_volume" :: held 0.873s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:43:27 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-89b173e8-99c5-4411-bed8-4819accdcda2 tempest-VolumeImageDependencyTests-511992875 None] Lock "cinder-903e0b67-2f52-429e-ac17-b4391d653e0b-delete_volume" released by "delete_volume" :: held 1.518s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:43:27 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-71096aa2-363d-4223-9316-10bf1558e4fa tempest-ProjectReaderTests-1564423168 None] Created reservations ['7f3dd45a-949e-4dcc-815d-1e772e4db7f8', '636ba896-74de-41d2-8b43-8d370dad4b40', '36415ec4-3780-40ed-9ec4-5e2e3898bc4b', '94b29d1e-0f47-46c1-a062-7d094bd7fd53'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:43:27 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-71096aa2-363d-4223-9316-10bf1558e4fa tempest-ProjectReaderTests-1564423168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:43:27 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-71096aa2-363d-4223-9316-10bf1558e4fa tempest-ProjectReaderTests-1564423168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:43:27 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-71096aa2-363d-4223-9316-10bf1558e4fa tempest-ProjectReaderTests-1564423168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:43:27 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-71096aa2-363d-4223-9316-10bf1558e4fa tempest-ProjectReaderTests-1564423168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:43:27 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-71096aa2-363d-4223-9316-10bf1558e4fa tempest-ProjectReaderTests-1564423168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:43:27 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-71096aa2-363d-4223-9316-10bf1558e4fa tempest-ProjectReaderTests-1564423168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:27 devstack sudo[107074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:43:27 devstack sudo[107074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:27 devstack sudo[107074]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:27 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-71096aa2-363d-4223-9316-10bf1558e4fa tempest-ProjectReaderTests-1564423168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.342s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:27 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-71096aa2-363d-4223-9316-10bf1558e4fa tempest-ProjectReaderTests-1564423168 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:43:27 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-71096aa2-363d-4223-9316-10bf1558e4fa tempest-ProjectReaderTests-1564423168 None] Deleted volume successfully.
Nov 03 18:43:27 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-71096aa2-363d-4223-9316-10bf1558e4fa tempest-ProjectReaderTests-1564423168 None] Lock "cinder-a23cbcec-cf68-4d54-aad6-85a1351c6f42-delete_volume" released by "delete_volume" :: held 1.546s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:43:27 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-50487150-d685-4114-9c92-dfeda8188229 tempest-CreateVolumesFromSnapshotTest-853708760 None] Acquiring lock "cinder-36587014-f68e-44a0-aeb7-a20bef182609-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:43:28 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-50487150-d685-4114-9c92-dfeda8188229 tempest-CreateVolumesFromSnapshotTest-853708760 None] Lock "cinder-36587014-f68e-44a0-aeb7-a20bef182609-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:43:28 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-50487150-d685-4114-9c92-dfeda8188229 tempest-CreateVolumesFromSnapshotTest-853708760 None] Acquiring lock "cinder-quobyte-36587014-f68e-44a0-aeb7-a20bef182609" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:43:28 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-59dc2b13-8db9-4316-9237-d9c5e931c1d7 tempest-ProjectReaderTests-1564423168 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:43:28 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-59dc2b13-8db9-4316-9237-d9c5e931c1d7 tempest-ProjectReaderTests-1564423168 None] Flow 'volume_create_manager' (04ed011b-1350-4eaa-8209-d4e0d5638841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:43:28 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-59dc2b13-8db9-4316-9237-d9c5e931c1d7 tempest-ProjectReaderTests-1564423168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecb345a7-2eec-416e-b2d9-c37513558a51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:43:28 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-50487150-d685-4114-9c92-dfeda8188229 tempest-CreateVolumesFromSnapshotTest-853708760 None] Lock "cinder-quobyte-36587014-f68e-44a0-aeb7-a20bef182609" acquired by "delete_volume" :: waited 0.061s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:43:28 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-59dc2b13-8db9-4316-9237-d9c5e931c1d7 tempest-ProjectReaderTests-1564423168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecb345a7-2eec-416e-b2d9-c37513558a51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:43:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-146778010',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=513e9c7f-f8fd-4433-96a2-91e711d2900a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63a008ea0c74489988e6e4d4fc9092fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:43:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:43:28Z,use_quota=True,user_id='cadcf4bf50674e62a89c06c21eb152fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:43:28 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-59dc2b13-8db9-4316-9237-d9c5e931c1d7 tempest-ProjectReaderTests-1564423168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21ae260c-3886-4f08-9217-d43f603119cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:43:28 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-59dc2b13-8db9-4316-9237-d9c5e931c1d7 tempest-ProjectReaderTests-1564423168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21ae260c-3886-4f08-9217-d43f603119cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:43:28 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-59dc2b13-8db9-4316-9237-d9c5e931c1d7 tempest-ProjectReaderTests-1564423168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac44992c-1b3b-48b8-95fa-64c2b525bec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:43:28 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-59dc2b13-8db9-4316-9237-d9c5e931c1d7 tempest-ProjectReaderTests-1564423168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac44992c-1b3b-48b8-95fa-64c2b525bec4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '513e9c7f-f8fd-4433-96a2-91e711d2900a', 'volume_name': 'volume-513e9c7f-f8fd-4433-96a2-91e711d2900a', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:43:28 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-59dc2b13-8db9-4316-9237-d9c5e931c1d7 tempest-ProjectReaderTests-1564423168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84a39acc-dd2e-417a-b593-772e8d92ceb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:43:28 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-59dc2b13-8db9-4316-9237-d9c5e931c1d7 tempest-ProjectReaderTests-1564423168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84a39acc-dd2e-417a-b593-772e8d92ceb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:43:28 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-59dc2b13-8db9-4316-9237-d9c5e931c1d7 tempest-ProjectReaderTests-1564423168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfb93036-c32d-4759-98e0-643981093387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:43:28 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-59dc2b13-8db9-4316-9237-d9c5e931c1d7 tempest-ProjectReaderTests-1564423168 None] Volume 513e9c7f-f8fd-4433-96a2-91e711d2900a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-513e9c7f-f8fd-4433-96a2-91e711d2900a', 'volume_size': 1}
Nov 03 18:43:28 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-59dc2b13-8db9-4316-9237-d9c5e931c1d7 tempest-ProjectReaderTests-1564423168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:43:28 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-59dc2b13-8db9-4316-9237-d9c5e931c1d7 tempest-ProjectReaderTests-1564423168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:43:28 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-59dc2b13-8db9-4316-9237-d9c5e931c1d7 tempest-ProjectReaderTests-1564423168 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:43:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-146778010',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=513e9c7f-f8fd-4433-96a2-91e711d2900a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63a008ea0c74489988e6e4d4fc9092fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:43:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:43:28Z,use_quota=True,user_id='cadcf4bf50674e62a89c06c21eb152fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:43:28 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-59dc2b13-8db9-4316-9237-d9c5e931c1d7 tempest-ProjectReaderTests-1564423168 None] Creating volume 513e9c7f-f8fd-4433-96a2-91e711d2900a {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:43:28 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-59dc2b13-8db9-4316-9237-d9c5e931c1d7 tempest-ProjectReaderTests-1564423168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:43:28 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-59dc2b13-8db9-4316-9237-d9c5e931c1d7 tempest-ProjectReaderTests-1564423168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:43:28 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-59dc2b13-8db9-4316-9237-d9c5e931c1d7 tempest-ProjectReaderTests-1564423168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:43:28 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-59dc2b13-8db9-4316-9237-d9c5e931c1d7 tempest-ProjectReaderTests-1564423168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:43:28 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-59dc2b13-8db9-4316-9237-d9c5e931c1d7 tempest-ProjectReaderTests-1564423168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:43:28 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-59dc2b13-8db9-4316-9237-d9c5e931c1d7 tempest-ProjectReaderTests-1564423168 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:43:28 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-59dc2b13-8db9-4316-9237-d9c5e931c1d7 tempest-ProjectReaderTests-1564423168 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:43:28 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-59dc2b13-8db9-4316-9237-d9c5e931c1d7 tempest-ProjectReaderTests-1564423168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-513e9c7f-f8fd-4433-96a2-91e711d2900a 1073741824 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:28 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[110a716d-7aa7-4c4a-a5fa-eadf60cc39d1]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:43:28 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-50487150-d685-4114-9c92-dfeda8188229 tempest-CreateVolumesFromSnapshotTest-853708760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-36587014-f68e-44a0-aeb7-a20bef182609 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:28 devstack sudo[107077]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-513e9c7f-f8fd-4433-96a2-91e711d2900a 1073741824
Nov 03 18:43:28 devstack sudo[107077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:28 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-f03a51d8-a16b-4d36-bba3-69e68f24dcb2 tempest-ProjectMemberTests-453978435 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:43:28 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-f03a51d8-a16b-4d36-bba3-69e68f24dcb2 tempest-ProjectMemberTests-453978435 None] Flow 'volume_create_manager' (5413a75d-2ebb-4899-b40c-44ca279dac80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:43:28 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-f03a51d8-a16b-4d36-bba3-69e68f24dcb2 tempest-ProjectMemberTests-453978435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5dc26e4-8dbc-4ad1-b30d-50827e28d7fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:43:28 devstack sudo[107078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-36587014-f68e-44a0-aeb7-a20bef182609
Nov 03 18:43:28 devstack sudo[107078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:28 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-f03a51d8-a16b-4d36-bba3-69e68f24dcb2 tempest-ProjectMemberTests-453978435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5dc26e4-8dbc-4ad1-b30d-50827e28d7fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:43:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1508180940',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64b8322f-631d-4339-b1a1-b3f3fca6c595,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac23a66460684cf18a0ec466545c9237',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:43:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:43:28Z,use_quota=True,user_id='1e72acdc7ff048f4b0d1e488804038f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:43:28 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-f03a51d8-a16b-4d36-bba3-69e68f24dcb2 tempest-ProjectMemberTests-453978435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2d3a1c9-8d68-4fc5-8461-953f40031632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:43:28 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-f03a51d8-a16b-4d36-bba3-69e68f24dcb2 tempest-ProjectMemberTests-453978435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2d3a1c9-8d68-4fc5-8461-953f40031632) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:43:28 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-f03a51d8-a16b-4d36-bba3-69e68f24dcb2 tempest-ProjectMemberTests-453978435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d920896c-f57e-435f-807d-f52f9e117444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:43:28 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-f03a51d8-a16b-4d36-bba3-69e68f24dcb2 tempest-ProjectMemberTests-453978435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d920896c-f57e-435f-807d-f52f9e117444) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64b8322f-631d-4339-b1a1-b3f3fca6c595', 'volume_name': 'volume-64b8322f-631d-4339-b1a1-b3f3fca6c595', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:43:28 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-f03a51d8-a16b-4d36-bba3-69e68f24dcb2 tempest-ProjectMemberTests-453978435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86acd4e8-e190-48aa-9943-8f7b493fe938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:43:28 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-f03a51d8-a16b-4d36-bba3-69e68f24dcb2 tempest-ProjectMemberTests-453978435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86acd4e8-e190-48aa-9943-8f7b493fe938) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:43:28 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-f03a51d8-a16b-4d36-bba3-69e68f24dcb2 tempest-ProjectMemberTests-453978435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17c9e401-db59-4ef1-8cb1-f7684676732f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:43:28 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-f03a51d8-a16b-4d36-bba3-69e68f24dcb2 tempest-ProjectMemberTests-453978435 None] Volume 64b8322f-631d-4339-b1a1-b3f3fca6c595: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64b8322f-631d-4339-b1a1-b3f3fca6c595', 'volume_size': 1}
Nov 03 18:43:28 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-f03a51d8-a16b-4d36-bba3-69e68f24dcb2 tempest-ProjectMemberTests-453978435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:43:28 devstack sudo[107078]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:28 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-50487150-d685-4114-9c92-dfeda8188229 tempest-CreateVolumesFromSnapshotTest-853708760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-36587014-f68e-44a0-aeb7-a20bef182609" returned: 0 in 0.419s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:28 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-50487150-d685-4114-9c92-dfeda8188229 tempest-CreateVolumesFromSnapshotTest-853708760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-36587014-f68e-44a0-aeb7-a20bef182609 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:28 devstack sudo[107088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-36587014-f68e-44a0-aeb7-a20bef182609
Nov 03 18:43:28 devstack sudo[107088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:28 devstack sudo[107077]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:28 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-59dc2b13-8db9-4316-9237-d9c5e931c1d7 tempest-ProjectReaderTests-1564423168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-513e9c7f-f8fd-4433-96a2-91e711d2900a 1073741824" returned: 0 in 0.553s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:28 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-59dc2b13-8db9-4316-9237-d9c5e931c1d7 tempest-ProjectReaderTests-1564423168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-513e9c7f-f8fd-4433-96a2-91e711d2900a {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:28 devstack sudo[107090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-513e9c7f-f8fd-4433-96a2-91e711d2900a
Nov 03 18:43:28 devstack sudo[107090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:29 devstack sudo[107088]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:29 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-50487150-d685-4114-9c92-dfeda8188229 tempest-CreateVolumesFromSnapshotTest-853708760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-36587014-f68e-44a0-aeb7-a20bef182609" returned: 0 in 0.294s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:29 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-50487150-d685-4114-9c92-dfeda8188229 tempest-CreateVolumesFromSnapshotTest-853708760 None] Lock "cinder-quobyte-36587014-f68e-44a0-aeb7-a20bef182609" released by "delete_volume" :: held 0.906s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:43:29 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-50487150-d685-4114-9c92-dfeda8188229 tempest-CreateVolumesFromSnapshotTest-853708760 None] Created reservations ['f7632c94-0e06-4170-9aa7-720f68b2551d', '3e44baf6-008f-4c98-9c59-2a23ca6811a2', '7b282646-1327-4b6a-844c-4f2dae8f78ca', 'c6cfd26f-af9f-4c7b-abdc-bca09f145ed5'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:43:29 devstack sudo[107090]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:29 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-59dc2b13-8db9-4316-9237-d9c5e931c1d7 tempest-ProjectReaderTests-1564423168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-513e9c7f-f8fd-4433-96a2-91e711d2900a" returned: 0 in 0.282s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:29 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-59dc2b13-8db9-4316-9237-d9c5e931c1d7 tempest-ProjectReaderTests-1564423168 None] <== create_volume: return (892ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:43:29 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-59dc2b13-8db9-4316-9237-d9c5e931c1d7 tempest-ProjectReaderTests-1564423168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.900s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:43:29 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-f03a51d8-a16b-4d36-bba3-69e68f24dcb2 tempest-ProjectMemberTests-453978435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.675s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:43:29 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-f03a51d8-a16b-4d36-bba3-69e68f24dcb2 tempest-ProjectMemberTests-453978435 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:43:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1508180940',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64b8322f-631d-4339-b1a1-b3f3fca6c595,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac23a66460684cf18a0ec466545c9237',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:43:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:43:28Z,use_quota=True,user_id='1e72acdc7ff048f4b0d1e488804038f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:43:29 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-f03a51d8-a16b-4d36-bba3-69e68f24dcb2 tempest-ProjectMemberTests-453978435 None] Creating volume 64b8322f-631d-4339-b1a1-b3f3fca6c595 {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:43:29 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-f03a51d8-a16b-4d36-bba3-69e68f24dcb2 tempest-ProjectMemberTests-453978435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:43:29 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-f03a51d8-a16b-4d36-bba3-69e68f24dcb2 tempest-ProjectMemberTests-453978435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:43:29 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-f03a51d8-a16b-4d36-bba3-69e68f24dcb2 tempest-ProjectMemberTests-453978435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:43:29 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-f03a51d8-a16b-4d36-bba3-69e68f24dcb2 tempest-ProjectMemberTests-453978435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:43:29 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-f03a51d8-a16b-4d36-bba3-69e68f24dcb2 tempest-ProjectMemberTests-453978435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:43:29 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-f03a51d8-a16b-4d36-bba3-69e68f24dcb2 tempest-ProjectMemberTests-453978435 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:43:29 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-f03a51d8-a16b-4d36-bba3-69e68f24dcb2 tempest-ProjectMemberTests-453978435 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:43:29 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-f03a51d8-a16b-4d36-bba3-69e68f24dcb2 tempest-ProjectMemberTests-453978435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-64b8322f-631d-4339-b1a1-b3f3fca6c595 1073741824 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:29 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-59dc2b13-8db9-4316-9237-d9c5e931c1d7 tempest-ProjectReaderTests-1564423168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfb93036-c32d-4759-98e0-643981093387) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-513e9c7f-f8fd-4433-96a2-91e711d2900a', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:43:29 devstack sudo[107094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-64b8322f-631d-4339-b1a1-b3f3fca6c595 1073741824
Nov 03 18:43:29 devstack sudo[107094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:29 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-59dc2b13-8db9-4316-9237-d9c5e931c1d7 tempest-ProjectReaderTests-1564423168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05d7a124-461b-498a-a192-492fa3be6127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:43:29 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-50487150-d685-4114-9c92-dfeda8188229 tempest-CreateVolumesFromSnapshotTest-853708760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:43:29 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-50487150-d685-4114-9c92-dfeda8188229 tempest-CreateVolumesFromSnapshotTest-853708760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:43:29 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-50487150-d685-4114-9c92-dfeda8188229 tempest-CreateVolumesFromSnapshotTest-853708760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:43:29 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-50487150-d685-4114-9c92-dfeda8188229 tempest-CreateVolumesFromSnapshotTest-853708760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:43:29 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-50487150-d685-4114-9c92-dfeda8188229 tempest-CreateVolumesFromSnapshotTest-853708760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:43:29 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-50487150-d685-4114-9c92-dfeda8188229 tempest-CreateVolumesFromSnapshotTest-853708760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:29 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-59dc2b13-8db9-4316-9237-d9c5e931c1d7 tempest-ProjectReaderTests-1564423168 None] Volume volume-513e9c7f-f8fd-4433-96a2-91e711d2900a (513e9c7f-f8fd-4433-96a2-91e711d2900a): created successfully
Nov 03 18:43:29 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-59dc2b13-8db9-4316-9237-d9c5e931c1d7 tempest-ProjectReaderTests-1564423168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05d7a124-461b-498a-a192-492fa3be6127) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:43:29 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-59dc2b13-8db9-4316-9237-d9c5e931c1d7 tempest-ProjectReaderTests-1564423168 None] Flow 'volume_create_manager' (04ed011b-1350-4eaa-8209-d4e0d5638841) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:43:29 devstack sudo[107096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:43:29 devstack sudo[107096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:29 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-59dc2b13-8db9-4316-9237-d9c5e931c1d7 tempest-ProjectReaderTests-1564423168 None] Created volume successfully.
Nov 03 18:43:29 devstack sudo[107096]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:29 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-50487150-d685-4114-9c92-dfeda8188229 tempest-CreateVolumesFromSnapshotTest-853708760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.292s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:29 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-50487150-d685-4114-9c92-dfeda8188229 tempest-CreateVolumesFromSnapshotTest-853708760 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:43:29 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-50487150-d685-4114-9c92-dfeda8188229 tempest-CreateVolumesFromSnapshotTest-853708760 None] Deleted volume successfully.
Nov 03 18:43:29 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-50487150-d685-4114-9c92-dfeda8188229 tempest-CreateVolumesFromSnapshotTest-853708760 None] Lock "cinder-36587014-f68e-44a0-aeb7-a20bef182609-delete_volume" released by "delete_volume" :: held 1.594s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:43:29 devstack sudo[107094]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:29 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-f03a51d8-a16b-4d36-bba3-69e68f24dcb2 tempest-ProjectMemberTests-453978435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-64b8322f-631d-4339-b1a1-b3f3fca6c595 1073741824" returned: 0 in 0.496s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:29 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-f03a51d8-a16b-4d36-bba3-69e68f24dcb2 tempest-ProjectMemberTests-453978435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-64b8322f-631d-4339-b1a1-b3f3fca6c595 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:29 devstack sudo[107104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-64b8322f-631d-4339-b1a1-b3f3fca6c595
Nov 03 18:43:29 devstack sudo[107104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:30 devstack sudo[107104]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:30 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-f03a51d8-a16b-4d36-bba3-69e68f24dcb2 tempest-ProjectMemberTests-453978435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-64b8322f-631d-4339-b1a1-b3f3fca6c595" returned: 0 in 0.257s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:30 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-f03a51d8-a16b-4d36-bba3-69e68f24dcb2 tempest-ProjectMemberTests-453978435 None] <== create_volume: return (798ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:43:30 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-f03a51d8-a16b-4d36-bba3-69e68f24dcb2 tempest-ProjectMemberTests-453978435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.801s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:43:30 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-f03a51d8-a16b-4d36-bba3-69e68f24dcb2 tempest-ProjectMemberTests-453978435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17c9e401-db59-4ef1-8cb1-f7684676732f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64b8322f-631d-4339-b1a1-b3f3fca6c595', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:43:30 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-f03a51d8-a16b-4d36-bba3-69e68f24dcb2 tempest-ProjectMemberTests-453978435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5b09ada-062e-46af-a911-fe693a6d993a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:43:30 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-f03a51d8-a16b-4d36-bba3-69e68f24dcb2 tempest-ProjectMemberTests-453978435 None] Volume volume-64b8322f-631d-4339-b1a1-b3f3fca6c595 (64b8322f-631d-4339-b1a1-b3f3fca6c595): created successfully
Nov 03 18:43:30 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-f03a51d8-a16b-4d36-bba3-69e68f24dcb2 tempest-ProjectMemberTests-453978435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5b09ada-062e-46af-a911-fe693a6d993a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:43:30 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-f03a51d8-a16b-4d36-bba3-69e68f24dcb2 tempest-ProjectMemberTests-453978435 None] Flow 'volume_create_manager' (5413a75d-2ebb-4899-b40c-44ca279dac80) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:43:30 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-f03a51d8-a16b-4d36-bba3-69e68f24dcb2 tempest-ProjectMemberTests-453978435 None] Created volume successfully.
Nov 03 18:43:30 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-9a4715b8-4c6e-4461-ad27-72030475e4e4 tempest-ProjectReaderTests-1564423168 None] Acquiring lock "cinder-513e9c7f-f8fd-4433-96a2-91e711d2900a-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:43:30 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-9a4715b8-4c6e-4461-ad27-72030475e4e4 tempest-ProjectReaderTests-1564423168 None] Lock "cinder-513e9c7f-f8fd-4433-96a2-91e711d2900a-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:43:30 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-54402d8b-2fad-4ad8-8c86-b3574debb2a3 tempest-CreateVolumesFromSnapshotTest-853708760 None] Acquiring lock "cinder-1dcddcb7-58e5-4611-b995-d4bacf111d51-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:43:30 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-9a4715b8-4c6e-4461-ad27-72030475e4e4 tempest-ProjectReaderTests-1564423168 None] Acquiring lock "cinder-quobyte-513e9c7f-f8fd-4433-96a2-91e711d2900a" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:43:30 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-54402d8b-2fad-4ad8-8c86-b3574debb2a3 tempest-CreateVolumesFromSnapshotTest-853708760 None] Lock "cinder-1dcddcb7-58e5-4611-b995-d4bacf111d51-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:43:30 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-9a4715b8-4c6e-4461-ad27-72030475e4e4 tempest-ProjectReaderTests-1564423168 None] Lock "cinder-quobyte-513e9c7f-f8fd-4433-96a2-91e711d2900a" acquired by "delete_volume" :: waited 0.031s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:43:30 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[724ae178-3551-40b3-ad60-0f6095c96f71]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:43:30 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-9a4715b8-4c6e-4461-ad27-72030475e4e4 tempest-ProjectReaderTests-1564423168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-513e9c7f-f8fd-4433-96a2-91e711d2900a {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:30 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-54402d8b-2fad-4ad8-8c86-b3574debb2a3 tempest-CreateVolumesFromSnapshotTest-853708760 None] Acquiring lock "cinder-quobyte-1dcddcb7-58e5-4611-b995-d4bacf111d51" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:43:30 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-54402d8b-2fad-4ad8-8c86-b3574debb2a3 tempest-CreateVolumesFromSnapshotTest-853708760 None] Lock "cinder-quobyte-1dcddcb7-58e5-4611-b995-d4bacf111d51" acquired by "delete_volume" :: waited 0.025s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:43:30 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1b45362-5458-49dd-bb74-a2aff946645c]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:43:30 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-54402d8b-2fad-4ad8-8c86-b3574debb2a3 tempest-CreateVolumesFromSnapshotTest-853708760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-1dcddcb7-58e5-4611-b995-d4bacf111d51 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:30 devstack sudo[107107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-513e9c7f-f8fd-4433-96a2-91e711d2900a
Nov 03 18:43:30 devstack sudo[107107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:30 devstack sudo[107108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-1dcddcb7-58e5-4611-b995-d4bacf111d51
Nov 03 18:43:30 devstack sudo[107108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:30 devstack sudo[107107]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:30 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-9a4715b8-4c6e-4461-ad27-72030475e4e4 tempest-ProjectReaderTests-1564423168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-513e9c7f-f8fd-4433-96a2-91e711d2900a" returned: 0 in 0.455s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:30 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-9a4715b8-4c6e-4461-ad27-72030475e4e4 tempest-ProjectReaderTests-1564423168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-513e9c7f-f8fd-4433-96a2-91e711d2900a {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:30 devstack sudo[107117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-513e9c7f-f8fd-4433-96a2-91e711d2900a
Nov 03 18:43:30 devstack sudo[107117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:30 devstack sudo[107108]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:30 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-54402d8b-2fad-4ad8-8c86-b3574debb2a3 tempest-CreateVolumesFromSnapshotTest-853708760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-1dcddcb7-58e5-4611-b995-d4bacf111d51" returned: 0 in 0.431s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:30 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-54402d8b-2fad-4ad8-8c86-b3574debb2a3 tempest-CreateVolumesFromSnapshotTest-853708760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-1dcddcb7-58e5-4611-b995-d4bacf111d51 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:30 devstack sudo[107119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-1dcddcb7-58e5-4611-b995-d4bacf111d51
Nov 03 18:43:30 devstack sudo[107119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:31 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-9d415974-4d4f-4fb2-bc1a-b0443b3ab0b8 tempest-ProjectMemberTests-453978435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:43:31 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-9d415974-4d4f-4fb2-bc1a-b0443b3ab0b8 tempest-ProjectMemberTests-453978435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:43:31 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-9d415974-4d4f-4fb2-bc1a-b0443b3ab0b8 tempest-ProjectMemberTests-453978435 None] Creating offline snapshot 0ebc9419-95aa-462e-aeea-ab623bd69a11 of volume 64b8322f-631d-4339-b1a1-b3f3fca6c595 {{(pid=86120) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 18:43:31 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[41b90183-1486-48b9-9220-ab51bc54b022]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:43:31 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-9d415974-4d4f-4fb2-bc1a-b0443b3ab0b8 tempest-ProjectMemberTests-453978435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-64b8322f-631d-4339-b1a1-b3f3fca6c595 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:31 devstack sudo[107117]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:31 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-9a4715b8-4c6e-4461-ad27-72030475e4e4 tempest-ProjectReaderTests-1564423168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-513e9c7f-f8fd-4433-96a2-91e711d2900a" returned: 0 in 0.325s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:31 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-9a4715b8-4c6e-4461-ad27-72030475e4e4 tempest-ProjectReaderTests-1564423168 None] Lock "cinder-quobyte-513e9c7f-f8fd-4433-96a2-91e711d2900a" released by "delete_volume" :: held 0.849s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:43:31 devstack sudo[107119]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:31 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-54402d8b-2fad-4ad8-8c86-b3574debb2a3 tempest-CreateVolumesFromSnapshotTest-853708760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-1dcddcb7-58e5-4611-b995-d4bacf111d51" returned: 0 in 0.337s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:31 devstack sudo[107122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-64b8322f-631d-4339-b1a1-b3f3fca6c595
Nov 03 18:43:31 devstack sudo[107122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:31 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-54402d8b-2fad-4ad8-8c86-b3574debb2a3 tempest-CreateVolumesFromSnapshotTest-853708760 None] Lock "cinder-quobyte-1dcddcb7-58e5-4611-b995-d4bacf111d51" released by "delete_volume" :: held 0.839s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:43:31 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-9a4715b8-4c6e-4461-ad27-72030475e4e4 tempest-ProjectReaderTests-1564423168 None] Created reservations ['f985da1a-74d3-48ab-9c29-0caa2037e052', '85980532-1af6-4545-ac01-1c0f6bbcdbe2', '0c5b2aac-dfb4-411a-9cf1-eb0d2b16a10c', 'c6832c13-b800-4734-b4ee-8909e4a0ea18'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:43:31 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-54402d8b-2fad-4ad8-8c86-b3574debb2a3 tempest-CreateVolumesFromSnapshotTest-853708760 None] Created reservations ['57f98fbb-7d87-4934-8baf-c9872da998a8', '738b17a8-c0af-4b10-9f83-60d67ca85606', '8a1ac374-fd82-4dfb-9424-40a15857d9c3', 'b2ca60e8-15a4-458b-a448-a4301e5083d8'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:43:31 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-9a4715b8-4c6e-4461-ad27-72030475e4e4 tempest-ProjectReaderTests-1564423168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:43:31 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-9a4715b8-4c6e-4461-ad27-72030475e4e4 tempest-ProjectReaderTests-1564423168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:43:31 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-9a4715b8-4c6e-4461-ad27-72030475e4e4 tempest-ProjectReaderTests-1564423168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:43:31 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-9a4715b8-4c6e-4461-ad27-72030475e4e4 tempest-ProjectReaderTests-1564423168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:43:31 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-9a4715b8-4c6e-4461-ad27-72030475e4e4 tempest-ProjectReaderTests-1564423168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:43:31 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-9a4715b8-4c6e-4461-ad27-72030475e4e4 tempest-ProjectReaderTests-1564423168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:31 devstack sudo[107125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:43:31 devstack sudo[107125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:31 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-54402d8b-2fad-4ad8-8c86-b3574debb2a3 tempest-CreateVolumesFromSnapshotTest-853708760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:43:31 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-54402d8b-2fad-4ad8-8c86-b3574debb2a3 tempest-CreateVolumesFromSnapshotTest-853708760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:43:31 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-54402d8b-2fad-4ad8-8c86-b3574debb2a3 tempest-CreateVolumesFromSnapshotTest-853708760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:43:31 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-54402d8b-2fad-4ad8-8c86-b3574debb2a3 tempest-CreateVolumesFromSnapshotTest-853708760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:43:31 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-54402d8b-2fad-4ad8-8c86-b3574debb2a3 tempest-CreateVolumesFromSnapshotTest-853708760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:43:31 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-54402d8b-2fad-4ad8-8c86-b3574debb2a3 tempest-CreateVolumesFromSnapshotTest-853708760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:31 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-a53f0253-9316-4f28-8566-b02a6b142567 tempest-CreateVolumesFromSnapshotTest-853708760 None] Acquiring lock "cinder-a76efa5e-863c-4db7-8577-0a8242cc4216-delete_snapshot" by "delete_snapshot" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:43:31 devstack sudo[107122]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:31 devstack sudo[107130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:43:31 devstack sudo[107130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:31 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-a53f0253-9316-4f28-8566-b02a6b142567 tempest-CreateVolumesFromSnapshotTest-853708760 None] Lock "cinder-a76efa5e-863c-4db7-8577-0a8242cc4216-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:43:31 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-a53f0253-9316-4f28-8566-b02a6b142567 tempest-CreateVolumesFromSnapshotTest-853708760 None] Acquiring lock "cinder-quobyte-f9db187f-e9b2-43db-973d-03dbca2d38c0" by "delete_snapshot" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:43:31 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-9d415974-4d4f-4fb2-bc1a-b0443b3ab0b8 tempest-ProjectMemberTests-453978435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-64b8322f-631d-4339-b1a1-b3f3fca6c595" returned: 0 in 0.518s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:31 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-9d415974-4d4f-4fb2-bc1a-b0443b3ab0b8 tempest-ProjectMemberTests-453978435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-64b8322f-631d-4339-b1a1-b3f3fca6c595,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-64b8322f-631d-4339-b1a1-b3f3fca6c595.0ebc9419-95aa-462e-aeea-ab623bd69a11 1G {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:31 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-a53f0253-9316-4f28-8566-b02a6b142567 tempest-CreateVolumesFromSnapshotTest-853708760 None] Lock "cinder-quobyte-f9db187f-e9b2-43db-973d-03dbca2d38c0" acquired by "delete_snapshot" :: waited 0.061s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:43:31 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-a53f0253-9316-4f28-8566-b02a6b142567 tempest-CreateVolumesFromSnapshotTest-853708760 None] Acquiring lock "cinder-quobyte-a76efa5e-863c-4db7-8577-0a8242cc4216" by "_delete_snapshot" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:43:31 devstack sudo[107132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-64b8322f-631d-4339-b1a1-b3f3fca6c595,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-64b8322f-631d-4339-b1a1-b3f3fca6c595.0ebc9419-95aa-462e-aeea-ab623bd69a11 1G
Nov 03 18:43:31 devstack sudo[107132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:31 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-a53f0253-9316-4f28-8566-b02a6b142567 tempest-CreateVolumesFromSnapshotTest-853708760 None] Lock "cinder-quobyte-a76efa5e-863c-4db7-8577-0a8242cc4216" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:43:31 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-a53f0253-9316-4f28-8566-b02a6b142567 tempest-CreateVolumesFromSnapshotTest-853708760 None] Deleting offline snapshot a76efa5e-863c-4db7-8577-0a8242cc4216 of volume f9db187f-e9b2-43db-973d-03dbca2d38c0 {{(pid=86120) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 18:43:31 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-a53f0253-9316-4f28-8566-b02a6b142567 tempest-CreateVolumesFromSnapshotTest-853708760 None] snapshot_file for this snap is: volume-f9db187f-e9b2-43db-973d-03dbca2d38c0.a76efa5e-863c-4db7-8577-0a8242cc4216 {{(pid=86120) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 18:43:31 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d53d03a-812b-4f1a-b988-647cafb6cd74]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:43:31 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-a53f0253-9316-4f28-8566-b02a6b142567 tempest-CreateVolumesFromSnapshotTest-853708760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f9db187f-e9b2-43db-973d-03dbca2d38c0.a76efa5e-863c-4db7-8577-0a8242cc4216 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:31 devstack sudo[107125]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:31 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-9a4715b8-4c6e-4461-ad27-72030475e4e4 tempest-ProjectReaderTests-1564423168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.456s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:31 devstack sudo[107130]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:31 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-9a4715b8-4c6e-4461-ad27-72030475e4e4 tempest-ProjectReaderTests-1564423168 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:43:31 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-54402d8b-2fad-4ad8-8c86-b3574debb2a3 tempest-CreateVolumesFromSnapshotTest-853708760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.369s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:31 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-54402d8b-2fad-4ad8-8c86-b3574debb2a3 tempest-CreateVolumesFromSnapshotTest-853708760 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:43:31 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-9a4715b8-4c6e-4461-ad27-72030475e4e4 tempest-ProjectReaderTests-1564423168 None] Deleted volume successfully.
Nov 03 18:43:31 devstack sudo[107135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f9db187f-e9b2-43db-973d-03dbca2d38c0.a76efa5e-863c-4db7-8577-0a8242cc4216
Nov 03 18:43:31 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-9a4715b8-4c6e-4461-ad27-72030475e4e4 tempest-ProjectReaderTests-1564423168 None] Lock "cinder-513e9c7f-f8fd-4433-96a2-91e711d2900a-delete_volume" released by "delete_volume" :: held 1.721s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:43:31 devstack sudo[107135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:31 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-54402d8b-2fad-4ad8-8c86-b3574debb2a3 tempest-CreateVolumesFromSnapshotTest-853708760 None] Deleted volume successfully.
Nov 03 18:43:32 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-54402d8b-2fad-4ad8-8c86-b3574debb2a3 tempest-CreateVolumesFromSnapshotTest-853708760 None] Lock "cinder-1dcddcb7-58e5-4611-b995-d4bacf111d51-delete_volume" released by "delete_volume" :: held 1.722s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:43:32 devstack sudo[107132]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:32 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-9d415974-4d4f-4fb2-bc1a-b0443b3ab0b8 tempest-ProjectMemberTests-453978435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-64b8322f-631d-4339-b1a1-b3f3fca6c595,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-64b8322f-631d-4339-b1a1-b3f3fca6c595.0ebc9419-95aa-462e-aeea-ab623bd69a11 1G" returned: 0 in 0.593s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:32 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-9d415974-4d4f-4fb2-bc1a-b0443b3ab0b8 tempest-ProjectMemberTests-453978435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64b8322f-631d-4339-b1a1-b3f3fca6c595 -F qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-64b8322f-631d-4339-b1a1-b3f3fca6c595.0ebc9419-95aa-462e-aeea-ab623bd69a11 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:32 devstack sudo[107144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64b8322f-631d-4339-b1a1-b3f3fca6c595 -F qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-64b8322f-631d-4339-b1a1-b3f3fca6c595.0ebc9419-95aa-462e-aeea-ab623bd69a11
Nov 03 18:43:32 devstack sudo[107144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:32 devstack sudo[107135]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:32 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-a53f0253-9316-4f28-8566-b02a6b142567 tempest-CreateVolumesFromSnapshotTest-853708760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f9db187f-e9b2-43db-973d-03dbca2d38c0.a76efa5e-863c-4db7-8577-0a8242cc4216" returned: 0 in 0.529s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:32 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-a53f0253-9316-4f28-8566-b02a6b142567 tempest-CreateVolumesFromSnapshotTest-853708760 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f9db187f-e9b2-43db-973d-03dbca2d38c0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86120) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 18:43:32 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7a33de1-a3e4-40ac-b75a-91c43cd716f3]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:43:32 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-a53f0253-9316-4f28-8566-b02a6b142567 tempest-CreateVolumesFromSnapshotTest-853708760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f9db187f-e9b2-43db-973d-03dbca2d38c0 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:32 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b356c5b-b424-409e-957a-6ab6a84944cf tempest-ProjectReaderTests-1564423168 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:43:32 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-0b356c5b-b424-409e-957a-6ab6a84944cf tempest-ProjectReaderTests-1564423168 None] Flow 'volume_create_manager' (27fa6f82-c709-447c-b8ef-bc9ee5b858a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:43:32 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-0b356c5b-b424-409e-957a-6ab6a84944cf tempest-ProjectReaderTests-1564423168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37951fef-0d7a-4953-9212-4ce0305445bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:43:32 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-0b356c5b-b424-409e-957a-6ab6a84944cf tempest-ProjectReaderTests-1564423168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37951fef-0d7a-4953-9212-4ce0305445bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:43:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-993177433',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45d01743-b359-497f-ac10-04f2dbe66dfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63a008ea0c74489988e6e4d4fc9092fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:43:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:43:32Z,use_quota=True,user_id='cadcf4bf50674e62a89c06c21eb152fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:43:32 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-0b356c5b-b424-409e-957a-6ab6a84944cf tempest-ProjectReaderTests-1564423168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e4aadf0-d9da-4eca-a05e-b0fcdbc0bdfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:43:32 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-0b356c5b-b424-409e-957a-6ab6a84944cf tempest-ProjectReaderTests-1564423168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e4aadf0-d9da-4eca-a05e-b0fcdbc0bdfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:43:32 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-0b356c5b-b424-409e-957a-6ab6a84944cf tempest-ProjectReaderTests-1564423168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7593bb3a-5764-4ec0-b414-2d9ca535a0fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:43:32 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-0b356c5b-b424-409e-957a-6ab6a84944cf tempest-ProjectReaderTests-1564423168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7593bb3a-5764-4ec0-b414-2d9ca535a0fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45d01743-b359-497f-ac10-04f2dbe66dfc', 'volume_name': 'volume-45d01743-b359-497f-ac10-04f2dbe66dfc', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:43:32 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-0b356c5b-b424-409e-957a-6ab6a84944cf tempest-ProjectReaderTests-1564423168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b8c746d-7e47-4c55-a724-170d52e9f83e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:43:32 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-0b356c5b-b424-409e-957a-6ab6a84944cf tempest-ProjectReaderTests-1564423168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b8c746d-7e47-4c55-a724-170d52e9f83e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:43:32 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-0b356c5b-b424-409e-957a-6ab6a84944cf tempest-ProjectReaderTests-1564423168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdff0aa1-dfb6-49de-9391-4e9c7a0ecc6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:43:32 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-0b356c5b-b424-409e-957a-6ab6a84944cf tempest-ProjectReaderTests-1564423168 None] Volume 45d01743-b359-497f-ac10-04f2dbe66dfc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45d01743-b359-497f-ac10-04f2dbe66dfc', 'volume_size': 1}
Nov 03 18:43:32 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-0b356c5b-b424-409e-957a-6ab6a84944cf tempest-ProjectReaderTests-1564423168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:43:32 devstack sudo[107147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f9db187f-e9b2-43db-973d-03dbca2d38c0
Nov 03 18:43:32 devstack sudo[107147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:32 devstack sudo[107144]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:32 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-9d415974-4d4f-4fb2-bc1a-b0443b3ab0b8 tempest-ProjectMemberTests-453978435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64b8322f-631d-4339-b1a1-b3f3fca6c595 -F qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-64b8322f-631d-4339-b1a1-b3f3fca6c595.0ebc9419-95aa-462e-aeea-ab623bd69a11" returned: 0 in 0.358s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:32 devstack cinder-volume[86120]: WARNING cinder.volume.drivers.remotefs [None req-9d415974-4d4f-4fb2-bc1a-b0443b3ab0b8 tempest-ProjectMemberTests-453978435 None] /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-64b8322f-631d-4339-b1a1-b3f3fca6c595.0ebc9419-95aa-462e-aeea-ab623bd69a11 is being set with open permissions: ugo+rw
Nov 03 18:43:32 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-9d415974-4d4f-4fb2-bc1a-b0443b3ab0b8 tempest-ProjectMemberTests-453978435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-64b8322f-631d-4339-b1a1-b3f3fca6c595.0ebc9419-95aa-462e-aeea-ab623bd69a11 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:32 devstack sudo[107152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-64b8322f-631d-4339-b1a1-b3f3fca6c595.0ebc9419-95aa-462e-aeea-ab623bd69a11
Nov 03 18:43:32 devstack sudo[107152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:32 devstack sudo[107147]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:32 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-a53f0253-9316-4f28-8566-b02a6b142567 tempest-CreateVolumesFromSnapshotTest-853708760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f9db187f-e9b2-43db-973d-03dbca2d38c0" returned: 0 in 0.451s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:32 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-a53f0253-9316-4f28-8566-b02a6b142567 tempest-CreateVolumesFromSnapshotTest-853708760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f9db187f-e9b2-43db-973d-03dbca2d38c0.a76efa5e-863c-4db7-8577-0a8242cc4216 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:32 devstack sudo[107152]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:32 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-9d415974-4d4f-4fb2-bc1a-b0443b3ab0b8 tempest-ProjectMemberTests-453978435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-64b8322f-631d-4339-b1a1-b3f3fca6c595.0ebc9419-95aa-462e-aeea-ab623bd69a11" returned: 0 in 0.262s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:32 devstack sudo[107159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f9db187f-e9b2-43db-973d-03dbca2d38c0.a76efa5e-863c-4db7-8577-0a8242cc4216
Nov 03 18:43:32 devstack sudo[107159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:32 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-9d415974-4d4f-4fb2-bc1a-b0443b3ab0b8 tempest-ProjectMemberTests-453978435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-64b8322f-631d-4339-b1a1-b3f3fca6c595.info {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:32 devstack sudo[107161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-64b8322f-631d-4339-b1a1-b3f3fca6c595.info
Nov 03 18:43:32 devstack sudo[107161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:33 devstack sudo[107161]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:33 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-9d415974-4d4f-4fb2-bc1a-b0443b3ab0b8 tempest-ProjectMemberTests-453978435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-64b8322f-631d-4339-b1a1-b3f3fca6c595.info" returned: 0 in 0.319s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:33 devstack cinder-volume[86120]: WARNING cinder.volume.drivers.remotefs [None req-9d415974-4d4f-4fb2-bc1a-b0443b3ab0b8 tempest-ProjectMemberTests-453978435 None] /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-64b8322f-631d-4339-b1a1-b3f3fca6c595.info is being set with open permissions: ugo+rw
Nov 03 18:43:33 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-9d415974-4d4f-4fb2-bc1a-b0443b3ab0b8 tempest-ProjectMemberTests-453978435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-64b8322f-631d-4339-b1a1-b3f3fca6c595.info {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:33 devstack sudo[107168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-64b8322f-631d-4339-b1a1-b3f3fca6c595.info
Nov 03 18:43:33 devstack sudo[107168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:33 devstack sudo[107159]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:33 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-a53f0253-9316-4f28-8566-b02a6b142567 tempest-CreateVolumesFromSnapshotTest-853708760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f9db187f-e9b2-43db-973d-03dbca2d38c0.a76efa5e-863c-4db7-8577-0a8242cc4216" returned: 0 in 0.420s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:33 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-a53f0253-9316-4f28-8566-b02a6b142567 tempest-CreateVolumesFromSnapshotTest-853708760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f9db187f-e9b2-43db-973d-03dbca2d38c0.a76efa5e-863c-4db7-8577-0a8242cc4216 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:33 devstack sudo[107170]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f9db187f-e9b2-43db-973d-03dbca2d38c0.a76efa5e-863c-4db7-8577-0a8242cc4216
Nov 03 18:43:33 devstack sudo[107170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:33 devstack sudo[107168]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:33 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-9d415974-4d4f-4fb2-bc1a-b0443b3ab0b8 tempest-ProjectMemberTests-453978435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-64b8322f-631d-4339-b1a1-b3f3fca6c595.info" returned: 0 in 0.273s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:33 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-9d415974-4d4f-4fb2-bc1a-b0443b3ab0b8 tempest-ProjectMemberTests-453978435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.442s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:43:33 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-0b356c5b-b424-409e-957a-6ab6a84944cf tempest-ProjectReaderTests-1564423168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.025s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:43:33 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-0b356c5b-b424-409e-957a-6ab6a84944cf tempest-ProjectReaderTests-1564423168 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:43:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-993177433',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45d01743-b359-497f-ac10-04f2dbe66dfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63a008ea0c74489988e6e4d4fc9092fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:43:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:43:32Z,use_quota=True,user_id='cadcf4bf50674e62a89c06c21eb152fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:43:33 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-0b356c5b-b424-409e-957a-6ab6a84944cf tempest-ProjectReaderTests-1564423168 None] Creating volume 45d01743-b359-497f-ac10-04f2dbe66dfc {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:43:33 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-0b356c5b-b424-409e-957a-6ab6a84944cf tempest-ProjectReaderTests-1564423168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:43:33 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-0b356c5b-b424-409e-957a-6ab6a84944cf tempest-ProjectReaderTests-1564423168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:43:33 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-0b356c5b-b424-409e-957a-6ab6a84944cf tempest-ProjectReaderTests-1564423168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:43:33 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-0b356c5b-b424-409e-957a-6ab6a84944cf tempest-ProjectReaderTests-1564423168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:43:33 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-0b356c5b-b424-409e-957a-6ab6a84944cf tempest-ProjectReaderTests-1564423168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:43:33 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-0b356c5b-b424-409e-957a-6ab6a84944cf tempest-ProjectReaderTests-1564423168 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:43:33 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-0b356c5b-b424-409e-957a-6ab6a84944cf tempest-ProjectReaderTests-1564423168 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:43:33 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-0b356c5b-b424-409e-957a-6ab6a84944cf tempest-ProjectReaderTests-1564423168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-45d01743-b359-497f-ac10-04f2dbe66dfc 1073741824 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:33 devstack sudo[107170]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:33 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-a53f0253-9316-4f28-8566-b02a6b142567 tempest-CreateVolumesFromSnapshotTest-853708760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f9db187f-e9b2-43db-973d-03dbca2d38c0.a76efa5e-863c-4db7-8577-0a8242cc4216" returned: 0 in 0.297s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:33 devstack sudo[107174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-45d01743-b359-497f-ac10-04f2dbe66dfc 1073741824
Nov 03 18:43:33 devstack sudo[107174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:33 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-9d415974-4d4f-4fb2-bc1a-b0443b3ab0b8 tempest-ProjectMemberTests-453978435 None] Create snapshot completed successfully
Nov 03 18:43:33 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-a53f0253-9316-4f28-8566-b02a6b142567 tempest-CreateVolumesFromSnapshotTest-853708760 None] Lock "cinder-quobyte-a76efa5e-863c-4db7-8577-0a8242cc4216" released by "_delete_snapshot" :: held 1.884s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:43:33 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-a53f0253-9316-4f28-8566-b02a6b142567 tempest-CreateVolumesFromSnapshotTest-853708760 None] Lock "cinder-quobyte-f9db187f-e9b2-43db-973d-03dbca2d38c0" released by "delete_snapshot" :: held 1.927s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:43:33 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-a53f0253-9316-4f28-8566-b02a6b142567 tempest-CreateVolumesFromSnapshotTest-853708760 None] Created reservations ['f6a095e0-4db8-4686-83a6-0631531923b1', '3ce80a47-d550-4497-a260-60fb91454d3c', 'f4394be5-3d1a-4ddb-9354-6397a4123bbb', '9b14feca-8d4e-445c-94b2-19d3b8bb0530'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:43:33 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-a53f0253-9316-4f28-8566-b02a6b142567 tempest-CreateVolumesFromSnapshotTest-853708760 None] Delete snapshot completed successfully.
Nov 03 18:43:33 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-a53f0253-9316-4f28-8566-b02a6b142567 tempest-CreateVolumesFromSnapshotTest-853708760 None] Lock "cinder-a76efa5e-863c-4db7-8577-0a8242cc4216-delete_snapshot" released by "delete_snapshot" :: held 2.131s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:43:34 devstack sudo[107174]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:34 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-0b356c5b-b424-409e-957a-6ab6a84944cf tempest-ProjectReaderTests-1564423168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-45d01743-b359-497f-ac10-04f2dbe66dfc 1073741824" returned: 0 in 0.515s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:34 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-0b356c5b-b424-409e-957a-6ab6a84944cf tempest-ProjectReaderTests-1564423168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-45d01743-b359-497f-ac10-04f2dbe66dfc {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:34 devstack sudo[107180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-45d01743-b359-497f-ac10-04f2dbe66dfc
Nov 03 18:43:34 devstack sudo[107180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:34 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-1d71ff8a-ece6-4890-86f5-9963718e2274 tempest-CreateVolumesFromSnapshotTest-853708760 None] Acquiring lock "cinder-f9db187f-e9b2-43db-973d-03dbca2d38c0-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:43:34 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-1d71ff8a-ece6-4890-86f5-9963718e2274 tempest-CreateVolumesFromSnapshotTest-853708760 None] Lock "cinder-f9db187f-e9b2-43db-973d-03dbca2d38c0-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:43:34 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-1d71ff8a-ece6-4890-86f5-9963718e2274 tempest-CreateVolumesFromSnapshotTest-853708760 None] Acquiring lock "cinder-quobyte-f9db187f-e9b2-43db-973d-03dbca2d38c0" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:43:34 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-0a02c53f-f954-4249-85c9-1b2e93082d9c tempest-ProjectMemberTests-453978435 None] Acquiring lock "cinder-0ebc9419-95aa-462e-aeea-ab623bd69a11-delete_snapshot" by "delete_snapshot" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:43:34 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-1d71ff8a-ece6-4890-86f5-9963718e2274 tempest-CreateVolumesFromSnapshotTest-853708760 None] Lock "cinder-quobyte-f9db187f-e9b2-43db-973d-03dbca2d38c0" acquired by "delete_volume" :: waited 0.044s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:43:34 devstack sudo[107180]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:34 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-0b356c5b-b424-409e-957a-6ab6a84944cf tempest-ProjectReaderTests-1564423168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-45d01743-b359-497f-ac10-04f2dbe66dfc" returned: 0 in 0.329s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:34 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-0b356c5b-b424-409e-957a-6ab6a84944cf tempest-ProjectReaderTests-1564423168 None] <== create_volume: return (887ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:43:34 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-0b356c5b-b424-409e-957a-6ab6a84944cf tempest-ProjectReaderTests-1564423168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.894s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:43:34 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-0a02c53f-f954-4249-85c9-1b2e93082d9c tempest-ProjectMemberTests-453978435 None] Lock "cinder-0ebc9419-95aa-462e-aeea-ab623bd69a11-delete_snapshot" acquired by "delete_snapshot" :: waited 0.081s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:43:34 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-0a02c53f-f954-4249-85c9-1b2e93082d9c tempest-ProjectMemberTests-453978435 None] Acquiring lock "cinder-quobyte-64b8322f-631d-4339-b1a1-b3f3fca6c595" by "delete_snapshot" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:43:34 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[26454746-8096-4484-bc15-5bdec263d6d0]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:43:34 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-1d71ff8a-ece6-4890-86f5-9963718e2274 tempest-CreateVolumesFromSnapshotTest-853708760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f9db187f-e9b2-43db-973d-03dbca2d38c0 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:34 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-0b356c5b-b424-409e-957a-6ab6a84944cf tempest-ProjectReaderTests-1564423168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdff0aa1-dfb6-49de-9391-4e9c7a0ecc6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45d01743-b359-497f-ac10-04f2dbe66dfc', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:43:34 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-0b356c5b-b424-409e-957a-6ab6a84944cf tempest-ProjectReaderTests-1564423168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14a6ab6b-c29c-4d67-982f-4e1ad6116205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:43:34 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-0a02c53f-f954-4249-85c9-1b2e93082d9c tempest-ProjectMemberTests-453978435 None] Lock "cinder-quobyte-64b8322f-631d-4339-b1a1-b3f3fca6c595" acquired by "delete_snapshot" :: waited 0.051s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:43:34 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-0a02c53f-f954-4249-85c9-1b2e93082d9c tempest-ProjectMemberTests-453978435 None] Acquiring lock "cinder-quobyte-0ebc9419-95aa-462e-aeea-ab623bd69a11" by "_delete_snapshot" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:43:34 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-0b356c5b-b424-409e-957a-6ab6a84944cf tempest-ProjectReaderTests-1564423168 None] Volume volume-45d01743-b359-497f-ac10-04f2dbe66dfc (45d01743-b359-497f-ac10-04f2dbe66dfc): created successfully
Nov 03 18:43:34 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-0b356c5b-b424-409e-957a-6ab6a84944cf tempest-ProjectReaderTests-1564423168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14a6ab6b-c29c-4d67-982f-4e1ad6116205) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:43:34 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-0b356c5b-b424-409e-957a-6ab6a84944cf tempest-ProjectReaderTests-1564423168 None] Flow 'volume_create_manager' (27fa6f82-c709-447c-b8ef-bc9ee5b858a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:43:34 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-0a02c53f-f954-4249-85c9-1b2e93082d9c tempest-ProjectMemberTests-453978435 None] Lock "cinder-quobyte-0ebc9419-95aa-462e-aeea-ab623bd69a11" acquired by "_delete_snapshot" :: waited 0.053s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:43:34 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-0a02c53f-f954-4249-85c9-1b2e93082d9c tempest-ProjectMemberTests-453978435 None] Deleting offline snapshot 0ebc9419-95aa-462e-aeea-ab623bd69a11 of volume 64b8322f-631d-4339-b1a1-b3f3fca6c595 {{(pid=86120) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 18:43:34 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-0a02c53f-f954-4249-85c9-1b2e93082d9c tempest-ProjectMemberTests-453978435 None] snapshot_file for this snap is: volume-64b8322f-631d-4339-b1a1-b3f3fca6c595.0ebc9419-95aa-462e-aeea-ab623bd69a11 {{(pid=86120) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 18:43:34 devstack sudo[107183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f9db187f-e9b2-43db-973d-03dbca2d38c0
Nov 03 18:43:34 devstack sudo[107183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:34 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-0b356c5b-b424-409e-957a-6ab6a84944cf tempest-ProjectReaderTests-1564423168 None] Created volume successfully.
Nov 03 18:43:34 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d12b6bc-dec4-415c-91b1-e082ebbdd775]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:43:34 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-0a02c53f-f954-4249-85c9-1b2e93082d9c tempest-ProjectMemberTests-453978435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-64b8322f-631d-4339-b1a1-b3f3fca6c595.0ebc9419-95aa-462e-aeea-ab623bd69a11 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:34 devstack sudo[107185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-64b8322f-631d-4339-b1a1-b3f3fca6c595.0ebc9419-95aa-462e-aeea-ab623bd69a11
Nov 03 18:43:34 devstack sudo[107185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:34 devstack sudo[107183]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:34 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-1d71ff8a-ece6-4890-86f5-9963718e2274 tempest-CreateVolumesFromSnapshotTest-853708760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f9db187f-e9b2-43db-973d-03dbca2d38c0" returned: 0 in 0.421s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:34 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-1d71ff8a-ece6-4890-86f5-9963718e2274 tempest-CreateVolumesFromSnapshotTest-853708760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f9db187f-e9b2-43db-973d-03dbca2d38c0 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:34 devstack sudo[107190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f9db187f-e9b2-43db-973d-03dbca2d38c0
Nov 03 18:43:34 devstack sudo[107190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:34 devstack sudo[107185]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:34 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-0a02c53f-f954-4249-85c9-1b2e93082d9c tempest-ProjectMemberTests-453978435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-64b8322f-631d-4339-b1a1-b3f3fca6c595.0ebc9419-95aa-462e-aeea-ab623bd69a11" returned: 0 in 0.424s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:34 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-0a02c53f-f954-4249-85c9-1b2e93082d9c tempest-ProjectMemberTests-453978435 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-64b8322f-631d-4339-b1a1-b3f3fca6c595(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86120) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 18:43:35 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e6d3e74-69e6-4fa7-855e-fffe489aedfd]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:43:35 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-0a02c53f-f954-4249-85c9-1b2e93082d9c tempest-ProjectMemberTests-453978435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-64b8322f-631d-4339-b1a1-b3f3fca6c595 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:35 devstack sudo[107190]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:35 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-1d71ff8a-ece6-4890-86f5-9963718e2274 tempest-CreateVolumesFromSnapshotTest-853708760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f9db187f-e9b2-43db-973d-03dbca2d38c0" returned: 0 in 0.282s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:35 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-1d71ff8a-ece6-4890-86f5-9963718e2274 tempest-CreateVolumesFromSnapshotTest-853708760 None] Lock "cinder-quobyte-f9db187f-e9b2-43db-973d-03dbca2d38c0" released by "delete_volume" :: held 0.812s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:43:35 devstack sudo[107195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-64b8322f-631d-4339-b1a1-b3f3fca6c595
Nov 03 18:43:35 devstack sudo[107195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:35 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-1d71ff8a-ece6-4890-86f5-9963718e2274 tempest-CreateVolumesFromSnapshotTest-853708760 None] Created reservations ['567c3efb-eae1-424d-aed2-0deb82ece241', '77b73090-b4df-456d-858c-76fda5991b9b', 'e8e95bcb-2229-4f34-bed0-998c2d61895f', '4eaa237c-dfd0-4f21-9300-2df2fc091ce6'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:43:35 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-1d71ff8a-ece6-4890-86f5-9963718e2274 tempest-CreateVolumesFromSnapshotTest-853708760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:43:35 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-1d71ff8a-ece6-4890-86f5-9963718e2274 tempest-CreateVolumesFromSnapshotTest-853708760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:43:35 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-1d71ff8a-ece6-4890-86f5-9963718e2274 tempest-CreateVolumesFromSnapshotTest-853708760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:43:35 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-1d71ff8a-ece6-4890-86f5-9963718e2274 tempest-CreateVolumesFromSnapshotTest-853708760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:43:35 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-1d71ff8a-ece6-4890-86f5-9963718e2274 tempest-CreateVolumesFromSnapshotTest-853708760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:43:35 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-1d71ff8a-ece6-4890-86f5-9963718e2274 tempest-CreateVolumesFromSnapshotTest-853708760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:35 devstack sudo[107198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:43:35 devstack sudo[107198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:35 devstack sudo[107195]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:35 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-0a02c53f-f954-4249-85c9-1b2e93082d9c tempest-ProjectMemberTests-453978435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-64b8322f-631d-4339-b1a1-b3f3fca6c595" returned: 0 in 0.517s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:35 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-0a02c53f-f954-4249-85c9-1b2e93082d9c tempest-ProjectMemberTests-453978435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-64b8322f-631d-4339-b1a1-b3f3fca6c595.0ebc9419-95aa-462e-aeea-ab623bd69a11 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:35 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-cf4426f3-92f8-4dea-9dd2-e50c87dab5a3 tempest-ProjectReaderTests-1564423168 None] Acquiring lock "cinder-45d01743-b359-497f-ac10-04f2dbe66dfc-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:43:35 devstack sudo[107198]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:35 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-1d71ff8a-ece6-4890-86f5-9963718e2274 tempest-CreateVolumesFromSnapshotTest-853708760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.326s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:35 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-1d71ff8a-ece6-4890-86f5-9963718e2274 tempest-CreateVolumesFromSnapshotTest-853708760 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:43:35 devstack sudo[107204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-64b8322f-631d-4339-b1a1-b3f3fca6c595.0ebc9419-95aa-462e-aeea-ab623bd69a11
Nov 03 18:43:35 devstack sudo[107204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:35 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-cf4426f3-92f8-4dea-9dd2-e50c87dab5a3 tempest-ProjectReaderTests-1564423168 None] Lock "cinder-45d01743-b359-497f-ac10-04f2dbe66dfc-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:43:35 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-1d71ff8a-ece6-4890-86f5-9963718e2274 tempest-CreateVolumesFromSnapshotTest-853708760 None] Deleted volume successfully.
Nov 03 18:43:35 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-1d71ff8a-ece6-4890-86f5-9963718e2274 tempest-CreateVolumesFromSnapshotTest-853708760 None] Lock "cinder-f9db187f-e9b2-43db-973d-03dbca2d38c0-delete_volume" released by "delete_volume" :: held 1.418s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:43:35 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-cf4426f3-92f8-4dea-9dd2-e50c87dab5a3 tempest-ProjectReaderTests-1564423168 None] Acquiring lock "cinder-quobyte-45d01743-b359-497f-ac10-04f2dbe66dfc" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:43:35 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-cf4426f3-92f8-4dea-9dd2-e50c87dab5a3 tempest-ProjectReaderTests-1564423168 None] Lock "cinder-quobyte-45d01743-b359-497f-ac10-04f2dbe66dfc" acquired by "delete_volume" :: waited 0.015s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:43:35 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0ef2f58-0dd7-4472-a761-aa0047bc0b74]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:43:35 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-cf4426f3-92f8-4dea-9dd2-e50c87dab5a3 tempest-ProjectReaderTests-1564423168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-45d01743-b359-497f-ac10-04f2dbe66dfc {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:35 devstack sudo[107206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-45d01743-b359-497f-ac10-04f2dbe66dfc
Nov 03 18:43:35 devstack sudo[107206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:36 devstack sudo[107204]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:36 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-0a02c53f-f954-4249-85c9-1b2e93082d9c tempest-ProjectMemberTests-453978435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-64b8322f-631d-4339-b1a1-b3f3fca6c595.0ebc9419-95aa-462e-aeea-ab623bd69a11" returned: 0 in 0.533s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:36 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-0a02c53f-f954-4249-85c9-1b2e93082d9c tempest-ProjectMemberTests-453978435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-64b8322f-631d-4339-b1a1-b3f3fca6c595.0ebc9419-95aa-462e-aeea-ab623bd69a11 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:36 devstack sudo[107245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-64b8322f-631d-4339-b1a1-b3f3fca6c595.0ebc9419-95aa-462e-aeea-ab623bd69a11
Nov 03 18:43:36 devstack sudo[107245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:36 devstack sudo[107206]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:36 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-cf4426f3-92f8-4dea-9dd2-e50c87dab5a3 tempest-ProjectReaderTests-1564423168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-45d01743-b359-497f-ac10-04f2dbe66dfc" returned: 0 in 0.581s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:36 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-cf4426f3-92f8-4dea-9dd2-e50c87dab5a3 tempest-ProjectReaderTests-1564423168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-45d01743-b359-497f-ac10-04f2dbe66dfc {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:36 devstack sudo[107254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-45d01743-b359-497f-ac10-04f2dbe66dfc
Nov 03 18:43:36 devstack sudo[107254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:36 devstack sudo[107245]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:36 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-0a02c53f-f954-4249-85c9-1b2e93082d9c tempest-ProjectMemberTests-453978435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-64b8322f-631d-4339-b1a1-b3f3fca6c595.0ebc9419-95aa-462e-aeea-ab623bd69a11" returned: 0 in 0.408s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:36 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-0a02c53f-f954-4249-85c9-1b2e93082d9c tempest-ProjectMemberTests-453978435 None] Lock "cinder-quobyte-0ebc9419-95aa-462e-aeea-ab623bd69a11" released by "_delete_snapshot" :: held 2.037s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:43:36 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-0a02c53f-f954-4249-85c9-1b2e93082d9c tempest-ProjectMemberTests-453978435 None] Lock "cinder-quobyte-64b8322f-631d-4339-b1a1-b3f3fca6c595" released by "delete_snapshot" :: held 2.100s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:43:36 devstack sudo[107254]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:36 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-cf4426f3-92f8-4dea-9dd2-e50c87dab5a3 tempest-ProjectReaderTests-1564423168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-45d01743-b359-497f-ac10-04f2dbe66dfc" returned: 0 in 0.323s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:36 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-0a02c53f-f954-4249-85c9-1b2e93082d9c tempest-ProjectMemberTests-453978435 None] Created reservations ['1180ba9e-548c-4e5a-9d64-db2d03ffe277', 'b194723d-2600-4f0c-b118-a4bbda01184c', '6a0d5586-151f-43bd-9e83-a3b38c70e941', '15c40aab-1c03-457f-944c-112a6db4d788'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:43:36 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-cf4426f3-92f8-4dea-9dd2-e50c87dab5a3 tempest-ProjectReaderTests-1564423168 None] Lock "cinder-quobyte-45d01743-b359-497f-ac10-04f2dbe66dfc" released by "delete_volume" :: held 0.960s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:43:36 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-cf4426f3-92f8-4dea-9dd2-e50c87dab5a3 tempest-ProjectReaderTests-1564423168 None] Created reservations ['ad683abe-8741-4133-b5da-66be146e92df', '80cc1a00-5cbf-4232-80cf-3f463963c66a', 'ea5d3118-f95d-448d-96ca-0f04f4add263', 'a0efa693-5a91-478f-b68f-02c67ad49d3e'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:43:36 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-0a02c53f-f954-4249-85c9-1b2e93082d9c tempest-ProjectMemberTests-453978435 None] Delete snapshot completed successfully.
Nov 03 18:43:36 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-0a02c53f-f954-4249-85c9-1b2e93082d9c tempest-ProjectMemberTests-453978435 None] Lock "cinder-0ebc9419-95aa-462e-aeea-ab623bd69a11-delete_snapshot" released by "delete_snapshot" :: held 2.366s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:43:36 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-cf4426f3-92f8-4dea-9dd2-e50c87dab5a3 tempest-ProjectReaderTests-1564423168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:43:36 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-cf4426f3-92f8-4dea-9dd2-e50c87dab5a3 tempest-ProjectReaderTests-1564423168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:43:36 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-cf4426f3-92f8-4dea-9dd2-e50c87dab5a3 tempest-ProjectReaderTests-1564423168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:43:36 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-cf4426f3-92f8-4dea-9dd2-e50c87dab5a3 tempest-ProjectReaderTests-1564423168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:43:36 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-cf4426f3-92f8-4dea-9dd2-e50c87dab5a3 tempest-ProjectReaderTests-1564423168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:43:36 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-cf4426f3-92f8-4dea-9dd2-e50c87dab5a3 tempest-ProjectReaderTests-1564423168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:36 devstack sudo[107258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:43:36 devstack sudo[107258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:37 devstack sudo[107258]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:37 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-cf4426f3-92f8-4dea-9dd2-e50c87dab5a3 tempest-ProjectReaderTests-1564423168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.312s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:37 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-cf4426f3-92f8-4dea-9dd2-e50c87dab5a3 tempest-ProjectReaderTests-1564423168 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:43:37 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-cf4426f3-92f8-4dea-9dd2-e50c87dab5a3 tempest-ProjectReaderTests-1564423168 None] Deleted volume successfully.
Nov 03 18:43:37 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-cf4426f3-92f8-4dea-9dd2-e50c87dab5a3 tempest-ProjectReaderTests-1564423168 None] Lock "cinder-45d01743-b359-497f-ac10-04f2dbe66dfc-delete_volume" released by "delete_volume" :: held 1.574s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:43:37 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-2c96b0e9-30ab-4f22-a78f-0ed59c97415c tempest-ProjectMemberTests-453978435 None] Acquiring lock "cinder-64b8322f-631d-4339-b1a1-b3f3fca6c595-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:43:37 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-2c96b0e9-30ab-4f22-a78f-0ed59c97415c tempest-ProjectMemberTests-453978435 None] Lock "cinder-64b8322f-631d-4339-b1a1-b3f3fca6c595-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:43:37 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-2c96b0e9-30ab-4f22-a78f-0ed59c97415c tempest-ProjectMemberTests-453978435 None] Acquiring lock "cinder-quobyte-64b8322f-631d-4339-b1a1-b3f3fca6c595" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:43:37 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-2c96b0e9-30ab-4f22-a78f-0ed59c97415c tempest-ProjectMemberTests-453978435 None] Lock "cinder-quobyte-64b8322f-631d-4339-b1a1-b3f3fca6c595" acquired by "delete_volume" :: waited 0.015s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:43:37 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b45f2b4-859a-4307-89fe-a73206043aa1]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:43:37 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-2c96b0e9-30ab-4f22-a78f-0ed59c97415c tempest-ProjectMemberTests-453978435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-64b8322f-631d-4339-b1a1-b3f3fca6c595 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:37 devstack sudo[107261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-64b8322f-631d-4339-b1a1-b3f3fca6c595
Nov 03 18:43:37 devstack sudo[107261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:38 devstack sudo[107261]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:38 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-2c96b0e9-30ab-4f22-a78f-0ed59c97415c tempest-ProjectMemberTests-453978435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-64b8322f-631d-4339-b1a1-b3f3fca6c595" returned: 0 in 0.489s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:38 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-2c96b0e9-30ab-4f22-a78f-0ed59c97415c tempest-ProjectMemberTests-453978435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-64b8322f-631d-4339-b1a1-b3f3fca6c595 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:38 devstack sudo[107267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-64b8322f-631d-4339-b1a1-b3f3fca6c595
Nov 03 18:43:38 devstack sudo[107267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:38 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-3bda02cb-7592-4f45-a341-f28a6dce975a tempest-ProjectReaderTests-1564423168 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:43:38 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-3bda02cb-7592-4f45-a341-f28a6dce975a tempest-ProjectReaderTests-1564423168 None] Flow 'volume_create_manager' (2406afc2-5526-4784-b2ae-c407f1003785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:43:38 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-3bda02cb-7592-4f45-a341-f28a6dce975a tempest-ProjectReaderTests-1564423168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (519516f9-6d71-4d30-a7af-225ea5cf986a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:43:38 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-3bda02cb-7592-4f45-a341-f28a6dce975a tempest-ProjectReaderTests-1564423168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (519516f9-6d71-4d30-a7af-225ea5cf986a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:43:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1614956162',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4f7a7d4-47ae-4a4c-9fd6-577eabf3d8dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63a008ea0c74489988e6e4d4fc9092fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:43:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:43:38Z,use_quota=True,user_id='cadcf4bf50674e62a89c06c21eb152fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:43:38 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-3bda02cb-7592-4f45-a341-f28a6dce975a tempest-ProjectReaderTests-1564423168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23d741ea-a269-4db8-b625-8041216ef33f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:43:38 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-3bda02cb-7592-4f45-a341-f28a6dce975a tempest-ProjectReaderTests-1564423168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23d741ea-a269-4db8-b625-8041216ef33f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:43:38 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-3bda02cb-7592-4f45-a341-f28a6dce975a tempest-ProjectReaderTests-1564423168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e166c64-5f3e-454c-b0dc-d8d30b286953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:43:38 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-3bda02cb-7592-4f45-a341-f28a6dce975a tempest-ProjectReaderTests-1564423168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e166c64-5f3e-454c-b0dc-d8d30b286953) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4f7a7d4-47ae-4a4c-9fd6-577eabf3d8dc', 'volume_name': 'volume-a4f7a7d4-47ae-4a4c-9fd6-577eabf3d8dc', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:43:38 devstack sudo[107267]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:38 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-3bda02cb-7592-4f45-a341-f28a6dce975a tempest-ProjectReaderTests-1564423168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca717658-0d4f-4e8d-83b2-905cc5c316ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:43:38 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-3bda02cb-7592-4f45-a341-f28a6dce975a tempest-ProjectReaderTests-1564423168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca717658-0d4f-4e8d-83b2-905cc5c316ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:43:38 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-3bda02cb-7592-4f45-a341-f28a6dce975a tempest-ProjectReaderTests-1564423168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (844b166b-bdfd-4cc2-9507-111cf45d05ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:43:38 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-3bda02cb-7592-4f45-a341-f28a6dce975a tempest-ProjectReaderTests-1564423168 None] Volume a4f7a7d4-47ae-4a4c-9fd6-577eabf3d8dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4f7a7d4-47ae-4a4c-9fd6-577eabf3d8dc', 'volume_size': 1}
Nov 03 18:43:38 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-3bda02cb-7592-4f45-a341-f28a6dce975a tempest-ProjectReaderTests-1564423168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:43:38 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-3bda02cb-7592-4f45-a341-f28a6dce975a tempest-ProjectReaderTests-1564423168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:43:38 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-3bda02cb-7592-4f45-a341-f28a6dce975a tempest-ProjectReaderTests-1564423168 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:43:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1614956162',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4f7a7d4-47ae-4a4c-9fd6-577eabf3d8dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63a008ea0c74489988e6e4d4fc9092fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:43:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:43:38Z,use_quota=True,user_id='cadcf4bf50674e62a89c06c21eb152fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:43:38 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-3bda02cb-7592-4f45-a341-f28a6dce975a tempest-ProjectReaderTests-1564423168 None] Creating volume a4f7a7d4-47ae-4a4c-9fd6-577eabf3d8dc {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:43:38 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-3bda02cb-7592-4f45-a341-f28a6dce975a tempest-ProjectReaderTests-1564423168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:43:38 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-3bda02cb-7592-4f45-a341-f28a6dce975a tempest-ProjectReaderTests-1564423168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:43:38 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-3bda02cb-7592-4f45-a341-f28a6dce975a tempest-ProjectReaderTests-1564423168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:43:38 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-3bda02cb-7592-4f45-a341-f28a6dce975a tempest-ProjectReaderTests-1564423168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:43:38 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-3bda02cb-7592-4f45-a341-f28a6dce975a tempest-ProjectReaderTests-1564423168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:43:38 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-3bda02cb-7592-4f45-a341-f28a6dce975a tempest-ProjectReaderTests-1564423168 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:43:38 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-3bda02cb-7592-4f45-a341-f28a6dce975a tempest-ProjectReaderTests-1564423168 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:43:38 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-3bda02cb-7592-4f45-a341-f28a6dce975a tempest-ProjectReaderTests-1564423168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-a4f7a7d4-47ae-4a4c-9fd6-577eabf3d8dc 1073741824 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:38 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-2c96b0e9-30ab-4f22-a78f-0ed59c97415c tempest-ProjectMemberTests-453978435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-64b8322f-631d-4339-b1a1-b3f3fca6c595" returned: 0 in 0.367s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:38 devstack sudo[107270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-a4f7a7d4-47ae-4a4c-9fd6-577eabf3d8dc 1073741824
Nov 03 18:43:38 devstack sudo[107270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:38 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-2c96b0e9-30ab-4f22-a78f-0ed59c97415c tempest-ProjectMemberTests-453978435 None] Lock "cinder-quobyte-64b8322f-631d-4339-b1a1-b3f3fca6c595" released by "delete_volume" :: held 0.930s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:43:38 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-2c96b0e9-30ab-4f22-a78f-0ed59c97415c tempest-ProjectMemberTests-453978435 None] Created reservations ['40bf1872-647e-4e5b-aefa-f43e9376da4b', '8a11d7b3-bf19-4820-8f68-c89c28162893', '344ee6ea-fb45-4b03-8d5e-57dd0c6f14e6', 'b06b5557-8cc7-460f-8270-7e25433a4d79'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:43:38 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-2c96b0e9-30ab-4f22-a78f-0ed59c97415c tempest-ProjectMemberTests-453978435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:43:38 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-2c96b0e9-30ab-4f22-a78f-0ed59c97415c tempest-ProjectMemberTests-453978435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:43:38 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-2c96b0e9-30ab-4f22-a78f-0ed59c97415c tempest-ProjectMemberTests-453978435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:43:38 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-2c96b0e9-30ab-4f22-a78f-0ed59c97415c tempest-ProjectMemberTests-453978435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:43:38 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-2c96b0e9-30ab-4f22-a78f-0ed59c97415c tempest-ProjectMemberTests-453978435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:43:38 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-2c96b0e9-30ab-4f22-a78f-0ed59c97415c tempest-ProjectMemberTests-453978435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:38 devstack sudo[107272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:43:38 devstack sudo[107272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:39 devstack sudo[107272]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:39 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-2c96b0e9-30ab-4f22-a78f-0ed59c97415c tempest-ProjectMemberTests-453978435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.308s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:39 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-2c96b0e9-30ab-4f22-a78f-0ed59c97415c tempest-ProjectMemberTests-453978435 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:43:39 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-2c96b0e9-30ab-4f22-a78f-0ed59c97415c tempest-ProjectMemberTests-453978435 None] Deleted volume successfully.
Nov 03 18:43:39 devstack sudo[107270]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:39 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-3bda02cb-7592-4f45-a341-f28a6dce975a tempest-ProjectReaderTests-1564423168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-a4f7a7d4-47ae-4a4c-9fd6-577eabf3d8dc 1073741824" returned: 0 in 0.579s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:39 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-2c96b0e9-30ab-4f22-a78f-0ed59c97415c tempest-ProjectMemberTests-453978435 None] Lock "cinder-64b8322f-631d-4339-b1a1-b3f3fca6c595-delete_volume" released by "delete_volume" :: held 1.553s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:43:39 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-3bda02cb-7592-4f45-a341-f28a6dce975a tempest-ProjectReaderTests-1564423168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-a4f7a7d4-47ae-4a4c-9fd6-577eabf3d8dc {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:39 devstack sudo[107279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-a4f7a7d4-47ae-4a4c-9fd6-577eabf3d8dc
Nov 03 18:43:39 devstack sudo[107279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:39 devstack sudo[107279]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:39 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-3bda02cb-7592-4f45-a341-f28a6dce975a tempest-ProjectReaderTests-1564423168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-a4f7a7d4-47ae-4a4c-9fd6-577eabf3d8dc" returned: 0 in 0.311s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:39 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-3bda02cb-7592-4f45-a341-f28a6dce975a tempest-ProjectReaderTests-1564423168 None] <== create_volume: return (941ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:43:39 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-3bda02cb-7592-4f45-a341-f28a6dce975a tempest-ProjectReaderTests-1564423168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.946s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:43:39 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-3bda02cb-7592-4f45-a341-f28a6dce975a tempest-ProjectReaderTests-1564423168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (844b166b-bdfd-4cc2-9507-111cf45d05ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4f7a7d4-47ae-4a4c-9fd6-577eabf3d8dc', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:43:39 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-3bda02cb-7592-4f45-a341-f28a6dce975a tempest-ProjectReaderTests-1564423168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4613e729-6848-4c17-a3d7-0db5a3ca2274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:43:39 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-3bda02cb-7592-4f45-a341-f28a6dce975a tempest-ProjectReaderTests-1564423168 None] Volume volume-a4f7a7d4-47ae-4a4c-9fd6-577eabf3d8dc (a4f7a7d4-47ae-4a4c-9fd6-577eabf3d8dc): created successfully
Nov 03 18:43:39 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-3bda02cb-7592-4f45-a341-f28a6dce975a tempest-ProjectReaderTests-1564423168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4613e729-6848-4c17-a3d7-0db5a3ca2274) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:43:39 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-3bda02cb-7592-4f45-a341-f28a6dce975a tempest-ProjectReaderTests-1564423168 None] Flow 'volume_create_manager' (2406afc2-5526-4784-b2ae-c407f1003785) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:43:39 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-3bda02cb-7592-4f45-a341-f28a6dce975a tempest-ProjectReaderTests-1564423168 None] Created volume successfully.
Nov 03 18:43:39 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-7364bd2a-b2b7-4dbe-a24d-45c8e2d28183 tempest-CinderUnicodeTest-501030678 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:43:39 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-7364bd2a-b2b7-4dbe-a24d-45c8e2d28183 tempest-CinderUnicodeTest-501030678 None] Flow 'volume_create_manager' (47187563-243c-4f29-8339-d9bfcacde977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:43:39 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-7364bd2a-b2b7-4dbe-a24d-45c8e2d28183 tempest-CinderUnicodeTest-501030678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d01cf8ef-19a3-4e47-afc4-d3361b06138a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:43:39 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-7364bd2a-b2b7-4dbe-a24d-45c8e2d28183 tempest-CinderUnicodeTest-501030678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d01cf8ef-19a3-4e47-afc4-d3361b06138a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:43:39Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b4470f0-4d03-412f-b5b9-6672df3bee78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82996a8e21fc45b7a61716df19d59615',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:43:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:43:40Z,use_quota=True,user_id='70dea3f2a44944fa8b30a5a5c9c838af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:43:39 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-7364bd2a-b2b7-4dbe-a24d-45c8e2d28183 tempest-CinderUnicodeTest-501030678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f15eb0a-b877-4783-af0a-5e9f1052cfa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:43:39 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-7364bd2a-b2b7-4dbe-a24d-45c8e2d28183 tempest-CinderUnicodeTest-501030678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f15eb0a-b877-4783-af0a-5e9f1052cfa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:43:39 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-7364bd2a-b2b7-4dbe-a24d-45c8e2d28183 tempest-CinderUnicodeTest-501030678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29e26af8-7f59-4a3c-bda3-496513fb4034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:43:39 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-7364bd2a-b2b7-4dbe-a24d-45c8e2d28183 tempest-CinderUnicodeTest-501030678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29e26af8-7f59-4a3c-bda3-496513fb4034) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b4470f0-4d03-412f-b5b9-6672df3bee78', 'volume_name': 'volume-9b4470f0-4d03-412f-b5b9-6672df3bee78', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:43:39 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-7364bd2a-b2b7-4dbe-a24d-45c8e2d28183 tempest-CinderUnicodeTest-501030678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a49a6a85-5b7a-4398-a83d-d429a637d5fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:43:39 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-7364bd2a-b2b7-4dbe-a24d-45c8e2d28183 tempest-CinderUnicodeTest-501030678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a49a6a85-5b7a-4398-a83d-d429a637d5fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:43:39 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-7364bd2a-b2b7-4dbe-a24d-45c8e2d28183 tempest-CinderUnicodeTest-501030678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fce8fe9-91aa-4316-861e-6bd4ad10d8eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:43:39 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-7364bd2a-b2b7-4dbe-a24d-45c8e2d28183 tempest-CinderUnicodeTest-501030678 None] Volume 9b4470f0-4d03-412f-b5b9-6672df3bee78: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b4470f0-4d03-412f-b5b9-6672df3bee78', 'volume_size': 1}
Nov 03 18:43:39 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-7364bd2a-b2b7-4dbe-a24d-45c8e2d28183 tempest-CinderUnicodeTest-501030678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:43:39 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-7364bd2a-b2b7-4dbe-a24d-45c8e2d28183 tempest-CinderUnicodeTest-501030678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:43:39 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-7364bd2a-b2b7-4dbe-a24d-45c8e2d28183 tempest-CinderUnicodeTest-501030678 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:43:39Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b4470f0-4d03-412f-b5b9-6672df3bee78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82996a8e21fc45b7a61716df19d59615',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:43:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:43:40Z,use_quota=True,user_id='70dea3f2a44944fa8b30a5a5c9c838af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:43:39 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-7364bd2a-b2b7-4dbe-a24d-45c8e2d28183 tempest-CinderUnicodeTest-501030678 None] Creating volume 9b4470f0-4d03-412f-b5b9-6672df3bee78 {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:43:39 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-7364bd2a-b2b7-4dbe-a24d-45c8e2d28183 tempest-CinderUnicodeTest-501030678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:43:39 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-7364bd2a-b2b7-4dbe-a24d-45c8e2d28183 tempest-CinderUnicodeTest-501030678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:43:39 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-7364bd2a-b2b7-4dbe-a24d-45c8e2d28183 tempest-CinderUnicodeTest-501030678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:43:39 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-7364bd2a-b2b7-4dbe-a24d-45c8e2d28183 tempest-CinderUnicodeTest-501030678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:43:39 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-7364bd2a-b2b7-4dbe-a24d-45c8e2d28183 tempest-CinderUnicodeTest-501030678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:43:39 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-7364bd2a-b2b7-4dbe-a24d-45c8e2d28183 tempest-CinderUnicodeTest-501030678 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:43:39 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-7364bd2a-b2b7-4dbe-a24d-45c8e2d28183 tempest-CinderUnicodeTest-501030678 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:43:39 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-7364bd2a-b2b7-4dbe-a24d-45c8e2d28183 tempest-CinderUnicodeTest-501030678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-9b4470f0-4d03-412f-b5b9-6672df3bee78 1073741824 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:39 devstack sudo[107284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-9b4470f0-4d03-412f-b5b9-6672df3bee78 1073741824
Nov 03 18:43:39 devstack sudo[107284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:40 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a7bd5e0-d5eb-4711-a6d5-755a23cdcd67 tempest-ProjectMemberTests-453978435 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:43:40 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-5a7bd5e0-d5eb-4711-a6d5-755a23cdcd67 tempest-ProjectMemberTests-453978435 None] Flow 'volume_create_manager' (07a392e2-f8cb-4a80-9fae-893f3c527a4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:43:40 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-5a7bd5e0-d5eb-4711-a6d5-755a23cdcd67 tempest-ProjectMemberTests-453978435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01836921-f9d3-43b6-8cce-1f537f5f394f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:43:40 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-5a7bd5e0-d5eb-4711-a6d5-755a23cdcd67 tempest-ProjectMemberTests-453978435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01836921-f9d3-43b6-8cce-1f537f5f394f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:43:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1259752315',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb0e8916-37a4-44bd-a6d7-8380cd538617,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac23a66460684cf18a0ec466545c9237',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:43:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:43:40Z,use_quota=True,user_id='1e72acdc7ff048f4b0d1e488804038f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:43:40 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-5a7bd5e0-d5eb-4711-a6d5-755a23cdcd67 tempest-ProjectMemberTests-453978435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7905dc1-9334-42ab-84d8-21b01824f29e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:43:40 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-5a7bd5e0-d5eb-4711-a6d5-755a23cdcd67 tempest-ProjectMemberTests-453978435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7905dc1-9334-42ab-84d8-21b01824f29e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:43:40 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-5a7bd5e0-d5eb-4711-a6d5-755a23cdcd67 tempest-ProjectMemberTests-453978435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04f25b51-2546-499d-832f-bb17c35d4a4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:43:40 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-5a7bd5e0-d5eb-4711-a6d5-755a23cdcd67 tempest-ProjectMemberTests-453978435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04f25b51-2546-499d-832f-bb17c35d4a4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb0e8916-37a4-44bd-a6d7-8380cd538617', 'volume_name': 'volume-eb0e8916-37a4-44bd-a6d7-8380cd538617', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:43:40 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-5a7bd5e0-d5eb-4711-a6d5-755a23cdcd67 tempest-ProjectMemberTests-453978435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f6d0f0c-2dcf-4977-80e7-b01ca9a5b9dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:43:40 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-5a7bd5e0-d5eb-4711-a6d5-755a23cdcd67 tempest-ProjectMemberTests-453978435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f6d0f0c-2dcf-4977-80e7-b01ca9a5b9dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:43:40 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-5a7bd5e0-d5eb-4711-a6d5-755a23cdcd67 tempest-ProjectMemberTests-453978435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5860ae3-bd3c-4333-99f1-3c501865177c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:43:40 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-5a7bd5e0-d5eb-4711-a6d5-755a23cdcd67 tempest-ProjectMemberTests-453978435 None] Volume eb0e8916-37a4-44bd-a6d7-8380cd538617: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb0e8916-37a4-44bd-a6d7-8380cd538617', 'volume_size': 1}
Nov 03 18:43:40 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-5a7bd5e0-d5eb-4711-a6d5-755a23cdcd67 tempest-ProjectMemberTests-453978435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:43:40 devstack sudo[107284]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:40 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-7364bd2a-b2b7-4dbe-a24d-45c8e2d28183 tempest-CinderUnicodeTest-501030678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-9b4470f0-4d03-412f-b5b9-6672df3bee78 1073741824" returned: 0 in 0.560s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:40 devstack cinder-volume[86120]: DEBUG dbcounter [-] [86120] Writing DB stats cinder:SELECT=245,cinder:UPDATE=334,cinder:INSERT=84,cinder:DELETE=29 {{(pid=86120) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 18:43:40 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-ad6b970a-bed5-4aa6-ab56-2aa6c2b274d3 tempest-ProjectReaderTests-1564423168 None] Acquiring lock "cinder-a4f7a7d4-47ae-4a4c-9fd6-577eabf3d8dc-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:43:40 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-7364bd2a-b2b7-4dbe-a24d-45c8e2d28183 tempest-CinderUnicodeTest-501030678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-9b4470f0-4d03-412f-b5b9-6672df3bee78 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:40 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-ad6b970a-bed5-4aa6-ab56-2aa6c2b274d3 tempest-ProjectReaderTests-1564423168 None] Lock "cinder-a4f7a7d4-47ae-4a4c-9fd6-577eabf3d8dc-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:43:40 devstack sudo[107290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-9b4470f0-4d03-412f-b5b9-6672df3bee78
Nov 03 18:43:40 devstack sudo[107290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:40 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-ad6b970a-bed5-4aa6-ab56-2aa6c2b274d3 tempest-ProjectReaderTests-1564423168 None] Acquiring lock "cinder-quobyte-a4f7a7d4-47ae-4a4c-9fd6-577eabf3d8dc" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:43:40 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-ad6b970a-bed5-4aa6-ab56-2aa6c2b274d3 tempest-ProjectReaderTests-1564423168 None] Lock "cinder-quobyte-a4f7a7d4-47ae-4a4c-9fd6-577eabf3d8dc" acquired by "delete_volume" :: waited 0.016s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:43:40 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab87e02e-ad9c-4a6b-810f-88d9a30fdc7d]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:43:40 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-ad6b970a-bed5-4aa6-ab56-2aa6c2b274d3 tempest-ProjectReaderTests-1564423168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-a4f7a7d4-47ae-4a4c-9fd6-577eabf3d8dc {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:40 devstack sudo[107292]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-a4f7a7d4-47ae-4a4c-9fd6-577eabf3d8dc
Nov 03 18:43:40 devstack sudo[107292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:40 devstack sudo[107290]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:40 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-7364bd2a-b2b7-4dbe-a24d-45c8e2d28183 tempest-CinderUnicodeTest-501030678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-9b4470f0-4d03-412f-b5b9-6672df3bee78" returned: 0 in 0.306s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:40 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-7364bd2a-b2b7-4dbe-a24d-45c8e2d28183 tempest-CinderUnicodeTest-501030678 None] <== create_volume: return (926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:43:40 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-7364bd2a-b2b7-4dbe-a24d-45c8e2d28183 tempest-CinderUnicodeTest-501030678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.930s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:43:40 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-5a7bd5e0-d5eb-4711-a6d5-755a23cdcd67 tempest-ProjectMemberTests-453978435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.434s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:43:40 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-5a7bd5e0-d5eb-4711-a6d5-755a23cdcd67 tempest-ProjectMemberTests-453978435 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:43:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1259752315',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb0e8916-37a4-44bd-a6d7-8380cd538617,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac23a66460684cf18a0ec466545c9237',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:43:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:43:40Z,use_quota=True,user_id='1e72acdc7ff048f4b0d1e488804038f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:43:40 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-5a7bd5e0-d5eb-4711-a6d5-755a23cdcd67 tempest-ProjectMemberTests-453978435 None] Creating volume eb0e8916-37a4-44bd-a6d7-8380cd538617 {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:43:40 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-5a7bd5e0-d5eb-4711-a6d5-755a23cdcd67 tempest-ProjectMemberTests-453978435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:43:40 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-5a7bd5e0-d5eb-4711-a6d5-755a23cdcd67 tempest-ProjectMemberTests-453978435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:43:40 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-5a7bd5e0-d5eb-4711-a6d5-755a23cdcd67 tempest-ProjectMemberTests-453978435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:43:40 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-5a7bd5e0-d5eb-4711-a6d5-755a23cdcd67 tempest-ProjectMemberTests-453978435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:43:40 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-5a7bd5e0-d5eb-4711-a6d5-755a23cdcd67 tempest-ProjectMemberTests-453978435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:43:40 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-5a7bd5e0-d5eb-4711-a6d5-755a23cdcd67 tempest-ProjectMemberTests-453978435 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:43:40 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-5a7bd5e0-d5eb-4711-a6d5-755a23cdcd67 tempest-ProjectMemberTests-453978435 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:43:40 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-5a7bd5e0-d5eb-4711-a6d5-755a23cdcd67 tempest-ProjectMemberTests-453978435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-eb0e8916-37a4-44bd-a6d7-8380cd538617 1073741824 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:40 devstack cinder-volume[86120]: DEBUG dbcounter [-] [86120] Writing DB stats cinder:UPDATE=320,cinder:SELECT=224,cinder:INSERT=87,cinder:DELETE=29 {{(pid=86120) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 18:43:40 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-7364bd2a-b2b7-4dbe-a24d-45c8e2d28183 tempest-CinderUnicodeTest-501030678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fce8fe9-91aa-4316-861e-6bd4ad10d8eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b4470f0-4d03-412f-b5b9-6672df3bee78', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:43:40 devstack sudo[107295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-eb0e8916-37a4-44bd-a6d7-8380cd538617 1073741824
Nov 03 18:43:40 devstack sudo[107295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:40 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-7364bd2a-b2b7-4dbe-a24d-45c8e2d28183 tempest-CinderUnicodeTest-501030678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ca9f362-7d67-4906-9687-460ab5946c30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:43:40 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-7364bd2a-b2b7-4dbe-a24d-45c8e2d28183 tempest-CinderUnicodeTest-501030678 None] Volume volume-9b4470f0-4d03-412f-b5b9-6672df3bee78 (9b4470f0-4d03-412f-b5b9-6672df3bee78): created successfully
Nov 03 18:43:40 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-7364bd2a-b2b7-4dbe-a24d-45c8e2d28183 tempest-CinderUnicodeTest-501030678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ca9f362-7d67-4906-9687-460ab5946c30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:43:40 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-7364bd2a-b2b7-4dbe-a24d-45c8e2d28183 tempest-CinderUnicodeTest-501030678 None] Flow 'volume_create_manager' (47187563-243c-4f29-8339-d9bfcacde977) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:43:40 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-7364bd2a-b2b7-4dbe-a24d-45c8e2d28183 tempest-CinderUnicodeTest-501030678 None] Created volume successfully.
Nov 03 18:43:41 devstack sudo[107292]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:41 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-ad6b970a-bed5-4aa6-ab56-2aa6c2b274d3 tempest-ProjectReaderTests-1564423168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-a4f7a7d4-47ae-4a4c-9fd6-577eabf3d8dc" returned: 0 in 0.418s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:41 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-ad6b970a-bed5-4aa6-ab56-2aa6c2b274d3 tempest-ProjectReaderTests-1564423168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-a4f7a7d4-47ae-4a4c-9fd6-577eabf3d8dc {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:41 devstack sudo[107300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-a4f7a7d4-47ae-4a4c-9fd6-577eabf3d8dc
Nov 03 18:43:41 devstack sudo[107300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:41 devstack sudo[107300]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:41 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-ad6b970a-bed5-4aa6-ab56-2aa6c2b274d3 tempest-ProjectReaderTests-1564423168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-a4f7a7d4-47ae-4a4c-9fd6-577eabf3d8dc" returned: 0 in 0.268s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:41 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-ad6b970a-bed5-4aa6-ab56-2aa6c2b274d3 tempest-ProjectReaderTests-1564423168 None] Lock "cinder-quobyte-a4f7a7d4-47ae-4a4c-9fd6-577eabf3d8dc" released by "delete_volume" :: held 0.732s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:43:41 devstack sudo[107295]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:41 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-5a7bd5e0-d5eb-4711-a6d5-755a23cdcd67 tempest-ProjectMemberTests-453978435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-eb0e8916-37a4-44bd-a6d7-8380cd538617 1073741824" returned: 0 in 0.510s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:41 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-5a7bd5e0-d5eb-4711-a6d5-755a23cdcd67 tempest-ProjectMemberTests-453978435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-eb0e8916-37a4-44bd-a6d7-8380cd538617 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:41 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-ad6b970a-bed5-4aa6-ab56-2aa6c2b274d3 tempest-ProjectReaderTests-1564423168 None] Created reservations ['5949d1fb-e669-4859-88e1-25285c8d9c4d', 'de56c810-2448-447c-941e-ad971444c7d9', '59e9cffa-5a1f-43d8-9f93-a1576e233906', 'e63cccea-b00c-48d5-b1db-c7cdb1f84668'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:43:41 devstack sudo[107308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-eb0e8916-37a4-44bd-a6d7-8380cd538617
Nov 03 18:43:41 devstack sudo[107308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:41 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-ad6b970a-bed5-4aa6-ab56-2aa6c2b274d3 tempest-ProjectReaderTests-1564423168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:43:41 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-ad6b970a-bed5-4aa6-ab56-2aa6c2b274d3 tempest-ProjectReaderTests-1564423168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:43:41 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-ad6b970a-bed5-4aa6-ab56-2aa6c2b274d3 tempest-ProjectReaderTests-1564423168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:43:41 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-ad6b970a-bed5-4aa6-ab56-2aa6c2b274d3 tempest-ProjectReaderTests-1564423168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:43:41 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-ad6b970a-bed5-4aa6-ab56-2aa6c2b274d3 tempest-ProjectReaderTests-1564423168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:43:41 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-ad6b970a-bed5-4aa6-ab56-2aa6c2b274d3 tempest-ProjectReaderTests-1564423168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:41 devstack sudo[107311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:43:41 devstack sudo[107311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:41 devstack sudo[107308]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:41 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-5a7bd5e0-d5eb-4711-a6d5-755a23cdcd67 tempest-ProjectMemberTests-453978435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-eb0e8916-37a4-44bd-a6d7-8380cd538617" returned: 0 in 0.284s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:41 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-5a7bd5e0-d5eb-4711-a6d5-755a23cdcd67 tempest-ProjectMemberTests-453978435 None] <== create_volume: return (850ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:43:41 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-5a7bd5e0-d5eb-4711-a6d5-755a23cdcd67 tempest-ProjectMemberTests-453978435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.853s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:43:41 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-5a7bd5e0-d5eb-4711-a6d5-755a23cdcd67 tempest-ProjectMemberTests-453978435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5860ae3-bd3c-4333-99f1-3c501865177c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb0e8916-37a4-44bd-a6d7-8380cd538617', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:43:41 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-5a7bd5e0-d5eb-4711-a6d5-755a23cdcd67 tempest-ProjectMemberTests-453978435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bb20656-605a-47cd-bc3e-3b12d92e8b3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:43:41 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-5a7bd5e0-d5eb-4711-a6d5-755a23cdcd67 tempest-ProjectMemberTests-453978435 None] Volume volume-eb0e8916-37a4-44bd-a6d7-8380cd538617 (eb0e8916-37a4-44bd-a6d7-8380cd538617): created successfully
Nov 03 18:43:41 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-5a7bd5e0-d5eb-4711-a6d5-755a23cdcd67 tempest-ProjectMemberTests-453978435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bb20656-605a-47cd-bc3e-3b12d92e8b3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:43:41 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-5a7bd5e0-d5eb-4711-a6d5-755a23cdcd67 tempest-ProjectMemberTests-453978435 None] Flow 'volume_create_manager' (07a392e2-f8cb-4a80-9fae-893f3c527a4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:43:41 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-5a7bd5e0-d5eb-4711-a6d5-755a23cdcd67 tempest-ProjectMemberTests-453978435 None] Created volume successfully.
Nov 03 18:43:41 devstack sudo[107311]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:41 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-ad6b970a-bed5-4aa6-ab56-2aa6c2b274d3 tempest-ProjectReaderTests-1564423168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.362s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:41 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-ad6b970a-bed5-4aa6-ab56-2aa6c2b274d3 tempest-ProjectReaderTests-1564423168 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:43:41 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-ad6b970a-bed5-4aa6-ab56-2aa6c2b274d3 tempest-ProjectReaderTests-1564423168 None] Deleted volume successfully.
Nov 03 18:43:41 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-ad6b970a-bed5-4aa6-ab56-2aa6c2b274d3 tempest-ProjectReaderTests-1564423168 None] Lock "cinder-a4f7a7d4-47ae-4a4c-9fd6-577eabf3d8dc-delete_volume" released by "delete_volume" :: held 1.359s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:43:42 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-6190e907-ee24-4053-9e50-3cebf2953606 tempest-CinderUnicodeTest-501030678 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:43:42 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-6190e907-ee24-4053-9e50-3cebf2953606 tempest-CinderUnicodeTest-501030678 None] Flow 'volume_create_manager' (fe89002f-b48c-477b-bae4-d0d813a5ead7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:43:42 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-6190e907-ee24-4053-9e50-3cebf2953606 tempest-CinderUnicodeTest-501030678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e53608e5-638c-4795-ae1b-87c0e87e0e10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:43:42 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-017015ac-38c4-4e49-8c0a-ac1d4064131a tempest-ProjectMemberTests-453978435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:43:42 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-017015ac-38c4-4e49-8c0a-ac1d4064131a tempest-ProjectMemberTests-453978435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:43:42 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-6190e907-ee24-4053-9e50-3cebf2953606 tempest-CinderUnicodeTest-501030678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e53608e5-638c-4795-ae1b-87c0e87e0e10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:43:42Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1263647015',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bea78f48-e79a-48af-b3c4-a7586cb4e855,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82996a8e21fc45b7a61716df19d59615',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:43:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:43:43Z,use_quota=True,user_id='70dea3f2a44944fa8b30a5a5c9c838af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:43:42 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-6190e907-ee24-4053-9e50-3cebf2953606 tempest-CinderUnicodeTest-501030678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06a3a9fe-e053-49cf-9432-7abc2d2b52bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:43:42 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-6190e907-ee24-4053-9e50-3cebf2953606 tempest-CinderUnicodeTest-501030678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06a3a9fe-e053-49cf-9432-7abc2d2b52bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:43:42 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-6190e907-ee24-4053-9e50-3cebf2953606 tempest-CinderUnicodeTest-501030678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb4524c9-be45-43dd-8160-f6cf43e14eb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:43:42 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-6190e907-ee24-4053-9e50-3cebf2953606 tempest-CinderUnicodeTest-501030678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb4524c9-be45-43dd-8160-f6cf43e14eb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bea78f48-e79a-48af-b3c4-a7586cb4e855', 'volume_name': 'volume-bea78f48-e79a-48af-b3c4-a7586cb4e855', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:43:42 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-6190e907-ee24-4053-9e50-3cebf2953606 tempest-CinderUnicodeTest-501030678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (887976dd-061b-4659-a90e-6b5d17390dfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:43:42 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-6190e907-ee24-4053-9e50-3cebf2953606 tempest-CinderUnicodeTest-501030678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (887976dd-061b-4659-a90e-6b5d17390dfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:43:42 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-6190e907-ee24-4053-9e50-3cebf2953606 tempest-CinderUnicodeTest-501030678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (911e3042-498d-4182-8fdb-c9688f42fb72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:43:42 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-6190e907-ee24-4053-9e50-3cebf2953606 tempest-CinderUnicodeTest-501030678 None] Volume bea78f48-e79a-48af-b3c4-a7586cb4e855: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bea78f48-e79a-48af-b3c4-a7586cb4e855', 'volume_size': 1}
Nov 03 18:43:42 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-6190e907-ee24-4053-9e50-3cebf2953606 tempest-CinderUnicodeTest-501030678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:43:42 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-017015ac-38c4-4e49-8c0a-ac1d4064131a tempest-ProjectMemberTests-453978435 None] Creating offline snapshot 9f77bafd-9127-4370-a18b-d1e6f377b9bf of volume eb0e8916-37a4-44bd-a6d7-8380cd538617 {{(pid=86120) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 18:43:42 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[27513d81-f192-40ad-9ec1-375edafe21a6]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:43:42 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-017015ac-38c4-4e49-8c0a-ac1d4064131a tempest-ProjectMemberTests-453978435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-eb0e8916-37a4-44bd-a6d7-8380cd538617 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:43 devstack sudo[107316]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-eb0e8916-37a4-44bd-a6d7-8380cd538617
Nov 03 18:43:43 devstack sudo[107316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:43 devstack sudo[107316]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:43 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-017015ac-38c4-4e49-8c0a-ac1d4064131a tempest-ProjectMemberTests-453978435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-eb0e8916-37a4-44bd-a6d7-8380cd538617" returned: 0 in 0.393s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:43 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-017015ac-38c4-4e49-8c0a-ac1d4064131a tempest-ProjectMemberTests-453978435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-eb0e8916-37a4-44bd-a6d7-8380cd538617,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-eb0e8916-37a4-44bd-a6d7-8380cd538617.9f77bafd-9127-4370-a18b-d1e6f377b9bf 1G {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:43 devstack sudo[107321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-eb0e8916-37a4-44bd-a6d7-8380cd538617,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-eb0e8916-37a4-44bd-a6d7-8380cd538617.9f77bafd-9127-4370-a18b-d1e6f377b9bf 1G
Nov 03 18:43:43 devstack sudo[107321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:43 devstack sudo[107321]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:43 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-017015ac-38c4-4e49-8c0a-ac1d4064131a tempest-ProjectMemberTests-453978435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-eb0e8916-37a4-44bd-a6d7-8380cd538617,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-eb0e8916-37a4-44bd-a6d7-8380cd538617.9f77bafd-9127-4370-a18b-d1e6f377b9bf 1G" returned: 0 in 0.500s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:43 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-017015ac-38c4-4e49-8c0a-ac1d4064131a tempest-ProjectMemberTests-453978435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb0e8916-37a4-44bd-a6d7-8380cd538617 -F qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-eb0e8916-37a4-44bd-a6d7-8380cd538617.9f77bafd-9127-4370-a18b-d1e6f377b9bf {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:43 devstack sudo[107326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb0e8916-37a4-44bd-a6d7-8380cd538617 -F qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-eb0e8916-37a4-44bd-a6d7-8380cd538617.9f77bafd-9127-4370-a18b-d1e6f377b9bf
Nov 03 18:43:43 devstack sudo[107326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:44 devstack sudo[107326]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:44 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-017015ac-38c4-4e49-8c0a-ac1d4064131a tempest-ProjectMemberTests-453978435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb0e8916-37a4-44bd-a6d7-8380cd538617 -F qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-eb0e8916-37a4-44bd-a6d7-8380cd538617.9f77bafd-9127-4370-a18b-d1e6f377b9bf" returned: 0 in 0.321s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:44 devstack cinder-volume[86120]: WARNING cinder.volume.drivers.remotefs [None req-017015ac-38c4-4e49-8c0a-ac1d4064131a tempest-ProjectMemberTests-453978435 None] /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-eb0e8916-37a4-44bd-a6d7-8380cd538617.9f77bafd-9127-4370-a18b-d1e6f377b9bf is being set with open permissions: ugo+rw
Nov 03 18:43:44 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-017015ac-38c4-4e49-8c0a-ac1d4064131a tempest-ProjectMemberTests-453978435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-eb0e8916-37a4-44bd-a6d7-8380cd538617.9f77bafd-9127-4370-a18b-d1e6f377b9bf {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:44 devstack sudo[107331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-eb0e8916-37a4-44bd-a6d7-8380cd538617.9f77bafd-9127-4370-a18b-d1e6f377b9bf
Nov 03 18:43:44 devstack sudo[107331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:44 devstack sudo[107331]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:44 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-017015ac-38c4-4e49-8c0a-ac1d4064131a tempest-ProjectMemberTests-453978435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-eb0e8916-37a4-44bd-a6d7-8380cd538617.9f77bafd-9127-4370-a18b-d1e6f377b9bf" returned: 0 in 0.265s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:44 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-017015ac-38c4-4e49-8c0a-ac1d4064131a tempest-ProjectMemberTests-453978435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-eb0e8916-37a4-44bd-a6d7-8380cd538617.info {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:44 devstack sudo[107334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-eb0e8916-37a4-44bd-a6d7-8380cd538617.info
Nov 03 18:43:44 devstack sudo[107334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:44 devstack sudo[107334]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:44 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-017015ac-38c4-4e49-8c0a-ac1d4064131a tempest-ProjectMemberTests-453978435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-eb0e8916-37a4-44bd-a6d7-8380cd538617.info" returned: 0 in 0.242s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:44 devstack cinder-volume[86120]: WARNING cinder.volume.drivers.remotefs [None req-017015ac-38c4-4e49-8c0a-ac1d4064131a tempest-ProjectMemberTests-453978435 None] /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-eb0e8916-37a4-44bd-a6d7-8380cd538617.info is being set with open permissions: ugo+rw
Nov 03 18:43:44 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-017015ac-38c4-4e49-8c0a-ac1d4064131a tempest-ProjectMemberTests-453978435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-eb0e8916-37a4-44bd-a6d7-8380cd538617.info {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:44 devstack sudo[107337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-eb0e8916-37a4-44bd-a6d7-8380cd538617.info
Nov 03 18:43:44 devstack sudo[107337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:44 devstack sudo[107337]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:44 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-017015ac-38c4-4e49-8c0a-ac1d4064131a tempest-ProjectMemberTests-453978435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-eb0e8916-37a4-44bd-a6d7-8380cd538617.info" returned: 0 in 0.246s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:44 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-017015ac-38c4-4e49-8c0a-ac1d4064131a tempest-ProjectMemberTests-453978435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.094s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:43:44 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-6190e907-ee24-4053-9e50-3cebf2953606 tempest-CinderUnicodeTest-501030678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.045s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:43:44 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-6190e907-ee24-4053-9e50-3cebf2953606 tempest-CinderUnicodeTest-501030678 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:43:42Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1263647015',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bea78f48-e79a-48af-b3c4-a7586cb4e855,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82996a8e21fc45b7a61716df19d59615',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:43:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:43:43Z,use_quota=True,user_id='70dea3f2a44944fa8b30a5a5c9c838af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:43:44 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-6190e907-ee24-4053-9e50-3cebf2953606 tempest-CinderUnicodeTest-501030678 None] Creating volume bea78f48-e79a-48af-b3c4-a7586cb4e855 {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:43:44 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-6190e907-ee24-4053-9e50-3cebf2953606 tempest-CinderUnicodeTest-501030678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:43:44 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-6190e907-ee24-4053-9e50-3cebf2953606 tempest-CinderUnicodeTest-501030678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:43:44 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-6190e907-ee24-4053-9e50-3cebf2953606 tempest-CinderUnicodeTest-501030678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:43:44 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-6190e907-ee24-4053-9e50-3cebf2953606 tempest-CinderUnicodeTest-501030678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:43:44 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-6190e907-ee24-4053-9e50-3cebf2953606 tempest-CinderUnicodeTest-501030678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:43:44 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-6190e907-ee24-4053-9e50-3cebf2953606 tempest-CinderUnicodeTest-501030678 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:43:44 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-6190e907-ee24-4053-9e50-3cebf2953606 tempest-CinderUnicodeTest-501030678 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:43:44 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-6190e907-ee24-4053-9e50-3cebf2953606 tempest-CinderUnicodeTest-501030678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-bea78f48-e79a-48af-b3c4-a7586cb4e855 1073741824 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:44 devstack sudo[107340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-bea78f48-e79a-48af-b3c4-a7586cb4e855 1073741824
Nov 03 18:43:44 devstack sudo[107340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:44 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-017015ac-38c4-4e49-8c0a-ac1d4064131a tempest-ProjectMemberTests-453978435 None] Create snapshot completed successfully
Nov 03 18:43:45 devstack sudo[107340]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:45 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-6190e907-ee24-4053-9e50-3cebf2953606 tempest-CinderUnicodeTest-501030678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-bea78f48-e79a-48af-b3c4-a7586cb4e855 1073741824" returned: 0 in 0.428s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:45 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-6190e907-ee24-4053-9e50-3cebf2953606 tempest-CinderUnicodeTest-501030678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-bea78f48-e79a-48af-b3c4-a7586cb4e855 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:45 devstack sudo[107346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-bea78f48-e79a-48af-b3c4-a7586cb4e855
Nov 03 18:43:45 devstack sudo[107346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:45 devstack sudo[107346]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:45 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-6190e907-ee24-4053-9e50-3cebf2953606 tempest-CinderUnicodeTest-501030678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-bea78f48-e79a-48af-b3c4-a7586cb4e855" returned: 0 in 0.262s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:45 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-6190e907-ee24-4053-9e50-3cebf2953606 tempest-CinderUnicodeTest-501030678 None] <== create_volume: return (728ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:43:45 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-6190e907-ee24-4053-9e50-3cebf2953606 tempest-CinderUnicodeTest-501030678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.731s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:43:45 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-6190e907-ee24-4053-9e50-3cebf2953606 tempest-CinderUnicodeTest-501030678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (911e3042-498d-4182-8fdb-c9688f42fb72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bea78f48-e79a-48af-b3c4-a7586cb4e855', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:43:45 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-6190e907-ee24-4053-9e50-3cebf2953606 tempest-CinderUnicodeTest-501030678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ca07168-3323-40e1-a104-b967d354b011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:43:45 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-6190e907-ee24-4053-9e50-3cebf2953606 tempest-CinderUnicodeTest-501030678 None] Volume volume-bea78f48-e79a-48af-b3c4-a7586cb4e855 (bea78f48-e79a-48af-b3c4-a7586cb4e855): created successfully
Nov 03 18:43:45 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-6190e907-ee24-4053-9e50-3cebf2953606 tempest-CinderUnicodeTest-501030678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ca07168-3323-40e1-a104-b967d354b011) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:43:45 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-6190e907-ee24-4053-9e50-3cebf2953606 tempest-CinderUnicodeTest-501030678 None] Flow 'volume_create_manager' (fe89002f-b48c-477b-bae4-d0d813a5ead7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:43:45 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-6190e907-ee24-4053-9e50-3cebf2953606 tempest-CinderUnicodeTest-501030678 None] Created volume successfully.
Nov 03 18:43:45 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-f9e97b2f-b1bb-452b-84a0-269d3e99d614 tempest-ProjectMemberTests-453978435 None] Acquiring lock "cinder-9f77bafd-9127-4370-a18b-d1e6f377b9bf-delete_snapshot" by "delete_snapshot" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:43:45 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-f9e97b2f-b1bb-452b-84a0-269d3e99d614 tempest-ProjectMemberTests-453978435 None] Lock "cinder-9f77bafd-9127-4370-a18b-d1e6f377b9bf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:43:45 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-f9e97b2f-b1bb-452b-84a0-269d3e99d614 tempest-ProjectMemberTests-453978435 None] Acquiring lock "cinder-quobyte-eb0e8916-37a4-44bd-a6d7-8380cd538617" by "delete_snapshot" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:43:45 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-f9e97b2f-b1bb-452b-84a0-269d3e99d614 tempest-ProjectMemberTests-453978435 None] Lock "cinder-quobyte-eb0e8916-37a4-44bd-a6d7-8380cd538617" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:43:45 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-f9e97b2f-b1bb-452b-84a0-269d3e99d614 tempest-ProjectMemberTests-453978435 None] Acquiring lock "cinder-quobyte-9f77bafd-9127-4370-a18b-d1e6f377b9bf" by "_delete_snapshot" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:43:45 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-f9e97b2f-b1bb-452b-84a0-269d3e99d614 tempest-ProjectMemberTests-453978435 None] Lock "cinder-quobyte-9f77bafd-9127-4370-a18b-d1e6f377b9bf" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:43:45 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-f9e97b2f-b1bb-452b-84a0-269d3e99d614 tempest-ProjectMemberTests-453978435 None] Deleting offline snapshot 9f77bafd-9127-4370-a18b-d1e6f377b9bf of volume eb0e8916-37a4-44bd-a6d7-8380cd538617 {{(pid=86120) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 18:43:45 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-f9e97b2f-b1bb-452b-84a0-269d3e99d614 tempest-ProjectMemberTests-453978435 None] snapshot_file for this snap is: volume-eb0e8916-37a4-44bd-a6d7-8380cd538617.9f77bafd-9127-4370-a18b-d1e6f377b9bf {{(pid=86120) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 18:43:45 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f95c246-9b26-4580-b5b7-b71b8f265592]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:43:45 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-f9e97b2f-b1bb-452b-84a0-269d3e99d614 tempest-ProjectMemberTests-453978435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-eb0e8916-37a4-44bd-a6d7-8380cd538617.9f77bafd-9127-4370-a18b-d1e6f377b9bf {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:45 devstack sudo[107349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-eb0e8916-37a4-44bd-a6d7-8380cd538617.9f77bafd-9127-4370-a18b-d1e6f377b9bf
Nov 03 18:43:45 devstack sudo[107349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:46 devstack sudo[107349]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:46 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-f9e97b2f-b1bb-452b-84a0-269d3e99d614 tempest-ProjectMemberTests-453978435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-eb0e8916-37a4-44bd-a6d7-8380cd538617.9f77bafd-9127-4370-a18b-d1e6f377b9bf" returned: 0 in 0.357s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:46 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-f9e97b2f-b1bb-452b-84a0-269d3e99d614 tempest-ProjectMemberTests-453978435 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eb0e8916-37a4-44bd-a6d7-8380cd538617(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86120) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 18:43:46 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[0656b44b-1173-4441-a2a7-8e666dd65467]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:43:46 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-f9e97b2f-b1bb-452b-84a0-269d3e99d614 tempest-ProjectMemberTests-453978435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-eb0e8916-37a4-44bd-a6d7-8380cd538617 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:46 devstack sudo[107354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-eb0e8916-37a4-44bd-a6d7-8380cd538617
Nov 03 18:43:46 devstack sudo[107354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:46 devstack sudo[107354]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:46 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-f9e97b2f-b1bb-452b-84a0-269d3e99d614 tempest-ProjectMemberTests-453978435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-eb0e8916-37a4-44bd-a6d7-8380cd538617" returned: 0 in 0.356s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:46 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-f9e97b2f-b1bb-452b-84a0-269d3e99d614 tempest-ProjectMemberTests-453978435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-eb0e8916-37a4-44bd-a6d7-8380cd538617.9f77bafd-9127-4370-a18b-d1e6f377b9bf {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:46 devstack sudo[107359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-eb0e8916-37a4-44bd-a6d7-8380cd538617.9f77bafd-9127-4370-a18b-d1e6f377b9bf
Nov 03 18:43:46 devstack sudo[107359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:46 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-fe96097a-e6e9-4689-a426-36f59e0fd583 tempest-CinderUnicodeTest-501030678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:43:46 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-fe96097a-e6e9-4689-a426-36f59e0fd583 tempest-CinderUnicodeTest-501030678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:43:46 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-fe96097a-e6e9-4689-a426-36f59e0fd583 tempest-CinderUnicodeTest-501030678 None] Creating offline snapshot bba19f22-02f1-4663-b995-6f24a9816243 of volume bea78f48-e79a-48af-b3c4-a7586cb4e855 {{(pid=86120) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 18:43:46 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d90d392-dd09-48e0-990e-1203aca00a0b]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:43:46 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-fe96097a-e6e9-4689-a426-36f59e0fd583 tempest-CinderUnicodeTest-501030678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-bea78f48-e79a-48af-b3c4-a7586cb4e855 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:47 devstack sudo[107359]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:47 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-f9e97b2f-b1bb-452b-84a0-269d3e99d614 tempest-ProjectMemberTests-453978435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-eb0e8916-37a4-44bd-a6d7-8380cd538617.9f77bafd-9127-4370-a18b-d1e6f377b9bf" returned: 0 in 0.384s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:47 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-f9e97b2f-b1bb-452b-84a0-269d3e99d614 tempest-ProjectMemberTests-453978435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-eb0e8916-37a4-44bd-a6d7-8380cd538617.9f77bafd-9127-4370-a18b-d1e6f377b9bf {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:47 devstack sudo[107366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-eb0e8916-37a4-44bd-a6d7-8380cd538617.9f77bafd-9127-4370-a18b-d1e6f377b9bf
Nov 03 18:43:47 devstack sudo[107366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:47 devstack sudo[107365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-bea78f48-e79a-48af-b3c4-a7586cb4e855
Nov 03 18:43:47 devstack sudo[107365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:47 devstack sudo[107366]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:47 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-f9e97b2f-b1bb-452b-84a0-269d3e99d614 tempest-ProjectMemberTests-453978435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-eb0e8916-37a4-44bd-a6d7-8380cd538617.9f77bafd-9127-4370-a18b-d1e6f377b9bf" returned: 0 in 0.257s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:47 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-f9e97b2f-b1bb-452b-84a0-269d3e99d614 tempest-ProjectMemberTests-453978435 None] Lock "cinder-quobyte-9f77bafd-9127-4370-a18b-d1e6f377b9bf" released by "_delete_snapshot" :: held 1.493s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:43:47 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-f9e97b2f-b1bb-452b-84a0-269d3e99d614 tempest-ProjectMemberTests-453978435 None] Lock "cinder-quobyte-eb0e8916-37a4-44bd-a6d7-8380cd538617" released by "delete_snapshot" :: held 1.519s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:43:47 devstack sudo[107365]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:47 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-fe96097a-e6e9-4689-a426-36f59e0fd583 tempest-CinderUnicodeTest-501030678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-bea78f48-e79a-48af-b3c4-a7586cb4e855" returned: 0 in 0.415s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:47 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-fe96097a-e6e9-4689-a426-36f59e0fd583 tempest-CinderUnicodeTest-501030678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-bea78f48-e79a-48af-b3c4-a7586cb4e855,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-bea78f48-e79a-48af-b3c4-a7586cb4e855.bba19f22-02f1-4663-b995-6f24a9816243 1G {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:47 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-f9e97b2f-b1bb-452b-84a0-269d3e99d614 tempest-ProjectMemberTests-453978435 None] Created reservations ['62c6027c-4fb9-4bfa-bd20-28fab0c4dde2', 'df3d4b53-612e-4a4c-8fc6-06cd3b6201c1', 'bb3a6c06-2e92-4cae-b466-cb2cc8284bfc', '956b4f6c-3519-4e54-a44c-e475fb8ce805'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:43:47 devstack sudo[107373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-bea78f48-e79a-48af-b3c4-a7586cb4e855,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-bea78f48-e79a-48af-b3c4-a7586cb4e855.bba19f22-02f1-4663-b995-6f24a9816243 1G
Nov 03 18:43:47 devstack sudo[107373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:47 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-f9e97b2f-b1bb-452b-84a0-269d3e99d614 tempest-ProjectMemberTests-453978435 None] Delete snapshot completed successfully.
Nov 03 18:43:47 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-f9e97b2f-b1bb-452b-84a0-269d3e99d614 tempest-ProjectMemberTests-453978435 None] Lock "cinder-9f77bafd-9127-4370-a18b-d1e6f377b9bf-delete_snapshot" released by "delete_snapshot" :: held 1.697s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:43:47 devstack sudo[107373]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:47 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-fe96097a-e6e9-4689-a426-36f59e0fd583 tempest-CinderUnicodeTest-501030678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-bea78f48-e79a-48af-b3c4-a7586cb4e855,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-bea78f48-e79a-48af-b3c4-a7586cb4e855.bba19f22-02f1-4663-b995-6f24a9816243 1G" returned: 0 in 0.431s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:47 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-fe96097a-e6e9-4689-a426-36f59e0fd583 tempest-CinderUnicodeTest-501030678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bea78f48-e79a-48af-b3c4-a7586cb4e855 -F qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-bea78f48-e79a-48af-b3c4-a7586cb4e855.bba19f22-02f1-4663-b995-6f24a9816243 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:47 devstack sudo[107379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bea78f48-e79a-48af-b3c4-a7586cb4e855 -F qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-bea78f48-e79a-48af-b3c4-a7586cb4e855.bba19f22-02f1-4663-b995-6f24a9816243
Nov 03 18:43:47 devstack sudo[107379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:48 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-cf6f01b9-b2a2-4976-82c8-b5a12a13520a tempest-ProjectMemberTests-453978435 None] Acquiring lock "cinder-eb0e8916-37a4-44bd-a6d7-8380cd538617-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:43:48 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-cf6f01b9-b2a2-4976-82c8-b5a12a13520a tempest-ProjectMemberTests-453978435 None] Lock "cinder-eb0e8916-37a4-44bd-a6d7-8380cd538617-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:43:48 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-cf6f01b9-b2a2-4976-82c8-b5a12a13520a tempest-ProjectMemberTests-453978435 None] Acquiring lock "cinder-quobyte-eb0e8916-37a4-44bd-a6d7-8380cd538617" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:43:48 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-cf6f01b9-b2a2-4976-82c8-b5a12a13520a tempest-ProjectMemberTests-453978435 None] Lock "cinder-quobyte-eb0e8916-37a4-44bd-a6d7-8380cd538617" acquired by "delete_volume" :: waited 0.018s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:43:48 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ae5fcab-3c11-4d24-a5ac-5431a3a2c62c]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:43:48 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-cf6f01b9-b2a2-4976-82c8-b5a12a13520a tempest-ProjectMemberTests-453978435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-eb0e8916-37a4-44bd-a6d7-8380cd538617 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:48 devstack sudo[107379]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:48 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-fe96097a-e6e9-4689-a426-36f59e0fd583 tempest-CinderUnicodeTest-501030678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bea78f48-e79a-48af-b3c4-a7586cb4e855 -F qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-bea78f48-e79a-48af-b3c4-a7586cb4e855.bba19f22-02f1-4663-b995-6f24a9816243" returned: 0 in 0.352s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:48 devstack cinder-volume[86120]: WARNING cinder.volume.drivers.remotefs [None req-fe96097a-e6e9-4689-a426-36f59e0fd583 tempest-CinderUnicodeTest-501030678 None] /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-bea78f48-e79a-48af-b3c4-a7586cb4e855.bba19f22-02f1-4663-b995-6f24a9816243 is being set with open permissions: ugo+rw
Nov 03 18:43:48 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-fe96097a-e6e9-4689-a426-36f59e0fd583 tempest-CinderUnicodeTest-501030678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-bea78f48-e79a-48af-b3c4-a7586cb4e855.bba19f22-02f1-4663-b995-6f24a9816243 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:48 devstack sudo[107385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-bea78f48-e79a-48af-b3c4-a7586cb4e855.bba19f22-02f1-4663-b995-6f24a9816243
Nov 03 18:43:48 devstack sudo[107385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:48 devstack sudo[107384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-eb0e8916-37a4-44bd-a6d7-8380cd538617
Nov 03 18:43:48 devstack sudo[107384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:48 devstack sudo[107385]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:48 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-fe96097a-e6e9-4689-a426-36f59e0fd583 tempest-CinderUnicodeTest-501030678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-bea78f48-e79a-48af-b3c4-a7586cb4e855.bba19f22-02f1-4663-b995-6f24a9816243" returned: 0 in 0.294s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:48 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-fe96097a-e6e9-4689-a426-36f59e0fd583 tempest-CinderUnicodeTest-501030678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-bea78f48-e79a-48af-b3c4-a7586cb4e855.info {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:48 devstack sudo[107391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-bea78f48-e79a-48af-b3c4-a7586cb4e855.info
Nov 03 18:43:48 devstack sudo[107391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:48 devstack sudo[107384]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:48 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-cf6f01b9-b2a2-4976-82c8-b5a12a13520a tempest-ProjectMemberTests-453978435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-eb0e8916-37a4-44bd-a6d7-8380cd538617" returned: 0 in 0.419s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:48 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-cf6f01b9-b2a2-4976-82c8-b5a12a13520a tempest-ProjectMemberTests-453978435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-eb0e8916-37a4-44bd-a6d7-8380cd538617 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:48 devstack sudo[107395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-eb0e8916-37a4-44bd-a6d7-8380cd538617
Nov 03 18:43:48 devstack sudo[107395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:48 devstack sudo[107391]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:48 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-fe96097a-e6e9-4689-a426-36f59e0fd583 tempest-CinderUnicodeTest-501030678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-bea78f48-e79a-48af-b3c4-a7586cb4e855.info" returned: 0 in 0.309s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:48 devstack cinder-volume[86120]: WARNING cinder.volume.drivers.remotefs [None req-fe96097a-e6e9-4689-a426-36f59e0fd583 tempest-CinderUnicodeTest-501030678 None] /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-bea78f48-e79a-48af-b3c4-a7586cb4e855.info is being set with open permissions: ugo+rw
Nov 03 18:43:48 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-fe96097a-e6e9-4689-a426-36f59e0fd583 tempest-CinderUnicodeTest-501030678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-bea78f48-e79a-48af-b3c4-a7586cb4e855.info {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:48 devstack sudo[107399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-bea78f48-e79a-48af-b3c4-a7586cb4e855.info
Nov 03 18:43:48 devstack sudo[107399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:48 devstack sudo[107395]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:48 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-cf6f01b9-b2a2-4976-82c8-b5a12a13520a tempest-ProjectMemberTests-453978435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-eb0e8916-37a4-44bd-a6d7-8380cd538617" returned: 0 in 0.295s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:48 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-cf6f01b9-b2a2-4976-82c8-b5a12a13520a tempest-ProjectMemberTests-453978435 None] Lock "cinder-quobyte-eb0e8916-37a4-44bd-a6d7-8380cd538617" released by "delete_volume" :: held 0.795s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:43:48 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-cf6f01b9-b2a2-4976-82c8-b5a12a13520a tempest-ProjectMemberTests-453978435 None] Created reservations ['48dd8d83-0c0c-4fc0-a34e-e329dc1778c7', '05674488-62ae-40bf-8a6c-013f8f19075d', '4e56c147-b9c8-4635-ab9b-9e512d953a1a', 'a4a709ec-3778-4372-bb90-794f1e6c0c24'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:43:49 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-cf6f01b9-b2a2-4976-82c8-b5a12a13520a tempest-ProjectMemberTests-453978435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:43:49 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-cf6f01b9-b2a2-4976-82c8-b5a12a13520a tempest-ProjectMemberTests-453978435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:43:49 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-cf6f01b9-b2a2-4976-82c8-b5a12a13520a tempest-ProjectMemberTests-453978435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:43:49 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-cf6f01b9-b2a2-4976-82c8-b5a12a13520a tempest-ProjectMemberTests-453978435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:43:49 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-cf6f01b9-b2a2-4976-82c8-b5a12a13520a tempest-ProjectMemberTests-453978435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:43:49 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-cf6f01b9-b2a2-4976-82c8-b5a12a13520a tempest-ProjectMemberTests-453978435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:49 devstack sudo[107402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:43:49 devstack sudo[107402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:49 devstack sudo[107399]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:49 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-fe96097a-e6e9-4689-a426-36f59e0fd583 tempest-CinderUnicodeTest-501030678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-bea78f48-e79a-48af-b3c4-a7586cb4e855.info" returned: 0 in 0.282s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:49 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-fe96097a-e6e9-4689-a426-36f59e0fd583 tempest-CinderUnicodeTest-501030678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.194s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:43:49 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-fe96097a-e6e9-4689-a426-36f59e0fd583 tempest-CinderUnicodeTest-501030678 None] Create snapshot completed successfully
Nov 03 18:43:49 devstack sudo[107402]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:49 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-cf6f01b9-b2a2-4976-82c8-b5a12a13520a tempest-ProjectMemberTests-453978435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.277s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:49 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-cf6f01b9-b2a2-4976-82c8-b5a12a13520a tempest-ProjectMemberTests-453978435 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:43:49 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-cf6f01b9-b2a2-4976-82c8-b5a12a13520a tempest-ProjectMemberTests-453978435 None] Deleted volume successfully.
Nov 03 18:43:49 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-cf6f01b9-b2a2-4976-82c8-b5a12a13520a tempest-ProjectMemberTests-453978435 None] Lock "cinder-eb0e8916-37a4-44bd-a6d7-8380cd538617-delete_volume" released by "delete_volume" :: held 1.327s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:43:49 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-576ca81a-81d9-461f-9993-62cf500c783b tempest-ProjectMemberTests-453978435 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:43:49 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-576ca81a-81d9-461f-9993-62cf500c783b tempest-ProjectMemberTests-453978435 None] Flow 'volume_create_manager' (5446f652-5226-4cdb-8a5b-8e4d71a0ca0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:43:49 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-576ca81a-81d9-461f-9993-62cf500c783b tempest-ProjectMemberTests-453978435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69ddce16-cbf3-41c8-9af2-5cd528f15d5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:43:49 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-576ca81a-81d9-461f-9993-62cf500c783b tempest-ProjectMemberTests-453978435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69ddce16-cbf3-41c8-9af2-5cd528f15d5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:43:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-610528665',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f253bb63-eb97-4a2c-be63-ca3578df64cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac23a66460684cf18a0ec466545c9237',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:43:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:43:50Z,use_quota=True,user_id='1e72acdc7ff048f4b0d1e488804038f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:43:49 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-576ca81a-81d9-461f-9993-62cf500c783b tempest-ProjectMemberTests-453978435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dce04270-1b37-4136-91c5-ca965335a8ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:43:49 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-576ca81a-81d9-461f-9993-62cf500c783b tempest-ProjectMemberTests-453978435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dce04270-1b37-4136-91c5-ca965335a8ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:43:49 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-576ca81a-81d9-461f-9993-62cf500c783b tempest-ProjectMemberTests-453978435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b459f4d-1370-463e-886e-de4c29d4f0ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:43:49 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-576ca81a-81d9-461f-9993-62cf500c783b tempest-ProjectMemberTests-453978435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b459f4d-1370-463e-886e-de4c29d4f0ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f253bb63-eb97-4a2c-be63-ca3578df64cc', 'volume_name': 'volume-f253bb63-eb97-4a2c-be63-ca3578df64cc', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:43:49 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-576ca81a-81d9-461f-9993-62cf500c783b tempest-ProjectMemberTests-453978435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (485d53d5-657b-47cb-ae80-10bf08515a63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:43:49 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-576ca81a-81d9-461f-9993-62cf500c783b tempest-ProjectMemberTests-453978435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (485d53d5-657b-47cb-ae80-10bf08515a63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:43:49 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-576ca81a-81d9-461f-9993-62cf500c783b tempest-ProjectMemberTests-453978435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2681922b-64e5-4eaa-b2fd-b2a77ae444c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:43:49 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-576ca81a-81d9-461f-9993-62cf500c783b tempest-ProjectMemberTests-453978435 None] Volume f253bb63-eb97-4a2c-be63-ca3578df64cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f253bb63-eb97-4a2c-be63-ca3578df64cc', 'volume_size': 1}
Nov 03 18:43:49 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-576ca81a-81d9-461f-9993-62cf500c783b tempest-ProjectMemberTests-453978435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:43:49 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-576ca81a-81d9-461f-9993-62cf500c783b tempest-ProjectMemberTests-453978435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:43:49 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-576ca81a-81d9-461f-9993-62cf500c783b tempest-ProjectMemberTests-453978435 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:43:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-610528665',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f253bb63-eb97-4a2c-be63-ca3578df64cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac23a66460684cf18a0ec466545c9237',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:43:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:43:50Z,use_quota=True,user_id='1e72acdc7ff048f4b0d1e488804038f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:43:49 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-576ca81a-81d9-461f-9993-62cf500c783b tempest-ProjectMemberTests-453978435 None] Creating volume f253bb63-eb97-4a2c-be63-ca3578df64cc {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:43:49 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-576ca81a-81d9-461f-9993-62cf500c783b tempest-ProjectMemberTests-453978435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:43:49 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-576ca81a-81d9-461f-9993-62cf500c783b tempest-ProjectMemberTests-453978435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:43:49 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-576ca81a-81d9-461f-9993-62cf500c783b tempest-ProjectMemberTests-453978435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:43:49 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-576ca81a-81d9-461f-9993-62cf500c783b tempest-ProjectMemberTests-453978435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:43:49 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-576ca81a-81d9-461f-9993-62cf500c783b tempest-ProjectMemberTests-453978435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:43:49 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-576ca81a-81d9-461f-9993-62cf500c783b tempest-ProjectMemberTests-453978435 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:43:49 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-576ca81a-81d9-461f-9993-62cf500c783b tempest-ProjectMemberTests-453978435 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:43:49 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-576ca81a-81d9-461f-9993-62cf500c783b tempest-ProjectMemberTests-453978435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f253bb63-eb97-4a2c-be63-ca3578df64cc 1073741824 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:49 devstack sudo[107406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f253bb63-eb97-4a2c-be63-ca3578df64cc 1073741824
Nov 03 18:43:49 devstack sudo[107406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:50 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-b9114b74-6c12-45d2-9250-39d79d0743f1 tempest-CinderUnicodeTest-501030678 None] Acquiring lock "cinder-bba19f22-02f1-4663-b995-6f24a9816243-delete_snapshot" by "delete_snapshot" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:43:50 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-b9114b74-6c12-45d2-9250-39d79d0743f1 tempest-CinderUnicodeTest-501030678 None] Lock "cinder-bba19f22-02f1-4663-b995-6f24a9816243-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:43:50 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-b9114b74-6c12-45d2-9250-39d79d0743f1 tempest-CinderUnicodeTest-501030678 None] Acquiring lock "cinder-quobyte-bea78f48-e79a-48af-b3c4-a7586cb4e855" by "delete_snapshot" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:43:50 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-b9114b74-6c12-45d2-9250-39d79d0743f1 tempest-CinderUnicodeTest-501030678 None] Lock "cinder-quobyte-bea78f48-e79a-48af-b3c4-a7586cb4e855" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:43:50 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-b9114b74-6c12-45d2-9250-39d79d0743f1 tempest-CinderUnicodeTest-501030678 None] Acquiring lock "cinder-quobyte-bba19f22-02f1-4663-b995-6f24a9816243" by "_delete_snapshot" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:43:50 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-b9114b74-6c12-45d2-9250-39d79d0743f1 tempest-CinderUnicodeTest-501030678 None] Lock "cinder-quobyte-bba19f22-02f1-4663-b995-6f24a9816243" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:43:50 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-b9114b74-6c12-45d2-9250-39d79d0743f1 tempest-CinderUnicodeTest-501030678 None] Deleting offline snapshot bba19f22-02f1-4663-b995-6f24a9816243 of volume bea78f48-e79a-48af-b3c4-a7586cb4e855 {{(pid=86120) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 18:43:50 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-b9114b74-6c12-45d2-9250-39d79d0743f1 tempest-CinderUnicodeTest-501030678 None] snapshot_file for this snap is: volume-bea78f48-e79a-48af-b3c4-a7586cb4e855.bba19f22-02f1-4663-b995-6f24a9816243 {{(pid=86120) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 18:43:50 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c45e478-8432-4cd2-9cbb-6ae82ed44b3f]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:43:50 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b9114b74-6c12-45d2-9250-39d79d0743f1 tempest-CinderUnicodeTest-501030678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-bea78f48-e79a-48af-b3c4-a7586cb4e855.bba19f22-02f1-4663-b995-6f24a9816243 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:50 devstack sudo[107406]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:50 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-576ca81a-81d9-461f-9993-62cf500c783b tempest-ProjectMemberTests-453978435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f253bb63-eb97-4a2c-be63-ca3578df64cc 1073741824" returned: 0 in 0.531s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:50 devstack sudo[107412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-bea78f48-e79a-48af-b3c4-a7586cb4e855.bba19f22-02f1-4663-b995-6f24a9816243
Nov 03 18:43:50 devstack sudo[107412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:50 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-576ca81a-81d9-461f-9993-62cf500c783b tempest-ProjectMemberTests-453978435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f253bb63-eb97-4a2c-be63-ca3578df64cc {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:50 devstack sudo[107414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f253bb63-eb97-4a2c-be63-ca3578df64cc
Nov 03 18:43:50 devstack sudo[107414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:50 devstack sudo[107414]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:50 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-576ca81a-81d9-461f-9993-62cf500c783b tempest-ProjectMemberTests-453978435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f253bb63-eb97-4a2c-be63-ca3578df64cc" returned: 0 in 0.266s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:50 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-576ca81a-81d9-461f-9993-62cf500c783b tempest-ProjectMemberTests-453978435 None] <== create_volume: return (868ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:43:50 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-576ca81a-81d9-461f-9993-62cf500c783b tempest-ProjectMemberTests-453978435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.872s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:43:50 devstack sudo[107412]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:50 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-576ca81a-81d9-461f-9993-62cf500c783b tempest-ProjectMemberTests-453978435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2681922b-64e5-4eaa-b2fd-b2a77ae444c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f253bb63-eb97-4a2c-be63-ca3578df64cc', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:43:50 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-576ca81a-81d9-461f-9993-62cf500c783b tempest-ProjectMemberTests-453978435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (358c3425-e871-4ec5-89ae-77f326a71077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:43:50 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b9114b74-6c12-45d2-9250-39d79d0743f1 tempest-CinderUnicodeTest-501030678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-bea78f48-e79a-48af-b3c4-a7586cb4e855.bba19f22-02f1-4663-b995-6f24a9816243" returned: 0 in 0.446s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:50 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-b9114b74-6c12-45d2-9250-39d79d0743f1 tempest-CinderUnicodeTest-501030678 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bea78f48-e79a-48af-b3c4-a7586cb4e855(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86120) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 18:43:50 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-576ca81a-81d9-461f-9993-62cf500c783b tempest-ProjectMemberTests-453978435 None] Volume volume-f253bb63-eb97-4a2c-be63-ca3578df64cc (f253bb63-eb97-4a2c-be63-ca3578df64cc): created successfully
Nov 03 18:43:50 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-576ca81a-81d9-461f-9993-62cf500c783b tempest-ProjectMemberTests-453978435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (358c3425-e871-4ec5-89ae-77f326a71077) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:43:50 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-576ca81a-81d9-461f-9993-62cf500c783b tempest-ProjectMemberTests-453978435 None] Flow 'volume_create_manager' (5446f652-5226-4cdb-8a5b-8e4d71a0ca0a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:43:50 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c1337ba-b4d5-4c24-858d-0380463b4bc7]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:43:50 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b9114b74-6c12-45d2-9250-39d79d0743f1 tempest-CinderUnicodeTest-501030678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-bea78f48-e79a-48af-b3c4-a7586cb4e855 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:50 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-576ca81a-81d9-461f-9993-62cf500c783b tempest-ProjectMemberTests-453978435 None] Created volume successfully.
Nov 03 18:43:50 devstack sudo[107420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-bea78f48-e79a-48af-b3c4-a7586cb4e855
Nov 03 18:43:50 devstack sudo[107420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:51 devstack sudo[107420]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:51 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b9114b74-6c12-45d2-9250-39d79d0743f1 tempest-CinderUnicodeTest-501030678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-bea78f48-e79a-48af-b3c4-a7586cb4e855" returned: 0 in 0.387s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:51 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b9114b74-6c12-45d2-9250-39d79d0743f1 tempest-CinderUnicodeTest-501030678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-bea78f48-e79a-48af-b3c4-a7586cb4e855.bba19f22-02f1-4663-b995-6f24a9816243 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:51 devstack sudo[107426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-bea78f48-e79a-48af-b3c4-a7586cb4e855.bba19f22-02f1-4663-b995-6f24a9816243
Nov 03 18:43:51 devstack sudo[107426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:51 devstack sudo[107426]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:51 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b9114b74-6c12-45d2-9250-39d79d0743f1 tempest-CinderUnicodeTest-501030678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-bea78f48-e79a-48af-b3c4-a7586cb4e855.bba19f22-02f1-4663-b995-6f24a9816243" returned: 0 in 0.349s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:51 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b9114b74-6c12-45d2-9250-39d79d0743f1 tempest-CinderUnicodeTest-501030678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-bea78f48-e79a-48af-b3c4-a7586cb4e855.bba19f22-02f1-4663-b995-6f24a9816243 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:51 devstack sudo[107432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-bea78f48-e79a-48af-b3c4-a7586cb4e855.bba19f22-02f1-4663-b995-6f24a9816243
Nov 03 18:43:51 devstack sudo[107432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:51 devstack sudo[107432]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:51 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b9114b74-6c12-45d2-9250-39d79d0743f1 tempest-CinderUnicodeTest-501030678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-bea78f48-e79a-48af-b3c4-a7586cb4e855.bba19f22-02f1-4663-b995-6f24a9816243" returned: 0 in 0.269s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:51 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-b9114b74-6c12-45d2-9250-39d79d0743f1 tempest-CinderUnicodeTest-501030678 None] Lock "cinder-quobyte-bba19f22-02f1-4663-b995-6f24a9816243" released by "_delete_snapshot" :: held 1.592s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:43:51 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-b9114b74-6c12-45d2-9250-39d79d0743f1 tempest-CinderUnicodeTest-501030678 None] Lock "cinder-quobyte-bea78f48-e79a-48af-b3c4-a7586cb4e855" released by "delete_snapshot" :: held 1.622s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:43:51 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-b9114b74-6c12-45d2-9250-39d79d0743f1 tempest-CinderUnicodeTest-501030678 None] Created reservations ['062a8f99-9925-4845-970d-d44c0c621fb9', 'dcf0f0f1-81d5-4bb6-9884-2cf146648696', '5c3147c4-a153-4b49-bb1b-33a972288c95', '01fbba27-eeec-490a-8299-dcad47696c67'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:43:51 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-b9114b74-6c12-45d2-9250-39d79d0743f1 tempest-CinderUnicodeTest-501030678 None] Delete snapshot completed successfully.
Nov 03 18:43:51 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-b9114b74-6c12-45d2-9250-39d79d0743f1 tempest-CinderUnicodeTest-501030678 None] Lock "cinder-bba19f22-02f1-4663-b995-6f24a9816243-delete_snapshot" released by "delete_snapshot" :: held 1.801s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:43:52 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-c6a5e265-fc7f-4c25-ab3d-19421f1b03d9 tempest-ProjectMemberTests-453978435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:43:52 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-c6a5e265-fc7f-4c25-ab3d-19421f1b03d9 tempest-ProjectMemberTests-453978435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:43:52 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-c6a5e265-fc7f-4c25-ab3d-19421f1b03d9 tempest-ProjectMemberTests-453978435 None] Creating offline snapshot 50547ba2-c8a9-4f9f-aacc-928d2f472c93 of volume f253bb63-eb97-4a2c-be63-ca3578df64cc {{(pid=86120) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 18:43:52 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[5585336c-c9b1-4be5-b7ce-0c52a49bc11d]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:43:52 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-c6a5e265-fc7f-4c25-ab3d-19421f1b03d9 tempest-ProjectMemberTests-453978435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f253bb63-eb97-4a2c-be63-ca3578df64cc {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:52 devstack sudo[107435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f253bb63-eb97-4a2c-be63-ca3578df64cc
Nov 03 18:43:52 devstack sudo[107435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:52 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-3c718d1b-d216-46b7-a806-bb29a1fc5d43 tempest-CinderUnicodeTest-501030678 None] Acquiring lock "cinder-bea78f48-e79a-48af-b3c4-a7586cb4e855-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:43:52 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-3c718d1b-d216-46b7-a806-bb29a1fc5d43 tempest-CinderUnicodeTest-501030678 None] Lock "cinder-bea78f48-e79a-48af-b3c4-a7586cb4e855-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:43:52 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-3c718d1b-d216-46b7-a806-bb29a1fc5d43 tempest-CinderUnicodeTest-501030678 None] Acquiring lock "cinder-quobyte-bea78f48-e79a-48af-b3c4-a7586cb4e855" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:43:52 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-3c718d1b-d216-46b7-a806-bb29a1fc5d43 tempest-CinderUnicodeTest-501030678 None] Lock "cinder-quobyte-bea78f48-e79a-48af-b3c4-a7586cb4e855" acquired by "delete_volume" :: waited 0.017s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:43:52 devstack sudo[107435]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:52 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[e43bca13-95f3-4193-8396-befc26583f8c]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:43:52 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-3c718d1b-d216-46b7-a806-bb29a1fc5d43 tempest-CinderUnicodeTest-501030678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-bea78f48-e79a-48af-b3c4-a7586cb4e855 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:52 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-c6a5e265-fc7f-4c25-ab3d-19421f1b03d9 tempest-ProjectMemberTests-453978435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f253bb63-eb97-4a2c-be63-ca3578df64cc" returned: 0 in 0.425s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:52 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-c6a5e265-fc7f-4c25-ab3d-19421f1b03d9 tempest-ProjectMemberTests-453978435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f253bb63-eb97-4a2c-be63-ca3578df64cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f253bb63-eb97-4a2c-be63-ca3578df64cc.50547ba2-c8a9-4f9f-aacc-928d2f472c93 1G {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:52 devstack sudo[107441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f253bb63-eb97-4a2c-be63-ca3578df64cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f253bb63-eb97-4a2c-be63-ca3578df64cc.50547ba2-c8a9-4f9f-aacc-928d2f472c93 1G
Nov 03 18:43:52 devstack sudo[107441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:52 devstack sudo[107440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-bea78f48-e79a-48af-b3c4-a7586cb4e855
Nov 03 18:43:52 devstack sudo[107440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:52 devstack sudo[107440]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:52 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-3c718d1b-d216-46b7-a806-bb29a1fc5d43 tempest-CinderUnicodeTest-501030678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-bea78f48-e79a-48af-b3c4-a7586cb4e855" returned: 0 in 0.393s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:52 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-3c718d1b-d216-46b7-a806-bb29a1fc5d43 tempest-CinderUnicodeTest-501030678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-bea78f48-e79a-48af-b3c4-a7586cb4e855 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:52 devstack sudo[107450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-bea78f48-e79a-48af-b3c4-a7586cb4e855
Nov 03 18:43:52 devstack sudo[107450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:53 devstack sudo[107441]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:53 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-c6a5e265-fc7f-4c25-ab3d-19421f1b03d9 tempest-ProjectMemberTests-453978435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f253bb63-eb97-4a2c-be63-ca3578df64cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f253bb63-eb97-4a2c-be63-ca3578df64cc.50547ba2-c8a9-4f9f-aacc-928d2f472c93 1G" returned: 0 in 0.572s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:53 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-c6a5e265-fc7f-4c25-ab3d-19421f1b03d9 tempest-ProjectMemberTests-453978435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f253bb63-eb97-4a2c-be63-ca3578df64cc -F qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f253bb63-eb97-4a2c-be63-ca3578df64cc.50547ba2-c8a9-4f9f-aacc-928d2f472c93 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:53 devstack sudo[107453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f253bb63-eb97-4a2c-be63-ca3578df64cc -F qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f253bb63-eb97-4a2c-be63-ca3578df64cc.50547ba2-c8a9-4f9f-aacc-928d2f472c93
Nov 03 18:43:53 devstack sudo[107453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:53 devstack sudo[107450]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:53 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-3c718d1b-d216-46b7-a806-bb29a1fc5d43 tempest-CinderUnicodeTest-501030678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-bea78f48-e79a-48af-b3c4-a7586cb4e855" returned: 0 in 0.326s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:53 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-3c718d1b-d216-46b7-a806-bb29a1fc5d43 tempest-CinderUnicodeTest-501030678 None] Lock "cinder-quobyte-bea78f48-e79a-48af-b3c4-a7586cb4e855" released by "delete_volume" :: held 0.809s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:43:53 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-3c718d1b-d216-46b7-a806-bb29a1fc5d43 tempest-CinderUnicodeTest-501030678 None] Created reservations ['334237f9-d268-4fb6-a76f-d0aa5a1d4728', '722a6b53-3fff-40a2-8bd4-398d895e2893', '6dd4a598-9015-4389-9a0e-b7fe44bfb6ca', '6c4ef086-33c5-46d2-930e-0a1e9bd7c6e8'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:43:53 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-3c718d1b-d216-46b7-a806-bb29a1fc5d43 tempest-CinderUnicodeTest-501030678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:43:53 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-3c718d1b-d216-46b7-a806-bb29a1fc5d43 tempest-CinderUnicodeTest-501030678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:43:53 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-3c718d1b-d216-46b7-a806-bb29a1fc5d43 tempest-CinderUnicodeTest-501030678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:43:53 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-3c718d1b-d216-46b7-a806-bb29a1fc5d43 tempest-CinderUnicodeTest-501030678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:43:53 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-3c718d1b-d216-46b7-a806-bb29a1fc5d43 tempest-CinderUnicodeTest-501030678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:43:53 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-3c718d1b-d216-46b7-a806-bb29a1fc5d43 tempest-CinderUnicodeTest-501030678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:53 devstack sudo[107453]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:53 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-c6a5e265-fc7f-4c25-ab3d-19421f1b03d9 tempest-ProjectMemberTests-453978435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f253bb63-eb97-4a2c-be63-ca3578df64cc -F qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f253bb63-eb97-4a2c-be63-ca3578df64cc.50547ba2-c8a9-4f9f-aacc-928d2f472c93" returned: 0 in 0.353s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:53 devstack cinder-volume[86120]: WARNING cinder.volume.drivers.remotefs [None req-c6a5e265-fc7f-4c25-ab3d-19421f1b03d9 tempest-ProjectMemberTests-453978435 None] /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f253bb63-eb97-4a2c-be63-ca3578df64cc.50547ba2-c8a9-4f9f-aacc-928d2f472c93 is being set with open permissions: ugo+rw
Nov 03 18:43:53 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-c6a5e265-fc7f-4c25-ab3d-19421f1b03d9 tempest-ProjectMemberTests-453978435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f253bb63-eb97-4a2c-be63-ca3578df64cc.50547ba2-c8a9-4f9f-aacc-928d2f472c93 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:53 devstack sudo[107460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:43:53 devstack sudo[107460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:53 devstack sudo[107462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f253bb63-eb97-4a2c-be63-ca3578df64cc.50547ba2-c8a9-4f9f-aacc-928d2f472c93
Nov 03 18:43:53 devstack sudo[107462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:53 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-8781708d-b3c6-400e-9634-c00150b90e02 tempest-CinderUnicodeTest-501030678 None] Acquiring lock "cinder-9b4470f0-4d03-412f-b5b9-6672df3bee78-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:43:53 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-8781708d-b3c6-400e-9634-c00150b90e02 tempest-CinderUnicodeTest-501030678 None] Lock "cinder-9b4470f0-4d03-412f-b5b9-6672df3bee78-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:43:53 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-8781708d-b3c6-400e-9634-c00150b90e02 tempest-CinderUnicodeTest-501030678 None] Acquiring lock "cinder-quobyte-9b4470f0-4d03-412f-b5b9-6672df3bee78" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:43:53 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-8781708d-b3c6-400e-9634-c00150b90e02 tempest-CinderUnicodeTest-501030678 None] Lock "cinder-quobyte-9b4470f0-4d03-412f-b5b9-6672df3bee78" acquired by "delete_volume" :: waited 0.019s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:43:53 devstack sudo[107460]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:53 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-3c718d1b-d216-46b7-a806-bb29a1fc5d43 tempest-CinderUnicodeTest-501030678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.308s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:53 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-3c718d1b-d216-46b7-a806-bb29a1fc5d43 tempest-CinderUnicodeTest-501030678 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:43:53 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-3c718d1b-d216-46b7-a806-bb29a1fc5d43 tempest-CinderUnicodeTest-501030678 None] Deleted volume successfully.
Nov 03 18:43:53 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[38d7da08-01df-496b-8e51-602f04cb25af]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:43:53 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-8781708d-b3c6-400e-9634-c00150b90e02 tempest-CinderUnicodeTest-501030678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-9b4470f0-4d03-412f-b5b9-6672df3bee78 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:53 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-3c718d1b-d216-46b7-a806-bb29a1fc5d43 tempest-CinderUnicodeTest-501030678 None] Lock "cinder-bea78f48-e79a-48af-b3c4-a7586cb4e855-delete_volume" released by "delete_volume" :: held 1.391s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:43:53 devstack sudo[107462]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:53 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-c6a5e265-fc7f-4c25-ab3d-19421f1b03d9 tempest-ProjectMemberTests-453978435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f253bb63-eb97-4a2c-be63-ca3578df64cc.50547ba2-c8a9-4f9f-aacc-928d2f472c93" returned: 0 in 0.354s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:53 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-c6a5e265-fc7f-4c25-ab3d-19421f1b03d9 tempest-ProjectMemberTests-453978435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f253bb63-eb97-4a2c-be63-ca3578df64cc.info {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:53 devstack sudo[107467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f253bb63-eb97-4a2c-be63-ca3578df64cc.info
Nov 03 18:43:53 devstack sudo[107467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:53 devstack sudo[107466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-9b4470f0-4d03-412f-b5b9-6672df3bee78
Nov 03 18:43:53 devstack sudo[107466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:54 devstack sudo[107467]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:54 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-c6a5e265-fc7f-4c25-ab3d-19421f1b03d9 tempest-ProjectMemberTests-453978435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f253bb63-eb97-4a2c-be63-ca3578df64cc.info" returned: 0 in 0.301s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:54 devstack cinder-volume[86120]: WARNING cinder.volume.drivers.remotefs [None req-c6a5e265-fc7f-4c25-ab3d-19421f1b03d9 tempest-ProjectMemberTests-453978435 None] /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f253bb63-eb97-4a2c-be63-ca3578df64cc.info is being set with open permissions: ugo+rw
Nov 03 18:43:54 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-c6a5e265-fc7f-4c25-ab3d-19421f1b03d9 tempest-ProjectMemberTests-453978435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f253bb63-eb97-4a2c-be63-ca3578df64cc.info {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:54 devstack sudo[107474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f253bb63-eb97-4a2c-be63-ca3578df64cc.info
Nov 03 18:43:54 devstack sudo[107474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:54 devstack sudo[107466]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:54 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-8781708d-b3c6-400e-9634-c00150b90e02 tempest-CinderUnicodeTest-501030678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-9b4470f0-4d03-412f-b5b9-6672df3bee78" returned: 0 in 0.423s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:54 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-8781708d-b3c6-400e-9634-c00150b90e02 tempest-CinderUnicodeTest-501030678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-9b4470f0-4d03-412f-b5b9-6672df3bee78 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:54 devstack sudo[107476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-9b4470f0-4d03-412f-b5b9-6672df3bee78
Nov 03 18:43:54 devstack sudo[107476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:54 devstack sudo[107474]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:54 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-c6a5e265-fc7f-4c25-ab3d-19421f1b03d9 tempest-ProjectMemberTests-453978435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f253bb63-eb97-4a2c-be63-ca3578df64cc.info" returned: 0 in 0.258s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:54 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-c6a5e265-fc7f-4c25-ab3d-19421f1b03d9 tempest-ProjectMemberTests-453978435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.358s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:43:54 devstack sudo[107476]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:54 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-8781708d-b3c6-400e-9634-c00150b90e02 tempest-CinderUnicodeTest-501030678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-9b4470f0-4d03-412f-b5b9-6672df3bee78" returned: 0 in 0.271s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:54 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-c6a5e265-fc7f-4c25-ab3d-19421f1b03d9 tempest-ProjectMemberTests-453978435 None] Create snapshot completed successfully
Nov 03 18:43:54 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-8781708d-b3c6-400e-9634-c00150b90e02 tempest-CinderUnicodeTest-501030678 None] Lock "cinder-quobyte-9b4470f0-4d03-412f-b5b9-6672df3bee78" released by "delete_volume" :: held 0.767s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:43:54 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-8781708d-b3c6-400e-9634-c00150b90e02 tempest-CinderUnicodeTest-501030678 None] Created reservations ['0f5ad404-d1e1-4d35-a36d-a13e3be694d6', 'b23ce1e0-07ec-4b6c-983d-30f40af5e096', 'd7d6bbd3-479e-4277-9d40-6a6e282c04d9', '1eb6b2dd-3f35-4633-982f-cbe4bd6ce085'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:43:54 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-8781708d-b3c6-400e-9634-c00150b90e02 tempest-CinderUnicodeTest-501030678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:43:54 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-8781708d-b3c6-400e-9634-c00150b90e02 tempest-CinderUnicodeTest-501030678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:43:54 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-8781708d-b3c6-400e-9634-c00150b90e02 tempest-CinderUnicodeTest-501030678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:43:54 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-8781708d-b3c6-400e-9634-c00150b90e02 tempest-CinderUnicodeTest-501030678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:43:54 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-8781708d-b3c6-400e-9634-c00150b90e02 tempest-CinderUnicodeTest-501030678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:43:54 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-8781708d-b3c6-400e-9634-c00150b90e02 tempest-CinderUnicodeTest-501030678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:54 devstack sudo[107480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:43:54 devstack sudo[107480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:54 devstack sudo[107480]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:54 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-8781708d-b3c6-400e-9634-c00150b90e02 tempest-CinderUnicodeTest-501030678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.284s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:54 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-8781708d-b3c6-400e-9634-c00150b90e02 tempest-CinderUnicodeTest-501030678 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:43:54 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-8781708d-b3c6-400e-9634-c00150b90e02 tempest-CinderUnicodeTest-501030678 None] Deleted volume successfully.
Nov 03 18:43:54 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-8781708d-b3c6-400e-9634-c00150b90e02 tempest-CinderUnicodeTest-501030678 None] Lock "cinder-9b4470f0-4d03-412f-b5b9-6672df3bee78-delete_volume" released by "delete_volume" :: held 1.286s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:43:55 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-e72dca6c-1dc5-4685-9276-c95b4abdd0c3 tempest-ProjectMemberTests-453978435 None] Acquiring lock "cinder-50547ba2-c8a9-4f9f-aacc-928d2f472c93-delete_snapshot" by "delete_snapshot" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:43:55 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-e72dca6c-1dc5-4685-9276-c95b4abdd0c3 tempest-ProjectMemberTests-453978435 None] Lock "cinder-50547ba2-c8a9-4f9f-aacc-928d2f472c93-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:43:55 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-e72dca6c-1dc5-4685-9276-c95b4abdd0c3 tempest-ProjectMemberTests-453978435 None] Acquiring lock "cinder-quobyte-f253bb63-eb97-4a2c-be63-ca3578df64cc" by "delete_snapshot" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:43:55 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-e72dca6c-1dc5-4685-9276-c95b4abdd0c3 tempest-ProjectMemberTests-453978435 None] Lock "cinder-quobyte-f253bb63-eb97-4a2c-be63-ca3578df64cc" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:43:55 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-e72dca6c-1dc5-4685-9276-c95b4abdd0c3 tempest-ProjectMemberTests-453978435 None] Acquiring lock "cinder-quobyte-50547ba2-c8a9-4f9f-aacc-928d2f472c93" by "_delete_snapshot" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:43:55 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-e72dca6c-1dc5-4685-9276-c95b4abdd0c3 tempest-ProjectMemberTests-453978435 None] Lock "cinder-quobyte-50547ba2-c8a9-4f9f-aacc-928d2f472c93" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:43:55 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-e72dca6c-1dc5-4685-9276-c95b4abdd0c3 tempest-ProjectMemberTests-453978435 None] Deleting offline snapshot 50547ba2-c8a9-4f9f-aacc-928d2f472c93 of volume f253bb63-eb97-4a2c-be63-ca3578df64cc {{(pid=86120) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 18:43:55 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-e72dca6c-1dc5-4685-9276-c95b4abdd0c3 tempest-ProjectMemberTests-453978435 None] snapshot_file for this snap is: volume-f253bb63-eb97-4a2c-be63-ca3578df64cc.50547ba2-c8a9-4f9f-aacc-928d2f472c93 {{(pid=86120) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 18:43:55 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e7a7579-8685-4407-8089-11ed472b7e26]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:43:55 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-e72dca6c-1dc5-4685-9276-c95b4abdd0c3 tempest-ProjectMemberTests-453978435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f253bb63-eb97-4a2c-be63-ca3578df64cc.50547ba2-c8a9-4f9f-aacc-928d2f472c93 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:55 devstack sudo[107483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f253bb63-eb97-4a2c-be63-ca3578df64cc.50547ba2-c8a9-4f9f-aacc-928d2f472c93
Nov 03 18:43:55 devstack sudo[107483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:55 devstack sudo[107483]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:55 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-e72dca6c-1dc5-4685-9276-c95b4abdd0c3 tempest-ProjectMemberTests-453978435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f253bb63-eb97-4a2c-be63-ca3578df64cc.50547ba2-c8a9-4f9f-aacc-928d2f472c93" returned: 0 in 0.412s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:55 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-e72dca6c-1dc5-4685-9276-c95b4abdd0c3 tempest-ProjectMemberTests-453978435 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f253bb63-eb97-4a2c-be63-ca3578df64cc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86120) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 18:43:55 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[fde672ff-530b-4fab-bc3a-56947f9a07a3]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:43:55 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-e72dca6c-1dc5-4685-9276-c95b4abdd0c3 tempest-ProjectMemberTests-453978435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f253bb63-eb97-4a2c-be63-ca3578df64cc {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:55 devstack sudo[107488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f253bb63-eb97-4a2c-be63-ca3578df64cc
Nov 03 18:43:55 devstack sudo[107488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:56 devstack sudo[107488]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:56 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-e72dca6c-1dc5-4685-9276-c95b4abdd0c3 tempest-ProjectMemberTests-453978435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f253bb63-eb97-4a2c-be63-ca3578df64cc" returned: 0 in 0.447s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:56 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-e72dca6c-1dc5-4685-9276-c95b4abdd0c3 tempest-ProjectMemberTests-453978435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f253bb63-eb97-4a2c-be63-ca3578df64cc.50547ba2-c8a9-4f9f-aacc-928d2f472c93 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:56 devstack sudo[107494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f253bb63-eb97-4a2c-be63-ca3578df64cc.50547ba2-c8a9-4f9f-aacc-928d2f472c93
Nov 03 18:43:56 devstack sudo[107494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:56 devstack sudo[107494]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:56 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-e72dca6c-1dc5-4685-9276-c95b4abdd0c3 tempest-ProjectMemberTests-453978435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f253bb63-eb97-4a2c-be63-ca3578df64cc.50547ba2-c8a9-4f9f-aacc-928d2f472c93" returned: 0 in 0.423s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:56 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-e72dca6c-1dc5-4685-9276-c95b4abdd0c3 tempest-ProjectMemberTests-453978435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f253bb63-eb97-4a2c-be63-ca3578df64cc.50547ba2-c8a9-4f9f-aacc-928d2f472c93 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:56 devstack sudo[107500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f253bb63-eb97-4a2c-be63-ca3578df64cc.50547ba2-c8a9-4f9f-aacc-928d2f472c93
Nov 03 18:43:56 devstack sudo[107500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:56 devstack sudo[107500]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:56 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-e72dca6c-1dc5-4685-9276-c95b4abdd0c3 tempest-ProjectMemberTests-453978435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f253bb63-eb97-4a2c-be63-ca3578df64cc.50547ba2-c8a9-4f9f-aacc-928d2f472c93" returned: 0 in 0.265s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:56 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-e72dca6c-1dc5-4685-9276-c95b4abdd0c3 tempest-ProjectMemberTests-453978435 None] Lock "cinder-quobyte-50547ba2-c8a9-4f9f-aacc-928d2f472c93" released by "_delete_snapshot" :: held 1.679s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:43:56 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-e72dca6c-1dc5-4685-9276-c95b4abdd0c3 tempest-ProjectMemberTests-453978435 None] Lock "cinder-quobyte-f253bb63-eb97-4a2c-be63-ca3578df64cc" released by "delete_snapshot" :: held 1.707s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:43:57 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-e72dca6c-1dc5-4685-9276-c95b4abdd0c3 tempest-ProjectMemberTests-453978435 None] Created reservations ['16dd8c3b-45cd-4d3d-9b34-3541d8cffec0', '5319d6e1-175c-48c5-a32c-88848d631ceb', '04d1cb8e-b67c-41f0-b2e9-8e30cd92ea6b', '17ed831a-af69-4fda-be9a-5a9610077465'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:43:57 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-e72dca6c-1dc5-4685-9276-c95b4abdd0c3 tempest-ProjectMemberTests-453978435 None] Delete snapshot completed successfully.
Nov 03 18:43:57 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-e72dca6c-1dc5-4685-9276-c95b4abdd0c3 tempest-ProjectMemberTests-453978435 None] Lock "cinder-50547ba2-c8a9-4f9f-aacc-928d2f472c93-delete_snapshot" released by "delete_snapshot" :: held 1.868s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:43:57 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-29951766-2d9f-41cf-93fa-9b582aff5505 tempest-ProjectMemberTests-453978435 None] Acquiring lock "cinder-f253bb63-eb97-4a2c-be63-ca3578df64cc-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:43:57 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-29951766-2d9f-41cf-93fa-9b582aff5505 tempest-ProjectMemberTests-453978435 None] Lock "cinder-f253bb63-eb97-4a2c-be63-ca3578df64cc-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:43:57 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-29951766-2d9f-41cf-93fa-9b582aff5505 tempest-ProjectMemberTests-453978435 None] Acquiring lock "cinder-quobyte-f253bb63-eb97-4a2c-be63-ca3578df64cc" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:43:57 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-29951766-2d9f-41cf-93fa-9b582aff5505 tempest-ProjectMemberTests-453978435 None] Lock "cinder-quobyte-f253bb63-eb97-4a2c-be63-ca3578df64cc" acquired by "delete_volume" :: waited 0.017s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:43:57 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9f208a1-83fb-4939-96ef-04d85097d64e]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:43:57 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-29951766-2d9f-41cf-93fa-9b582aff5505 tempest-ProjectMemberTests-453978435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f253bb63-eb97-4a2c-be63-ca3578df64cc {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:57 devstack sudo[107503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f253bb63-eb97-4a2c-be63-ca3578df64cc
Nov 03 18:43:57 devstack sudo[107503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:57 devstack sudo[107503]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:57 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-29951766-2d9f-41cf-93fa-9b582aff5505 tempest-ProjectMemberTests-453978435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f253bb63-eb97-4a2c-be63-ca3578df64cc" returned: 0 in 0.390s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:57 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-29951766-2d9f-41cf-93fa-9b582aff5505 tempest-ProjectMemberTests-453978435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f253bb63-eb97-4a2c-be63-ca3578df64cc {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:57 devstack sudo[107509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f253bb63-eb97-4a2c-be63-ca3578df64cc
Nov 03 18:43:57 devstack sudo[107509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:58 devstack sudo[107509]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:58 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-29951766-2d9f-41cf-93fa-9b582aff5505 tempest-ProjectMemberTests-453978435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-f253bb63-eb97-4a2c-be63-ca3578df64cc" returned: 0 in 0.294s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:58 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-29951766-2d9f-41cf-93fa-9b582aff5505 tempest-ProjectMemberTests-453978435 None] Lock "cinder-quobyte-f253bb63-eb97-4a2c-be63-ca3578df64cc" released by "delete_volume" :: held 0.759s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:43:58 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-29951766-2d9f-41cf-93fa-9b582aff5505 tempest-ProjectMemberTests-453978435 None] Created reservations ['1e7293e0-847e-444f-abaf-c7a58e20d009', 'b841e733-8af5-4d6c-b307-748f1f77e6f9', 'f54e333d-ac58-460f-9179-7d3b0907dc8b', 'a58a9fbd-2144-4e41-bb04-fa4c10e299a0'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:43:58 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-29951766-2d9f-41cf-93fa-9b582aff5505 tempest-ProjectMemberTests-453978435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:43:58 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-29951766-2d9f-41cf-93fa-9b582aff5505 tempest-ProjectMemberTests-453978435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:43:58 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-29951766-2d9f-41cf-93fa-9b582aff5505 tempest-ProjectMemberTests-453978435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:43:58 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-29951766-2d9f-41cf-93fa-9b582aff5505 tempest-ProjectMemberTests-453978435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:43:58 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-29951766-2d9f-41cf-93fa-9b582aff5505 tempest-ProjectMemberTests-453978435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:43:58 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-29951766-2d9f-41cf-93fa-9b582aff5505 tempest-ProjectMemberTests-453978435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:58 devstack sudo[107512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:43:58 devstack sudo[107512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:58 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-7e541133-ecbe-48eb-b461-b3fc90e32ba2 tempest-ProjectAdminTests-320428768 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.6699981689453, 'free_capacity_gb': 1773.6699981689453, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86120) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Nov 03 18:43:58 devstack sudo[107512]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:58 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-29951766-2d9f-41cf-93fa-9b582aff5505 tempest-ProjectMemberTests-453978435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.283s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:58 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-29951766-2d9f-41cf-93fa-9b582aff5505 tempest-ProjectMemberTests-453978435 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:43:58 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-29951766-2d9f-41cf-93fa-9b582aff5505 tempest-ProjectMemberTests-453978435 None] Deleted volume successfully.
Nov 03 18:43:58 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-29951766-2d9f-41cf-93fa-9b582aff5505 tempest-ProjectMemberTests-453978435 None] Lock "cinder-f253bb63-eb97-4a2c-be63-ca3578df64cc-delete_volume" released by "delete_volume" :: held 1.293s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:43:59 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c421f66-cfc7-4848-84fa-e938740fe107 tempest-ProjectMemberTests-453978435 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:43:59 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-0c421f66-cfc7-4848-84fa-e938740fe107 tempest-ProjectMemberTests-453978435 None] Flow 'volume_create_manager' (35d053e5-b6ea-463b-9add-588a9c074367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:43:59 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-0c421f66-cfc7-4848-84fa-e938740fe107 tempest-ProjectMemberTests-453978435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7dcac665-f61a-4dd2-9301-c1c351dc2df7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:43:59 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-0c421f66-cfc7-4848-84fa-e938740fe107 tempest-ProjectMemberTests-453978435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7dcac665-f61a-4dd2-9301-c1c351dc2df7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:43:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1355437676',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d754c6f-9db4-4d84-b6ee-8d89d47a200c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac23a66460684cf18a0ec466545c9237',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:43:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:43:59Z,use_quota=True,user_id='1e72acdc7ff048f4b0d1e488804038f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:43:59 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-0c421f66-cfc7-4848-84fa-e938740fe107 tempest-ProjectMemberTests-453978435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (097a028c-0e2b-4c58-a37e-7f5ec3a5e211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:43:59 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-0c421f66-cfc7-4848-84fa-e938740fe107 tempest-ProjectMemberTests-453978435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (097a028c-0e2b-4c58-a37e-7f5ec3a5e211) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:43:59 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-0c421f66-cfc7-4848-84fa-e938740fe107 tempest-ProjectMemberTests-453978435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c82b84e8-ee6a-4387-8550-c066bb616c08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:43:59 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-0c421f66-cfc7-4848-84fa-e938740fe107 tempest-ProjectMemberTests-453978435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c82b84e8-ee6a-4387-8550-c066bb616c08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d754c6f-9db4-4d84-b6ee-8d89d47a200c', 'volume_name': 'volume-3d754c6f-9db4-4d84-b6ee-8d89d47a200c', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:43:59 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-0c421f66-cfc7-4848-84fa-e938740fe107 tempest-ProjectMemberTests-453978435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9d9fd6b-9119-4845-9741-83fd04a8adfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:43:59 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-0c421f66-cfc7-4848-84fa-e938740fe107 tempest-ProjectMemberTests-453978435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9d9fd6b-9119-4845-9741-83fd04a8adfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:43:59 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-0c421f66-cfc7-4848-84fa-e938740fe107 tempest-ProjectMemberTests-453978435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4868337-1704-4618-834f-6c497c698f8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:43:59 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-0c421f66-cfc7-4848-84fa-e938740fe107 tempest-ProjectMemberTests-453978435 None] Volume 3d754c6f-9db4-4d84-b6ee-8d89d47a200c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d754c6f-9db4-4d84-b6ee-8d89d47a200c', 'volume_size': 1}
Nov 03 18:43:59 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-0c421f66-cfc7-4848-84fa-e938740fe107 tempest-ProjectMemberTests-453978435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:43:59 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-0c421f66-cfc7-4848-84fa-e938740fe107 tempest-ProjectMemberTests-453978435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:43:59 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-0c421f66-cfc7-4848-84fa-e938740fe107 tempest-ProjectMemberTests-453978435 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:43:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1355437676',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d754c6f-9db4-4d84-b6ee-8d89d47a200c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac23a66460684cf18a0ec466545c9237',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:43:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:43:59Z,use_quota=True,user_id='1e72acdc7ff048f4b0d1e488804038f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:43:59 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-0c421f66-cfc7-4848-84fa-e938740fe107 tempest-ProjectMemberTests-453978435 None] Creating volume 3d754c6f-9db4-4d84-b6ee-8d89d47a200c {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:43:59 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-0c421f66-cfc7-4848-84fa-e938740fe107 tempest-ProjectMemberTests-453978435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:43:59 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-0c421f66-cfc7-4848-84fa-e938740fe107 tempest-ProjectMemberTests-453978435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:43:59 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-0c421f66-cfc7-4848-84fa-e938740fe107 tempest-ProjectMemberTests-453978435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:43:59 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-0c421f66-cfc7-4848-84fa-e938740fe107 tempest-ProjectMemberTests-453978435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:43:59 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-0c421f66-cfc7-4848-84fa-e938740fe107 tempest-ProjectMemberTests-453978435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:43:59 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-0c421f66-cfc7-4848-84fa-e938740fe107 tempest-ProjectMemberTests-453978435 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:43:59 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-0c421f66-cfc7-4848-84fa-e938740fe107 tempest-ProjectMemberTests-453978435 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:43:59 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-0c421f66-cfc7-4848-84fa-e938740fe107 tempest-ProjectMemberTests-453978435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3d754c6f-9db4-4d84-b6ee-8d89d47a200c 1073741824 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:59 devstack sudo[107515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3d754c6f-9db4-4d84-b6ee-8d89d47a200c 1073741824
Nov 03 18:43:59 devstack sudo[107515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:43:59 devstack sudo[107515]: pam_unix(sudo:session): session closed for user root
Nov 03 18:43:59 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-0c421f66-cfc7-4848-84fa-e938740fe107 tempest-ProjectMemberTests-453978435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3d754c6f-9db4-4d84-b6ee-8d89d47a200c 1073741824" returned: 0 in 0.501s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:43:59 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-0c421f66-cfc7-4848-84fa-e938740fe107 tempest-ProjectMemberTests-453978435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3d754c6f-9db4-4d84-b6ee-8d89d47a200c {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:43:59 devstack sudo[107522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3d754c6f-9db4-4d84-b6ee-8d89d47a200c
Nov 03 18:43:59 devstack sudo[107522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:44:00 devstack sudo[107522]: pam_unix(sudo:session): session closed for user root
Nov 03 18:44:00 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-0c421f66-cfc7-4848-84fa-e938740fe107 tempest-ProjectMemberTests-453978435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3d754c6f-9db4-4d84-b6ee-8d89d47a200c" returned: 0 in 0.259s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:44:00 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-0c421f66-cfc7-4848-84fa-e938740fe107 tempest-ProjectMemberTests-453978435 None] <== create_volume: return (819ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:44:00 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-0c421f66-cfc7-4848-84fa-e938740fe107 tempest-ProjectMemberTests-453978435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.824s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:44:00 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-0c421f66-cfc7-4848-84fa-e938740fe107 tempest-ProjectMemberTests-453978435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4868337-1704-4618-834f-6c497c698f8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d754c6f-9db4-4d84-b6ee-8d89d47a200c', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:44:00 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-0c421f66-cfc7-4848-84fa-e938740fe107 tempest-ProjectMemberTests-453978435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6dd0c1f-f983-4b03-b69a-465960522b09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:44:00 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-0c421f66-cfc7-4848-84fa-e938740fe107 tempest-ProjectMemberTests-453978435 None] Volume volume-3d754c6f-9db4-4d84-b6ee-8d89d47a200c (3d754c6f-9db4-4d84-b6ee-8d89d47a200c): created successfully
Nov 03 18:44:00 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-0c421f66-cfc7-4848-84fa-e938740fe107 tempest-ProjectMemberTests-453978435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6dd0c1f-f983-4b03-b69a-465960522b09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:44:00 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-0c421f66-cfc7-4848-84fa-e938740fe107 tempest-ProjectMemberTests-453978435 None] Flow 'volume_create_manager' (35d053e5-b6ea-463b-9add-588a9c074367) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:44:00 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-0c421f66-cfc7-4848-84fa-e938740fe107 tempest-ProjectMemberTests-453978435 None] Created volume successfully.
Nov 03 18:44:01 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-3dd33cb9-fbbd-43cb-b36e-9160dcea28f6 tempest-ProjectMemberTests-453978435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:44:01 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-3dd33cb9-fbbd-43cb-b36e-9160dcea28f6 tempest-ProjectMemberTests-453978435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:44:01 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-3dd33cb9-fbbd-43cb-b36e-9160dcea28f6 tempest-ProjectMemberTests-453978435 None] Creating offline snapshot 2d4dc3aa-67b6-4dc8-a054-709e86f51b11 of volume 3d754c6f-9db4-4d84-b6ee-8d89d47a200c {{(pid=86120) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 18:44:01 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fdab972-1883-4fbd-9bad-171ad22e61ac]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:44:01 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-3dd33cb9-fbbd-43cb-b36e-9160dcea28f6 tempest-ProjectMemberTests-453978435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3d754c6f-9db4-4d84-b6ee-8d89d47a200c {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:44:01 devstack sudo[107525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3d754c6f-9db4-4d84-b6ee-8d89d47a200c
Nov 03 18:44:01 devstack sudo[107525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:44:01 devstack sudo[107525]: pam_unix(sudo:session): session closed for user root
Nov 03 18:44:01 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-3dd33cb9-fbbd-43cb-b36e-9160dcea28f6 tempest-ProjectMemberTests-453978435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3d754c6f-9db4-4d84-b6ee-8d89d47a200c" returned: 0 in 0.388s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:44:01 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-3dd33cb9-fbbd-43cb-b36e-9160dcea28f6 tempest-ProjectMemberTests-453978435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3d754c6f-9db4-4d84-b6ee-8d89d47a200c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3d754c6f-9db4-4d84-b6ee-8d89d47a200c.2d4dc3aa-67b6-4dc8-a054-709e86f51b11 1G {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:44:01 devstack sudo[107531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3d754c6f-9db4-4d84-b6ee-8d89d47a200c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3d754c6f-9db4-4d84-b6ee-8d89d47a200c.2d4dc3aa-67b6-4dc8-a054-709e86f51b11 1G
Nov 03 18:44:01 devstack sudo[107531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:44:02 devstack sudo[107531]: pam_unix(sudo:session): session closed for user root
Nov 03 18:44:02 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-3dd33cb9-fbbd-43cb-b36e-9160dcea28f6 tempest-ProjectMemberTests-453978435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3d754c6f-9db4-4d84-b6ee-8d89d47a200c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3d754c6f-9db4-4d84-b6ee-8d89d47a200c.2d4dc3aa-67b6-4dc8-a054-709e86f51b11 1G" returned: 0 in 0.430s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:44:02 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-3dd33cb9-fbbd-43cb-b36e-9160dcea28f6 tempest-ProjectMemberTests-453978435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d754c6f-9db4-4d84-b6ee-8d89d47a200c -F qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3d754c6f-9db4-4d84-b6ee-8d89d47a200c.2d4dc3aa-67b6-4dc8-a054-709e86f51b11 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:44:02 devstack sudo[107537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d754c6f-9db4-4d84-b6ee-8d89d47a200c -F qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3d754c6f-9db4-4d84-b6ee-8d89d47a200c.2d4dc3aa-67b6-4dc8-a054-709e86f51b11
Nov 03 18:44:02 devstack sudo[107537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:44:02 devstack sudo[107537]: pam_unix(sudo:session): session closed for user root
Nov 03 18:44:02 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-3dd33cb9-fbbd-43cb-b36e-9160dcea28f6 tempest-ProjectMemberTests-453978435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d754c6f-9db4-4d84-b6ee-8d89d47a200c -F qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3d754c6f-9db4-4d84-b6ee-8d89d47a200c.2d4dc3aa-67b6-4dc8-a054-709e86f51b11" returned: 0 in 0.303s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:44:02 devstack cinder-volume[86120]: WARNING cinder.volume.drivers.remotefs [None req-3dd33cb9-fbbd-43cb-b36e-9160dcea28f6 tempest-ProjectMemberTests-453978435 None] /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3d754c6f-9db4-4d84-b6ee-8d89d47a200c.2d4dc3aa-67b6-4dc8-a054-709e86f51b11 is being set with open permissions: ugo+rw
Nov 03 18:44:02 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-3dd33cb9-fbbd-43cb-b36e-9160dcea28f6 tempest-ProjectMemberTests-453978435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3d754c6f-9db4-4d84-b6ee-8d89d47a200c.2d4dc3aa-67b6-4dc8-a054-709e86f51b11 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:44:02 devstack sudo[107543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3d754c6f-9db4-4d84-b6ee-8d89d47a200c.2d4dc3aa-67b6-4dc8-a054-709e86f51b11
Nov 03 18:44:02 devstack sudo[107543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:44:02 devstack sudo[107543]: pam_unix(sudo:session): session closed for user root
Nov 03 18:44:02 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-3dd33cb9-fbbd-43cb-b36e-9160dcea28f6 tempest-ProjectMemberTests-453978435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3d754c6f-9db4-4d84-b6ee-8d89d47a200c.2d4dc3aa-67b6-4dc8-a054-709e86f51b11" returned: 0 in 0.256s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:44:02 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-3dd33cb9-fbbd-43cb-b36e-9160dcea28f6 tempest-ProjectMemberTests-453978435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3d754c6f-9db4-4d84-b6ee-8d89d47a200c.info {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:44:02 devstack sudo[107546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3d754c6f-9db4-4d84-b6ee-8d89d47a200c.info
Nov 03 18:44:02 devstack sudo[107546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:44:03 devstack sudo[107546]: pam_unix(sudo:session): session closed for user root
Nov 03 18:44:03 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-3dd33cb9-fbbd-43cb-b36e-9160dcea28f6 tempest-ProjectMemberTests-453978435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3d754c6f-9db4-4d84-b6ee-8d89d47a200c.info" returned: 0 in 0.277s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:44:03 devstack cinder-volume[86120]: WARNING cinder.volume.drivers.remotefs [None req-3dd33cb9-fbbd-43cb-b36e-9160dcea28f6 tempest-ProjectMemberTests-453978435 None] /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3d754c6f-9db4-4d84-b6ee-8d89d47a200c.info is being set with open permissions: ugo+rw
Nov 03 18:44:03 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-3dd33cb9-fbbd-43cb-b36e-9160dcea28f6 tempest-ProjectMemberTests-453978435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3d754c6f-9db4-4d84-b6ee-8d89d47a200c.info {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:44:03 devstack sudo[107549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3d754c6f-9db4-4d84-b6ee-8d89d47a200c.info
Nov 03 18:44:03 devstack sudo[107549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:44:03 devstack sudo[107549]: pam_unix(sudo:session): session closed for user root
Nov 03 18:44:03 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-3dd33cb9-fbbd-43cb-b36e-9160dcea28f6 tempest-ProjectMemberTests-453978435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3d754c6f-9db4-4d84-b6ee-8d89d47a200c.info" returned: 0 in 0.261s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:44:03 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-3dd33cb9-fbbd-43cb-b36e-9160dcea28f6 tempest-ProjectMemberTests-453978435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.017s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:44:03 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-3dd33cb9-fbbd-43cb-b36e-9160dcea28f6 tempest-ProjectMemberTests-453978435 None] Create snapshot completed successfully
Nov 03 18:44:04 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-6fd656a0-7df5-4c25-b755-ba022126d137 tempest-ProjectMemberTests-453978435 None] Acquiring lock "cinder-2d4dc3aa-67b6-4dc8-a054-709e86f51b11-delete_snapshot" by "delete_snapshot" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:44:04 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-6fd656a0-7df5-4c25-b755-ba022126d137 tempest-ProjectMemberTests-453978435 None] Lock "cinder-2d4dc3aa-67b6-4dc8-a054-709e86f51b11-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:44:04 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-6fd656a0-7df5-4c25-b755-ba022126d137 tempest-ProjectMemberTests-453978435 None] Acquiring lock "cinder-quobyte-3d754c6f-9db4-4d84-b6ee-8d89d47a200c" by "delete_snapshot" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:44:04 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-6fd656a0-7df5-4c25-b755-ba022126d137 tempest-ProjectMemberTests-453978435 None] Lock "cinder-quobyte-3d754c6f-9db4-4d84-b6ee-8d89d47a200c" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:44:04 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-6fd656a0-7df5-4c25-b755-ba022126d137 tempest-ProjectMemberTests-453978435 None] Acquiring lock "cinder-quobyte-2d4dc3aa-67b6-4dc8-a054-709e86f51b11" by "_delete_snapshot" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:44:04 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-6fd656a0-7df5-4c25-b755-ba022126d137 tempest-ProjectMemberTests-453978435 None] Lock "cinder-quobyte-2d4dc3aa-67b6-4dc8-a054-709e86f51b11" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:44:04 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-6fd656a0-7df5-4c25-b755-ba022126d137 tempest-ProjectMemberTests-453978435 None] Deleting offline snapshot 2d4dc3aa-67b6-4dc8-a054-709e86f51b11 of volume 3d754c6f-9db4-4d84-b6ee-8d89d47a200c {{(pid=86120) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 18:44:04 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-6fd656a0-7df5-4c25-b755-ba022126d137 tempest-ProjectMemberTests-453978435 None] snapshot_file for this snap is: volume-3d754c6f-9db4-4d84-b6ee-8d89d47a200c.2d4dc3aa-67b6-4dc8-a054-709e86f51b11 {{(pid=86120) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 18:44:04 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[e17790a1-830c-4188-b41e-c8c6d0168766]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:44:04 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-6fd656a0-7df5-4c25-b755-ba022126d137 tempest-ProjectMemberTests-453978435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3d754c6f-9db4-4d84-b6ee-8d89d47a200c.2d4dc3aa-67b6-4dc8-a054-709e86f51b11 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:44:04 devstack sudo[107553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3d754c6f-9db4-4d84-b6ee-8d89d47a200c.2d4dc3aa-67b6-4dc8-a054-709e86f51b11
Nov 03 18:44:04 devstack sudo[107553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:44:04 devstack sudo[107553]: pam_unix(sudo:session): session closed for user root
Nov 03 18:44:04 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-6fd656a0-7df5-4c25-b755-ba022126d137 tempest-ProjectMemberTests-453978435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3d754c6f-9db4-4d84-b6ee-8d89d47a200c.2d4dc3aa-67b6-4dc8-a054-709e86f51b11" returned: 0 in 0.359s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:44:04 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-6fd656a0-7df5-4c25-b755-ba022126d137 tempest-ProjectMemberTests-453978435 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3d754c6f-9db4-4d84-b6ee-8d89d47a200c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86120) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 18:44:05 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[9300a573-fdf1-417b-bfe8-ece32ef41c4d]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:44:05 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-6fd656a0-7df5-4c25-b755-ba022126d137 tempest-ProjectMemberTests-453978435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3d754c6f-9db4-4d84-b6ee-8d89d47a200c {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:44:05 devstack sudo[107558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3d754c6f-9db4-4d84-b6ee-8d89d47a200c
Nov 03 18:44:05 devstack sudo[107558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:44:05 devstack sudo[107558]: pam_unix(sudo:session): session closed for user root
Nov 03 18:44:05 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-6fd656a0-7df5-4c25-b755-ba022126d137 tempest-ProjectMemberTests-453978435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3d754c6f-9db4-4d84-b6ee-8d89d47a200c" returned: 0 in 0.349s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:44:05 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-6fd656a0-7df5-4c25-b755-ba022126d137 tempest-ProjectMemberTests-453978435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3d754c6f-9db4-4d84-b6ee-8d89d47a200c.2d4dc3aa-67b6-4dc8-a054-709e86f51b11 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:44:05 devstack sudo[107563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3d754c6f-9db4-4d84-b6ee-8d89d47a200c.2d4dc3aa-67b6-4dc8-a054-709e86f51b11
Nov 03 18:44:05 devstack sudo[107563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:44:05 devstack sudo[107563]: pam_unix(sudo:session): session closed for user root
Nov 03 18:44:05 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-6fd656a0-7df5-4c25-b755-ba022126d137 tempest-ProjectMemberTests-453978435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3d754c6f-9db4-4d84-b6ee-8d89d47a200c.2d4dc3aa-67b6-4dc8-a054-709e86f51b11" returned: 0 in 0.329s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:44:05 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-6fd656a0-7df5-4c25-b755-ba022126d137 tempest-ProjectMemberTests-453978435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3d754c6f-9db4-4d84-b6ee-8d89d47a200c.2d4dc3aa-67b6-4dc8-a054-709e86f51b11 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:44:05 devstack sudo[107568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3d754c6f-9db4-4d84-b6ee-8d89d47a200c.2d4dc3aa-67b6-4dc8-a054-709e86f51b11
Nov 03 18:44:05 devstack sudo[107568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:44:05 devstack sudo[107568]: pam_unix(sudo:session): session closed for user root
Nov 03 18:44:05 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-6fd656a0-7df5-4c25-b755-ba022126d137 tempest-ProjectMemberTests-453978435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3d754c6f-9db4-4d84-b6ee-8d89d47a200c.2d4dc3aa-67b6-4dc8-a054-709e86f51b11" returned: 0 in 0.243s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:44:05 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-6fd656a0-7df5-4c25-b755-ba022126d137 tempest-ProjectMemberTests-453978435 None] Lock "cinder-quobyte-2d4dc3aa-67b6-4dc8-a054-709e86f51b11" released by "_delete_snapshot" :: held 1.373s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:44:05 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-6fd656a0-7df5-4c25-b755-ba022126d137 tempest-ProjectMemberTests-453978435 None] Lock "cinder-quobyte-3d754c6f-9db4-4d84-b6ee-8d89d47a200c" released by "delete_snapshot" :: held 1.393s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:44:06 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-6fd656a0-7df5-4c25-b755-ba022126d137 tempest-ProjectMemberTests-453978435 None] Created reservations ['78696fd2-a3bd-4302-9511-7869108ea655', 'fd60f8e2-e01f-41e7-89cf-04de123e8f96', '33c7d607-6e75-4da4-8bf1-2d1f9963ce6e', '2f15a436-1e95-4ba2-abf0-6a7dba99c925'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:44:06 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-6fd656a0-7df5-4c25-b755-ba022126d137 tempest-ProjectMemberTests-453978435 None] Delete snapshot completed successfully.
Nov 03 18:44:06 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-6fd656a0-7df5-4c25-b755-ba022126d137 tempest-ProjectMemberTests-453978435 None] Lock "cinder-2d4dc3aa-67b6-4dc8-a054-709e86f51b11-delete_snapshot" released by "delete_snapshot" :: held 1.520s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:44:06 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-5f2f3eed-6b94-4037-8960-b9cd13041c31 tempest-ProjectMemberTests-453978435 None] Acquiring lock "cinder-3d754c6f-9db4-4d84-b6ee-8d89d47a200c-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:44:06 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-5f2f3eed-6b94-4037-8960-b9cd13041c31 tempest-ProjectMemberTests-453978435 None] Lock "cinder-3d754c6f-9db4-4d84-b6ee-8d89d47a200c-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:44:06 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-5f2f3eed-6b94-4037-8960-b9cd13041c31 tempest-ProjectMemberTests-453978435 None] Acquiring lock "cinder-quobyte-3d754c6f-9db4-4d84-b6ee-8d89d47a200c" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:44:06 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-5f2f3eed-6b94-4037-8960-b9cd13041c31 tempest-ProjectMemberTests-453978435 None] Lock "cinder-quobyte-3d754c6f-9db4-4d84-b6ee-8d89d47a200c" acquired by "delete_volume" :: waited 0.015s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:44:06 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba6e0d9e-e503-46ac-bcea-0b796655fbab]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:44:06 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-5f2f3eed-6b94-4037-8960-b9cd13041c31 tempest-ProjectMemberTests-453978435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3d754c6f-9db4-4d84-b6ee-8d89d47a200c {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:44:06 devstack sudo[107571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3d754c6f-9db4-4d84-b6ee-8d89d47a200c
Nov 03 18:44:06 devstack sudo[107571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:44:07 devstack sudo[107571]: pam_unix(sudo:session): session closed for user root
Nov 03 18:44:07 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-5f2f3eed-6b94-4037-8960-b9cd13041c31 tempest-ProjectMemberTests-453978435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3d754c6f-9db4-4d84-b6ee-8d89d47a200c" returned: 0 in 0.352s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:44:07 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-5f2f3eed-6b94-4037-8960-b9cd13041c31 tempest-ProjectMemberTests-453978435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3d754c6f-9db4-4d84-b6ee-8d89d47a200c {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:44:07 devstack sudo[107576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3d754c6f-9db4-4d84-b6ee-8d89d47a200c
Nov 03 18:44:07 devstack sudo[107576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:44:07 devstack sudo[107576]: pam_unix(sudo:session): session closed for user root
Nov 03 18:44:07 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-5f2f3eed-6b94-4037-8960-b9cd13041c31 tempest-ProjectMemberTests-453978435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-3d754c6f-9db4-4d84-b6ee-8d89d47a200c" returned: 0 in 0.244s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:44:07 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-5f2f3eed-6b94-4037-8960-b9cd13041c31 tempest-ProjectMemberTests-453978435 None] Lock "cinder-quobyte-3d754c6f-9db4-4d84-b6ee-8d89d47a200c" released by "delete_volume" :: held 0.655s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:44:07 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-5f2f3eed-6b94-4037-8960-b9cd13041c31 tempest-ProjectMemberTests-453978435 None] Created reservations ['881d4449-1084-41dc-bdeb-3447ad27cdbb', '038e9cb5-7d33-4fc0-9bb3-d5c685fe554e', 'a86dd13e-e232-4f43-939d-b9b24b139ba8', '5e13ffb0-6b7d-4870-a3ce-21a29613bffd'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:44:07 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-5f2f3eed-6b94-4037-8960-b9cd13041c31 tempest-ProjectMemberTests-453978435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:44:07 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-5f2f3eed-6b94-4037-8960-b9cd13041c31 tempest-ProjectMemberTests-453978435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:44:07 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-5f2f3eed-6b94-4037-8960-b9cd13041c31 tempest-ProjectMemberTests-453978435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:44:07 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-5f2f3eed-6b94-4037-8960-b9cd13041c31 tempest-ProjectMemberTests-453978435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:44:07 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-5f2f3eed-6b94-4037-8960-b9cd13041c31 tempest-ProjectMemberTests-453978435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:44:07 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-5f2f3eed-6b94-4037-8960-b9cd13041c31 tempest-ProjectMemberTests-453978435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:44:07 devstack sudo[107579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:44:07 devstack sudo[107579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:44:07 devstack sudo[107579]: pam_unix(sudo:session): session closed for user root
Nov 03 18:44:07 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-5f2f3eed-6b94-4037-8960-b9cd13041c31 tempest-ProjectMemberTests-453978435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.252s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:44:07 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-5f2f3eed-6b94-4037-8960-b9cd13041c31 tempest-ProjectMemberTests-453978435 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:44:07 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-5f2f3eed-6b94-4037-8960-b9cd13041c31 tempest-ProjectMemberTests-453978435 None] Deleted volume successfully.
Nov 03 18:44:07 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-5f2f3eed-6b94-4037-8960-b9cd13041c31 tempest-ProjectMemberTests-453978435 None] Lock "cinder-3d754c6f-9db4-4d84-b6ee-8d89d47a200c-delete_volume" released by "delete_volume" :: held 1.097s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:44:08 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbde0afb-41cb-452a-a92f-8d46c73bf232 tempest-ProjectMemberTests-453978435 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:44:08 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-fbde0afb-41cb-452a-a92f-8d46c73bf232 tempest-ProjectMemberTests-453978435 None] Flow 'volume_create_manager' (a5f84289-3c1d-47d8-94b3-0123f942f1e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:44:08 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-fbde0afb-41cb-452a-a92f-8d46c73bf232 tempest-ProjectMemberTests-453978435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52057d75-299d-47de-ae09-40f37986c0e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:44:08 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-fbde0afb-41cb-452a-a92f-8d46c73bf232 tempest-ProjectMemberTests-453978435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52057d75-299d-47de-ae09-40f37986c0e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:44:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-508875965',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=499f387b-d421-4bcc-8220-d53aa346060e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac23a66460684cf18a0ec466545c9237',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:44:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:44:08Z,use_quota=True,user_id='1e72acdc7ff048f4b0d1e488804038f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:44:08 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-fbde0afb-41cb-452a-a92f-8d46c73bf232 tempest-ProjectMemberTests-453978435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3411ffb0-375a-4f46-b391-43b92197f44d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:44:08 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-fbde0afb-41cb-452a-a92f-8d46c73bf232 tempest-ProjectMemberTests-453978435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3411ffb0-375a-4f46-b391-43b92197f44d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:44:08 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-fbde0afb-41cb-452a-a92f-8d46c73bf232 tempest-ProjectMemberTests-453978435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ca65fdd-af11-4f14-9940-c2d3a30d1d51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:44:08 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-fbde0afb-41cb-452a-a92f-8d46c73bf232 tempest-ProjectMemberTests-453978435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ca65fdd-af11-4f14-9940-c2d3a30d1d51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '499f387b-d421-4bcc-8220-d53aa346060e', 'volume_name': 'volume-499f387b-d421-4bcc-8220-d53aa346060e', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:44:08 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-fbde0afb-41cb-452a-a92f-8d46c73bf232 tempest-ProjectMemberTests-453978435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be4cc5c3-f891-4680-8a56-07648959d415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:44:08 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-fbde0afb-41cb-452a-a92f-8d46c73bf232 tempest-ProjectMemberTests-453978435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be4cc5c3-f891-4680-8a56-07648959d415) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:44:08 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-fbde0afb-41cb-452a-a92f-8d46c73bf232 tempest-ProjectMemberTests-453978435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72c9388f-a3c3-4779-b951-0ecec43d0001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:44:08 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-fbde0afb-41cb-452a-a92f-8d46c73bf232 tempest-ProjectMemberTests-453978435 None] Volume 499f387b-d421-4bcc-8220-d53aa346060e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-499f387b-d421-4bcc-8220-d53aa346060e', 'volume_size': 1}
Nov 03 18:44:08 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-fbde0afb-41cb-452a-a92f-8d46c73bf232 tempest-ProjectMemberTests-453978435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:44:08 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-fbde0afb-41cb-452a-a92f-8d46c73bf232 tempest-ProjectMemberTests-453978435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:44:08 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-fbde0afb-41cb-452a-a92f-8d46c73bf232 tempest-ProjectMemberTests-453978435 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:44:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-508875965',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=499f387b-d421-4bcc-8220-d53aa346060e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac23a66460684cf18a0ec466545c9237',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:44:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:44:08Z,use_quota=True,user_id='1e72acdc7ff048f4b0d1e488804038f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:44:08 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-fbde0afb-41cb-452a-a92f-8d46c73bf232 tempest-ProjectMemberTests-453978435 None] Creating volume 499f387b-d421-4bcc-8220-d53aa346060e {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:44:08 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-fbde0afb-41cb-452a-a92f-8d46c73bf232 tempest-ProjectMemberTests-453978435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:44:08 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-fbde0afb-41cb-452a-a92f-8d46c73bf232 tempest-ProjectMemberTests-453978435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:44:08 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-fbde0afb-41cb-452a-a92f-8d46c73bf232 tempest-ProjectMemberTests-453978435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:44:08 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-fbde0afb-41cb-452a-a92f-8d46c73bf232 tempest-ProjectMemberTests-453978435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:44:08 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-fbde0afb-41cb-452a-a92f-8d46c73bf232 tempest-ProjectMemberTests-453978435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:44:08 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-fbde0afb-41cb-452a-a92f-8d46c73bf232 tempest-ProjectMemberTests-453978435 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:44:08 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-fbde0afb-41cb-452a-a92f-8d46c73bf232 tempest-ProjectMemberTests-453978435 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:44:08 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-fbde0afb-41cb-452a-a92f-8d46c73bf232 tempest-ProjectMemberTests-453978435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-499f387b-d421-4bcc-8220-d53aa346060e 1073741824 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:44:08 devstack sudo[107582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-499f387b-d421-4bcc-8220-d53aa346060e 1073741824
Nov 03 18:44:08 devstack sudo[107582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:44:08 devstack sudo[107582]: pam_unix(sudo:session): session closed for user root
Nov 03 18:44:08 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-fbde0afb-41cb-452a-a92f-8d46c73bf232 tempest-ProjectMemberTests-453978435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-499f387b-d421-4bcc-8220-d53aa346060e 1073741824" returned: 0 in 0.411s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:44:08 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-fbde0afb-41cb-452a-a92f-8d46c73bf232 tempest-ProjectMemberTests-453978435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-499f387b-d421-4bcc-8220-d53aa346060e {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:44:08 devstack sudo[107588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-499f387b-d421-4bcc-8220-d53aa346060e
Nov 03 18:44:08 devstack sudo[107588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:44:09 devstack sudo[107588]: pam_unix(sudo:session): session closed for user root
Nov 03 18:44:09 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-fbde0afb-41cb-452a-a92f-8d46c73bf232 tempest-ProjectMemberTests-453978435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-499f387b-d421-4bcc-8220-d53aa346060e" returned: 0 in 0.250s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:44:09 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-fbde0afb-41cb-452a-a92f-8d46c73bf232 tempest-ProjectMemberTests-453978435 None] <== create_volume: return (705ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:44:09 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-fbde0afb-41cb-452a-a92f-8d46c73bf232 tempest-ProjectMemberTests-453978435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.708s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:44:09 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-fbde0afb-41cb-452a-a92f-8d46c73bf232 tempest-ProjectMemberTests-453978435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72c9388f-a3c3-4779-b951-0ecec43d0001) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-499f387b-d421-4bcc-8220-d53aa346060e', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:44:09 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-fbde0afb-41cb-452a-a92f-8d46c73bf232 tempest-ProjectMemberTests-453978435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ca3ea03-b018-407b-9aee-01172e5494ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:44:09 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-fbde0afb-41cb-452a-a92f-8d46c73bf232 tempest-ProjectMemberTests-453978435 None] Volume volume-499f387b-d421-4bcc-8220-d53aa346060e (499f387b-d421-4bcc-8220-d53aa346060e): created successfully
Nov 03 18:44:09 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-fbde0afb-41cb-452a-a92f-8d46c73bf232 tempest-ProjectMemberTests-453978435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ca3ea03-b018-407b-9aee-01172e5494ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:44:09 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-fbde0afb-41cb-452a-a92f-8d46c73bf232 tempest-ProjectMemberTests-453978435 None] Flow 'volume_create_manager' (a5f84289-3c1d-47d8-94b3-0123f942f1e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:44:09 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-fbde0afb-41cb-452a-a92f-8d46c73bf232 tempest-ProjectMemberTests-453978435 None] Created volume successfully.
Nov 03 18:44:09 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-7529d2a5-6d26-4662-936d-3dad0b97d5d5 tempest-ProjectMemberTests-453978435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:44:09 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-7529d2a5-6d26-4662-936d-3dad0b97d5d5 tempest-ProjectMemberTests-453978435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:44:09 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-7529d2a5-6d26-4662-936d-3dad0b97d5d5 tempest-ProjectMemberTests-453978435 None] Creating offline snapshot b57868ff-0f14-4eaf-bb04-5cfc615913aa of volume 499f387b-d421-4bcc-8220-d53aa346060e {{(pid=86120) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 18:44:09 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c14a84f-2548-41d9-a3ce-573184b0df67]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:44:09 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-7529d2a5-6d26-4662-936d-3dad0b97d5d5 tempest-ProjectMemberTests-453978435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-499f387b-d421-4bcc-8220-d53aa346060e {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:44:09 devstack sudo[107592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-499f387b-d421-4bcc-8220-d53aa346060e
Nov 03 18:44:09 devstack sudo[107592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:44:09 devstack sudo[107592]: pam_unix(sudo:session): session closed for user root
Nov 03 18:44:09 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-7529d2a5-6d26-4662-936d-3dad0b97d5d5 tempest-ProjectMemberTests-453978435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-499f387b-d421-4bcc-8220-d53aa346060e" returned: 0 in 0.367s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:44:09 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-7529d2a5-6d26-4662-936d-3dad0b97d5d5 tempest-ProjectMemberTests-453978435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-499f387b-d421-4bcc-8220-d53aa346060e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-499f387b-d421-4bcc-8220-d53aa346060e.b57868ff-0f14-4eaf-bb04-5cfc615913aa 1G {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:44:09 devstack sudo[107597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-499f387b-d421-4bcc-8220-d53aa346060e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-499f387b-d421-4bcc-8220-d53aa346060e.b57868ff-0f14-4eaf-bb04-5cfc615913aa 1G
Nov 03 18:44:09 devstack sudo[107597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:44:10 devstack sudo[107597]: pam_unix(sudo:session): session closed for user root
Nov 03 18:44:10 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-7529d2a5-6d26-4662-936d-3dad0b97d5d5 tempest-ProjectMemberTests-453978435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-499f387b-d421-4bcc-8220-d53aa346060e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-499f387b-d421-4bcc-8220-d53aa346060e.b57868ff-0f14-4eaf-bb04-5cfc615913aa 1G" returned: 0 in 0.375s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:44:10 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-7529d2a5-6d26-4662-936d-3dad0b97d5d5 tempest-ProjectMemberTests-453978435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-499f387b-d421-4bcc-8220-d53aa346060e -F qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-499f387b-d421-4bcc-8220-d53aa346060e.b57868ff-0f14-4eaf-bb04-5cfc615913aa {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:44:10 devstack sudo[107603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-499f387b-d421-4bcc-8220-d53aa346060e -F qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-499f387b-d421-4bcc-8220-d53aa346060e.b57868ff-0f14-4eaf-bb04-5cfc615913aa
Nov 03 18:44:10 devstack sudo[107603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:44:10 devstack sudo[107603]: pam_unix(sudo:session): session closed for user root
Nov 03 18:44:10 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-7529d2a5-6d26-4662-936d-3dad0b97d5d5 tempest-ProjectMemberTests-453978435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-499f387b-d421-4bcc-8220-d53aa346060e -F qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-499f387b-d421-4bcc-8220-d53aa346060e.b57868ff-0f14-4eaf-bb04-5cfc615913aa" returned: 0 in 0.284s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:44:10 devstack cinder-volume[86120]: WARNING cinder.volume.drivers.remotefs [None req-7529d2a5-6d26-4662-936d-3dad0b97d5d5 tempest-ProjectMemberTests-453978435 None] /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-499f387b-d421-4bcc-8220-d53aa346060e.b57868ff-0f14-4eaf-bb04-5cfc615913aa is being set with open permissions: ugo+rw
Nov 03 18:44:10 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-7529d2a5-6d26-4662-936d-3dad0b97d5d5 tempest-ProjectMemberTests-453978435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-499f387b-d421-4bcc-8220-d53aa346060e.b57868ff-0f14-4eaf-bb04-5cfc615913aa {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:44:10 devstack sudo[107609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-499f387b-d421-4bcc-8220-d53aa346060e.b57868ff-0f14-4eaf-bb04-5cfc615913aa
Nov 03 18:44:10 devstack sudo[107609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:44:10 devstack sudo[107609]: pam_unix(sudo:session): session closed for user root
Nov 03 18:44:10 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-7529d2a5-6d26-4662-936d-3dad0b97d5d5 tempest-ProjectMemberTests-453978435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-499f387b-d421-4bcc-8220-d53aa346060e.b57868ff-0f14-4eaf-bb04-5cfc615913aa" returned: 0 in 0.239s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:44:10 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-7529d2a5-6d26-4662-936d-3dad0b97d5d5 tempest-ProjectMemberTests-453978435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-499f387b-d421-4bcc-8220-d53aa346060e.info {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:44:10 devstack sudo[107612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-499f387b-d421-4bcc-8220-d53aa346060e.info
Nov 03 18:44:10 devstack sudo[107612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:44:10 devstack sudo[107612]: pam_unix(sudo:session): session closed for user root
Nov 03 18:44:10 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-7529d2a5-6d26-4662-936d-3dad0b97d5d5 tempest-ProjectMemberTests-453978435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-499f387b-d421-4bcc-8220-d53aa346060e.info" returned: 0 in 0.243s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:44:10 devstack cinder-volume[86120]: WARNING cinder.volume.drivers.remotefs [None req-7529d2a5-6d26-4662-936d-3dad0b97d5d5 tempest-ProjectMemberTests-453978435 None] /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-499f387b-d421-4bcc-8220-d53aa346060e.info is being set with open permissions: ugo+rw
Nov 03 18:44:10 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-7529d2a5-6d26-4662-936d-3dad0b97d5d5 tempest-ProjectMemberTests-453978435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-499f387b-d421-4bcc-8220-d53aa346060e.info {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:44:11 devstack sudo[107615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-499f387b-d421-4bcc-8220-d53aa346060e.info
Nov 03 18:44:11 devstack sudo[107615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:44:11 devstack sudo[107615]: pam_unix(sudo:session): session closed for user root
Nov 03 18:44:11 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-7529d2a5-6d26-4662-936d-3dad0b97d5d5 tempest-ProjectMemberTests-453978435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-499f387b-d421-4bcc-8220-d53aa346060e.info" returned: 0 in 0.233s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:44:11 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-7529d2a5-6d26-4662-936d-3dad0b97d5d5 tempest-ProjectMemberTests-453978435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.821s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:44:11 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-7529d2a5-6d26-4662-936d-3dad0b97d5d5 tempest-ProjectMemberTests-453978435 None] Create snapshot completed successfully
Nov 03 18:44:11 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-e8969691-9927-42fb-8379-81efce255949 tempest-ProjectMemberTests-453978435 None] Acquiring lock "cinder-b57868ff-0f14-4eaf-bb04-5cfc615913aa-delete_snapshot" by "delete_snapshot" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:44:11 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-e8969691-9927-42fb-8379-81efce255949 tempest-ProjectMemberTests-453978435 None] Lock "cinder-b57868ff-0f14-4eaf-bb04-5cfc615913aa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:44:11 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-e8969691-9927-42fb-8379-81efce255949 tempest-ProjectMemberTests-453978435 None] Acquiring lock "cinder-quobyte-499f387b-d421-4bcc-8220-d53aa346060e" by "delete_snapshot" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:44:11 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-e8969691-9927-42fb-8379-81efce255949 tempest-ProjectMemberTests-453978435 None] Lock "cinder-quobyte-499f387b-d421-4bcc-8220-d53aa346060e" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:44:11 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-e8969691-9927-42fb-8379-81efce255949 tempest-ProjectMemberTests-453978435 None] Acquiring lock "cinder-quobyte-b57868ff-0f14-4eaf-bb04-5cfc615913aa" by "_delete_snapshot" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:44:11 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-e8969691-9927-42fb-8379-81efce255949 tempest-ProjectMemberTests-453978435 None] Lock "cinder-quobyte-b57868ff-0f14-4eaf-bb04-5cfc615913aa" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:44:11 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-e8969691-9927-42fb-8379-81efce255949 tempest-ProjectMemberTests-453978435 None] Deleting offline snapshot b57868ff-0f14-4eaf-bb04-5cfc615913aa of volume 499f387b-d421-4bcc-8220-d53aa346060e {{(pid=86120) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 18:44:11 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-e8969691-9927-42fb-8379-81efce255949 tempest-ProjectMemberTests-453978435 None] snapshot_file for this snap is: volume-499f387b-d421-4bcc-8220-d53aa346060e.b57868ff-0f14-4eaf-bb04-5cfc615913aa {{(pid=86120) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 18:44:11 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[d07d7053-eec9-4dc4-b610-091d414d1401]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:44:11 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-e8969691-9927-42fb-8379-81efce255949 tempest-ProjectMemberTests-453978435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-499f387b-d421-4bcc-8220-d53aa346060e.b57868ff-0f14-4eaf-bb04-5cfc615913aa {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:44:11 devstack sudo[107618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-499f387b-d421-4bcc-8220-d53aa346060e.b57868ff-0f14-4eaf-bb04-5cfc615913aa
Nov 03 18:44:11 devstack sudo[107618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:44:11 devstack sudo[107618]: pam_unix(sudo:session): session closed for user root
Nov 03 18:44:11 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-e8969691-9927-42fb-8379-81efce255949 tempest-ProjectMemberTests-453978435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-499f387b-d421-4bcc-8220-d53aa346060e.b57868ff-0f14-4eaf-bb04-5cfc615913aa" returned: 0 in 0.346s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:44:11 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-e8969691-9927-42fb-8379-81efce255949 tempest-ProjectMemberTests-453978435 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-499f387b-d421-4bcc-8220-d53aa346060e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86120) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 18:44:12 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[e207bb7a-0502-41b2-b9fd-a7706ca68928]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:44:12 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-e8969691-9927-42fb-8379-81efce255949 tempest-ProjectMemberTests-453978435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-499f387b-d421-4bcc-8220-d53aa346060e {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:44:12 devstack sudo[107623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-499f387b-d421-4bcc-8220-d53aa346060e
Nov 03 18:44:12 devstack sudo[107623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:44:12 devstack sudo[107623]: pam_unix(sudo:session): session closed for user root
Nov 03 18:44:12 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-e8969691-9927-42fb-8379-81efce255949 tempest-ProjectMemberTests-453978435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-499f387b-d421-4bcc-8220-d53aa346060e" returned: 0 in 0.343s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:44:12 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-e8969691-9927-42fb-8379-81efce255949 tempest-ProjectMemberTests-453978435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-499f387b-d421-4bcc-8220-d53aa346060e.b57868ff-0f14-4eaf-bb04-5cfc615913aa {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:44:12 devstack sudo[107628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-499f387b-d421-4bcc-8220-d53aa346060e.b57868ff-0f14-4eaf-bb04-5cfc615913aa
Nov 03 18:44:12 devstack sudo[107628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:44:12 devstack sudo[107628]: pam_unix(sudo:session): session closed for user root
Nov 03 18:44:12 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-e8969691-9927-42fb-8379-81efce255949 tempest-ProjectMemberTests-453978435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-499f387b-d421-4bcc-8220-d53aa346060e.b57868ff-0f14-4eaf-bb04-5cfc615913aa" returned: 0 in 0.320s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:44:12 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-e8969691-9927-42fb-8379-81efce255949 tempest-ProjectMemberTests-453978435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-499f387b-d421-4bcc-8220-d53aa346060e.b57868ff-0f14-4eaf-bb04-5cfc615913aa {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:44:12 devstack sudo[107633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-499f387b-d421-4bcc-8220-d53aa346060e.b57868ff-0f14-4eaf-bb04-5cfc615913aa
Nov 03 18:44:12 devstack sudo[107633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:44:12 devstack sudo[107633]: pam_unix(sudo:session): session closed for user root
Nov 03 18:44:12 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-e8969691-9927-42fb-8379-81efce255949 tempest-ProjectMemberTests-453978435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-499f387b-d421-4bcc-8220-d53aa346060e.b57868ff-0f14-4eaf-bb04-5cfc615913aa" returned: 0 in 0.246s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:44:12 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-e8969691-9927-42fb-8379-81efce255949 tempest-ProjectMemberTests-453978435 None] Lock "cinder-quobyte-b57868ff-0f14-4eaf-bb04-5cfc615913aa" released by "_delete_snapshot" :: held 1.348s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:44:12 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-e8969691-9927-42fb-8379-81efce255949 tempest-ProjectMemberTests-453978435 None] Lock "cinder-quobyte-499f387b-d421-4bcc-8220-d53aa346060e" released by "delete_snapshot" :: held 1.371s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:44:13 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-e8969691-9927-42fb-8379-81efce255949 tempest-ProjectMemberTests-453978435 None] Created reservations ['475d78a7-92fc-4979-99b4-08252ecc1378', 'e94bec67-0c26-4f5d-93da-20a54eb20f89', '0058b8d6-0528-4924-9d4a-dd6b27466b6f', '2ce7d976-f931-411c-83d0-b74536d9b84e'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:44:13 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-e8969691-9927-42fb-8379-81efce255949 tempest-ProjectMemberTests-453978435 None] Delete snapshot completed successfully.
Nov 03 18:44:13 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-e8969691-9927-42fb-8379-81efce255949 tempest-ProjectMemberTests-453978435 None] Lock "cinder-b57868ff-0f14-4eaf-bb04-5cfc615913aa-delete_snapshot" released by "delete_snapshot" :: held 1.507s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:44:13 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-64a1d693-5196-4dab-81d8-7f748e84c36e tempest-ProjectMemberTests-453978435 None] Acquiring lock "cinder-499f387b-d421-4bcc-8220-d53aa346060e-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:44:13 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-64a1d693-5196-4dab-81d8-7f748e84c36e tempest-ProjectMemberTests-453978435 None] Lock "cinder-499f387b-d421-4bcc-8220-d53aa346060e-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:44:13 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-64a1d693-5196-4dab-81d8-7f748e84c36e tempest-ProjectMemberTests-453978435 None] Acquiring lock "cinder-quobyte-499f387b-d421-4bcc-8220-d53aa346060e" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:44:13 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-64a1d693-5196-4dab-81d8-7f748e84c36e tempest-ProjectMemberTests-453978435 None] Lock "cinder-quobyte-499f387b-d421-4bcc-8220-d53aa346060e" acquired by "delete_volume" :: waited 0.016s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:44:13 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fade342-6c2f-4085-a5bc-4be5594fa9f5]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:44:13 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-64a1d693-5196-4dab-81d8-7f748e84c36e tempest-ProjectMemberTests-453978435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-499f387b-d421-4bcc-8220-d53aa346060e {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:44:13 devstack sudo[107636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-499f387b-d421-4bcc-8220-d53aa346060e
Nov 03 18:44:13 devstack sudo[107636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:44:14 devstack sudo[107636]: pam_unix(sudo:session): session closed for user root
Nov 03 18:44:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-64a1d693-5196-4dab-81d8-7f748e84c36e tempest-ProjectMemberTests-453978435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-499f387b-d421-4bcc-8220-d53aa346060e" returned: 0 in 0.357s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:44:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-64a1d693-5196-4dab-81d8-7f748e84c36e tempest-ProjectMemberTests-453978435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-499f387b-d421-4bcc-8220-d53aa346060e {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:44:14 devstack sudo[107641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-499f387b-d421-4bcc-8220-d53aa346060e
Nov 03 18:44:14 devstack sudo[107641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:44:14 devstack sudo[107641]: pam_unix(sudo:session): session closed for user root
Nov 03 18:44:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-64a1d693-5196-4dab-81d8-7f748e84c36e tempest-ProjectMemberTests-453978435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-499f387b-d421-4bcc-8220-d53aa346060e" returned: 0 in 0.239s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:44:14 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-64a1d693-5196-4dab-81d8-7f748e84c36e tempest-ProjectMemberTests-453978435 None] Lock "cinder-quobyte-499f387b-d421-4bcc-8220-d53aa346060e" released by "delete_volume" :: held 0.654s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:44:14 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-64a1d693-5196-4dab-81d8-7f748e84c36e tempest-ProjectMemberTests-453978435 None] Created reservations ['bd959280-bbf8-48e5-bc63-3c4364e53bc9', '7e35d302-b9de-4449-99c8-a0081427d689', 'ff8ab257-b6d0-4705-a52b-42e1fef81be4', '5e417f8f-e662-402c-be0d-1678ce74b23f'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:44:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-64a1d693-5196-4dab-81d8-7f748e84c36e tempest-ProjectMemberTests-453978435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:44:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-64a1d693-5196-4dab-81d8-7f748e84c36e tempest-ProjectMemberTests-453978435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:44:14 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-64a1d693-5196-4dab-81d8-7f748e84c36e tempest-ProjectMemberTests-453978435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:44:14 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-64a1d693-5196-4dab-81d8-7f748e84c36e tempest-ProjectMemberTests-453978435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:44:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-64a1d693-5196-4dab-81d8-7f748e84c36e tempest-ProjectMemberTests-453978435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:44:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-64a1d693-5196-4dab-81d8-7f748e84c36e tempest-ProjectMemberTests-453978435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:44:14 devstack sudo[107644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:44:14 devstack sudo[107644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:44:14 devstack sudo[107644]: pam_unix(sudo:session): session closed for user root
Nov 03 18:44:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-64a1d693-5196-4dab-81d8-7f748e84c36e tempest-ProjectMemberTests-453978435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.235s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:44:14 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-64a1d693-5196-4dab-81d8-7f748e84c36e tempest-ProjectMemberTests-453978435 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:44:14 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-64a1d693-5196-4dab-81d8-7f748e84c36e tempest-ProjectMemberTests-453978435 None] Deleted volume successfully.
Nov 03 18:44:14 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-64a1d693-5196-4dab-81d8-7f748e84c36e tempest-ProjectMemberTests-453978435 None] Lock "cinder-499f387b-d421-4bcc-8220-d53aa346060e-delete_volume" released by "delete_volume" :: held 1.075s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:44:14 devstack cinder-volume[86120]: DEBUG oslo_service.periodic_task [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86120) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 18:44:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:44:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:44:14 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:44:14 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:44:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:44:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:44:14 devstack sudo[107653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:44:14 devstack sudo[107653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:44:15 devstack sudo[107653]: pam_unix(sudo:session): session closed for user root
Nov 03 18:44:15 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.250s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:44:15 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:44:15 devstack cinder-volume[86120]: DEBUG oslo_service.periodic_task [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Running periodic task VolumeManager._thread_info {{(pid=86120) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 18:44:15 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] thread count: 29 {{(pid=86120) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 03 18:44:15 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] thread info: [<_MainThread(MainThread, started 134747145822336)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134747033686336)>, <Thread(Thread-3 (stat_writer), started daemon 134747030828736)>, <Thread(Rabbit-heartbeat, started daemon 134747035433408)>, <Thread(Thread-5 (_runner), started daemon 134747029587392)>, <Thread(Thread-7 (_runner), started daemon 134747029784256)>, <Thread(fd_logger, started daemon 134747027909120)>, <Thread(privsep_reader, started daemon 134747027006592)>, <Thread(tpool_thread_0, started daemon 134747018950336)>, <Thread(tpool_thread_1, started daemon 134747010541248)>, <Thread(tpool_thread_2, started daemon 134747002132160)>, <Thread(tpool_thread_3, started daemon 134746993723072)>, <Thread(tpool_thread_4, started daemon 134746985313984)>, <Thread(tpool_thread_5, started daemon 134746976904896)>, <Thread(tpool_thread_6, started daemon 134746968495808)>, <Thread(tpool_thread_7, started daemon 134746960086720)>, <Thread(tpool_thread_8, started daemon 134746951677632)>, <Thread(tpool_thread_9, started daemon 134746943268544)>, <Thread(tpool_thread_10, started daemon 134746934859456)>, <Thread(tpool_thread_11, started daemon 134746926450368)>, <Thread(tpool_thread_12, started daemon 134746918041280)>, <Thread(tpool_thread_13, started daemon 134746909632192)>, <Thread(tpool_thread_14, started daemon 134746901223104)>, <Thread(tpool_thread_15, started daemon 134746892814016)>, <Thread(tpool_thread_16, started daemon 134746884404928)>, <Thread(tpool_thread_17, started daemon 134746875995840)>, <Thread(tpool_thread_18, started daemon 134746867586752)>, <Thread(tpool_thread_19, started daemon 134746859177664)>, <Thread(Rabbit-heartbeat, started daemon 134747021651648)>] {{(pid=86120) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 03 18:44:15 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-9bc0401a-0fa9-4f85-a7a0-ebc768b55438 tempest-ProjectMemberTests-453978435 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:44:15 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-9bc0401a-0fa9-4f85-a7a0-ebc768b55438 tempest-ProjectMemberTests-453978435 None] Flow 'volume_create_manager' (cc38f83e-124e-4c1e-81de-e4de4a7ed199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:44:15 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-9bc0401a-0fa9-4f85-a7a0-ebc768b55438 tempest-ProjectMemberTests-453978435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ffb8c93-9448-4db3-8c86-a093d79f357a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:44:15 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-9bc0401a-0fa9-4f85-a7a0-ebc768b55438 tempest-ProjectMemberTests-453978435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ffb8c93-9448-4db3-8c86-a093d79f357a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:44:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1895223298',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d4c69f9-b824-4c17-8d58-c6e4327d17e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac23a66460684cf18a0ec466545c9237',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:44:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:44:15Z,use_quota=True,user_id='1e72acdc7ff048f4b0d1e488804038f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:44:15 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-9bc0401a-0fa9-4f85-a7a0-ebc768b55438 tempest-ProjectMemberTests-453978435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1839989-1ee9-4eb5-b47b-460e0ee61e25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:44:15 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-9bc0401a-0fa9-4f85-a7a0-ebc768b55438 tempest-ProjectMemberTests-453978435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1839989-1ee9-4eb5-b47b-460e0ee61e25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:44:15 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-9bc0401a-0fa9-4f85-a7a0-ebc768b55438 tempest-ProjectMemberTests-453978435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e307a7c-753b-471e-975e-a99c038529c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:44:15 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-9bc0401a-0fa9-4f85-a7a0-ebc768b55438 tempest-ProjectMemberTests-453978435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e307a7c-753b-471e-975e-a99c038529c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d4c69f9-b824-4c17-8d58-c6e4327d17e1', 'volume_name': 'volume-0d4c69f9-b824-4c17-8d58-c6e4327d17e1', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:44:15 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-9bc0401a-0fa9-4f85-a7a0-ebc768b55438 tempest-ProjectMemberTests-453978435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19e48aa0-a81f-49d7-9ecc-1650e2f70324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:44:15 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-9bc0401a-0fa9-4f85-a7a0-ebc768b55438 tempest-ProjectMemberTests-453978435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19e48aa0-a81f-49d7-9ecc-1650e2f70324) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:44:15 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-9bc0401a-0fa9-4f85-a7a0-ebc768b55438 tempest-ProjectMemberTests-453978435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e560ab4-f2e4-41ca-a7bd-6c50401472d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:44:15 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-9bc0401a-0fa9-4f85-a7a0-ebc768b55438 tempest-ProjectMemberTests-453978435 None] Volume 0d4c69f9-b824-4c17-8d58-c6e4327d17e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d4c69f9-b824-4c17-8d58-c6e4327d17e1', 'volume_size': 1}
Nov 03 18:44:15 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-9bc0401a-0fa9-4f85-a7a0-ebc768b55438 tempest-ProjectMemberTests-453978435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:44:15 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-9bc0401a-0fa9-4f85-a7a0-ebc768b55438 tempest-ProjectMemberTests-453978435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:44:15 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-9bc0401a-0fa9-4f85-a7a0-ebc768b55438 tempest-ProjectMemberTests-453978435 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:44:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1895223298',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d4c69f9-b824-4c17-8d58-c6e4327d17e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac23a66460684cf18a0ec466545c9237',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:44:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:44:15Z,use_quota=True,user_id='1e72acdc7ff048f4b0d1e488804038f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:44:15 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-9bc0401a-0fa9-4f85-a7a0-ebc768b55438 tempest-ProjectMemberTests-453978435 None] Creating volume 0d4c69f9-b824-4c17-8d58-c6e4327d17e1 {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:44:15 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-9bc0401a-0fa9-4f85-a7a0-ebc768b55438 tempest-ProjectMemberTests-453978435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:44:15 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-9bc0401a-0fa9-4f85-a7a0-ebc768b55438 tempest-ProjectMemberTests-453978435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:44:15 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-9bc0401a-0fa9-4f85-a7a0-ebc768b55438 tempest-ProjectMemberTests-453978435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:44:15 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-9bc0401a-0fa9-4f85-a7a0-ebc768b55438 tempest-ProjectMemberTests-453978435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:44:15 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-9bc0401a-0fa9-4f85-a7a0-ebc768b55438 tempest-ProjectMemberTests-453978435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:44:15 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-9bc0401a-0fa9-4f85-a7a0-ebc768b55438 tempest-ProjectMemberTests-453978435 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:44:15 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-9bc0401a-0fa9-4f85-a7a0-ebc768b55438 tempest-ProjectMemberTests-453978435 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:44:15 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-9bc0401a-0fa9-4f85-a7a0-ebc768b55438 tempest-ProjectMemberTests-453978435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-0d4c69f9-b824-4c17-8d58-c6e4327d17e1 1073741824 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:44:15 devstack sudo[107656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-0d4c69f9-b824-4c17-8d58-c6e4327d17e1 1073741824
Nov 03 18:44:15 devstack sudo[107656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:44:15 devstack sudo[107656]: pam_unix(sudo:session): session closed for user root
Nov 03 18:44:15 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-9bc0401a-0fa9-4f85-a7a0-ebc768b55438 tempest-ProjectMemberTests-453978435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-0d4c69f9-b824-4c17-8d58-c6e4327d17e1 1073741824" returned: 0 in 0.402s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:44:15 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-9bc0401a-0fa9-4f85-a7a0-ebc768b55438 tempest-ProjectMemberTests-453978435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-0d4c69f9-b824-4c17-8d58-c6e4327d17e1 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:44:15 devstack sudo[107662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-0d4c69f9-b824-4c17-8d58-c6e4327d17e1
Nov 03 18:44:15 devstack sudo[107662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:44:16 devstack sudo[107662]: pam_unix(sudo:session): session closed for user root
Nov 03 18:44:16 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-9bc0401a-0fa9-4f85-a7a0-ebc768b55438 tempest-ProjectMemberTests-453978435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-0d4c69f9-b824-4c17-8d58-c6e4327d17e1" returned: 0 in 0.243s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:44:16 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-9bc0401a-0fa9-4f85-a7a0-ebc768b55438 tempest-ProjectMemberTests-453978435 None] <== create_volume: return (685ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:44:16 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-9bc0401a-0fa9-4f85-a7a0-ebc768b55438 tempest-ProjectMemberTests-453978435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.688s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:44:16 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-9bc0401a-0fa9-4f85-a7a0-ebc768b55438 tempest-ProjectMemberTests-453978435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e560ab4-f2e4-41ca-a7bd-6c50401472d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d4c69f9-b824-4c17-8d58-c6e4327d17e1', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:44:16 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-9bc0401a-0fa9-4f85-a7a0-ebc768b55438 tempest-ProjectMemberTests-453978435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f931854d-9dd8-41bd-a1df-e3af38db19ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:44:16 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-9bc0401a-0fa9-4f85-a7a0-ebc768b55438 tempest-ProjectMemberTests-453978435 None] Volume volume-0d4c69f9-b824-4c17-8d58-c6e4327d17e1 (0d4c69f9-b824-4c17-8d58-c6e4327d17e1): created successfully
Nov 03 18:44:16 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-9bc0401a-0fa9-4f85-a7a0-ebc768b55438 tempest-ProjectMemberTests-453978435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f931854d-9dd8-41bd-a1df-e3af38db19ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:44:16 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-9bc0401a-0fa9-4f85-a7a0-ebc768b55438 tempest-ProjectMemberTests-453978435 None] Flow 'volume_create_manager' (cc38f83e-124e-4c1e-81de-e4de4a7ed199) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:44:16 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-9bc0401a-0fa9-4f85-a7a0-ebc768b55438 tempest-ProjectMemberTests-453978435 None] Created volume successfully.
Nov 03 18:44:16 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-b2e1de7f-401e-4025-97f6-1ffd00a7d3a2 tempest-ProjectMemberTests-453978435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:44:16 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-b2e1de7f-401e-4025-97f6-1ffd00a7d3a2 tempest-ProjectMemberTests-453978435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:44:16 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-b2e1de7f-401e-4025-97f6-1ffd00a7d3a2 tempest-ProjectMemberTests-453978435 None] Creating offline snapshot ea7e9200-02ff-4322-9f68-07cc93c7b867 of volume 0d4c69f9-b824-4c17-8d58-c6e4327d17e1 {{(pid=86120) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 18:44:16 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb0dc0b0-84f6-4487-a961-6d8a995a596d]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:44:16 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b2e1de7f-401e-4025-97f6-1ffd00a7d3a2 tempest-ProjectMemberTests-453978435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-0d4c69f9-b824-4c17-8d58-c6e4327d17e1 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:44:16 devstack sudo[107665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-0d4c69f9-b824-4c17-8d58-c6e4327d17e1
Nov 03 18:44:16 devstack sudo[107665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:44:16 devstack sudo[107665]: pam_unix(sudo:session): session closed for user root
Nov 03 18:44:16 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b2e1de7f-401e-4025-97f6-1ffd00a7d3a2 tempest-ProjectMemberTests-453978435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-0d4c69f9-b824-4c17-8d58-c6e4327d17e1" returned: 0 in 0.355s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:44:16 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b2e1de7f-401e-4025-97f6-1ffd00a7d3a2 tempest-ProjectMemberTests-453978435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-0d4c69f9-b824-4c17-8d58-c6e4327d17e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-0d4c69f9-b824-4c17-8d58-c6e4327d17e1.ea7e9200-02ff-4322-9f68-07cc93c7b867 1G {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:44:16 devstack sudo[107670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-0d4c69f9-b824-4c17-8d58-c6e4327d17e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-0d4c69f9-b824-4c17-8d58-c6e4327d17e1.ea7e9200-02ff-4322-9f68-07cc93c7b867 1G
Nov 03 18:44:16 devstack sudo[107670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:44:17 devstack sudo[107670]: pam_unix(sudo:session): session closed for user root
Nov 03 18:44:17 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b2e1de7f-401e-4025-97f6-1ffd00a7d3a2 tempest-ProjectMemberTests-453978435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-0d4c69f9-b824-4c17-8d58-c6e4327d17e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-0d4c69f9-b824-4c17-8d58-c6e4327d17e1.ea7e9200-02ff-4322-9f68-07cc93c7b867 1G" returned: 0 in 0.380s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:44:17 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b2e1de7f-401e-4025-97f6-1ffd00a7d3a2 tempest-ProjectMemberTests-453978435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d4c69f9-b824-4c17-8d58-c6e4327d17e1 -F qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-0d4c69f9-b824-4c17-8d58-c6e4327d17e1.ea7e9200-02ff-4322-9f68-07cc93c7b867 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:44:17 devstack sudo[107675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d4c69f9-b824-4c17-8d58-c6e4327d17e1 -F qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-0d4c69f9-b824-4c17-8d58-c6e4327d17e1.ea7e9200-02ff-4322-9f68-07cc93c7b867
Nov 03 18:44:17 devstack sudo[107675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:44:17 devstack sudo[107675]: pam_unix(sudo:session): session closed for user root
Nov 03 18:44:17 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b2e1de7f-401e-4025-97f6-1ffd00a7d3a2 tempest-ProjectMemberTests-453978435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d4c69f9-b824-4c17-8d58-c6e4327d17e1 -F qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-0d4c69f9-b824-4c17-8d58-c6e4327d17e1.ea7e9200-02ff-4322-9f68-07cc93c7b867" returned: 0 in 0.298s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:44:17 devstack cinder-volume[86120]: WARNING cinder.volume.drivers.remotefs [None req-b2e1de7f-401e-4025-97f6-1ffd00a7d3a2 tempest-ProjectMemberTests-453978435 None] /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-0d4c69f9-b824-4c17-8d58-c6e4327d17e1.ea7e9200-02ff-4322-9f68-07cc93c7b867 is being set with open permissions: ugo+rw
Nov 03 18:44:17 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b2e1de7f-401e-4025-97f6-1ffd00a7d3a2 tempest-ProjectMemberTests-453978435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-0d4c69f9-b824-4c17-8d58-c6e4327d17e1.ea7e9200-02ff-4322-9f68-07cc93c7b867 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:44:17 devstack sudo[107680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-0d4c69f9-b824-4c17-8d58-c6e4327d17e1.ea7e9200-02ff-4322-9f68-07cc93c7b867
Nov 03 18:44:17 devstack sudo[107680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:44:17 devstack sudo[107680]: pam_unix(sudo:session): session closed for user root
Nov 03 18:44:17 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b2e1de7f-401e-4025-97f6-1ffd00a7d3a2 tempest-ProjectMemberTests-453978435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-0d4c69f9-b824-4c17-8d58-c6e4327d17e1.ea7e9200-02ff-4322-9f68-07cc93c7b867" returned: 0 in 0.238s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:44:17 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b2e1de7f-401e-4025-97f6-1ffd00a7d3a2 tempest-ProjectMemberTests-453978435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-0d4c69f9-b824-4c17-8d58-c6e4327d17e1.info {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:44:17 devstack sudo[107683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-0d4c69f9-b824-4c17-8d58-c6e4327d17e1.info
Nov 03 18:44:17 devstack sudo[107683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:44:18 devstack sudo[107683]: pam_unix(sudo:session): session closed for user root
Nov 03 18:44:18 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b2e1de7f-401e-4025-97f6-1ffd00a7d3a2 tempest-ProjectMemberTests-453978435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-0d4c69f9-b824-4c17-8d58-c6e4327d17e1.info" returned: 0 in 0.246s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:44:18 devstack cinder-volume[86120]: WARNING cinder.volume.drivers.remotefs [None req-b2e1de7f-401e-4025-97f6-1ffd00a7d3a2 tempest-ProjectMemberTests-453978435 None] /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-0d4c69f9-b824-4c17-8d58-c6e4327d17e1.info is being set with open permissions: ugo+rw
Nov 03 18:44:18 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b2e1de7f-401e-4025-97f6-1ffd00a7d3a2 tempest-ProjectMemberTests-453978435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-0d4c69f9-b824-4c17-8d58-c6e4327d17e1.info {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:44:18 devstack sudo[107686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-0d4c69f9-b824-4c17-8d58-c6e4327d17e1.info
Nov 03 18:44:18 devstack sudo[107686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:44:18 devstack sudo[107686]: pam_unix(sudo:session): session closed for user root
Nov 03 18:44:18 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b2e1de7f-401e-4025-97f6-1ffd00a7d3a2 tempest-ProjectMemberTests-453978435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-0d4c69f9-b824-4c17-8d58-c6e4327d17e1.info" returned: 0 in 0.255s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:44:18 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-b2e1de7f-401e-4025-97f6-1ffd00a7d3a2 tempest-ProjectMemberTests-453978435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.850s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:44:18 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-b2e1de7f-401e-4025-97f6-1ffd00a7d3a2 tempest-ProjectMemberTests-453978435 None] Create snapshot completed successfully
Nov 03 18:44:18 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-466ce3e1-c7fc-44a3-89f1-c9bbf2df6725 tempest-ProjectMemberTests-453978435 None] Acquiring lock "cinder-ea7e9200-02ff-4322-9f68-07cc93c7b867-delete_snapshot" by "delete_snapshot" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:44:18 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-466ce3e1-c7fc-44a3-89f1-c9bbf2df6725 tempest-ProjectMemberTests-453978435 None] Lock "cinder-ea7e9200-02ff-4322-9f68-07cc93c7b867-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:44:18 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-466ce3e1-c7fc-44a3-89f1-c9bbf2df6725 tempest-ProjectMemberTests-453978435 None] Acquiring lock "cinder-quobyte-0d4c69f9-b824-4c17-8d58-c6e4327d17e1" by "delete_snapshot" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:44:18 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-466ce3e1-c7fc-44a3-89f1-c9bbf2df6725 tempest-ProjectMemberTests-453978435 None] Lock "cinder-quobyte-0d4c69f9-b824-4c17-8d58-c6e4327d17e1" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:44:18 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-466ce3e1-c7fc-44a3-89f1-c9bbf2df6725 tempest-ProjectMemberTests-453978435 None] Acquiring lock "cinder-quobyte-ea7e9200-02ff-4322-9f68-07cc93c7b867" by "_delete_snapshot" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:44:18 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-466ce3e1-c7fc-44a3-89f1-c9bbf2df6725 tempest-ProjectMemberTests-453978435 None] Lock "cinder-quobyte-ea7e9200-02ff-4322-9f68-07cc93c7b867" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:44:18 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-466ce3e1-c7fc-44a3-89f1-c9bbf2df6725 tempest-ProjectMemberTests-453978435 None] Deleting offline snapshot ea7e9200-02ff-4322-9f68-07cc93c7b867 of volume 0d4c69f9-b824-4c17-8d58-c6e4327d17e1 {{(pid=86120) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 18:44:18 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-466ce3e1-c7fc-44a3-89f1-c9bbf2df6725 tempest-ProjectMemberTests-453978435 None] snapshot_file for this snap is: volume-0d4c69f9-b824-4c17-8d58-c6e4327d17e1.ea7e9200-02ff-4322-9f68-07cc93c7b867 {{(pid=86120) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 18:44:18 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[23a39d12-279b-45df-84fb-5a305574e65b]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:44:18 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-466ce3e1-c7fc-44a3-89f1-c9bbf2df6725 tempest-ProjectMemberTests-453978435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-0d4c69f9-b824-4c17-8d58-c6e4327d17e1.ea7e9200-02ff-4322-9f68-07cc93c7b867 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:44:18 devstack sudo[107689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-0d4c69f9-b824-4c17-8d58-c6e4327d17e1.ea7e9200-02ff-4322-9f68-07cc93c7b867
Nov 03 18:44:18 devstack sudo[107689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:44:18 devstack sudo[107689]: pam_unix(sudo:session): session closed for user root
Nov 03 18:44:18 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-466ce3e1-c7fc-44a3-89f1-c9bbf2df6725 tempest-ProjectMemberTests-453978435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-0d4c69f9-b824-4c17-8d58-c6e4327d17e1.ea7e9200-02ff-4322-9f68-07cc93c7b867" returned: 0 in 0.349s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:44:18 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-466ce3e1-c7fc-44a3-89f1-c9bbf2df6725 tempest-ProjectMemberTests-453978435 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0d4c69f9-b824-4c17-8d58-c6e4327d17e1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86120) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 18:44:19 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[53f7d43f-38d9-4b62-b2f6-a6c5162b62de]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:44:19 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-466ce3e1-c7fc-44a3-89f1-c9bbf2df6725 tempest-ProjectMemberTests-453978435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-0d4c69f9-b824-4c17-8d58-c6e4327d17e1 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:44:19 devstack sudo[107695]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-0d4c69f9-b824-4c17-8d58-c6e4327d17e1
Nov 03 18:44:19 devstack sudo[107695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:44:19 devstack sudo[107695]: pam_unix(sudo:session): session closed for user root
Nov 03 18:44:19 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-466ce3e1-c7fc-44a3-89f1-c9bbf2df6725 tempest-ProjectMemberTests-453978435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-0d4c69f9-b824-4c17-8d58-c6e4327d17e1" returned: 0 in 0.341s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:44:19 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-466ce3e1-c7fc-44a3-89f1-c9bbf2df6725 tempest-ProjectMemberTests-453978435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-0d4c69f9-b824-4c17-8d58-c6e4327d17e1.ea7e9200-02ff-4322-9f68-07cc93c7b867 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:44:19 devstack sudo[107700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-0d4c69f9-b824-4c17-8d58-c6e4327d17e1.ea7e9200-02ff-4322-9f68-07cc93c7b867
Nov 03 18:44:19 devstack sudo[107700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:44:19 devstack sudo[107700]: pam_unix(sudo:session): session closed for user root
Nov 03 18:44:19 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-466ce3e1-c7fc-44a3-89f1-c9bbf2df6725 tempest-ProjectMemberTests-453978435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-0d4c69f9-b824-4c17-8d58-c6e4327d17e1.ea7e9200-02ff-4322-9f68-07cc93c7b867" returned: 0 in 0.330s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:44:19 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-466ce3e1-c7fc-44a3-89f1-c9bbf2df6725 tempest-ProjectMemberTests-453978435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-0d4c69f9-b824-4c17-8d58-c6e4327d17e1.ea7e9200-02ff-4322-9f68-07cc93c7b867 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:44:19 devstack sudo[107706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-0d4c69f9-b824-4c17-8d58-c6e4327d17e1.ea7e9200-02ff-4322-9f68-07cc93c7b867
Nov 03 18:44:19 devstack sudo[107706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:44:19 devstack sudo[107706]: pam_unix(sudo:session): session closed for user root
Nov 03 18:44:19 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-466ce3e1-c7fc-44a3-89f1-c9bbf2df6725 tempest-ProjectMemberTests-453978435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-0d4c69f9-b824-4c17-8d58-c6e4327d17e1.ea7e9200-02ff-4322-9f68-07cc93c7b867" returned: 0 in 0.245s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:44:19 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-466ce3e1-c7fc-44a3-89f1-c9bbf2df6725 tempest-ProjectMemberTests-453978435 None] Lock "cinder-quobyte-ea7e9200-02ff-4322-9f68-07cc93c7b867" released by "_delete_snapshot" :: held 1.360s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:44:19 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-466ce3e1-c7fc-44a3-89f1-c9bbf2df6725 tempest-ProjectMemberTests-453978435 None] Lock "cinder-quobyte-0d4c69f9-b824-4c17-8d58-c6e4327d17e1" released by "delete_snapshot" :: held 1.381s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:44:20 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-466ce3e1-c7fc-44a3-89f1-c9bbf2df6725 tempest-ProjectMemberTests-453978435 None] Created reservations ['f0d428f2-7a03-4ccb-9558-48f12a4ce26e', 'afca18d1-46cf-49a5-ba85-ad5007a2d8bd', 'ce9d9cdc-9a3e-4180-897f-e7d0bf6f50fd', '9953d098-bd04-4bbb-bae3-285f1c010cee'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:44:20 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-466ce3e1-c7fc-44a3-89f1-c9bbf2df6725 tempest-ProjectMemberTests-453978435 None] Delete snapshot completed successfully.
Nov 03 18:44:20 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-466ce3e1-c7fc-44a3-89f1-c9bbf2df6725 tempest-ProjectMemberTests-453978435 None] Lock "cinder-ea7e9200-02ff-4322-9f68-07cc93c7b867-delete_snapshot" released by "delete_snapshot" :: held 1.508s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:44:20 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-487212a8-e243-42cf-99ab-b135709d19cb tempest-ProjectMemberTests-453978435 None] Acquiring lock "cinder-0d4c69f9-b824-4c17-8d58-c6e4327d17e1-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:44:20 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-487212a8-e243-42cf-99ab-b135709d19cb tempest-ProjectMemberTests-453978435 None] Lock "cinder-0d4c69f9-b824-4c17-8d58-c6e4327d17e1-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:44:20 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-487212a8-e243-42cf-99ab-b135709d19cb tempest-ProjectMemberTests-453978435 None] Acquiring lock "cinder-quobyte-0d4c69f9-b824-4c17-8d58-c6e4327d17e1" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:44:20 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-487212a8-e243-42cf-99ab-b135709d19cb tempest-ProjectMemberTests-453978435 None] Lock "cinder-quobyte-0d4c69f9-b824-4c17-8d58-c6e4327d17e1" acquired by "delete_volume" :: waited 0.017s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:44:20 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[67407c3d-c696-4871-be40-49721259d81a]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:44:20 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-487212a8-e243-42cf-99ab-b135709d19cb tempest-ProjectMemberTests-453978435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-0d4c69f9-b824-4c17-8d58-c6e4327d17e1 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:44:20 devstack sudo[107709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-0d4c69f9-b824-4c17-8d58-c6e4327d17e1
Nov 03 18:44:20 devstack sudo[107709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:44:21 devstack sudo[107709]: pam_unix(sudo:session): session closed for user root
Nov 03 18:44:21 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-487212a8-e243-42cf-99ab-b135709d19cb tempest-ProjectMemberTests-453978435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-0d4c69f9-b824-4c17-8d58-c6e4327d17e1" returned: 0 in 0.348s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:44:21 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-487212a8-e243-42cf-99ab-b135709d19cb tempest-ProjectMemberTests-453978435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-0d4c69f9-b824-4c17-8d58-c6e4327d17e1 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:44:21 devstack sudo[107714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-0d4c69f9-b824-4c17-8d58-c6e4327d17e1
Nov 03 18:44:21 devstack sudo[107714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:44:21 devstack sudo[107714]: pam_unix(sudo:session): session closed for user root
Nov 03 18:44:21 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-487212a8-e243-42cf-99ab-b135709d19cb tempest-ProjectMemberTests-453978435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-0d4c69f9-b824-4c17-8d58-c6e4327d17e1" returned: 0 in 0.245s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:44:21 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-487212a8-e243-42cf-99ab-b135709d19cb tempest-ProjectMemberTests-453978435 None] Lock "cinder-quobyte-0d4c69f9-b824-4c17-8d58-c6e4327d17e1" released by "delete_volume" :: held 0.654s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:44:21 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-487212a8-e243-42cf-99ab-b135709d19cb tempest-ProjectMemberTests-453978435 None] Created reservations ['20ab81c4-ecb3-4a5d-93f0-7a693e6c5435', 'c896dd00-784b-4ac8-9448-8d581ef00763', '22a508f6-ca73-4138-8aa5-0fe26b607053', 'a1e39da4-f4cf-439b-b16b-d563d2352314'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:44:21 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-487212a8-e243-42cf-99ab-b135709d19cb tempest-ProjectMemberTests-453978435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:44:21 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-487212a8-e243-42cf-99ab-b135709d19cb tempest-ProjectMemberTests-453978435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:44:21 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-487212a8-e243-42cf-99ab-b135709d19cb tempest-ProjectMemberTests-453978435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:44:21 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-487212a8-e243-42cf-99ab-b135709d19cb tempest-ProjectMemberTests-453978435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:44:21 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-487212a8-e243-42cf-99ab-b135709d19cb tempest-ProjectMemberTests-453978435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:44:21 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-487212a8-e243-42cf-99ab-b135709d19cb tempest-ProjectMemberTests-453978435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:44:21 devstack sudo[107717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:44:21 devstack sudo[107717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:44:21 devstack sudo[107717]: pam_unix(sudo:session): session closed for user root
Nov 03 18:44:21 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-487212a8-e243-42cf-99ab-b135709d19cb tempest-ProjectMemberTests-453978435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.242s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:44:21 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-487212a8-e243-42cf-99ab-b135709d19cb tempest-ProjectMemberTests-453978435 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:44:21 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-487212a8-e243-42cf-99ab-b135709d19cb tempest-ProjectMemberTests-453978435 None] Deleted volume successfully.
Nov 03 18:44:21 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-487212a8-e243-42cf-99ab-b135709d19cb tempest-ProjectMemberTests-453978435 None] Lock "cinder-0d4c69f9-b824-4c17-8d58-c6e4327d17e1-delete_volume" released by "delete_volume" :: held 1.083s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:44:22 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6a6c791-caae-478e-89bf-d6a8a0c1403f tempest-ProjectMemberTests-453978435 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:44:22 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-e6a6c791-caae-478e-89bf-d6a8a0c1403f tempest-ProjectMemberTests-453978435 None] Flow 'volume_create_manager' (4223f7c0-d052-41e9-a5da-446524bfc667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:44:22 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-e6a6c791-caae-478e-89bf-d6a8a0c1403f tempest-ProjectMemberTests-453978435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac73f527-9121-42ab-8c08-3bf8a6234365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:44:22 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-e6a6c791-caae-478e-89bf-d6a8a0c1403f tempest-ProjectMemberTests-453978435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac73f527-9121-42ab-8c08-3bf8a6234365) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:44:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1989968173',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cc74b29-0061-4568-911e-a1dd3cdb2ac3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac23a66460684cf18a0ec466545c9237',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:44:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:44:22Z,use_quota=True,user_id='1e72acdc7ff048f4b0d1e488804038f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:44:22 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-e6a6c791-caae-478e-89bf-d6a8a0c1403f tempest-ProjectMemberTests-453978435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e452886d-602f-41a2-8051-f2f2a6724503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:44:22 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-e6a6c791-caae-478e-89bf-d6a8a0c1403f tempest-ProjectMemberTests-453978435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e452886d-602f-41a2-8051-f2f2a6724503) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:44:22 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-e6a6c791-caae-478e-89bf-d6a8a0c1403f tempest-ProjectMemberTests-453978435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbcbb530-3b64-484e-a8af-d1283b3b8943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:44:22 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-e6a6c791-caae-478e-89bf-d6a8a0c1403f tempest-ProjectMemberTests-453978435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbcbb530-3b64-484e-a8af-d1283b3b8943) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6cc74b29-0061-4568-911e-a1dd3cdb2ac3', 'volume_name': 'volume-6cc74b29-0061-4568-911e-a1dd3cdb2ac3', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:44:22 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-e6a6c791-caae-478e-89bf-d6a8a0c1403f tempest-ProjectMemberTests-453978435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a969804-35db-4f00-8bbb-fd9da0c45091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:44:22 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-e6a6c791-caae-478e-89bf-d6a8a0c1403f tempest-ProjectMemberTests-453978435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a969804-35db-4f00-8bbb-fd9da0c45091) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:44:22 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-e6a6c791-caae-478e-89bf-d6a8a0c1403f tempest-ProjectMemberTests-453978435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7978275a-35ce-487a-b1bd-507a43cf1287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:44:22 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-e6a6c791-caae-478e-89bf-d6a8a0c1403f tempest-ProjectMemberTests-453978435 None] Volume 6cc74b29-0061-4568-911e-a1dd3cdb2ac3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6cc74b29-0061-4568-911e-a1dd3cdb2ac3', 'volume_size': 1}
Nov 03 18:44:22 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-e6a6c791-caae-478e-89bf-d6a8a0c1403f tempest-ProjectMemberTests-453978435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:44:22 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-e6a6c791-caae-478e-89bf-d6a8a0c1403f tempest-ProjectMemberTests-453978435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:44:22 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-e6a6c791-caae-478e-89bf-d6a8a0c1403f tempest-ProjectMemberTests-453978435 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:44:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1989968173',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cc74b29-0061-4568-911e-a1dd3cdb2ac3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac23a66460684cf18a0ec466545c9237',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:44:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:44:22Z,use_quota=True,user_id='1e72acdc7ff048f4b0d1e488804038f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:44:22 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-e6a6c791-caae-478e-89bf-d6a8a0c1403f tempest-ProjectMemberTests-453978435 None] Creating volume 6cc74b29-0061-4568-911e-a1dd3cdb2ac3 {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:44:22 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-e6a6c791-caae-478e-89bf-d6a8a0c1403f tempest-ProjectMemberTests-453978435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:44:22 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-e6a6c791-caae-478e-89bf-d6a8a0c1403f tempest-ProjectMemberTests-453978435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:44:22 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-e6a6c791-caae-478e-89bf-d6a8a0c1403f tempest-ProjectMemberTests-453978435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:44:22 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-e6a6c791-caae-478e-89bf-d6a8a0c1403f tempest-ProjectMemberTests-453978435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:44:22 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-e6a6c791-caae-478e-89bf-d6a8a0c1403f tempest-ProjectMemberTests-453978435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:44:22 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-e6a6c791-caae-478e-89bf-d6a8a0c1403f tempest-ProjectMemberTests-453978435 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:44:22 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-e6a6c791-caae-478e-89bf-d6a8a0c1403f tempest-ProjectMemberTests-453978435 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:44:22 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-e6a6c791-caae-478e-89bf-d6a8a0c1403f tempest-ProjectMemberTests-453978435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6cc74b29-0061-4568-911e-a1dd3cdb2ac3 1073741824 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:44:22 devstack sudo[107720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6cc74b29-0061-4568-911e-a1dd3cdb2ac3 1073741824
Nov 03 18:44:22 devstack sudo[107720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:44:22 devstack sudo[107720]: pam_unix(sudo:session): session closed for user root
Nov 03 18:44:22 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-e6a6c791-caae-478e-89bf-d6a8a0c1403f tempest-ProjectMemberTests-453978435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6cc74b29-0061-4568-911e-a1dd3cdb2ac3 1073741824" returned: 0 in 0.424s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:44:22 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-e6a6c791-caae-478e-89bf-d6a8a0c1403f tempest-ProjectMemberTests-453978435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6cc74b29-0061-4568-911e-a1dd3cdb2ac3 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:44:22 devstack sudo[107726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6cc74b29-0061-4568-911e-a1dd3cdb2ac3
Nov 03 18:44:22 devstack sudo[107726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:44:23 devstack sudo[107726]: pam_unix(sudo:session): session closed for user root
Nov 03 18:44:23 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-e6a6c791-caae-478e-89bf-d6a8a0c1403f tempest-ProjectMemberTests-453978435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6cc74b29-0061-4568-911e-a1dd3cdb2ac3" returned: 0 in 0.256s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:44:23 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-e6a6c791-caae-478e-89bf-d6a8a0c1403f tempest-ProjectMemberTests-453978435 None] <== create_volume: return (728ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:44:23 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-e6a6c791-caae-478e-89bf-d6a8a0c1403f tempest-ProjectMemberTests-453978435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.731s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:44:23 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-e6a6c791-caae-478e-89bf-d6a8a0c1403f tempest-ProjectMemberTests-453978435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7978275a-35ce-487a-b1bd-507a43cf1287) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6cc74b29-0061-4568-911e-a1dd3cdb2ac3', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:44:23 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-e6a6c791-caae-478e-89bf-d6a8a0c1403f tempest-ProjectMemberTests-453978435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6c4188d-1912-4600-8f07-ab54be402233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:44:23 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-e6a6c791-caae-478e-89bf-d6a8a0c1403f tempest-ProjectMemberTests-453978435 None] Volume volume-6cc74b29-0061-4568-911e-a1dd3cdb2ac3 (6cc74b29-0061-4568-911e-a1dd3cdb2ac3): created successfully
Nov 03 18:44:23 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-e6a6c791-caae-478e-89bf-d6a8a0c1403f tempest-ProjectMemberTests-453978435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6c4188d-1912-4600-8f07-ab54be402233) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:44:23 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-e6a6c791-caae-478e-89bf-d6a8a0c1403f tempest-ProjectMemberTests-453978435 None] Flow 'volume_create_manager' (4223f7c0-d052-41e9-a5da-446524bfc667) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:44:23 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-e6a6c791-caae-478e-89bf-d6a8a0c1403f tempest-ProjectMemberTests-453978435 None] Created volume successfully.
Nov 03 18:44:23 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-923c56da-34c5-497c-a3c6-8467215d5d8a tempest-ProjectMemberTests-453978435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:44:23 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-923c56da-34c5-497c-a3c6-8467215d5d8a tempest-ProjectMemberTests-453978435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:44:23 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-923c56da-34c5-497c-a3c6-8467215d5d8a tempest-ProjectMemberTests-453978435 None] Creating offline snapshot 34d32d4e-6b92-4636-801b-e12522c85e54 of volume 6cc74b29-0061-4568-911e-a1dd3cdb2ac3 {{(pid=86120) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 18:44:23 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[33b76949-f6f3-4d93-a92b-d591b8980830]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:44:23 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-923c56da-34c5-497c-a3c6-8467215d5d8a tempest-ProjectMemberTests-453978435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6cc74b29-0061-4568-911e-a1dd3cdb2ac3 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:44:23 devstack sudo[107729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6cc74b29-0061-4568-911e-a1dd3cdb2ac3
Nov 03 18:44:23 devstack sudo[107729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:44:23 devstack sudo[107729]: pam_unix(sudo:session): session closed for user root
Nov 03 18:44:23 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-923c56da-34c5-497c-a3c6-8467215d5d8a tempest-ProjectMemberTests-453978435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6cc74b29-0061-4568-911e-a1dd3cdb2ac3" returned: 0 in 0.363s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:44:23 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-923c56da-34c5-497c-a3c6-8467215d5d8a tempest-ProjectMemberTests-453978435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6cc74b29-0061-4568-911e-a1dd3cdb2ac3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6cc74b29-0061-4568-911e-a1dd3cdb2ac3.34d32d4e-6b92-4636-801b-e12522c85e54 1G {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:44:23 devstack sudo[107734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6cc74b29-0061-4568-911e-a1dd3cdb2ac3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6cc74b29-0061-4568-911e-a1dd3cdb2ac3.34d32d4e-6b92-4636-801b-e12522c85e54 1G
Nov 03 18:44:23 devstack sudo[107734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:44:24 devstack sudo[107734]: pam_unix(sudo:session): session closed for user root
Nov 03 18:44:24 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-923c56da-34c5-497c-a3c6-8467215d5d8a tempest-ProjectMemberTests-453978435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6cc74b29-0061-4568-911e-a1dd3cdb2ac3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6cc74b29-0061-4568-911e-a1dd3cdb2ac3.34d32d4e-6b92-4636-801b-e12522c85e54 1G" returned: 0 in 0.394s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:44:24 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-923c56da-34c5-497c-a3c6-8467215d5d8a tempest-ProjectMemberTests-453978435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6cc74b29-0061-4568-911e-a1dd3cdb2ac3 -F qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6cc74b29-0061-4568-911e-a1dd3cdb2ac3.34d32d4e-6b92-4636-801b-e12522c85e54 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:44:24 devstack sudo[107739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6cc74b29-0061-4568-911e-a1dd3cdb2ac3 -F qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6cc74b29-0061-4568-911e-a1dd3cdb2ac3.34d32d4e-6b92-4636-801b-e12522c85e54
Nov 03 18:44:24 devstack sudo[107739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:44:24 devstack sudo[107739]: pam_unix(sudo:session): session closed for user root
Nov 03 18:44:24 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-923c56da-34c5-497c-a3c6-8467215d5d8a tempest-ProjectMemberTests-453978435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6cc74b29-0061-4568-911e-a1dd3cdb2ac3 -F qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6cc74b29-0061-4568-911e-a1dd3cdb2ac3.34d32d4e-6b92-4636-801b-e12522c85e54" returned: 0 in 0.283s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:44:24 devstack cinder-volume[86120]: WARNING cinder.volume.drivers.remotefs [None req-923c56da-34c5-497c-a3c6-8467215d5d8a tempest-ProjectMemberTests-453978435 None] /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6cc74b29-0061-4568-911e-a1dd3cdb2ac3.34d32d4e-6b92-4636-801b-e12522c85e54 is being set with open permissions: ugo+rw
Nov 03 18:44:24 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-923c56da-34c5-497c-a3c6-8467215d5d8a tempest-ProjectMemberTests-453978435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6cc74b29-0061-4568-911e-a1dd3cdb2ac3.34d32d4e-6b92-4636-801b-e12522c85e54 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:44:24 devstack sudo[107744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6cc74b29-0061-4568-911e-a1dd3cdb2ac3.34d32d4e-6b92-4636-801b-e12522c85e54
Nov 03 18:44:24 devstack sudo[107744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:44:24 devstack sudo[107744]: pam_unix(sudo:session): session closed for user root
Nov 03 18:44:24 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-923c56da-34c5-497c-a3c6-8467215d5d8a tempest-ProjectMemberTests-453978435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6cc74b29-0061-4568-911e-a1dd3cdb2ac3.34d32d4e-6b92-4636-801b-e12522c85e54" returned: 0 in 0.237s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:44:24 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-923c56da-34c5-497c-a3c6-8467215d5d8a tempest-ProjectMemberTests-453978435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6cc74b29-0061-4568-911e-a1dd3cdb2ac3.info {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:44:24 devstack sudo[107747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6cc74b29-0061-4568-911e-a1dd3cdb2ac3.info
Nov 03 18:44:24 devstack sudo[107747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:44:25 devstack sudo[107747]: pam_unix(sudo:session): session closed for user root
Nov 03 18:44:25 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-923c56da-34c5-497c-a3c6-8467215d5d8a tempest-ProjectMemberTests-453978435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6cc74b29-0061-4568-911e-a1dd3cdb2ac3.info" returned: 0 in 0.257s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:44:25 devstack cinder-volume[86120]: WARNING cinder.volume.drivers.remotefs [None req-923c56da-34c5-497c-a3c6-8467215d5d8a tempest-ProjectMemberTests-453978435 None] /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6cc74b29-0061-4568-911e-a1dd3cdb2ac3.info is being set with open permissions: ugo+rw
Nov 03 18:44:25 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-923c56da-34c5-497c-a3c6-8467215d5d8a tempest-ProjectMemberTests-453978435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6cc74b29-0061-4568-911e-a1dd3cdb2ac3.info {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:44:25 devstack sudo[107750]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6cc74b29-0061-4568-911e-a1dd3cdb2ac3.info
Nov 03 18:44:25 devstack sudo[107750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:44:25 devstack sudo[107750]: pam_unix(sudo:session): session closed for user root
Nov 03 18:44:25 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-923c56da-34c5-497c-a3c6-8467215d5d8a tempest-ProjectMemberTests-453978435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6cc74b29-0061-4568-911e-a1dd3cdb2ac3.info" returned: 0 in 0.245s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:44:25 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-923c56da-34c5-497c-a3c6-8467215d5d8a tempest-ProjectMemberTests-453978435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.862s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:44:25 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-923c56da-34c5-497c-a3c6-8467215d5d8a tempest-ProjectMemberTests-453978435 None] Create snapshot completed successfully
Nov 03 18:44:25 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-23cc993e-661c-47c8-9858-d3ad3adbfb4f tempest-ProjectMemberTests-453978435 None] Acquiring lock "cinder-34d32d4e-6b92-4636-801b-e12522c85e54-delete_snapshot" by "delete_snapshot" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:44:25 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-23cc993e-661c-47c8-9858-d3ad3adbfb4f tempest-ProjectMemberTests-453978435 None] Lock "cinder-34d32d4e-6b92-4636-801b-e12522c85e54-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:44:25 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-23cc993e-661c-47c8-9858-d3ad3adbfb4f tempest-ProjectMemberTests-453978435 None] Acquiring lock "cinder-quobyte-6cc74b29-0061-4568-911e-a1dd3cdb2ac3" by "delete_snapshot" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:44:25 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-23cc993e-661c-47c8-9858-d3ad3adbfb4f tempest-ProjectMemberTests-453978435 None] Lock "cinder-quobyte-6cc74b29-0061-4568-911e-a1dd3cdb2ac3" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:44:25 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-23cc993e-661c-47c8-9858-d3ad3adbfb4f tempest-ProjectMemberTests-453978435 None] Acquiring lock "cinder-quobyte-34d32d4e-6b92-4636-801b-e12522c85e54" by "_delete_snapshot" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:44:25 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-23cc993e-661c-47c8-9858-d3ad3adbfb4f tempest-ProjectMemberTests-453978435 None] Lock "cinder-quobyte-34d32d4e-6b92-4636-801b-e12522c85e54" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:44:25 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-23cc993e-661c-47c8-9858-d3ad3adbfb4f tempest-ProjectMemberTests-453978435 None] Deleting offline snapshot 34d32d4e-6b92-4636-801b-e12522c85e54 of volume 6cc74b29-0061-4568-911e-a1dd3cdb2ac3 {{(pid=86120) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 18:44:25 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-23cc993e-661c-47c8-9858-d3ad3adbfb4f tempest-ProjectMemberTests-453978435 None] snapshot_file for this snap is: volume-6cc74b29-0061-4568-911e-a1dd3cdb2ac3.34d32d4e-6b92-4636-801b-e12522c85e54 {{(pid=86120) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 18:44:25 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[c88764b3-a0fb-4d6f-b616-b20b37bf6511]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:44:25 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-23cc993e-661c-47c8-9858-d3ad3adbfb4f tempest-ProjectMemberTests-453978435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6cc74b29-0061-4568-911e-a1dd3cdb2ac3.34d32d4e-6b92-4636-801b-e12522c85e54 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:44:25 devstack sudo[107753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6cc74b29-0061-4568-911e-a1dd3cdb2ac3.34d32d4e-6b92-4636-801b-e12522c85e54
Nov 03 18:44:25 devstack sudo[107753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:44:26 devstack sudo[107753]: pam_unix(sudo:session): session closed for user root
Nov 03 18:44:26 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-23cc993e-661c-47c8-9858-d3ad3adbfb4f tempest-ProjectMemberTests-453978435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6cc74b29-0061-4568-911e-a1dd3cdb2ac3.34d32d4e-6b92-4636-801b-e12522c85e54" returned: 0 in 0.358s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:44:26 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-23cc993e-661c-47c8-9858-d3ad3adbfb4f tempest-ProjectMemberTests-453978435 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6cc74b29-0061-4568-911e-a1dd3cdb2ac3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86120) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 18:44:26 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[a311fb4e-3378-46c7-a0fc-c5c43a7a0a54]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:44:26 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-23cc993e-661c-47c8-9858-d3ad3adbfb4f tempest-ProjectMemberTests-453978435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6cc74b29-0061-4568-911e-a1dd3cdb2ac3 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:44:26 devstack sudo[107758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6cc74b29-0061-4568-911e-a1dd3cdb2ac3
Nov 03 18:44:26 devstack sudo[107758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:44:26 devstack sudo[107758]: pam_unix(sudo:session): session closed for user root
Nov 03 18:44:26 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-23cc993e-661c-47c8-9858-d3ad3adbfb4f tempest-ProjectMemberTests-453978435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6cc74b29-0061-4568-911e-a1dd3cdb2ac3" returned: 0 in 0.353s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:44:26 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-23cc993e-661c-47c8-9858-d3ad3adbfb4f tempest-ProjectMemberTests-453978435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6cc74b29-0061-4568-911e-a1dd3cdb2ac3.34d32d4e-6b92-4636-801b-e12522c85e54 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:44:26 devstack sudo[107763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6cc74b29-0061-4568-911e-a1dd3cdb2ac3.34d32d4e-6b92-4636-801b-e12522c85e54
Nov 03 18:44:26 devstack sudo[107763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:44:26 devstack sudo[107763]: pam_unix(sudo:session): session closed for user root
Nov 03 18:44:26 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-23cc993e-661c-47c8-9858-d3ad3adbfb4f tempest-ProjectMemberTests-453978435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6cc74b29-0061-4568-911e-a1dd3cdb2ac3.34d32d4e-6b92-4636-801b-e12522c85e54" returned: 0 in 0.333s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:44:26 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-23cc993e-661c-47c8-9858-d3ad3adbfb4f tempest-ProjectMemberTests-453978435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6cc74b29-0061-4568-911e-a1dd3cdb2ac3.34d32d4e-6b92-4636-801b-e12522c85e54 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:44:26 devstack sudo[107769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6cc74b29-0061-4568-911e-a1dd3cdb2ac3.34d32d4e-6b92-4636-801b-e12522c85e54
Nov 03 18:44:26 devstack sudo[107769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:44:26 devstack sudo[107769]: pam_unix(sudo:session): session closed for user root
Nov 03 18:44:26 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-23cc993e-661c-47c8-9858-d3ad3adbfb4f tempest-ProjectMemberTests-453978435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6cc74b29-0061-4568-911e-a1dd3cdb2ac3.34d32d4e-6b92-4636-801b-e12522c85e54" returned: 0 in 0.246s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:44:27 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-23cc993e-661c-47c8-9858-d3ad3adbfb4f tempest-ProjectMemberTests-453978435 None] Lock "cinder-quobyte-34d32d4e-6b92-4636-801b-e12522c85e54" released by "_delete_snapshot" :: held 1.380s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:44:27 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-23cc993e-661c-47c8-9858-d3ad3adbfb4f tempest-ProjectMemberTests-453978435 None] Lock "cinder-quobyte-6cc74b29-0061-4568-911e-a1dd3cdb2ac3" released by "delete_snapshot" :: held 1.400s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:44:27 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-23cc993e-661c-47c8-9858-d3ad3adbfb4f tempest-ProjectMemberTests-453978435 None] Created reservations ['2c915c75-adda-459f-8b31-37b3e8ca39da', '9dc6bcf6-b5b5-464f-8fd7-10be9c848ad6', '4103a51f-acfd-444f-a8dc-7a81be19d980', 'fa850a7b-6196-409d-9e0a-40e6a042a8a5'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:44:27 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-23cc993e-661c-47c8-9858-d3ad3adbfb4f tempest-ProjectMemberTests-453978435 None] Delete snapshot completed successfully.
Nov 03 18:44:27 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-23cc993e-661c-47c8-9858-d3ad3adbfb4f tempest-ProjectMemberTests-453978435 None] Lock "cinder-34d32d4e-6b92-4636-801b-e12522c85e54-delete_snapshot" released by "delete_snapshot" :: held 1.528s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:44:27 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-0a4aa9af-24cb-4204-9896-c7c17c1204ef tempest-ProjectMemberTests-453978435 None] Acquiring lock "cinder-6cc74b29-0061-4568-911e-a1dd3cdb2ac3-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:44:27 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-0a4aa9af-24cb-4204-9896-c7c17c1204ef tempest-ProjectMemberTests-453978435 None] Lock "cinder-6cc74b29-0061-4568-911e-a1dd3cdb2ac3-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:44:27 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-0a4aa9af-24cb-4204-9896-c7c17c1204ef tempest-ProjectMemberTests-453978435 None] Acquiring lock "cinder-quobyte-6cc74b29-0061-4568-911e-a1dd3cdb2ac3" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:44:27 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-0a4aa9af-24cb-4204-9896-c7c17c1204ef tempest-ProjectMemberTests-453978435 None] Lock "cinder-quobyte-6cc74b29-0061-4568-911e-a1dd3cdb2ac3" acquired by "delete_volume" :: waited 0.014s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:44:27 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a517f32-b99b-45c8-b4dc-501e6d5cda1f]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:44:27 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-0a4aa9af-24cb-4204-9896-c7c17c1204ef tempest-ProjectMemberTests-453978435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6cc74b29-0061-4568-911e-a1dd3cdb2ac3 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:44:27 devstack sudo[107772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6cc74b29-0061-4568-911e-a1dd3cdb2ac3
Nov 03 18:44:27 devstack sudo[107772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:44:28 devstack sudo[107772]: pam_unix(sudo:session): session closed for user root
Nov 03 18:44:28 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-0a4aa9af-24cb-4204-9896-c7c17c1204ef tempest-ProjectMemberTests-453978435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6cc74b29-0061-4568-911e-a1dd3cdb2ac3" returned: 0 in 0.361s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:44:28 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-0a4aa9af-24cb-4204-9896-c7c17c1204ef tempest-ProjectMemberTests-453978435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6cc74b29-0061-4568-911e-a1dd3cdb2ac3 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:44:28 devstack sudo[107777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6cc74b29-0061-4568-911e-a1dd3cdb2ac3
Nov 03 18:44:28 devstack sudo[107777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:44:28 devstack sudo[107777]: pam_unix(sudo:session): session closed for user root
Nov 03 18:44:28 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-0a4aa9af-24cb-4204-9896-c7c17c1204ef tempest-ProjectMemberTests-453978435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6cc74b29-0061-4568-911e-a1dd3cdb2ac3" returned: 0 in 0.251s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:44:28 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-0a4aa9af-24cb-4204-9896-c7c17c1204ef tempest-ProjectMemberTests-453978435 None] Lock "cinder-quobyte-6cc74b29-0061-4568-911e-a1dd3cdb2ac3" released by "delete_volume" :: held 0.671s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:44:28 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-0a4aa9af-24cb-4204-9896-c7c17c1204ef tempest-ProjectMemberTests-453978435 None] Created reservations ['837ec9f9-c315-4755-a3a2-1bf1813d8028', 'cf356cc4-0759-421c-b5a5-e55411de9598', '8abc6a5c-2840-420d-9335-5874cba38f91', 'ec13f616-a4c7-42ca-a8a2-2a992b25c63c'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:44:28 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-0a4aa9af-24cb-4204-9896-c7c17c1204ef tempest-ProjectMemberTests-453978435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:44:28 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-0a4aa9af-24cb-4204-9896-c7c17c1204ef tempest-ProjectMemberTests-453978435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:44:28 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-0a4aa9af-24cb-4204-9896-c7c17c1204ef tempest-ProjectMemberTests-453978435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:44:28 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-0a4aa9af-24cb-4204-9896-c7c17c1204ef tempest-ProjectMemberTests-453978435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:44:28 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-0a4aa9af-24cb-4204-9896-c7c17c1204ef tempest-ProjectMemberTests-453978435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:44:28 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-0a4aa9af-24cb-4204-9896-c7c17c1204ef tempest-ProjectMemberTests-453978435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:44:28 devstack sudo[107780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:44:28 devstack sudo[107780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:44:28 devstack sudo[107780]: pam_unix(sudo:session): session closed for user root
Nov 03 18:44:28 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-0a4aa9af-24cb-4204-9896-c7c17c1204ef tempest-ProjectMemberTests-453978435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.257s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:44:28 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-0a4aa9af-24cb-4204-9896-c7c17c1204ef tempest-ProjectMemberTests-453978435 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:44:28 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-0a4aa9af-24cb-4204-9896-c7c17c1204ef tempest-ProjectMemberTests-453978435 None] Deleted volume successfully.
Nov 03 18:44:28 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-0a4aa9af-24cb-4204-9896-c7c17c1204ef tempest-ProjectMemberTests-453978435 None] Lock "cinder-6cc74b29-0061-4568-911e-a1dd3cdb2ac3-delete_volume" released by "delete_volume" :: held 1.167s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:44:29 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8bc07a8-26c1-43e6-bb59-9168eda15466 tempest-ProjectMemberTests-453978435 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:44:29 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-e8bc07a8-26c1-43e6-bb59-9168eda15466 tempest-ProjectMemberTests-453978435 None] Flow 'volume_create_manager' (5446dce7-b747-47f7-9ff9-e60733a622af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:44:29 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-e8bc07a8-26c1-43e6-bb59-9168eda15466 tempest-ProjectMemberTests-453978435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7be74a4e-3238-408a-ac07-824a873c049b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:44:29 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-e8bc07a8-26c1-43e6-bb59-9168eda15466 tempest-ProjectMemberTests-453978435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7be74a4e-3238-408a-ac07-824a873c049b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:44:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-131964409',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b904e05-a365-4993-aa30-77d5af7594fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac23a66460684cf18a0ec466545c9237',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:44:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:44:29Z,use_quota=True,user_id='1e72acdc7ff048f4b0d1e488804038f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:44:29 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-e8bc07a8-26c1-43e6-bb59-9168eda15466 tempest-ProjectMemberTests-453978435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (118decda-48c9-436b-bfcf-79359dd19ace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:44:29 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-e8bc07a8-26c1-43e6-bb59-9168eda15466 tempest-ProjectMemberTests-453978435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (118decda-48c9-436b-bfcf-79359dd19ace) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:44:29 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-e8bc07a8-26c1-43e6-bb59-9168eda15466 tempest-ProjectMemberTests-453978435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (787d5cbc-28d8-44b1-8a2b-8d0bf7facd52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:44:29 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-e8bc07a8-26c1-43e6-bb59-9168eda15466 tempest-ProjectMemberTests-453978435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (787d5cbc-28d8-44b1-8a2b-8d0bf7facd52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b904e05-a365-4993-aa30-77d5af7594fd', 'volume_name': 'volume-8b904e05-a365-4993-aa30-77d5af7594fd', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:44:29 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-e8bc07a8-26c1-43e6-bb59-9168eda15466 tempest-ProjectMemberTests-453978435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f7d59b5-9390-4a83-a14a-9f891199bf31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:44:29 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-e8bc07a8-26c1-43e6-bb59-9168eda15466 tempest-ProjectMemberTests-453978435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f7d59b5-9390-4a83-a14a-9f891199bf31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:44:29 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-e8bc07a8-26c1-43e6-bb59-9168eda15466 tempest-ProjectMemberTests-453978435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (013ae211-d608-4ebf-aa28-410078a95d44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:44:29 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-e8bc07a8-26c1-43e6-bb59-9168eda15466 tempest-ProjectMemberTests-453978435 None] Volume 8b904e05-a365-4993-aa30-77d5af7594fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b904e05-a365-4993-aa30-77d5af7594fd', 'volume_size': 1}
Nov 03 18:44:29 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-e8bc07a8-26c1-43e6-bb59-9168eda15466 tempest-ProjectMemberTests-453978435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:44:29 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-e8bc07a8-26c1-43e6-bb59-9168eda15466 tempest-ProjectMemberTests-453978435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:44:29 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-e8bc07a8-26c1-43e6-bb59-9168eda15466 tempest-ProjectMemberTests-453978435 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:44:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-131964409',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b904e05-a365-4993-aa30-77d5af7594fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac23a66460684cf18a0ec466545c9237',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:44:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:44:29Z,use_quota=True,user_id='1e72acdc7ff048f4b0d1e488804038f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:44:29 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-e8bc07a8-26c1-43e6-bb59-9168eda15466 tempest-ProjectMemberTests-453978435 None] Creating volume 8b904e05-a365-4993-aa30-77d5af7594fd {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:44:29 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-e8bc07a8-26c1-43e6-bb59-9168eda15466 tempest-ProjectMemberTests-453978435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:44:29 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-e8bc07a8-26c1-43e6-bb59-9168eda15466 tempest-ProjectMemberTests-453978435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:44:29 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-e8bc07a8-26c1-43e6-bb59-9168eda15466 tempest-ProjectMemberTests-453978435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:44:29 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-e8bc07a8-26c1-43e6-bb59-9168eda15466 tempest-ProjectMemberTests-453978435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:44:29 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-e8bc07a8-26c1-43e6-bb59-9168eda15466 tempest-ProjectMemberTests-453978435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:44:29 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-e8bc07a8-26c1-43e6-bb59-9168eda15466 tempest-ProjectMemberTests-453978435 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:44:29 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-e8bc07a8-26c1-43e6-bb59-9168eda15466 tempest-ProjectMemberTests-453978435 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:44:29 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-e8bc07a8-26c1-43e6-bb59-9168eda15466 tempest-ProjectMemberTests-453978435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8b904e05-a365-4993-aa30-77d5af7594fd 1073741824 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:44:29 devstack sudo[107783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8b904e05-a365-4993-aa30-77d5af7594fd 1073741824
Nov 03 18:44:29 devstack sudo[107783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:44:29 devstack sudo[107783]: pam_unix(sudo:session): session closed for user root
Nov 03 18:44:29 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-e8bc07a8-26c1-43e6-bb59-9168eda15466 tempest-ProjectMemberTests-453978435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8b904e05-a365-4993-aa30-77d5af7594fd 1073741824" returned: 0 in 0.400s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:44:29 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-e8bc07a8-26c1-43e6-bb59-9168eda15466 tempest-ProjectMemberTests-453978435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8b904e05-a365-4993-aa30-77d5af7594fd {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:44:29 devstack sudo[107790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8b904e05-a365-4993-aa30-77d5af7594fd
Nov 03 18:44:29 devstack sudo[107790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:44:30 devstack sudo[107790]: pam_unix(sudo:session): session closed for user root
Nov 03 18:44:30 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-e8bc07a8-26c1-43e6-bb59-9168eda15466 tempest-ProjectMemberTests-453978435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8b904e05-a365-4993-aa30-77d5af7594fd" returned: 0 in 0.245s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:44:30 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-e8bc07a8-26c1-43e6-bb59-9168eda15466 tempest-ProjectMemberTests-453978435 None] <== create_volume: return (685ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:44:30 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-e8bc07a8-26c1-43e6-bb59-9168eda15466 tempest-ProjectMemberTests-453978435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.687s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:44:30 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-e8bc07a8-26c1-43e6-bb59-9168eda15466 tempest-ProjectMemberTests-453978435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (013ae211-d608-4ebf-aa28-410078a95d44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b904e05-a365-4993-aa30-77d5af7594fd', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:44:30 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-e8bc07a8-26c1-43e6-bb59-9168eda15466 tempest-ProjectMemberTests-453978435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a45c02a-8a14-4561-82ae-238c2737f24c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:44:30 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-e8bc07a8-26c1-43e6-bb59-9168eda15466 tempest-ProjectMemberTests-453978435 None] Volume volume-8b904e05-a365-4993-aa30-77d5af7594fd (8b904e05-a365-4993-aa30-77d5af7594fd): created successfully
Nov 03 18:44:30 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-e8bc07a8-26c1-43e6-bb59-9168eda15466 tempest-ProjectMemberTests-453978435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a45c02a-8a14-4561-82ae-238c2737f24c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:44:30 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-e8bc07a8-26c1-43e6-bb59-9168eda15466 tempest-ProjectMemberTests-453978435 None] Flow 'volume_create_manager' (5446dce7-b747-47f7-9ff9-e60733a622af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:44:30 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-e8bc07a8-26c1-43e6-bb59-9168eda15466 tempest-ProjectMemberTests-453978435 None] Created volume successfully.
Nov 03 18:44:30 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-f6fde6e0-f8db-44c0-9668-bcc0270f692b tempest-ProjectMemberTests-453978435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:44:30 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-f6fde6e0-f8db-44c0-9668-bcc0270f692b tempest-ProjectMemberTests-453978435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:44:30 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-f6fde6e0-f8db-44c0-9668-bcc0270f692b tempest-ProjectMemberTests-453978435 None] Creating offline snapshot 8bbd26ac-ba9a-47a6-b800-762db679da6d of volume 8b904e05-a365-4993-aa30-77d5af7594fd {{(pid=86120) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 18:44:30 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee88e0b4-8e36-462d-a397-99e74cd76020]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:44:30 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-f6fde6e0-f8db-44c0-9668-bcc0270f692b tempest-ProjectMemberTests-453978435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8b904e05-a365-4993-aa30-77d5af7594fd {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:44:30 devstack sudo[107793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8b904e05-a365-4993-aa30-77d5af7594fd
Nov 03 18:44:30 devstack sudo[107793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:44:30 devstack sudo[107793]: pam_unix(sudo:session): session closed for user root
Nov 03 18:44:30 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-f6fde6e0-f8db-44c0-9668-bcc0270f692b tempest-ProjectMemberTests-453978435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8b904e05-a365-4993-aa30-77d5af7594fd" returned: 0 in 0.374s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:44:30 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-f6fde6e0-f8db-44c0-9668-bcc0270f692b tempest-ProjectMemberTests-453978435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8b904e05-a365-4993-aa30-77d5af7594fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8b904e05-a365-4993-aa30-77d5af7594fd.8bbd26ac-ba9a-47a6-b800-762db679da6d 1G {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:44:30 devstack sudo[107798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8b904e05-a365-4993-aa30-77d5af7594fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8b904e05-a365-4993-aa30-77d5af7594fd.8bbd26ac-ba9a-47a6-b800-762db679da6d 1G
Nov 03 18:44:30 devstack sudo[107798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:44:31 devstack sudo[107798]: pam_unix(sudo:session): session closed for user root
Nov 03 18:44:31 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-f6fde6e0-f8db-44c0-9668-bcc0270f692b tempest-ProjectMemberTests-453978435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8b904e05-a365-4993-aa30-77d5af7594fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8b904e05-a365-4993-aa30-77d5af7594fd.8bbd26ac-ba9a-47a6-b800-762db679da6d 1G" returned: 0 in 0.408s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:44:31 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-f6fde6e0-f8db-44c0-9668-bcc0270f692b tempest-ProjectMemberTests-453978435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b904e05-a365-4993-aa30-77d5af7594fd -F qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8b904e05-a365-4993-aa30-77d5af7594fd.8bbd26ac-ba9a-47a6-b800-762db679da6d {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:44:31 devstack sudo[107803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b904e05-a365-4993-aa30-77d5af7594fd -F qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8b904e05-a365-4993-aa30-77d5af7594fd.8bbd26ac-ba9a-47a6-b800-762db679da6d
Nov 03 18:44:31 devstack sudo[107803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:44:31 devstack sudo[107803]: pam_unix(sudo:session): session closed for user root
Nov 03 18:44:31 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-f6fde6e0-f8db-44c0-9668-bcc0270f692b tempest-ProjectMemberTests-453978435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b904e05-a365-4993-aa30-77d5af7594fd -F qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8b904e05-a365-4993-aa30-77d5af7594fd.8bbd26ac-ba9a-47a6-b800-762db679da6d" returned: 0 in 0.299s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:44:31 devstack cinder-volume[86120]: WARNING cinder.volume.drivers.remotefs [None req-f6fde6e0-f8db-44c0-9668-bcc0270f692b tempest-ProjectMemberTests-453978435 None] /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8b904e05-a365-4993-aa30-77d5af7594fd.8bbd26ac-ba9a-47a6-b800-762db679da6d is being set with open permissions: ugo+rw
Nov 03 18:44:31 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-f6fde6e0-f8db-44c0-9668-bcc0270f692b tempest-ProjectMemberTests-453978435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8b904e05-a365-4993-aa30-77d5af7594fd.8bbd26ac-ba9a-47a6-b800-762db679da6d {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:44:31 devstack sudo[107808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8b904e05-a365-4993-aa30-77d5af7594fd.8bbd26ac-ba9a-47a6-b800-762db679da6d
Nov 03 18:44:31 devstack sudo[107808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:44:31 devstack sudo[107808]: pam_unix(sudo:session): session closed for user root
Nov 03 18:44:31 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-f6fde6e0-f8db-44c0-9668-bcc0270f692b tempest-ProjectMemberTests-453978435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8b904e05-a365-4993-aa30-77d5af7594fd.8bbd26ac-ba9a-47a6-b800-762db679da6d" returned: 0 in 0.240s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:44:31 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-f6fde6e0-f8db-44c0-9668-bcc0270f692b tempest-ProjectMemberTests-453978435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8b904e05-a365-4993-aa30-77d5af7594fd.info {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:44:31 devstack sudo[107811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8b904e05-a365-4993-aa30-77d5af7594fd.info
Nov 03 18:44:31 devstack sudo[107811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:44:32 devstack sudo[107811]: pam_unix(sudo:session): session closed for user root
Nov 03 18:44:32 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-f6fde6e0-f8db-44c0-9668-bcc0270f692b tempest-ProjectMemberTests-453978435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8b904e05-a365-4993-aa30-77d5af7594fd.info" returned: 0 in 0.252s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:44:32 devstack cinder-volume[86120]: WARNING cinder.volume.drivers.remotefs [None req-f6fde6e0-f8db-44c0-9668-bcc0270f692b tempest-ProjectMemberTests-453978435 None] /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8b904e05-a365-4993-aa30-77d5af7594fd.info is being set with open permissions: ugo+rw
Nov 03 18:44:32 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-f6fde6e0-f8db-44c0-9668-bcc0270f692b tempest-ProjectMemberTests-453978435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8b904e05-a365-4993-aa30-77d5af7594fd.info {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:44:32 devstack sudo[107814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8b904e05-a365-4993-aa30-77d5af7594fd.info
Nov 03 18:44:32 devstack sudo[107814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:44:32 devstack sudo[107814]: pam_unix(sudo:session): session closed for user root
Nov 03 18:44:32 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-f6fde6e0-f8db-44c0-9668-bcc0270f692b tempest-ProjectMemberTests-453978435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8b904e05-a365-4993-aa30-77d5af7594fd.info" returned: 0 in 0.243s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:44:32 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-f6fde6e0-f8db-44c0-9668-bcc0270f692b tempest-ProjectMemberTests-453978435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.897s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:44:32 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-f6fde6e0-f8db-44c0-9668-bcc0270f692b tempest-ProjectMemberTests-453978435 None] Create snapshot completed successfully
Nov 03 18:44:32 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-cc57245c-0ae4-4b23-a93c-549721a79d7e tempest-ProjectMemberTests-453978435 None] Acquiring lock "cinder-8bbd26ac-ba9a-47a6-b800-762db679da6d-delete_snapshot" by "delete_snapshot" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:44:32 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-cc57245c-0ae4-4b23-a93c-549721a79d7e tempest-ProjectMemberTests-453978435 None] Lock "cinder-8bbd26ac-ba9a-47a6-b800-762db679da6d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:44:32 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-cc57245c-0ae4-4b23-a93c-549721a79d7e tempest-ProjectMemberTests-453978435 None] Acquiring lock "cinder-quobyte-8b904e05-a365-4993-aa30-77d5af7594fd" by "delete_snapshot" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:44:32 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-cc57245c-0ae4-4b23-a93c-549721a79d7e tempest-ProjectMemberTests-453978435 None] Lock "cinder-quobyte-8b904e05-a365-4993-aa30-77d5af7594fd" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:44:32 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-cc57245c-0ae4-4b23-a93c-549721a79d7e tempest-ProjectMemberTests-453978435 None] Acquiring lock "cinder-quobyte-8bbd26ac-ba9a-47a6-b800-762db679da6d" by "_delete_snapshot" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:44:32 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-cc57245c-0ae4-4b23-a93c-549721a79d7e tempest-ProjectMemberTests-453978435 None] Lock "cinder-quobyte-8bbd26ac-ba9a-47a6-b800-762db679da6d" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:44:32 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-cc57245c-0ae4-4b23-a93c-549721a79d7e tempest-ProjectMemberTests-453978435 None] Deleting offline snapshot 8bbd26ac-ba9a-47a6-b800-762db679da6d of volume 8b904e05-a365-4993-aa30-77d5af7594fd {{(pid=86120) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 18:44:32 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-cc57245c-0ae4-4b23-a93c-549721a79d7e tempest-ProjectMemberTests-453978435 None] snapshot_file for this snap is: volume-8b904e05-a365-4993-aa30-77d5af7594fd.8bbd26ac-ba9a-47a6-b800-762db679da6d {{(pid=86120) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 18:44:32 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d99a937-1d0e-46ce-a623-b1bc683156fd]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:44:32 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-cc57245c-0ae4-4b23-a93c-549721a79d7e tempest-ProjectMemberTests-453978435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8b904e05-a365-4993-aa30-77d5af7594fd.8bbd26ac-ba9a-47a6-b800-762db679da6d {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:44:32 devstack sudo[107817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8b904e05-a365-4993-aa30-77d5af7594fd.8bbd26ac-ba9a-47a6-b800-762db679da6d
Nov 03 18:44:32 devstack sudo[107817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:44:33 devstack sudo[107817]: pam_unix(sudo:session): session closed for user root
Nov 03 18:44:33 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-cc57245c-0ae4-4b23-a93c-549721a79d7e tempest-ProjectMemberTests-453978435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8b904e05-a365-4993-aa30-77d5af7594fd.8bbd26ac-ba9a-47a6-b800-762db679da6d" returned: 0 in 0.359s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:44:33 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-cc57245c-0ae4-4b23-a93c-549721a79d7e tempest-ProjectMemberTests-453978435 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8b904e05-a365-4993-aa30-77d5af7594fd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86120) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 18:44:33 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc8dfa77-569b-4b17-9974-c3e9443c1c2a]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:44:33 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-cc57245c-0ae4-4b23-a93c-549721a79d7e tempest-ProjectMemberTests-453978435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8b904e05-a365-4993-aa30-77d5af7594fd {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:44:33 devstack sudo[107822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8b904e05-a365-4993-aa30-77d5af7594fd
Nov 03 18:44:33 devstack sudo[107822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:44:33 devstack sudo[107822]: pam_unix(sudo:session): session closed for user root
Nov 03 18:44:33 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-cc57245c-0ae4-4b23-a93c-549721a79d7e tempest-ProjectMemberTests-453978435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8b904e05-a365-4993-aa30-77d5af7594fd" returned: 0 in 0.358s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:44:33 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-cc57245c-0ae4-4b23-a93c-549721a79d7e tempest-ProjectMemberTests-453978435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8b904e05-a365-4993-aa30-77d5af7594fd.8bbd26ac-ba9a-47a6-b800-762db679da6d {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:44:33 devstack sudo[107827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8b904e05-a365-4993-aa30-77d5af7594fd.8bbd26ac-ba9a-47a6-b800-762db679da6d
Nov 03 18:44:33 devstack sudo[107827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:44:33 devstack sudo[107827]: pam_unix(sudo:session): session closed for user root
Nov 03 18:44:33 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-cc57245c-0ae4-4b23-a93c-549721a79d7e tempest-ProjectMemberTests-453978435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8b904e05-a365-4993-aa30-77d5af7594fd.8bbd26ac-ba9a-47a6-b800-762db679da6d" returned: 0 in 0.338s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:44:33 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-cc57245c-0ae4-4b23-a93c-549721a79d7e tempest-ProjectMemberTests-453978435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8b904e05-a365-4993-aa30-77d5af7594fd.8bbd26ac-ba9a-47a6-b800-762db679da6d {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:44:33 devstack sudo[107832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8b904e05-a365-4993-aa30-77d5af7594fd.8bbd26ac-ba9a-47a6-b800-762db679da6d
Nov 03 18:44:33 devstack sudo[107832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:44:34 devstack sudo[107832]: pam_unix(sudo:session): session closed for user root
Nov 03 18:44:34 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-cc57245c-0ae4-4b23-a93c-549721a79d7e tempest-ProjectMemberTests-453978435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8b904e05-a365-4993-aa30-77d5af7594fd.8bbd26ac-ba9a-47a6-b800-762db679da6d" returned: 0 in 0.252s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:44:34 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-cc57245c-0ae4-4b23-a93c-549721a79d7e tempest-ProjectMemberTests-453978435 None] Lock "cinder-quobyte-8bbd26ac-ba9a-47a6-b800-762db679da6d" released by "_delete_snapshot" :: held 1.403s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:44:34 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-cc57245c-0ae4-4b23-a93c-549721a79d7e tempest-ProjectMemberTests-453978435 None] Lock "cinder-quobyte-8b904e05-a365-4993-aa30-77d5af7594fd" released by "delete_snapshot" :: held 1.424s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:44:34 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-cc57245c-0ae4-4b23-a93c-549721a79d7e tempest-ProjectMemberTests-453978435 None] Created reservations ['6af6c8ea-7e29-4b30-a3d7-06ef9de4baec', '19461047-2fc9-4d39-b835-fd9c814c9b9c', 'f31f1ecb-2a15-47c5-9bab-2d12b4626b50', 'a29fd39c-e31e-48fe-903e-b9e763bc9f47'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:44:34 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-cc57245c-0ae4-4b23-a93c-549721a79d7e tempest-ProjectMemberTests-453978435 None] Delete snapshot completed successfully.
Nov 03 18:44:34 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-cc57245c-0ae4-4b23-a93c-549721a79d7e tempest-ProjectMemberTests-453978435 None] Lock "cinder-8bbd26ac-ba9a-47a6-b800-762db679da6d-delete_snapshot" released by "delete_snapshot" :: held 1.549s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:44:34 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-52123a22-0b98-4e40-86ef-d474f8f69e8d tempest-ProjectMemberTests-453978435 None] Acquiring lock "cinder-8b904e05-a365-4993-aa30-77d5af7594fd-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:44:34 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-52123a22-0b98-4e40-86ef-d474f8f69e8d tempest-ProjectMemberTests-453978435 None] Lock "cinder-8b904e05-a365-4993-aa30-77d5af7594fd-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:44:34 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-52123a22-0b98-4e40-86ef-d474f8f69e8d tempest-ProjectMemberTests-453978435 None] Acquiring lock "cinder-quobyte-8b904e05-a365-4993-aa30-77d5af7594fd" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:44:34 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-52123a22-0b98-4e40-86ef-d474f8f69e8d tempest-ProjectMemberTests-453978435 None] Lock "cinder-quobyte-8b904e05-a365-4993-aa30-77d5af7594fd" acquired by "delete_volume" :: waited 0.017s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:44:34 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[e88104d3-2173-43b6-b174-dd02bc56d033]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:44:34 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-52123a22-0b98-4e40-86ef-d474f8f69e8d tempest-ProjectMemberTests-453978435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8b904e05-a365-4993-aa30-77d5af7594fd {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:44:35 devstack sudo[107835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8b904e05-a365-4993-aa30-77d5af7594fd
Nov 03 18:44:35 devstack sudo[107835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:44:35 devstack sudo[107835]: pam_unix(sudo:session): session closed for user root
Nov 03 18:44:35 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-52123a22-0b98-4e40-86ef-d474f8f69e8d tempest-ProjectMemberTests-453978435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8b904e05-a365-4993-aa30-77d5af7594fd" returned: 0 in 0.361s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:44:35 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-52123a22-0b98-4e40-86ef-d474f8f69e8d tempest-ProjectMemberTests-453978435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8b904e05-a365-4993-aa30-77d5af7594fd {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:44:35 devstack sudo[107840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8b904e05-a365-4993-aa30-77d5af7594fd
Nov 03 18:44:35 devstack sudo[107840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:44:35 devstack sudo[107840]: pam_unix(sudo:session): session closed for user root
Nov 03 18:44:35 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-52123a22-0b98-4e40-86ef-d474f8f69e8d tempest-ProjectMemberTests-453978435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-8b904e05-a365-4993-aa30-77d5af7594fd" returned: 0 in 0.247s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:44:35 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-52123a22-0b98-4e40-86ef-d474f8f69e8d tempest-ProjectMemberTests-453978435 None] Lock "cinder-quobyte-8b904e05-a365-4993-aa30-77d5af7594fd" released by "delete_volume" :: held 0.676s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:44:35 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-52123a22-0b98-4e40-86ef-d474f8f69e8d tempest-ProjectMemberTests-453978435 None] Created reservations ['2d48a712-ecd4-4d67-adcd-06dac6d4a302', 'c7dd7523-593b-48a0-87a7-471b9ff48a7f', '459386fd-0bb1-4af2-bbbe-f3c1a2eb6855', 'c8d2516b-1f74-42ea-9194-673f51617a33'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:44:35 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-52123a22-0b98-4e40-86ef-d474f8f69e8d tempest-ProjectMemberTests-453978435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:44:35 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-52123a22-0b98-4e40-86ef-d474f8f69e8d tempest-ProjectMemberTests-453978435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:44:35 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-52123a22-0b98-4e40-86ef-d474f8f69e8d tempest-ProjectMemberTests-453978435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:44:35 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-52123a22-0b98-4e40-86ef-d474f8f69e8d tempest-ProjectMemberTests-453978435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:44:35 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-52123a22-0b98-4e40-86ef-d474f8f69e8d tempest-ProjectMemberTests-453978435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:44:35 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-52123a22-0b98-4e40-86ef-d474f8f69e8d tempest-ProjectMemberTests-453978435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:44:35 devstack sudo[107843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:44:35 devstack sudo[107843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:44:35 devstack sudo[107843]: pam_unix(sudo:session): session closed for user root
Nov 03 18:44:35 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-52123a22-0b98-4e40-86ef-d474f8f69e8d tempest-ProjectMemberTests-453978435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.248s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:44:35 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-52123a22-0b98-4e40-86ef-d474f8f69e8d tempest-ProjectMemberTests-453978435 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:44:35 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-52123a22-0b98-4e40-86ef-d474f8f69e8d tempest-ProjectMemberTests-453978435 None] Deleted volume successfully.
Nov 03 18:44:35 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-52123a22-0b98-4e40-86ef-d474f8f69e8d tempest-ProjectMemberTests-453978435 None] Lock "cinder-8b904e05-a365-4993-aa30-77d5af7594fd-delete_volume" released by "delete_volume" :: held 1.129s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:44:36 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-81954041-64b7-4fac-a94b-1c1e98d83d6c tempest-ProjectMemberTests-453978435 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:44:36 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-81954041-64b7-4fac-a94b-1c1e98d83d6c tempest-ProjectMemberTests-453978435 None] Flow 'volume_create_manager' (4310a567-e1bf-4106-a30f-ce0d35fc8717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:44:36 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-81954041-64b7-4fac-a94b-1c1e98d83d6c tempest-ProjectMemberTests-453978435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6dd47f6d-808d-4738-8bad-0dd2b9567d59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:44:36 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-81954041-64b7-4fac-a94b-1c1e98d83d6c tempest-ProjectMemberTests-453978435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6dd47f6d-808d-4738-8bad-0dd2b9567d59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:44:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-448326382',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91ceaea0-d3f0-4348-b98a-3a1478ef8ee1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac23a66460684cf18a0ec466545c9237',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:44:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:44:36Z,use_quota=True,user_id='1e72acdc7ff048f4b0d1e488804038f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:44:36 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-81954041-64b7-4fac-a94b-1c1e98d83d6c tempest-ProjectMemberTests-453978435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28ac2bce-f864-45ed-94cb-e77df1df938f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:44:36 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-81954041-64b7-4fac-a94b-1c1e98d83d6c tempest-ProjectMemberTests-453978435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28ac2bce-f864-45ed-94cb-e77df1df938f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:44:36 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-81954041-64b7-4fac-a94b-1c1e98d83d6c tempest-ProjectMemberTests-453978435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3676812-e4c9-41df-9ee0-97c302862940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:44:36 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-81954041-64b7-4fac-a94b-1c1e98d83d6c tempest-ProjectMemberTests-453978435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3676812-e4c9-41df-9ee0-97c302862940) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91ceaea0-d3f0-4348-b98a-3a1478ef8ee1', 'volume_name': 'volume-91ceaea0-d3f0-4348-b98a-3a1478ef8ee1', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:44:36 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-81954041-64b7-4fac-a94b-1c1e98d83d6c tempest-ProjectMemberTests-453978435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19800102-e317-4564-8a10-fb60c525032b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:44:36 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-81954041-64b7-4fac-a94b-1c1e98d83d6c tempest-ProjectMemberTests-453978435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19800102-e317-4564-8a10-fb60c525032b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:44:36 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-81954041-64b7-4fac-a94b-1c1e98d83d6c tempest-ProjectMemberTests-453978435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bdb6346-27c6-4b2a-b29a-1a553644f266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:44:36 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-81954041-64b7-4fac-a94b-1c1e98d83d6c tempest-ProjectMemberTests-453978435 None] Volume 91ceaea0-d3f0-4348-b98a-3a1478ef8ee1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91ceaea0-d3f0-4348-b98a-3a1478ef8ee1', 'volume_size': 1}
Nov 03 18:44:36 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-81954041-64b7-4fac-a94b-1c1e98d83d6c tempest-ProjectMemberTests-453978435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:44:36 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-81954041-64b7-4fac-a94b-1c1e98d83d6c tempest-ProjectMemberTests-453978435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:44:36 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-81954041-64b7-4fac-a94b-1c1e98d83d6c tempest-ProjectMemberTests-453978435 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:44:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-448326382',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91ceaea0-d3f0-4348-b98a-3a1478ef8ee1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac23a66460684cf18a0ec466545c9237',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:44:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:44:36Z,use_quota=True,user_id='1e72acdc7ff048f4b0d1e488804038f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:44:36 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-81954041-64b7-4fac-a94b-1c1e98d83d6c tempest-ProjectMemberTests-453978435 None] Creating volume 91ceaea0-d3f0-4348-b98a-3a1478ef8ee1 {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:44:36 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-81954041-64b7-4fac-a94b-1c1e98d83d6c tempest-ProjectMemberTests-453978435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:44:36 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-81954041-64b7-4fac-a94b-1c1e98d83d6c tempest-ProjectMemberTests-453978435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:44:36 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-81954041-64b7-4fac-a94b-1c1e98d83d6c tempest-ProjectMemberTests-453978435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:44:36 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-81954041-64b7-4fac-a94b-1c1e98d83d6c tempest-ProjectMemberTests-453978435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:44:36 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-81954041-64b7-4fac-a94b-1c1e98d83d6c tempest-ProjectMemberTests-453978435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:44:36 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-81954041-64b7-4fac-a94b-1c1e98d83d6c tempest-ProjectMemberTests-453978435 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:44:36 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-81954041-64b7-4fac-a94b-1c1e98d83d6c tempest-ProjectMemberTests-453978435 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:44:36 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-81954041-64b7-4fac-a94b-1c1e98d83d6c tempest-ProjectMemberTests-453978435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-91ceaea0-d3f0-4348-b98a-3a1478ef8ee1 1073741824 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:44:36 devstack sudo[107880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-91ceaea0-d3f0-4348-b98a-3a1478ef8ee1 1073741824
Nov 03 18:44:36 devstack sudo[107880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:44:36 devstack sudo[107880]: pam_unix(sudo:session): session closed for user root
Nov 03 18:44:36 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-81954041-64b7-4fac-a94b-1c1e98d83d6c tempest-ProjectMemberTests-453978435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-91ceaea0-d3f0-4348-b98a-3a1478ef8ee1 1073741824" returned: 0 in 0.418s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:44:36 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-81954041-64b7-4fac-a94b-1c1e98d83d6c tempest-ProjectMemberTests-453978435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-91ceaea0-d3f0-4348-b98a-3a1478ef8ee1 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:44:36 devstack sudo[107887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-91ceaea0-d3f0-4348-b98a-3a1478ef8ee1
Nov 03 18:44:36 devstack sudo[107887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:44:37 devstack sudo[107887]: pam_unix(sudo:session): session closed for user root
Nov 03 18:44:37 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-81954041-64b7-4fac-a94b-1c1e98d83d6c tempest-ProjectMemberTests-453978435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-91ceaea0-d3f0-4348-b98a-3a1478ef8ee1" returned: 0 in 0.244s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:44:37 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-81954041-64b7-4fac-a94b-1c1e98d83d6c tempest-ProjectMemberTests-453978435 None] <== create_volume: return (701ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:44:37 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-81954041-64b7-4fac-a94b-1c1e98d83d6c tempest-ProjectMemberTests-453978435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.704s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:44:37 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-81954041-64b7-4fac-a94b-1c1e98d83d6c tempest-ProjectMemberTests-453978435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bdb6346-27c6-4b2a-b29a-1a553644f266) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91ceaea0-d3f0-4348-b98a-3a1478ef8ee1', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:44:37 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-81954041-64b7-4fac-a94b-1c1e98d83d6c tempest-ProjectMemberTests-453978435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7392176a-23f1-47de-80ae-81c487d0922d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:44:37 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-81954041-64b7-4fac-a94b-1c1e98d83d6c tempest-ProjectMemberTests-453978435 None] Volume volume-91ceaea0-d3f0-4348-b98a-3a1478ef8ee1 (91ceaea0-d3f0-4348-b98a-3a1478ef8ee1): created successfully
Nov 03 18:44:37 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-81954041-64b7-4fac-a94b-1c1e98d83d6c tempest-ProjectMemberTests-453978435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7392176a-23f1-47de-80ae-81c487d0922d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:44:37 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-81954041-64b7-4fac-a94b-1c1e98d83d6c tempest-ProjectMemberTests-453978435 None] Flow 'volume_create_manager' (4310a567-e1bf-4106-a30f-ce0d35fc8717) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:44:37 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-81954041-64b7-4fac-a94b-1c1e98d83d6c tempest-ProjectMemberTests-453978435 None] Created volume successfully.
Nov 03 18:44:37 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-928c22ea-84da-4565-bae0-e18cd68a8974 tempest-ProjectMemberTests-453978435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:44:37 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-928c22ea-84da-4565-bae0-e18cd68a8974 tempest-ProjectMemberTests-453978435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:44:37 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-928c22ea-84da-4565-bae0-e18cd68a8974 tempest-ProjectMemberTests-453978435 None] Creating offline snapshot 220f38a9-9d80-42e5-8b70-58a55d8166a1 of volume 91ceaea0-d3f0-4348-b98a-3a1478ef8ee1 {{(pid=86120) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 18:44:37 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[9984dcd5-4254-4a2e-8c7a-e05966aede2c]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:44:37 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-928c22ea-84da-4565-bae0-e18cd68a8974 tempest-ProjectMemberTests-453978435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-91ceaea0-d3f0-4348-b98a-3a1478ef8ee1 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:44:37 devstack sudo[107890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-91ceaea0-d3f0-4348-b98a-3a1478ef8ee1
Nov 03 18:44:37 devstack sudo[107890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:44:37 devstack sudo[107890]: pam_unix(sudo:session): session closed for user root
Nov 03 18:44:37 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-928c22ea-84da-4565-bae0-e18cd68a8974 tempest-ProjectMemberTests-453978435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-91ceaea0-d3f0-4348-b98a-3a1478ef8ee1" returned: 0 in 0.362s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:44:37 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-928c22ea-84da-4565-bae0-e18cd68a8974 tempest-ProjectMemberTests-453978435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-91ceaea0-d3f0-4348-b98a-3a1478ef8ee1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-91ceaea0-d3f0-4348-b98a-3a1478ef8ee1.220f38a9-9d80-42e5-8b70-58a55d8166a1 1G {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:44:37 devstack sudo[107895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-91ceaea0-d3f0-4348-b98a-3a1478ef8ee1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-91ceaea0-d3f0-4348-b98a-3a1478ef8ee1.220f38a9-9d80-42e5-8b70-58a55d8166a1 1G
Nov 03 18:44:37 devstack sudo[107895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:44:38 devstack sudo[107895]: pam_unix(sudo:session): session closed for user root
Nov 03 18:44:38 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-928c22ea-84da-4565-bae0-e18cd68a8974 tempest-ProjectMemberTests-453978435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-91ceaea0-d3f0-4348-b98a-3a1478ef8ee1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-91ceaea0-d3f0-4348-b98a-3a1478ef8ee1.220f38a9-9d80-42e5-8b70-58a55d8166a1 1G" returned: 0 in 0.385s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:44:38 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-928c22ea-84da-4565-bae0-e18cd68a8974 tempest-ProjectMemberTests-453978435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91ceaea0-d3f0-4348-b98a-3a1478ef8ee1 -F qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-91ceaea0-d3f0-4348-b98a-3a1478ef8ee1.220f38a9-9d80-42e5-8b70-58a55d8166a1 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:44:38 devstack sudo[107900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91ceaea0-d3f0-4348-b98a-3a1478ef8ee1 -F qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-91ceaea0-d3f0-4348-b98a-3a1478ef8ee1.220f38a9-9d80-42e5-8b70-58a55d8166a1
Nov 03 18:44:38 devstack sudo[107900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:44:38 devstack sudo[107900]: pam_unix(sudo:session): session closed for user root
Nov 03 18:44:38 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-928c22ea-84da-4565-bae0-e18cd68a8974 tempest-ProjectMemberTests-453978435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91ceaea0-d3f0-4348-b98a-3a1478ef8ee1 -F qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-91ceaea0-d3f0-4348-b98a-3a1478ef8ee1.220f38a9-9d80-42e5-8b70-58a55d8166a1" returned: 0 in 0.289s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:44:38 devstack cinder-volume[86120]: WARNING cinder.volume.drivers.remotefs [None req-928c22ea-84da-4565-bae0-e18cd68a8974 tempest-ProjectMemberTests-453978435 None] /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-91ceaea0-d3f0-4348-b98a-3a1478ef8ee1.220f38a9-9d80-42e5-8b70-58a55d8166a1 is being set with open permissions: ugo+rw
Nov 03 18:44:38 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-928c22ea-84da-4565-bae0-e18cd68a8974 tempest-ProjectMemberTests-453978435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-91ceaea0-d3f0-4348-b98a-3a1478ef8ee1.220f38a9-9d80-42e5-8b70-58a55d8166a1 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:44:38 devstack sudo[107905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-91ceaea0-d3f0-4348-b98a-3a1478ef8ee1.220f38a9-9d80-42e5-8b70-58a55d8166a1
Nov 03 18:44:38 devstack sudo[107905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:44:38 devstack sudo[107905]: pam_unix(sudo:session): session closed for user root
Nov 03 18:44:38 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-928c22ea-84da-4565-bae0-e18cd68a8974 tempest-ProjectMemberTests-453978435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-91ceaea0-d3f0-4348-b98a-3a1478ef8ee1.220f38a9-9d80-42e5-8b70-58a55d8166a1" returned: 0 in 0.244s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:44:38 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-928c22ea-84da-4565-bae0-e18cd68a8974 tempest-ProjectMemberTests-453978435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-91ceaea0-d3f0-4348-b98a-3a1478ef8ee1.info {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:44:38 devstack sudo[107908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-91ceaea0-d3f0-4348-b98a-3a1478ef8ee1.info
Nov 03 18:44:38 devstack sudo[107908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:44:39 devstack sudo[107908]: pam_unix(sudo:session): session closed for user root
Nov 03 18:44:39 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-928c22ea-84da-4565-bae0-e18cd68a8974 tempest-ProjectMemberTests-453978435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-91ceaea0-d3f0-4348-b98a-3a1478ef8ee1.info" returned: 0 in 0.255s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:44:39 devstack cinder-volume[86120]: WARNING cinder.volume.drivers.remotefs [None req-928c22ea-84da-4565-bae0-e18cd68a8974 tempest-ProjectMemberTests-453978435 None] /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-91ceaea0-d3f0-4348-b98a-3a1478ef8ee1.info is being set with open permissions: ugo+rw
Nov 03 18:44:39 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-928c22ea-84da-4565-bae0-e18cd68a8974 tempest-ProjectMemberTests-453978435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-91ceaea0-d3f0-4348-b98a-3a1478ef8ee1.info {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:44:39 devstack sudo[107911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-91ceaea0-d3f0-4348-b98a-3a1478ef8ee1.info
Nov 03 18:44:39 devstack sudo[107911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:44:39 devstack sudo[107911]: pam_unix(sudo:session): session closed for user root
Nov 03 18:44:39 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-928c22ea-84da-4565-bae0-e18cd68a8974 tempest-ProjectMemberTests-453978435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-91ceaea0-d3f0-4348-b98a-3a1478ef8ee1.info" returned: 0 in 0.244s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:44:39 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-928c22ea-84da-4565-bae0-e18cd68a8974 tempest-ProjectMemberTests-453978435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.859s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:44:39 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-928c22ea-84da-4565-bae0-e18cd68a8974 tempest-ProjectMemberTests-453978435 None] Create snapshot completed successfully
Nov 03 18:44:39 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-c888536c-0615-47cf-8bc7-316a60263895 tempest-ProjectMemberTests-453978435 None] Acquiring lock "cinder-220f38a9-9d80-42e5-8b70-58a55d8166a1-delete_snapshot" by "delete_snapshot" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:44:39 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-c888536c-0615-47cf-8bc7-316a60263895 tempest-ProjectMemberTests-453978435 None] Lock "cinder-220f38a9-9d80-42e5-8b70-58a55d8166a1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:44:39 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-c888536c-0615-47cf-8bc7-316a60263895 tempest-ProjectMemberTests-453978435 None] Acquiring lock "cinder-quobyte-91ceaea0-d3f0-4348-b98a-3a1478ef8ee1" by "delete_snapshot" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:44:39 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-c888536c-0615-47cf-8bc7-316a60263895 tempest-ProjectMemberTests-453978435 None] Lock "cinder-quobyte-91ceaea0-d3f0-4348-b98a-3a1478ef8ee1" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:44:39 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-c888536c-0615-47cf-8bc7-316a60263895 tempest-ProjectMemberTests-453978435 None] Acquiring lock "cinder-quobyte-220f38a9-9d80-42e5-8b70-58a55d8166a1" by "_delete_snapshot" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:44:39 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-c888536c-0615-47cf-8bc7-316a60263895 tempest-ProjectMemberTests-453978435 None] Lock "cinder-quobyte-220f38a9-9d80-42e5-8b70-58a55d8166a1" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:44:39 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-c888536c-0615-47cf-8bc7-316a60263895 tempest-ProjectMemberTests-453978435 None] Deleting offline snapshot 220f38a9-9d80-42e5-8b70-58a55d8166a1 of volume 91ceaea0-d3f0-4348-b98a-3a1478ef8ee1 {{(pid=86120) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 18:44:39 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-c888536c-0615-47cf-8bc7-316a60263895 tempest-ProjectMemberTests-453978435 None] snapshot_file for this snap is: volume-91ceaea0-d3f0-4348-b98a-3a1478ef8ee1.220f38a9-9d80-42e5-8b70-58a55d8166a1 {{(pid=86120) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 18:44:39 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[404d5230-c15d-420d-86b3-1760ff954b6f]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:44:39 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-c888536c-0615-47cf-8bc7-316a60263895 tempest-ProjectMemberTests-453978435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-91ceaea0-d3f0-4348-b98a-3a1478ef8ee1.220f38a9-9d80-42e5-8b70-58a55d8166a1 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:44:39 devstack sudo[107916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-91ceaea0-d3f0-4348-b98a-3a1478ef8ee1.220f38a9-9d80-42e5-8b70-58a55d8166a1
Nov 03 18:44:39 devstack sudo[107916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:44:40 devstack sudo[107916]: pam_unix(sudo:session): session closed for user root
Nov 03 18:44:40 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-c888536c-0615-47cf-8bc7-316a60263895 tempest-ProjectMemberTests-453978435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-91ceaea0-d3f0-4348-b98a-3a1478ef8ee1.220f38a9-9d80-42e5-8b70-58a55d8166a1" returned: 0 in 0.358s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:44:40 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-c888536c-0615-47cf-8bc7-316a60263895 tempest-ProjectMemberTests-453978435 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-91ceaea0-d3f0-4348-b98a-3a1478ef8ee1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86120) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 18:44:40 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d680c89-205d-4f52-a148-106cbc4b1877]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:44:40 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-c888536c-0615-47cf-8bc7-316a60263895 tempest-ProjectMemberTests-453978435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-91ceaea0-d3f0-4348-b98a-3a1478ef8ee1 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:44:40 devstack sudo[107921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-91ceaea0-d3f0-4348-b98a-3a1478ef8ee1
Nov 03 18:44:40 devstack sudo[107921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:44:40 devstack sudo[107921]: pam_unix(sudo:session): session closed for user root
Nov 03 18:44:40 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-c888536c-0615-47cf-8bc7-316a60263895 tempest-ProjectMemberTests-453978435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-91ceaea0-d3f0-4348-b98a-3a1478ef8ee1" returned: 0 in 0.368s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:44:40 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-c888536c-0615-47cf-8bc7-316a60263895 tempest-ProjectMemberTests-453978435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-91ceaea0-d3f0-4348-b98a-3a1478ef8ee1.220f38a9-9d80-42e5-8b70-58a55d8166a1 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:44:40 devstack sudo[107926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-91ceaea0-d3f0-4348-b98a-3a1478ef8ee1.220f38a9-9d80-42e5-8b70-58a55d8166a1
Nov 03 18:44:40 devstack sudo[107926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:44:40 devstack sudo[107926]: pam_unix(sudo:session): session closed for user root
Nov 03 18:44:40 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-c888536c-0615-47cf-8bc7-316a60263895 tempest-ProjectMemberTests-453978435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-91ceaea0-d3f0-4348-b98a-3a1478ef8ee1.220f38a9-9d80-42e5-8b70-58a55d8166a1" returned: 0 in 0.328s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:44:40 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-c888536c-0615-47cf-8bc7-316a60263895 tempest-ProjectMemberTests-453978435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-91ceaea0-d3f0-4348-b98a-3a1478ef8ee1.220f38a9-9d80-42e5-8b70-58a55d8166a1 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:44:40 devstack sudo[107931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-91ceaea0-d3f0-4348-b98a-3a1478ef8ee1.220f38a9-9d80-42e5-8b70-58a55d8166a1
Nov 03 18:44:40 devstack sudo[107931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:44:41 devstack sudo[107931]: pam_unix(sudo:session): session closed for user root
Nov 03 18:44:41 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-c888536c-0615-47cf-8bc7-316a60263895 tempest-ProjectMemberTests-453978435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-91ceaea0-d3f0-4348-b98a-3a1478ef8ee1.220f38a9-9d80-42e5-8b70-58a55d8166a1" returned: 0 in 0.244s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:44:41 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-c888536c-0615-47cf-8bc7-316a60263895 tempest-ProjectMemberTests-453978435 None] Lock "cinder-quobyte-220f38a9-9d80-42e5-8b70-58a55d8166a1" released by "_delete_snapshot" :: held 1.390s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:44:41 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-c888536c-0615-47cf-8bc7-316a60263895 tempest-ProjectMemberTests-453978435 None] Lock "cinder-quobyte-91ceaea0-d3f0-4348-b98a-3a1478ef8ee1" released by "delete_snapshot" :: held 1.413s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:44:41 devstack cinder-volume[86120]: DEBUG dbcounter [-] [86120] Writing DB stats cinder:SELECT=124,cinder:UPDATE=173,cinder:INSERT=53,cinder:DELETE=9 {{(pid=86120) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 18:44:41 devstack cinder-volume[86120]: DEBUG dbcounter [-] [86120] Writing DB stats cinder:DELETE=20,cinder:SELECT=135,cinder:INSERT=37,cinder:UPDATE=157 {{(pid=86120) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 18:44:41 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-c888536c-0615-47cf-8bc7-316a60263895 tempest-ProjectMemberTests-453978435 None] Created reservations ['8fbbd264-037e-4fcf-b7a1-467a42a3a090', '30915868-2784-4395-9dcc-61b900a8315f', 'b1b8786b-d29a-4fd7-8868-a19b586e6529', 'd8a22b5b-8718-4359-a460-a4545a84a47e'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:44:41 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-c888536c-0615-47cf-8bc7-316a60263895 tempest-ProjectMemberTests-453978435 None] Delete snapshot completed successfully.
Nov 03 18:44:41 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-c888536c-0615-47cf-8bc7-316a60263895 tempest-ProjectMemberTests-453978435 None] Lock "cinder-220f38a9-9d80-42e5-8b70-58a55d8166a1-delete_snapshot" released by "delete_snapshot" :: held 1.553s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:44:41 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-d89d8056-f10b-475c-9d0e-b87e64f9859d tempest-ProjectMemberTests-453978435 None] Acquiring lock "cinder-91ceaea0-d3f0-4348-b98a-3a1478ef8ee1-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:44:41 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-d89d8056-f10b-475c-9d0e-b87e64f9859d tempest-ProjectMemberTests-453978435 None] Lock "cinder-91ceaea0-d3f0-4348-b98a-3a1478ef8ee1-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:44:41 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-d89d8056-f10b-475c-9d0e-b87e64f9859d tempest-ProjectMemberTests-453978435 None] Acquiring lock "cinder-quobyte-91ceaea0-d3f0-4348-b98a-3a1478ef8ee1" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:44:42 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-d89d8056-f10b-475c-9d0e-b87e64f9859d tempest-ProjectMemberTests-453978435 None] Lock "cinder-quobyte-91ceaea0-d3f0-4348-b98a-3a1478ef8ee1" acquired by "delete_volume" :: waited 0.017s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:44:42 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[16c1240b-6cc1-400c-8aab-bb708934386a]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:44:42 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-d89d8056-f10b-475c-9d0e-b87e64f9859d tempest-ProjectMemberTests-453978435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-91ceaea0-d3f0-4348-b98a-3a1478ef8ee1 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:44:42 devstack sudo[107936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-91ceaea0-d3f0-4348-b98a-3a1478ef8ee1
Nov 03 18:44:42 devstack sudo[107936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:44:42 devstack sudo[107936]: pam_unix(sudo:session): session closed for user root
Nov 03 18:44:42 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-d89d8056-f10b-475c-9d0e-b87e64f9859d tempest-ProjectMemberTests-453978435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-91ceaea0-d3f0-4348-b98a-3a1478ef8ee1" returned: 0 in 0.363s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:44:42 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-d89d8056-f10b-475c-9d0e-b87e64f9859d tempest-ProjectMemberTests-453978435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-91ceaea0-d3f0-4348-b98a-3a1478ef8ee1 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:44:42 devstack sudo[107941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-91ceaea0-d3f0-4348-b98a-3a1478ef8ee1
Nov 03 18:44:42 devstack sudo[107941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:44:42 devstack sudo[107941]: pam_unix(sudo:session): session closed for user root
Nov 03 18:44:42 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-d89d8056-f10b-475c-9d0e-b87e64f9859d tempest-ProjectMemberTests-453978435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-91ceaea0-d3f0-4348-b98a-3a1478ef8ee1" returned: 0 in 0.248s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:44:42 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-d89d8056-f10b-475c-9d0e-b87e64f9859d tempest-ProjectMemberTests-453978435 None] Lock "cinder-quobyte-91ceaea0-d3f0-4348-b98a-3a1478ef8ee1" released by "delete_volume" :: held 0.673s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:44:42 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-d89d8056-f10b-475c-9d0e-b87e64f9859d tempest-ProjectMemberTests-453978435 None] Created reservations ['1624af87-78ce-4fc3-b9bf-2851745940d7', '586b3afa-8792-4a37-8b68-33bc618a96d6', '6b9d135b-0337-400b-b8f6-a56f8a94dd76', 'a265a340-967e-46cd-b49d-617fc601bb37'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:44:42 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-d89d8056-f10b-475c-9d0e-b87e64f9859d tempest-ProjectMemberTests-453978435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:44:42 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-d89d8056-f10b-475c-9d0e-b87e64f9859d tempest-ProjectMemberTests-453978435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:44:42 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-d89d8056-f10b-475c-9d0e-b87e64f9859d tempest-ProjectMemberTests-453978435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:44:42 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-d89d8056-f10b-475c-9d0e-b87e64f9859d tempest-ProjectMemberTests-453978435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:44:42 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-d89d8056-f10b-475c-9d0e-b87e64f9859d tempest-ProjectMemberTests-453978435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:44:42 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-d89d8056-f10b-475c-9d0e-b87e64f9859d tempest-ProjectMemberTests-453978435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:44:42 devstack sudo[107944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:44:42 devstack sudo[107944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:44:43 devstack sudo[107944]: pam_unix(sudo:session): session closed for user root
Nov 03 18:44:43 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-d89d8056-f10b-475c-9d0e-b87e64f9859d tempest-ProjectMemberTests-453978435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.260s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:44:43 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-d89d8056-f10b-475c-9d0e-b87e64f9859d tempest-ProjectMemberTests-453978435 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:44:43 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-d89d8056-f10b-475c-9d0e-b87e64f9859d tempest-ProjectMemberTests-453978435 None] Deleted volume successfully.
Nov 03 18:44:43 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-d89d8056-f10b-475c-9d0e-b87e64f9859d tempest-ProjectMemberTests-453978435 None] Lock "cinder-91ceaea0-d3f0-4348-b98a-3a1478ef8ee1-delete_volume" released by "delete_volume" :: held 1.119s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:44:46 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd8ba973-383f-481c-9a6d-2832fed74743 tempest-ProjectReaderTests-467028060 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:44:46 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-cd8ba973-383f-481c-9a6d-2832fed74743 tempest-ProjectReaderTests-467028060 None] Flow 'volume_create_manager' (52b40b43-d530-43d3-889b-dd6e163718d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:44:46 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-cd8ba973-383f-481c-9a6d-2832fed74743 tempest-ProjectReaderTests-467028060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd569e85-7773-47c0-8940-633726f51cae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:44:46 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-cd8ba973-383f-481c-9a6d-2832fed74743 tempest-ProjectReaderTests-467028060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd569e85-7773-47c0-8940-633726f51cae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:44:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-432385262',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a29d2c7-ce84-4096-8cb8-0f88d1356eb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50252b1b4e7043feb4ce25984f80f28b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:44:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:44:46Z,use_quota=True,user_id='0775f8e7db7d41039e0f7dd52466882e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:44:46 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-cd8ba973-383f-481c-9a6d-2832fed74743 tempest-ProjectReaderTests-467028060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e6c7049-b9ae-452d-9e96-5ecff395e18f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:44:46 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-cd8ba973-383f-481c-9a6d-2832fed74743 tempest-ProjectReaderTests-467028060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e6c7049-b9ae-452d-9e96-5ecff395e18f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:44:46 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-cd8ba973-383f-481c-9a6d-2832fed74743 tempest-ProjectReaderTests-467028060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bac7b88-8a5c-4667-b7bd-b1a6dc1af830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:44:46 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-cd8ba973-383f-481c-9a6d-2832fed74743 tempest-ProjectReaderTests-467028060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bac7b88-8a5c-4667-b7bd-b1a6dc1af830) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a29d2c7-ce84-4096-8cb8-0f88d1356eb8', 'volume_name': 'volume-2a29d2c7-ce84-4096-8cb8-0f88d1356eb8', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:44:46 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-cd8ba973-383f-481c-9a6d-2832fed74743 tempest-ProjectReaderTests-467028060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8397dec0-57f7-4dea-b358-c5977effa44d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:44:46 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-cd8ba973-383f-481c-9a6d-2832fed74743 tempest-ProjectReaderTests-467028060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8397dec0-57f7-4dea-b358-c5977effa44d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:44:46 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-cd8ba973-383f-481c-9a6d-2832fed74743 tempest-ProjectReaderTests-467028060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ad9e1cf-7cf6-4774-9d65-1eba88b39589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:44:46 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-cd8ba973-383f-481c-9a6d-2832fed74743 tempest-ProjectReaderTests-467028060 None] Volume 2a29d2c7-ce84-4096-8cb8-0f88d1356eb8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a29d2c7-ce84-4096-8cb8-0f88d1356eb8', 'volume_size': 1}
Nov 03 18:44:46 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-cd8ba973-383f-481c-9a6d-2832fed74743 tempest-ProjectReaderTests-467028060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:44:46 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-cd8ba973-383f-481c-9a6d-2832fed74743 tempest-ProjectReaderTests-467028060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:44:46 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-cd8ba973-383f-481c-9a6d-2832fed74743 tempest-ProjectReaderTests-467028060 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:44:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-432385262',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a29d2c7-ce84-4096-8cb8-0f88d1356eb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50252b1b4e7043feb4ce25984f80f28b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:44:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:44:46Z,use_quota=True,user_id='0775f8e7db7d41039e0f7dd52466882e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:44:46 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-cd8ba973-383f-481c-9a6d-2832fed74743 tempest-ProjectReaderTests-467028060 None] Creating volume 2a29d2c7-ce84-4096-8cb8-0f88d1356eb8 {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:44:46 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-cd8ba973-383f-481c-9a6d-2832fed74743 tempest-ProjectReaderTests-467028060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:44:46 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-cd8ba973-383f-481c-9a6d-2832fed74743 tempest-ProjectReaderTests-467028060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:44:46 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-cd8ba973-383f-481c-9a6d-2832fed74743 tempest-ProjectReaderTests-467028060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:44:46 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-cd8ba973-383f-481c-9a6d-2832fed74743 tempest-ProjectReaderTests-467028060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:44:46 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-cd8ba973-383f-481c-9a6d-2832fed74743 tempest-ProjectReaderTests-467028060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:44:46 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-cd8ba973-383f-481c-9a6d-2832fed74743 tempest-ProjectReaderTests-467028060 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:44:46 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-cd8ba973-383f-481c-9a6d-2832fed74743 tempest-ProjectReaderTests-467028060 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:44:46 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-cd8ba973-383f-481c-9a6d-2832fed74743 tempest-ProjectReaderTests-467028060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2a29d2c7-ce84-4096-8cb8-0f88d1356eb8 1073741824 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:44:46 devstack sudo[107947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2a29d2c7-ce84-4096-8cb8-0f88d1356eb8 1073741824
Nov 03 18:44:46 devstack sudo[107947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:44:47 devstack sudo[107947]: pam_unix(sudo:session): session closed for user root
Nov 03 18:44:47 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-cd8ba973-383f-481c-9a6d-2832fed74743 tempest-ProjectReaderTests-467028060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2a29d2c7-ce84-4096-8cb8-0f88d1356eb8 1073741824" returned: 0 in 0.415s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:44:47 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-cd8ba973-383f-481c-9a6d-2832fed74743 tempest-ProjectReaderTests-467028060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2a29d2c7-ce84-4096-8cb8-0f88d1356eb8 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:44:47 devstack sudo[107952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2a29d2c7-ce84-4096-8cb8-0f88d1356eb8
Nov 03 18:44:47 devstack sudo[107952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:44:47 devstack sudo[107952]: pam_unix(sudo:session): session closed for user root
Nov 03 18:44:47 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-cd8ba973-383f-481c-9a6d-2832fed74743 tempest-ProjectReaderTests-467028060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2a29d2c7-ce84-4096-8cb8-0f88d1356eb8" returned: 0 in 0.242s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:44:47 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-cd8ba973-383f-481c-9a6d-2832fed74743 tempest-ProjectReaderTests-467028060 None] <== create_volume: return (699ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:44:47 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-cd8ba973-383f-481c-9a6d-2832fed74743 tempest-ProjectReaderTests-467028060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.702s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:44:47 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-cd8ba973-383f-481c-9a6d-2832fed74743 tempest-ProjectReaderTests-467028060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ad9e1cf-7cf6-4774-9d65-1eba88b39589) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a29d2c7-ce84-4096-8cb8-0f88d1356eb8', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:44:47 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-cd8ba973-383f-481c-9a6d-2832fed74743 tempest-ProjectReaderTests-467028060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e8e49fb-0389-4237-be8e-4e1451b2025d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:44:47 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-cd8ba973-383f-481c-9a6d-2832fed74743 tempest-ProjectReaderTests-467028060 None] Volume volume-2a29d2c7-ce84-4096-8cb8-0f88d1356eb8 (2a29d2c7-ce84-4096-8cb8-0f88d1356eb8): created successfully
Nov 03 18:44:47 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-cd8ba973-383f-481c-9a6d-2832fed74743 tempest-ProjectReaderTests-467028060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e8e49fb-0389-4237-be8e-4e1451b2025d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:44:47 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-cd8ba973-383f-481c-9a6d-2832fed74743 tempest-ProjectReaderTests-467028060 None] Flow 'volume_create_manager' (52b40b43-d530-43d3-889b-dd6e163718d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:44:47 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-cd8ba973-383f-481c-9a6d-2832fed74743 tempest-ProjectReaderTests-467028060 None] Created volume successfully.
Nov 03 18:44:47 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-844a05d5-947d-4304-bacc-a3d8435c352c tempest-ProjectReaderTests-467028060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:44:47 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-844a05d5-947d-4304-bacc-a3d8435c352c tempest-ProjectReaderTests-467028060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:44:47 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-844a05d5-947d-4304-bacc-a3d8435c352c tempest-ProjectReaderTests-467028060 None] Creating offline snapshot cafabf86-ab52-465d-b81b-28a03f01720a of volume 2a29d2c7-ce84-4096-8cb8-0f88d1356eb8 {{(pid=86120) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 18:44:47 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1cae8d5-e754-408c-8875-d417a6234a14]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:44:47 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-844a05d5-947d-4304-bacc-a3d8435c352c tempest-ProjectReaderTests-467028060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2a29d2c7-ce84-4096-8cb8-0f88d1356eb8 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:44:47 devstack sudo[107955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2a29d2c7-ce84-4096-8cb8-0f88d1356eb8
Nov 03 18:44:47 devstack sudo[107955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:44:48 devstack sudo[107955]: pam_unix(sudo:session): session closed for user root
Nov 03 18:44:48 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-844a05d5-947d-4304-bacc-a3d8435c352c tempest-ProjectReaderTests-467028060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2a29d2c7-ce84-4096-8cb8-0f88d1356eb8" returned: 0 in 0.365s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:44:48 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-844a05d5-947d-4304-bacc-a3d8435c352c tempest-ProjectReaderTests-467028060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2a29d2c7-ce84-4096-8cb8-0f88d1356eb8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2a29d2c7-ce84-4096-8cb8-0f88d1356eb8.cafabf86-ab52-465d-b81b-28a03f01720a 1G {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:44:48 devstack sudo[107960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2a29d2c7-ce84-4096-8cb8-0f88d1356eb8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2a29d2c7-ce84-4096-8cb8-0f88d1356eb8.cafabf86-ab52-465d-b81b-28a03f01720a 1G
Nov 03 18:44:48 devstack sudo[107960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:44:48 devstack sudo[107960]: pam_unix(sudo:session): session closed for user root
Nov 03 18:44:48 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-844a05d5-947d-4304-bacc-a3d8435c352c tempest-ProjectReaderTests-467028060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2a29d2c7-ce84-4096-8cb8-0f88d1356eb8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2a29d2c7-ce84-4096-8cb8-0f88d1356eb8.cafabf86-ab52-465d-b81b-28a03f01720a 1G" returned: 0 in 0.385s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:44:48 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-844a05d5-947d-4304-bacc-a3d8435c352c tempest-ProjectReaderTests-467028060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a29d2c7-ce84-4096-8cb8-0f88d1356eb8 -F qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2a29d2c7-ce84-4096-8cb8-0f88d1356eb8.cafabf86-ab52-465d-b81b-28a03f01720a {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:44:48 devstack sudo[107965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a29d2c7-ce84-4096-8cb8-0f88d1356eb8 -F qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2a29d2c7-ce84-4096-8cb8-0f88d1356eb8.cafabf86-ab52-465d-b81b-28a03f01720a
Nov 03 18:44:48 devstack sudo[107965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:44:48 devstack sudo[107965]: pam_unix(sudo:session): session closed for user root
Nov 03 18:44:48 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-844a05d5-947d-4304-bacc-a3d8435c352c tempest-ProjectReaderTests-467028060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a29d2c7-ce84-4096-8cb8-0f88d1356eb8 -F qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2a29d2c7-ce84-4096-8cb8-0f88d1356eb8.cafabf86-ab52-465d-b81b-28a03f01720a" returned: 0 in 0.289s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:44:48 devstack cinder-volume[86120]: WARNING cinder.volume.drivers.remotefs [None req-844a05d5-947d-4304-bacc-a3d8435c352c tempest-ProjectReaderTests-467028060 None] /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2a29d2c7-ce84-4096-8cb8-0f88d1356eb8.cafabf86-ab52-465d-b81b-28a03f01720a is being set with open permissions: ugo+rw
Nov 03 18:44:48 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-844a05d5-947d-4304-bacc-a3d8435c352c tempest-ProjectReaderTests-467028060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2a29d2c7-ce84-4096-8cb8-0f88d1356eb8.cafabf86-ab52-465d-b81b-28a03f01720a {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:44:48 devstack sudo[107970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2a29d2c7-ce84-4096-8cb8-0f88d1356eb8.cafabf86-ab52-465d-b81b-28a03f01720a
Nov 03 18:44:48 devstack sudo[107970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:44:48 devstack sudo[107970]: pam_unix(sudo:session): session closed for user root
Nov 03 18:44:48 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-844a05d5-947d-4304-bacc-a3d8435c352c tempest-ProjectReaderTests-467028060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2a29d2c7-ce84-4096-8cb8-0f88d1356eb8.cafabf86-ab52-465d-b81b-28a03f01720a" returned: 0 in 0.242s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:44:49 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-844a05d5-947d-4304-bacc-a3d8435c352c tempest-ProjectReaderTests-467028060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2a29d2c7-ce84-4096-8cb8-0f88d1356eb8.info {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:44:49 devstack sudo[107973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2a29d2c7-ce84-4096-8cb8-0f88d1356eb8.info
Nov 03 18:44:49 devstack sudo[107973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:44:49 devstack sudo[107973]: pam_unix(sudo:session): session closed for user root
Nov 03 18:44:49 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-844a05d5-947d-4304-bacc-a3d8435c352c tempest-ProjectReaderTests-467028060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2a29d2c7-ce84-4096-8cb8-0f88d1356eb8.info" returned: 0 in 0.251s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:44:49 devstack cinder-volume[86120]: WARNING cinder.volume.drivers.remotefs [None req-844a05d5-947d-4304-bacc-a3d8435c352c tempest-ProjectReaderTests-467028060 None] /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2a29d2c7-ce84-4096-8cb8-0f88d1356eb8.info is being set with open permissions: ugo+rw
Nov 03 18:44:49 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-844a05d5-947d-4304-bacc-a3d8435c352c tempest-ProjectReaderTests-467028060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2a29d2c7-ce84-4096-8cb8-0f88d1356eb8.info {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:44:49 devstack sudo[107976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2a29d2c7-ce84-4096-8cb8-0f88d1356eb8.info
Nov 03 18:44:49 devstack sudo[107976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:44:49 devstack sudo[107976]: pam_unix(sudo:session): session closed for user root
Nov 03 18:44:49 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-844a05d5-947d-4304-bacc-a3d8435c352c tempest-ProjectReaderTests-467028060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2a29d2c7-ce84-4096-8cb8-0f88d1356eb8.info" returned: 0 in 0.242s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:44:49 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-844a05d5-947d-4304-bacc-a3d8435c352c tempest-ProjectReaderTests-467028060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.851s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:44:49 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-844a05d5-947d-4304-bacc-a3d8435c352c tempest-ProjectReaderTests-467028060 None] Create snapshot completed successfully
Nov 03 18:44:49 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-4dfceda3-f6bb-4f41-8a72-3302e054181b tempest-ProjectReaderTests-467028060 None] Acquiring lock "cinder-cafabf86-ab52-465d-b81b-28a03f01720a-delete_snapshot" by "delete_snapshot" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:44:49 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-4dfceda3-f6bb-4f41-8a72-3302e054181b tempest-ProjectReaderTests-467028060 None] Lock "cinder-cafabf86-ab52-465d-b81b-28a03f01720a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:44:49 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-4dfceda3-f6bb-4f41-8a72-3302e054181b tempest-ProjectReaderTests-467028060 None] Acquiring lock "cinder-quobyte-2a29d2c7-ce84-4096-8cb8-0f88d1356eb8" by "delete_snapshot" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:44:49 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-4dfceda3-f6bb-4f41-8a72-3302e054181b tempest-ProjectReaderTests-467028060 None] Lock "cinder-quobyte-2a29d2c7-ce84-4096-8cb8-0f88d1356eb8" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:44:49 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-4dfceda3-f6bb-4f41-8a72-3302e054181b tempest-ProjectReaderTests-467028060 None] Acquiring lock "cinder-quobyte-cafabf86-ab52-465d-b81b-28a03f01720a" by "_delete_snapshot" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:44:49 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-4dfceda3-f6bb-4f41-8a72-3302e054181b tempest-ProjectReaderTests-467028060 None] Lock "cinder-quobyte-cafabf86-ab52-465d-b81b-28a03f01720a" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:44:49 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-4dfceda3-f6bb-4f41-8a72-3302e054181b tempest-ProjectReaderTests-467028060 None] Deleting offline snapshot cafabf86-ab52-465d-b81b-28a03f01720a of volume 2a29d2c7-ce84-4096-8cb8-0f88d1356eb8 {{(pid=86120) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 18:44:49 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-4dfceda3-f6bb-4f41-8a72-3302e054181b tempest-ProjectReaderTests-467028060 None] snapshot_file for this snap is: volume-2a29d2c7-ce84-4096-8cb8-0f88d1356eb8.cafabf86-ab52-465d-b81b-28a03f01720a {{(pid=86120) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 18:44:49 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[c04e6fb6-1d7f-427b-a0ba-ef7c1a9b9bc4]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:44:49 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-4dfceda3-f6bb-4f41-8a72-3302e054181b tempest-ProjectReaderTests-467028060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2a29d2c7-ce84-4096-8cb8-0f88d1356eb8.cafabf86-ab52-465d-b81b-28a03f01720a {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:44:50 devstack sudo[107980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2a29d2c7-ce84-4096-8cb8-0f88d1356eb8.cafabf86-ab52-465d-b81b-28a03f01720a
Nov 03 18:44:50 devstack sudo[107980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:44:50 devstack sudo[107980]: pam_unix(sudo:session): session closed for user root
Nov 03 18:44:50 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-4dfceda3-f6bb-4f41-8a72-3302e054181b tempest-ProjectReaderTests-467028060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2a29d2c7-ce84-4096-8cb8-0f88d1356eb8.cafabf86-ab52-465d-b81b-28a03f01720a" returned: 0 in 0.357s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:44:50 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-4dfceda3-f6bb-4f41-8a72-3302e054181b tempest-ProjectReaderTests-467028060 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2a29d2c7-ce84-4096-8cb8-0f88d1356eb8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86120) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 18:44:50 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea8d9750-124a-4068-b44a-704ccf6a4375]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:44:50 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-4dfceda3-f6bb-4f41-8a72-3302e054181b tempest-ProjectReaderTests-467028060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2a29d2c7-ce84-4096-8cb8-0f88d1356eb8 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:44:50 devstack sudo[107985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2a29d2c7-ce84-4096-8cb8-0f88d1356eb8
Nov 03 18:44:50 devstack sudo[107985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:44:50 devstack sudo[107985]: pam_unix(sudo:session): session closed for user root
Nov 03 18:44:50 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-4dfceda3-f6bb-4f41-8a72-3302e054181b tempest-ProjectReaderTests-467028060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2a29d2c7-ce84-4096-8cb8-0f88d1356eb8" returned: 0 in 0.355s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:44:50 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-4dfceda3-f6bb-4f41-8a72-3302e054181b tempest-ProjectReaderTests-467028060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2a29d2c7-ce84-4096-8cb8-0f88d1356eb8.cafabf86-ab52-465d-b81b-28a03f01720a {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:44:50 devstack sudo[107990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2a29d2c7-ce84-4096-8cb8-0f88d1356eb8.cafabf86-ab52-465d-b81b-28a03f01720a
Nov 03 18:44:50 devstack sudo[107990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:44:51 devstack sudo[107990]: pam_unix(sudo:session): session closed for user root
Nov 03 18:44:51 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-4dfceda3-f6bb-4f41-8a72-3302e054181b tempest-ProjectReaderTests-467028060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2a29d2c7-ce84-4096-8cb8-0f88d1356eb8.cafabf86-ab52-465d-b81b-28a03f01720a" returned: 0 in 0.331s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:44:51 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-4dfceda3-f6bb-4f41-8a72-3302e054181b tempest-ProjectReaderTests-467028060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2a29d2c7-ce84-4096-8cb8-0f88d1356eb8.cafabf86-ab52-465d-b81b-28a03f01720a {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:44:51 devstack sudo[107995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2a29d2c7-ce84-4096-8cb8-0f88d1356eb8.cafabf86-ab52-465d-b81b-28a03f01720a
Nov 03 18:44:51 devstack sudo[107995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:44:51 devstack sudo[107995]: pam_unix(sudo:session): session closed for user root
Nov 03 18:44:51 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-4dfceda3-f6bb-4f41-8a72-3302e054181b tempest-ProjectReaderTests-467028060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2a29d2c7-ce84-4096-8cb8-0f88d1356eb8.cafabf86-ab52-465d-b81b-28a03f01720a" returned: 0 in 0.252s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:44:51 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-4dfceda3-f6bb-4f41-8a72-3302e054181b tempest-ProjectReaderTests-467028060 None] Lock "cinder-quobyte-cafabf86-ab52-465d-b81b-28a03f01720a" released by "_delete_snapshot" :: held 1.393s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:44:51 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-4dfceda3-f6bb-4f41-8a72-3302e054181b tempest-ProjectReaderTests-467028060 None] Lock "cinder-quobyte-2a29d2c7-ce84-4096-8cb8-0f88d1356eb8" released by "delete_snapshot" :: held 1.414s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:44:51 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-4dfceda3-f6bb-4f41-8a72-3302e054181b tempest-ProjectReaderTests-467028060 None] Created reservations ['f1304d49-41aa-4372-b382-dd3d291fbea5', '81fc2059-5526-48cd-9454-61ae2cf9a397', '9afd36d3-e547-448b-9de6-63af90e2a1f3', 'b4c5a266-9076-498d-adb2-949f26877163'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:44:51 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-4dfceda3-f6bb-4f41-8a72-3302e054181b tempest-ProjectReaderTests-467028060 None] Delete snapshot completed successfully.
Nov 03 18:44:51 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-4dfceda3-f6bb-4f41-8a72-3302e054181b tempest-ProjectReaderTests-467028060 None] Lock "cinder-cafabf86-ab52-465d-b81b-28a03f01720a-delete_snapshot" released by "delete_snapshot" :: held 1.537s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:44:52 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-763cd2db-ba73-4b46-acb1-2ba0a63e149b tempest-ProjectReaderTests-467028060 None] Acquiring lock "cinder-2a29d2c7-ce84-4096-8cb8-0f88d1356eb8-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:44:52 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-763cd2db-ba73-4b46-acb1-2ba0a63e149b tempest-ProjectReaderTests-467028060 None] Lock "cinder-2a29d2c7-ce84-4096-8cb8-0f88d1356eb8-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:44:52 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-763cd2db-ba73-4b46-acb1-2ba0a63e149b tempest-ProjectReaderTests-467028060 None] Acquiring lock "cinder-quobyte-2a29d2c7-ce84-4096-8cb8-0f88d1356eb8" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:44:52 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-763cd2db-ba73-4b46-acb1-2ba0a63e149b tempest-ProjectReaderTests-467028060 None] Lock "cinder-quobyte-2a29d2c7-ce84-4096-8cb8-0f88d1356eb8" acquired by "delete_volume" :: waited 0.016s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:44:52 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ec842c5-96d1-416a-81c5-03079a83ad37]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:44:52 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-763cd2db-ba73-4b46-acb1-2ba0a63e149b tempest-ProjectReaderTests-467028060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2a29d2c7-ce84-4096-8cb8-0f88d1356eb8 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:44:52 devstack sudo[107998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2a29d2c7-ce84-4096-8cb8-0f88d1356eb8
Nov 03 18:44:52 devstack sudo[107998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:44:52 devstack sudo[107998]: pam_unix(sudo:session): session closed for user root
Nov 03 18:44:52 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-763cd2db-ba73-4b46-acb1-2ba0a63e149b tempest-ProjectReaderTests-467028060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2a29d2c7-ce84-4096-8cb8-0f88d1356eb8" returned: 0 in 0.355s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:44:52 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-763cd2db-ba73-4b46-acb1-2ba0a63e149b tempest-ProjectReaderTests-467028060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2a29d2c7-ce84-4096-8cb8-0f88d1356eb8 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:44:52 devstack sudo[108003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2a29d2c7-ce84-4096-8cb8-0f88d1356eb8
Nov 03 18:44:52 devstack sudo[108003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:44:52 devstack sudo[108003]: pam_unix(sudo:session): session closed for user root
Nov 03 18:44:52 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-763cd2db-ba73-4b46-acb1-2ba0a63e149b tempest-ProjectReaderTests-467028060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2a29d2c7-ce84-4096-8cb8-0f88d1356eb8" returned: 0 in 0.248s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:44:52 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-763cd2db-ba73-4b46-acb1-2ba0a63e149b tempest-ProjectReaderTests-467028060 None] Lock "cinder-quobyte-2a29d2c7-ce84-4096-8cb8-0f88d1356eb8" released by "delete_volume" :: held 0.663s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:44:52 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-763cd2db-ba73-4b46-acb1-2ba0a63e149b tempest-ProjectReaderTests-467028060 None] Created reservations ['b99e0167-bb56-413b-827f-f20095cd94ea', 'fc95c93c-f443-4314-81ec-797e7c36b39f', '3c0bf7fa-be7d-4abc-bb6d-67c502e1847b', '0d9649d7-b1c3-4d4e-b044-17e82099c9af'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:44:52 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-763cd2db-ba73-4b46-acb1-2ba0a63e149b tempest-ProjectReaderTests-467028060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:44:52 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-763cd2db-ba73-4b46-acb1-2ba0a63e149b tempest-ProjectReaderTests-467028060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:44:52 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-763cd2db-ba73-4b46-acb1-2ba0a63e149b tempest-ProjectReaderTests-467028060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:44:52 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-763cd2db-ba73-4b46-acb1-2ba0a63e149b tempest-ProjectReaderTests-467028060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:44:52 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-763cd2db-ba73-4b46-acb1-2ba0a63e149b tempest-ProjectReaderTests-467028060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:44:52 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-763cd2db-ba73-4b46-acb1-2ba0a63e149b tempest-ProjectReaderTests-467028060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:44:52 devstack sudo[108006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:44:52 devstack sudo[108006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:44:53 devstack sudo[108006]: pam_unix(sudo:session): session closed for user root
Nov 03 18:44:53 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-763cd2db-ba73-4b46-acb1-2ba0a63e149b tempest-ProjectReaderTests-467028060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.255s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:44:53 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-763cd2db-ba73-4b46-acb1-2ba0a63e149b tempest-ProjectReaderTests-467028060 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:44:53 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-763cd2db-ba73-4b46-acb1-2ba0a63e149b tempest-ProjectReaderTests-467028060 None] Deleted volume successfully.
Nov 03 18:44:53 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-763cd2db-ba73-4b46-acb1-2ba0a63e149b tempest-ProjectReaderTests-467028060 None] Lock "cinder-2a29d2c7-ce84-4096-8cb8-0f88d1356eb8-delete_volume" released by "delete_volume" :: held 1.100s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:44:53 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-24f9f56c-6d16-427f-8719-0ba1d0b0d734 tempest-ProjectReaderTests-467028060 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:44:53 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-24f9f56c-6d16-427f-8719-0ba1d0b0d734 tempest-ProjectReaderTests-467028060 None] Flow 'volume_create_manager' (40896e75-0b38-4650-8081-95b0aff682f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:44:53 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-24f9f56c-6d16-427f-8719-0ba1d0b0d734 tempest-ProjectReaderTests-467028060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (949cd3a0-721d-4bc2-a542-b01797c3fa5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:44:53 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-24f9f56c-6d16-427f-8719-0ba1d0b0d734 tempest-ProjectReaderTests-467028060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (949cd3a0-721d-4bc2-a542-b01797c3fa5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:44:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-176862894',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad42b393-97cc-494d-b6e8-272b7bdbd64e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50252b1b4e7043feb4ce25984f80f28b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:44:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:44:54Z,use_quota=True,user_id='0775f8e7db7d41039e0f7dd52466882e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:44:53 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-24f9f56c-6d16-427f-8719-0ba1d0b0d734 tempest-ProjectReaderTests-467028060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3255a34c-75d8-4aed-bc2d-0a0c02e872d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:44:53 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-24f9f56c-6d16-427f-8719-0ba1d0b0d734 tempest-ProjectReaderTests-467028060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3255a34c-75d8-4aed-bc2d-0a0c02e872d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:44:53 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-24f9f56c-6d16-427f-8719-0ba1d0b0d734 tempest-ProjectReaderTests-467028060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcb1d75f-04dd-440e-bb47-14bdb36d40b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:44:53 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-24f9f56c-6d16-427f-8719-0ba1d0b0d734 tempest-ProjectReaderTests-467028060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcb1d75f-04dd-440e-bb47-14bdb36d40b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad42b393-97cc-494d-b6e8-272b7bdbd64e', 'volume_name': 'volume-ad42b393-97cc-494d-b6e8-272b7bdbd64e', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:44:53 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-24f9f56c-6d16-427f-8719-0ba1d0b0d734 tempest-ProjectReaderTests-467028060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3a15332-9f91-4abd-9fd5-9eafa8fcb38f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:44:53 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-24f9f56c-6d16-427f-8719-0ba1d0b0d734 tempest-ProjectReaderTests-467028060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3a15332-9f91-4abd-9fd5-9eafa8fcb38f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:44:53 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-24f9f56c-6d16-427f-8719-0ba1d0b0d734 tempest-ProjectReaderTests-467028060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (111275c8-0707-4ca8-ab95-926a5c887bbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:44:53 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-24f9f56c-6d16-427f-8719-0ba1d0b0d734 tempest-ProjectReaderTests-467028060 None] Volume ad42b393-97cc-494d-b6e8-272b7bdbd64e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad42b393-97cc-494d-b6e8-272b7bdbd64e', 'volume_size': 1}
Nov 03 18:44:53 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-24f9f56c-6d16-427f-8719-0ba1d0b0d734 tempest-ProjectReaderTests-467028060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:44:53 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-24f9f56c-6d16-427f-8719-0ba1d0b0d734 tempest-ProjectReaderTests-467028060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:44:53 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-24f9f56c-6d16-427f-8719-0ba1d0b0d734 tempest-ProjectReaderTests-467028060 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:44:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-176862894',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad42b393-97cc-494d-b6e8-272b7bdbd64e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50252b1b4e7043feb4ce25984f80f28b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:44:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:44:54Z,use_quota=True,user_id='0775f8e7db7d41039e0f7dd52466882e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:44:53 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-24f9f56c-6d16-427f-8719-0ba1d0b0d734 tempest-ProjectReaderTests-467028060 None] Creating volume ad42b393-97cc-494d-b6e8-272b7bdbd64e {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:44:53 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-24f9f56c-6d16-427f-8719-0ba1d0b0d734 tempest-ProjectReaderTests-467028060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:44:53 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-24f9f56c-6d16-427f-8719-0ba1d0b0d734 tempest-ProjectReaderTests-467028060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:44:53 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-24f9f56c-6d16-427f-8719-0ba1d0b0d734 tempest-ProjectReaderTests-467028060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:44:53 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-24f9f56c-6d16-427f-8719-0ba1d0b0d734 tempest-ProjectReaderTests-467028060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:44:53 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-24f9f56c-6d16-427f-8719-0ba1d0b0d734 tempest-ProjectReaderTests-467028060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:44:53 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-24f9f56c-6d16-427f-8719-0ba1d0b0d734 tempest-ProjectReaderTests-467028060 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:44:53 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-24f9f56c-6d16-427f-8719-0ba1d0b0d734 tempest-ProjectReaderTests-467028060 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:44:53 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-24f9f56c-6d16-427f-8719-0ba1d0b0d734 tempest-ProjectReaderTests-467028060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ad42b393-97cc-494d-b6e8-272b7bdbd64e 1073741824 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:44:53 devstack sudo[108009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ad42b393-97cc-494d-b6e8-272b7bdbd64e 1073741824
Nov 03 18:44:53 devstack sudo[108009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:44:54 devstack sudo[108009]: pam_unix(sudo:session): session closed for user root
Nov 03 18:44:54 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-24f9f56c-6d16-427f-8719-0ba1d0b0d734 tempest-ProjectReaderTests-467028060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ad42b393-97cc-494d-b6e8-272b7bdbd64e 1073741824" returned: 0 in 0.425s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:44:54 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-24f9f56c-6d16-427f-8719-0ba1d0b0d734 tempest-ProjectReaderTests-467028060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ad42b393-97cc-494d-b6e8-272b7bdbd64e {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:44:54 devstack sudo[108014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ad42b393-97cc-494d-b6e8-272b7bdbd64e
Nov 03 18:44:54 devstack sudo[108014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:44:54 devstack sudo[108014]: pam_unix(sudo:session): session closed for user root
Nov 03 18:44:54 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-24f9f56c-6d16-427f-8719-0ba1d0b0d734 tempest-ProjectReaderTests-467028060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ad42b393-97cc-494d-b6e8-272b7bdbd64e" returned: 0 in 0.248s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:44:54 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-24f9f56c-6d16-427f-8719-0ba1d0b0d734 tempest-ProjectReaderTests-467028060 None] <== create_volume: return (715ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:44:54 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-24f9f56c-6d16-427f-8719-0ba1d0b0d734 tempest-ProjectReaderTests-467028060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.718s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:44:54 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-24f9f56c-6d16-427f-8719-0ba1d0b0d734 tempest-ProjectReaderTests-467028060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (111275c8-0707-4ca8-ab95-926a5c887bbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad42b393-97cc-494d-b6e8-272b7bdbd64e', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:44:54 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-24f9f56c-6d16-427f-8719-0ba1d0b0d734 tempest-ProjectReaderTests-467028060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a531a7bf-9707-432d-ac73-8ccaef0aae13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:44:54 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-24f9f56c-6d16-427f-8719-0ba1d0b0d734 tempest-ProjectReaderTests-467028060 None] Volume volume-ad42b393-97cc-494d-b6e8-272b7bdbd64e (ad42b393-97cc-494d-b6e8-272b7bdbd64e): created successfully
Nov 03 18:44:54 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-24f9f56c-6d16-427f-8719-0ba1d0b0d734 tempest-ProjectReaderTests-467028060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a531a7bf-9707-432d-ac73-8ccaef0aae13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:44:54 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-24f9f56c-6d16-427f-8719-0ba1d0b0d734 tempest-ProjectReaderTests-467028060 None] Flow 'volume_create_manager' (40896e75-0b38-4650-8081-95b0aff682f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:44:54 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-24f9f56c-6d16-427f-8719-0ba1d0b0d734 tempest-ProjectReaderTests-467028060 None] Created volume successfully.
Nov 03 18:44:55 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-84f7fbf1-7090-420b-b3cc-48c1b294c755 tempest-ProjectReaderTests-467028060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:44:55 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-84f7fbf1-7090-420b-b3cc-48c1b294c755 tempest-ProjectReaderTests-467028060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:44:55 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-84f7fbf1-7090-420b-b3cc-48c1b294c755 tempest-ProjectReaderTests-467028060 None] Creating offline snapshot 92e59cf4-8453-45de-87c9-e1f52f132dd0 of volume ad42b393-97cc-494d-b6e8-272b7bdbd64e {{(pid=86120) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 18:44:55 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[35c61ad4-211a-4895-9c5b-767e76b92070]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:44:55 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-84f7fbf1-7090-420b-b3cc-48c1b294c755 tempest-ProjectReaderTests-467028060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ad42b393-97cc-494d-b6e8-272b7bdbd64e {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:44:55 devstack sudo[108017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ad42b393-97cc-494d-b6e8-272b7bdbd64e
Nov 03 18:44:55 devstack sudo[108017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:44:55 devstack sudo[108017]: pam_unix(sudo:session): session closed for user root
Nov 03 18:44:55 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-84f7fbf1-7090-420b-b3cc-48c1b294c755 tempest-ProjectReaderTests-467028060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ad42b393-97cc-494d-b6e8-272b7bdbd64e" returned: 0 in 0.356s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:44:55 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-84f7fbf1-7090-420b-b3cc-48c1b294c755 tempest-ProjectReaderTests-467028060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ad42b393-97cc-494d-b6e8-272b7bdbd64e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ad42b393-97cc-494d-b6e8-272b7bdbd64e.92e59cf4-8453-45de-87c9-e1f52f132dd0 1G {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:44:55 devstack sudo[108022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ad42b393-97cc-494d-b6e8-272b7bdbd64e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ad42b393-97cc-494d-b6e8-272b7bdbd64e.92e59cf4-8453-45de-87c9-e1f52f132dd0 1G
Nov 03 18:44:55 devstack sudo[108022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:44:55 devstack sudo[108022]: pam_unix(sudo:session): session closed for user root
Nov 03 18:44:55 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-84f7fbf1-7090-420b-b3cc-48c1b294c755 tempest-ProjectReaderTests-467028060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ad42b393-97cc-494d-b6e8-272b7bdbd64e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ad42b393-97cc-494d-b6e8-272b7bdbd64e.92e59cf4-8453-45de-87c9-e1f52f132dd0 1G" returned: 0 in 0.396s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:44:55 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-84f7fbf1-7090-420b-b3cc-48c1b294c755 tempest-ProjectReaderTests-467028060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad42b393-97cc-494d-b6e8-272b7bdbd64e -F qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ad42b393-97cc-494d-b6e8-272b7bdbd64e.92e59cf4-8453-45de-87c9-e1f52f132dd0 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:44:55 devstack sudo[108027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad42b393-97cc-494d-b6e8-272b7bdbd64e -F qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ad42b393-97cc-494d-b6e8-272b7bdbd64e.92e59cf4-8453-45de-87c9-e1f52f132dd0
Nov 03 18:44:55 devstack sudo[108027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:44:56 devstack sudo[108027]: pam_unix(sudo:session): session closed for user root
Nov 03 18:44:56 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-84f7fbf1-7090-420b-b3cc-48c1b294c755 tempest-ProjectReaderTests-467028060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad42b393-97cc-494d-b6e8-272b7bdbd64e -F qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ad42b393-97cc-494d-b6e8-272b7bdbd64e.92e59cf4-8453-45de-87c9-e1f52f132dd0" returned: 0 in 0.288s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:44:56 devstack cinder-volume[86120]: WARNING cinder.volume.drivers.remotefs [None req-84f7fbf1-7090-420b-b3cc-48c1b294c755 tempest-ProjectReaderTests-467028060 None] /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ad42b393-97cc-494d-b6e8-272b7bdbd64e.92e59cf4-8453-45de-87c9-e1f52f132dd0 is being set with open permissions: ugo+rw
Nov 03 18:44:56 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-84f7fbf1-7090-420b-b3cc-48c1b294c755 tempest-ProjectReaderTests-467028060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ad42b393-97cc-494d-b6e8-272b7bdbd64e.92e59cf4-8453-45de-87c9-e1f52f132dd0 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:44:56 devstack sudo[108032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ad42b393-97cc-494d-b6e8-272b7bdbd64e.92e59cf4-8453-45de-87c9-e1f52f132dd0
Nov 03 18:44:56 devstack sudo[108032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:44:56 devstack sudo[108032]: pam_unix(sudo:session): session closed for user root
Nov 03 18:44:56 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-84f7fbf1-7090-420b-b3cc-48c1b294c755 tempest-ProjectReaderTests-467028060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ad42b393-97cc-494d-b6e8-272b7bdbd64e.92e59cf4-8453-45de-87c9-e1f52f132dd0" returned: 0 in 0.239s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:44:56 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-84f7fbf1-7090-420b-b3cc-48c1b294c755 tempest-ProjectReaderTests-467028060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ad42b393-97cc-494d-b6e8-272b7bdbd64e.info {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:44:56 devstack sudo[108035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ad42b393-97cc-494d-b6e8-272b7bdbd64e.info
Nov 03 18:44:56 devstack sudo[108035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:44:56 devstack sudo[108035]: pam_unix(sudo:session): session closed for user root
Nov 03 18:44:56 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-84f7fbf1-7090-420b-b3cc-48c1b294c755 tempest-ProjectReaderTests-467028060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ad42b393-97cc-494d-b6e8-272b7bdbd64e.info" returned: 0 in 0.258s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:44:56 devstack cinder-volume[86120]: WARNING cinder.volume.drivers.remotefs [None req-84f7fbf1-7090-420b-b3cc-48c1b294c755 tempest-ProjectReaderTests-467028060 None] /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ad42b393-97cc-494d-b6e8-272b7bdbd64e.info is being set with open permissions: ugo+rw
Nov 03 18:44:56 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-84f7fbf1-7090-420b-b3cc-48c1b294c755 tempest-ProjectReaderTests-467028060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ad42b393-97cc-494d-b6e8-272b7bdbd64e.info {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:44:56 devstack sudo[108038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ad42b393-97cc-494d-b6e8-272b7bdbd64e.info
Nov 03 18:44:56 devstack sudo[108038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:44:56 devstack sudo[108038]: pam_unix(sudo:session): session closed for user root
Nov 03 18:44:56 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-84f7fbf1-7090-420b-b3cc-48c1b294c755 tempest-ProjectReaderTests-467028060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ad42b393-97cc-494d-b6e8-272b7bdbd64e.info" returned: 0 in 0.243s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:44:56 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-84f7fbf1-7090-420b-b3cc-48c1b294c755 tempest-ProjectReaderTests-467028060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.863s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:44:56 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-84f7fbf1-7090-420b-b3cc-48c1b294c755 tempest-ProjectReaderTests-467028060 None] Create snapshot completed successfully
Nov 03 18:44:57 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-b62b40fd-54f9-4031-a980-a31479c6ca9b tempest-ProjectReaderTests-467028060 None] Acquiring lock "cinder-92e59cf4-8453-45de-87c9-e1f52f132dd0-delete_snapshot" by "delete_snapshot" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:44:57 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-b62b40fd-54f9-4031-a980-a31479c6ca9b tempest-ProjectReaderTests-467028060 None] Lock "cinder-92e59cf4-8453-45de-87c9-e1f52f132dd0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:44:57 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-b62b40fd-54f9-4031-a980-a31479c6ca9b tempest-ProjectReaderTests-467028060 None] Acquiring lock "cinder-quobyte-ad42b393-97cc-494d-b6e8-272b7bdbd64e" by "delete_snapshot" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:44:57 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-b62b40fd-54f9-4031-a980-a31479c6ca9b tempest-ProjectReaderTests-467028060 None] Lock "cinder-quobyte-ad42b393-97cc-494d-b6e8-272b7bdbd64e" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:44:57 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-b62b40fd-54f9-4031-a980-a31479c6ca9b tempest-ProjectReaderTests-467028060 None] Acquiring lock "cinder-quobyte-92e59cf4-8453-45de-87c9-e1f52f132dd0" by "_delete_snapshot" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:44:57 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-b62b40fd-54f9-4031-a980-a31479c6ca9b tempest-ProjectReaderTests-467028060 None] Lock "cinder-quobyte-92e59cf4-8453-45de-87c9-e1f52f132dd0" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:44:57 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-b62b40fd-54f9-4031-a980-a31479c6ca9b tempest-ProjectReaderTests-467028060 None] Deleting offline snapshot 92e59cf4-8453-45de-87c9-e1f52f132dd0 of volume ad42b393-97cc-494d-b6e8-272b7bdbd64e {{(pid=86120) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 18:44:57 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-b62b40fd-54f9-4031-a980-a31479c6ca9b tempest-ProjectReaderTests-467028060 None] snapshot_file for this snap is: volume-ad42b393-97cc-494d-b6e8-272b7bdbd64e.92e59cf4-8453-45de-87c9-e1f52f132dd0 {{(pid=86120) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 18:44:57 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[51944655-45c8-49d7-b1e7-835880603709]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:44:57 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b62b40fd-54f9-4031-a980-a31479c6ca9b tempest-ProjectReaderTests-467028060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ad42b393-97cc-494d-b6e8-272b7bdbd64e.92e59cf4-8453-45de-87c9-e1f52f132dd0 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:44:57 devstack sudo[108041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ad42b393-97cc-494d-b6e8-272b7bdbd64e.92e59cf4-8453-45de-87c9-e1f52f132dd0
Nov 03 18:44:57 devstack sudo[108041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:44:57 devstack sudo[108041]: pam_unix(sudo:session): session closed for user root
Nov 03 18:44:57 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b62b40fd-54f9-4031-a980-a31479c6ca9b tempest-ProjectReaderTests-467028060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ad42b393-97cc-494d-b6e8-272b7bdbd64e.92e59cf4-8453-45de-87c9-e1f52f132dd0" returned: 0 in 0.351s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:44:57 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-b62b40fd-54f9-4031-a980-a31479c6ca9b tempest-ProjectReaderTests-467028060 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ad42b393-97cc-494d-b6e8-272b7bdbd64e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86120) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 18:44:57 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[65c8becf-510f-4763-8761-5a69117c06c3]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:44:57 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b62b40fd-54f9-4031-a980-a31479c6ca9b tempest-ProjectReaderTests-467028060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ad42b393-97cc-494d-b6e8-272b7bdbd64e {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:44:57 devstack sudo[108046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ad42b393-97cc-494d-b6e8-272b7bdbd64e
Nov 03 18:44:57 devstack sudo[108046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:44:57 devstack sudo[108046]: pam_unix(sudo:session): session closed for user root
Nov 03 18:44:57 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b62b40fd-54f9-4031-a980-a31479c6ca9b tempest-ProjectReaderTests-467028060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ad42b393-97cc-494d-b6e8-272b7bdbd64e" returned: 0 in 0.359s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:44:57 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b62b40fd-54f9-4031-a980-a31479c6ca9b tempest-ProjectReaderTests-467028060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ad42b393-97cc-494d-b6e8-272b7bdbd64e.92e59cf4-8453-45de-87c9-e1f52f132dd0 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:44:58 devstack sudo[108051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ad42b393-97cc-494d-b6e8-272b7bdbd64e.92e59cf4-8453-45de-87c9-e1f52f132dd0
Nov 03 18:44:58 devstack sudo[108051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:44:58 devstack sudo[108051]: pam_unix(sudo:session): session closed for user root
Nov 03 18:44:58 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b62b40fd-54f9-4031-a980-a31479c6ca9b tempest-ProjectReaderTests-467028060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ad42b393-97cc-494d-b6e8-272b7bdbd64e.92e59cf4-8453-45de-87c9-e1f52f132dd0" returned: 0 in 0.317s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:44:58 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b62b40fd-54f9-4031-a980-a31479c6ca9b tempest-ProjectReaderTests-467028060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ad42b393-97cc-494d-b6e8-272b7bdbd64e.92e59cf4-8453-45de-87c9-e1f52f132dd0 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:44:58 devstack sudo[108056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ad42b393-97cc-494d-b6e8-272b7bdbd64e.92e59cf4-8453-45de-87c9-e1f52f132dd0
Nov 03 18:44:58 devstack sudo[108056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:44:58 devstack sudo[108056]: pam_unix(sudo:session): session closed for user root
Nov 03 18:44:58 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b62b40fd-54f9-4031-a980-a31479c6ca9b tempest-ProjectReaderTests-467028060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ad42b393-97cc-494d-b6e8-272b7bdbd64e.92e59cf4-8453-45de-87c9-e1f52f132dd0" returned: 0 in 0.245s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:44:58 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-b62b40fd-54f9-4031-a980-a31479c6ca9b tempest-ProjectReaderTests-467028060 None] Lock "cinder-quobyte-92e59cf4-8453-45de-87c9-e1f52f132dd0" released by "_delete_snapshot" :: held 1.364s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:44:58 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-b62b40fd-54f9-4031-a980-a31479c6ca9b tempest-ProjectReaderTests-467028060 None] Lock "cinder-quobyte-ad42b393-97cc-494d-b6e8-272b7bdbd64e" released by "delete_snapshot" :: held 1.385s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:44:58 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-b62b40fd-54f9-4031-a980-a31479c6ca9b tempest-ProjectReaderTests-467028060 None] Created reservations ['a68f8cc5-79a5-4d78-8b84-18f1fd9cfc61', '4f8f0ec4-231e-4452-9fe5-f269aa87b5cb', 'a7737a8d-e80b-424c-b63c-01a8050193fb', '2060ee6e-1117-4e2b-bffd-d4908b190773'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:44:58 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-b62b40fd-54f9-4031-a980-a31479c6ca9b tempest-ProjectReaderTests-467028060 None] Delete snapshot completed successfully.
Nov 03 18:44:58 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-b62b40fd-54f9-4031-a980-a31479c6ca9b tempest-ProjectReaderTests-467028060 None] Lock "cinder-92e59cf4-8453-45de-87c9-e1f52f132dd0-delete_snapshot" released by "delete_snapshot" :: held 1.513s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:44:59 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-461c058f-085e-4137-a396-fc52ee95dd86 tempest-ProjectReaderTests-467028060 None] Acquiring lock "cinder-ad42b393-97cc-494d-b6e8-272b7bdbd64e-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:44:59 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-461c058f-085e-4137-a396-fc52ee95dd86 tempest-ProjectReaderTests-467028060 None] Lock "cinder-ad42b393-97cc-494d-b6e8-272b7bdbd64e-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:44:59 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-461c058f-085e-4137-a396-fc52ee95dd86 tempest-ProjectReaderTests-467028060 None] Acquiring lock "cinder-quobyte-ad42b393-97cc-494d-b6e8-272b7bdbd64e" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:44:59 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-461c058f-085e-4137-a396-fc52ee95dd86 tempest-ProjectReaderTests-467028060 None] Lock "cinder-quobyte-ad42b393-97cc-494d-b6e8-272b7bdbd64e" acquired by "delete_volume" :: waited 0.013s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:44:59 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[c41c5083-d1b5-449a-b467-2da2c736ccbe]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:44:59 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-461c058f-085e-4137-a396-fc52ee95dd86 tempest-ProjectReaderTests-467028060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ad42b393-97cc-494d-b6e8-272b7bdbd64e {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:44:59 devstack sudo[108059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ad42b393-97cc-494d-b6e8-272b7bdbd64e
Nov 03 18:44:59 devstack sudo[108059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:44:59 devstack sudo[108059]: pam_unix(sudo:session): session closed for user root
Nov 03 18:44:59 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-461c058f-085e-4137-a396-fc52ee95dd86 tempest-ProjectReaderTests-467028060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ad42b393-97cc-494d-b6e8-272b7bdbd64e" returned: 0 in 0.364s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:44:59 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-461c058f-085e-4137-a396-fc52ee95dd86 tempest-ProjectReaderTests-467028060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ad42b393-97cc-494d-b6e8-272b7bdbd64e {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:44:59 devstack sudo[108065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ad42b393-97cc-494d-b6e8-272b7bdbd64e
Nov 03 18:44:59 devstack sudo[108065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:45:00 devstack sudo[108065]: pam_unix(sudo:session): session closed for user root
Nov 03 18:45:00 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-461c058f-085e-4137-a396-fc52ee95dd86 tempest-ProjectReaderTests-467028060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-ad42b393-97cc-494d-b6e8-272b7bdbd64e" returned: 0 in 0.250s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:45:00 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-461c058f-085e-4137-a396-fc52ee95dd86 tempest-ProjectReaderTests-467028060 None] Lock "cinder-quobyte-ad42b393-97cc-494d-b6e8-272b7bdbd64e" released by "delete_volume" :: held 0.677s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:45:00 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-461c058f-085e-4137-a396-fc52ee95dd86 tempest-ProjectReaderTests-467028060 None] Created reservations ['3a0f196c-3f5f-4506-974e-f19d25500a5d', 'f046377d-abec-426b-891b-af6db0e0c885', '8c550d6e-ba9f-4028-a4d8-ab0f99cb7d36', 'f9212a32-31a4-41af-ba1f-a4ea1e05ee73'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:45:00 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-461c058f-085e-4137-a396-fc52ee95dd86 tempest-ProjectReaderTests-467028060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:45:00 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-461c058f-085e-4137-a396-fc52ee95dd86 tempest-ProjectReaderTests-467028060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:45:00 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-461c058f-085e-4137-a396-fc52ee95dd86 tempest-ProjectReaderTests-467028060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:45:00 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-461c058f-085e-4137-a396-fc52ee95dd86 tempest-ProjectReaderTests-467028060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:45:00 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-461c058f-085e-4137-a396-fc52ee95dd86 tempest-ProjectReaderTests-467028060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:45:00 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-461c058f-085e-4137-a396-fc52ee95dd86 tempest-ProjectReaderTests-467028060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:45:00 devstack sudo[108068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:45:00 devstack sudo[108068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:45:00 devstack sudo[108068]: pam_unix(sudo:session): session closed for user root
Nov 03 18:45:00 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-461c058f-085e-4137-a396-fc52ee95dd86 tempest-ProjectReaderTests-467028060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.261s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:45:00 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-461c058f-085e-4137-a396-fc52ee95dd86 tempest-ProjectReaderTests-467028060 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:45:00 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-461c058f-085e-4137-a396-fc52ee95dd86 tempest-ProjectReaderTests-467028060 None] Deleted volume successfully.
Nov 03 18:45:00 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-461c058f-085e-4137-a396-fc52ee95dd86 tempest-ProjectReaderTests-467028060 None] Lock "cinder-ad42b393-97cc-494d-b6e8-272b7bdbd64e-delete_volume" released by "delete_volume" :: held 1.114s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:45:00 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-222e99b2-4dcb-4a04-95eb-80ee217bbb54 tempest-ProjectReaderTests-467028060 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:45:00 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-222e99b2-4dcb-4a04-95eb-80ee217bbb54 tempest-ProjectReaderTests-467028060 None] Flow 'volume_create_manager' (a5760092-dcf3-4e03-b912-f169d06a5563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:45:00 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-222e99b2-4dcb-4a04-95eb-80ee217bbb54 tempest-ProjectReaderTests-467028060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea36a06a-202e-41a1-93d2-d5d01db4ec65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:45:00 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-222e99b2-4dcb-4a04-95eb-80ee217bbb54 tempest-ProjectReaderTests-467028060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea36a06a-202e-41a1-93d2-d5d01db4ec65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:45:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-704730835',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f602a06-96b4-4fd0-8771-6b5cad6013b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50252b1b4e7043feb4ce25984f80f28b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:45:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:45:01Z,use_quota=True,user_id='0775f8e7db7d41039e0f7dd52466882e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:45:00 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-222e99b2-4dcb-4a04-95eb-80ee217bbb54 tempest-ProjectReaderTests-467028060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (491c7c88-5a99-40cc-b5f7-e7861efce26c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:45:00 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-222e99b2-4dcb-4a04-95eb-80ee217bbb54 tempest-ProjectReaderTests-467028060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (491c7c88-5a99-40cc-b5f7-e7861efce26c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:45:00 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-222e99b2-4dcb-4a04-95eb-80ee217bbb54 tempest-ProjectReaderTests-467028060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33ed5ff5-b264-4299-971c-77c673cf2743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:45:00 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-222e99b2-4dcb-4a04-95eb-80ee217bbb54 tempest-ProjectReaderTests-467028060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33ed5ff5-b264-4299-971c-77c673cf2743) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f602a06-96b4-4fd0-8771-6b5cad6013b0', 'volume_name': 'volume-6f602a06-96b4-4fd0-8771-6b5cad6013b0', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:45:00 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-222e99b2-4dcb-4a04-95eb-80ee217bbb54 tempest-ProjectReaderTests-467028060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bda5b185-5990-4cbe-8e08-c4fb4fe4847a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:45:00 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-222e99b2-4dcb-4a04-95eb-80ee217bbb54 tempest-ProjectReaderTests-467028060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bda5b185-5990-4cbe-8e08-c4fb4fe4847a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:45:00 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-222e99b2-4dcb-4a04-95eb-80ee217bbb54 tempest-ProjectReaderTests-467028060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a38450f-a586-46ad-ba04-dbc0fe815fac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:45:00 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-222e99b2-4dcb-4a04-95eb-80ee217bbb54 tempest-ProjectReaderTests-467028060 None] Volume 6f602a06-96b4-4fd0-8771-6b5cad6013b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f602a06-96b4-4fd0-8771-6b5cad6013b0', 'volume_size': 1}
Nov 03 18:45:00 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-222e99b2-4dcb-4a04-95eb-80ee217bbb54 tempest-ProjectReaderTests-467028060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:45:00 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-222e99b2-4dcb-4a04-95eb-80ee217bbb54 tempest-ProjectReaderTests-467028060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:45:00 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-222e99b2-4dcb-4a04-95eb-80ee217bbb54 tempest-ProjectReaderTests-467028060 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:45:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-704730835',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f602a06-96b4-4fd0-8771-6b5cad6013b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50252b1b4e7043feb4ce25984f80f28b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:45:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:45:01Z,use_quota=True,user_id='0775f8e7db7d41039e0f7dd52466882e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:45:00 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-222e99b2-4dcb-4a04-95eb-80ee217bbb54 tempest-ProjectReaderTests-467028060 None] Creating volume 6f602a06-96b4-4fd0-8771-6b5cad6013b0 {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:45:00 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-222e99b2-4dcb-4a04-95eb-80ee217bbb54 tempest-ProjectReaderTests-467028060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:45:00 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-222e99b2-4dcb-4a04-95eb-80ee217bbb54 tempest-ProjectReaderTests-467028060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:45:00 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-222e99b2-4dcb-4a04-95eb-80ee217bbb54 tempest-ProjectReaderTests-467028060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:45:00 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-222e99b2-4dcb-4a04-95eb-80ee217bbb54 tempest-ProjectReaderTests-467028060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:45:00 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-222e99b2-4dcb-4a04-95eb-80ee217bbb54 tempest-ProjectReaderTests-467028060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:45:00 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-222e99b2-4dcb-4a04-95eb-80ee217bbb54 tempest-ProjectReaderTests-467028060 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:45:00 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-222e99b2-4dcb-4a04-95eb-80ee217bbb54 tempest-ProjectReaderTests-467028060 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:45:00 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-222e99b2-4dcb-4a04-95eb-80ee217bbb54 tempest-ProjectReaderTests-467028060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6f602a06-96b4-4fd0-8771-6b5cad6013b0 1073741824 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:45:01 devstack sudo[108071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6f602a06-96b4-4fd0-8771-6b5cad6013b0 1073741824
Nov 03 18:45:01 devstack sudo[108071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:45:01 devstack sudo[108071]: pam_unix(sudo:session): session closed for user root
Nov 03 18:45:01 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-222e99b2-4dcb-4a04-95eb-80ee217bbb54 tempest-ProjectReaderTests-467028060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6f602a06-96b4-4fd0-8771-6b5cad6013b0 1073741824" returned: 0 in 0.404s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:45:01 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-222e99b2-4dcb-4a04-95eb-80ee217bbb54 tempest-ProjectReaderTests-467028060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6f602a06-96b4-4fd0-8771-6b5cad6013b0 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:45:01 devstack sudo[108079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6f602a06-96b4-4fd0-8771-6b5cad6013b0
Nov 03 18:45:01 devstack sudo[108079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:45:01 devstack sudo[108079]: pam_unix(sudo:session): session closed for user root
Nov 03 18:45:01 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-222e99b2-4dcb-4a04-95eb-80ee217bbb54 tempest-ProjectReaderTests-467028060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6f602a06-96b4-4fd0-8771-6b5cad6013b0" returned: 0 in 0.242s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:45:01 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-222e99b2-4dcb-4a04-95eb-80ee217bbb54 tempest-ProjectReaderTests-467028060 None] <== create_volume: return (686ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:45:01 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-222e99b2-4dcb-4a04-95eb-80ee217bbb54 tempest-ProjectReaderTests-467028060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.689s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:45:01 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-222e99b2-4dcb-4a04-95eb-80ee217bbb54 tempest-ProjectReaderTests-467028060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a38450f-a586-46ad-ba04-dbc0fe815fac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f602a06-96b4-4fd0-8771-6b5cad6013b0', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:45:01 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-222e99b2-4dcb-4a04-95eb-80ee217bbb54 tempest-ProjectReaderTests-467028060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd290ccd-3a4c-40c0-9c01-1351dd7a02dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:45:01 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-222e99b2-4dcb-4a04-95eb-80ee217bbb54 tempest-ProjectReaderTests-467028060 None] Volume volume-6f602a06-96b4-4fd0-8771-6b5cad6013b0 (6f602a06-96b4-4fd0-8771-6b5cad6013b0): created successfully
Nov 03 18:45:01 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-222e99b2-4dcb-4a04-95eb-80ee217bbb54 tempest-ProjectReaderTests-467028060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd290ccd-3a4c-40c0-9c01-1351dd7a02dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:45:01 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-222e99b2-4dcb-4a04-95eb-80ee217bbb54 tempest-ProjectReaderTests-467028060 None] Flow 'volume_create_manager' (a5760092-dcf3-4e03-b912-f169d06a5563) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:45:01 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-222e99b2-4dcb-4a04-95eb-80ee217bbb54 tempest-ProjectReaderTests-467028060 None] Created volume successfully.
Nov 03 18:45:02 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-415320a4-b481-4076-8fc2-daded02b0d8c tempest-ProjectReaderTests-467028060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:45:02 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-415320a4-b481-4076-8fc2-daded02b0d8c tempest-ProjectReaderTests-467028060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:45:02 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-415320a4-b481-4076-8fc2-daded02b0d8c tempest-ProjectReaderTests-467028060 None] Creating offline snapshot 6677d457-3e7f-44ee-87c3-8f578e898f1a of volume 6f602a06-96b4-4fd0-8771-6b5cad6013b0 {{(pid=86120) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 18:45:02 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c0f0358-197c-4ef7-af16-ecbe1e7367e3]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:45:02 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-415320a4-b481-4076-8fc2-daded02b0d8c tempest-ProjectReaderTests-467028060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6f602a06-96b4-4fd0-8771-6b5cad6013b0 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:45:02 devstack sudo[108082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6f602a06-96b4-4fd0-8771-6b5cad6013b0
Nov 03 18:45:02 devstack sudo[108082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:45:02 devstack sudo[108082]: pam_unix(sudo:session): session closed for user root
Nov 03 18:45:02 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-415320a4-b481-4076-8fc2-daded02b0d8c tempest-ProjectReaderTests-467028060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6f602a06-96b4-4fd0-8771-6b5cad6013b0" returned: 0 in 0.353s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:45:02 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-415320a4-b481-4076-8fc2-daded02b0d8c tempest-ProjectReaderTests-467028060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6f602a06-96b4-4fd0-8771-6b5cad6013b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6f602a06-96b4-4fd0-8771-6b5cad6013b0.6677d457-3e7f-44ee-87c3-8f578e898f1a 1G {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:45:02 devstack sudo[108087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6f602a06-96b4-4fd0-8771-6b5cad6013b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6f602a06-96b4-4fd0-8771-6b5cad6013b0.6677d457-3e7f-44ee-87c3-8f578e898f1a 1G
Nov 03 18:45:02 devstack sudo[108087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:45:02 devstack sudo[108087]: pam_unix(sudo:session): session closed for user root
Nov 03 18:45:02 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-415320a4-b481-4076-8fc2-daded02b0d8c tempest-ProjectReaderTests-467028060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6f602a06-96b4-4fd0-8771-6b5cad6013b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6f602a06-96b4-4fd0-8771-6b5cad6013b0.6677d457-3e7f-44ee-87c3-8f578e898f1a 1G" returned: 0 in 0.386s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:45:02 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-415320a4-b481-4076-8fc2-daded02b0d8c tempest-ProjectReaderTests-467028060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f602a06-96b4-4fd0-8771-6b5cad6013b0 -F qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6f602a06-96b4-4fd0-8771-6b5cad6013b0.6677d457-3e7f-44ee-87c3-8f578e898f1a {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:45:02 devstack sudo[108092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f602a06-96b4-4fd0-8771-6b5cad6013b0 -F qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6f602a06-96b4-4fd0-8771-6b5cad6013b0.6677d457-3e7f-44ee-87c3-8f578e898f1a
Nov 03 18:45:02 devstack sudo[108092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:45:03 devstack sudo[108092]: pam_unix(sudo:session): session closed for user root
Nov 03 18:45:03 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-415320a4-b481-4076-8fc2-daded02b0d8c tempest-ProjectReaderTests-467028060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f602a06-96b4-4fd0-8771-6b5cad6013b0 -F qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6f602a06-96b4-4fd0-8771-6b5cad6013b0.6677d457-3e7f-44ee-87c3-8f578e898f1a" returned: 0 in 0.292s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:45:03 devstack cinder-volume[86120]: WARNING cinder.volume.drivers.remotefs [None req-415320a4-b481-4076-8fc2-daded02b0d8c tempest-ProjectReaderTests-467028060 None] /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6f602a06-96b4-4fd0-8771-6b5cad6013b0.6677d457-3e7f-44ee-87c3-8f578e898f1a is being set with open permissions: ugo+rw
Nov 03 18:45:03 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-415320a4-b481-4076-8fc2-daded02b0d8c tempest-ProjectReaderTests-467028060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6f602a06-96b4-4fd0-8771-6b5cad6013b0.6677d457-3e7f-44ee-87c3-8f578e898f1a {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:45:03 devstack sudo[108097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6f602a06-96b4-4fd0-8771-6b5cad6013b0.6677d457-3e7f-44ee-87c3-8f578e898f1a
Nov 03 18:45:03 devstack sudo[108097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:45:03 devstack sudo[108097]: pam_unix(sudo:session): session closed for user root
Nov 03 18:45:03 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-415320a4-b481-4076-8fc2-daded02b0d8c tempest-ProjectReaderTests-467028060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6f602a06-96b4-4fd0-8771-6b5cad6013b0.6677d457-3e7f-44ee-87c3-8f578e898f1a" returned: 0 in 0.245s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:45:03 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-415320a4-b481-4076-8fc2-daded02b0d8c tempest-ProjectReaderTests-467028060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6f602a06-96b4-4fd0-8771-6b5cad6013b0.info {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:45:03 devstack sudo[108100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6f602a06-96b4-4fd0-8771-6b5cad6013b0.info
Nov 03 18:45:03 devstack sudo[108100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:45:03 devstack sudo[108100]: pam_unix(sudo:session): session closed for user root
Nov 03 18:45:03 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-415320a4-b481-4076-8fc2-daded02b0d8c tempest-ProjectReaderTests-467028060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6f602a06-96b4-4fd0-8771-6b5cad6013b0.info" returned: 0 in 0.267s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:45:03 devstack cinder-volume[86120]: WARNING cinder.volume.drivers.remotefs [None req-415320a4-b481-4076-8fc2-daded02b0d8c tempest-ProjectReaderTests-467028060 None] /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6f602a06-96b4-4fd0-8771-6b5cad6013b0.info is being set with open permissions: ugo+rw
Nov 03 18:45:03 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-415320a4-b481-4076-8fc2-daded02b0d8c tempest-ProjectReaderTests-467028060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6f602a06-96b4-4fd0-8771-6b5cad6013b0.info {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:45:03 devstack sudo[108104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6f602a06-96b4-4fd0-8771-6b5cad6013b0.info
Nov 03 18:45:03 devstack sudo[108104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:45:03 devstack sudo[108104]: pam_unix(sudo:session): session closed for user root
Nov 03 18:45:03 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-415320a4-b481-4076-8fc2-daded02b0d8c tempest-ProjectReaderTests-467028060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6f602a06-96b4-4fd0-8771-6b5cad6013b0.info" returned: 0 in 0.245s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:45:03 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-415320a4-b481-4076-8fc2-daded02b0d8c tempest-ProjectReaderTests-467028060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.867s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:45:03 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-415320a4-b481-4076-8fc2-daded02b0d8c tempest-ProjectReaderTests-467028060 None] Create snapshot completed successfully
Nov 03 18:45:04 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-9ad8cac3-6cef-4a99-908c-795ffe9753f7 tempest-ProjectReaderTests-467028060 None] Acquiring lock "cinder-6677d457-3e7f-44ee-87c3-8f578e898f1a-delete_snapshot" by "delete_snapshot" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:45:04 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-9ad8cac3-6cef-4a99-908c-795ffe9753f7 tempest-ProjectReaderTests-467028060 None] Lock "cinder-6677d457-3e7f-44ee-87c3-8f578e898f1a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:45:04 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-9ad8cac3-6cef-4a99-908c-795ffe9753f7 tempest-ProjectReaderTests-467028060 None] Acquiring lock "cinder-quobyte-6f602a06-96b4-4fd0-8771-6b5cad6013b0" by "delete_snapshot" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:45:04 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-9ad8cac3-6cef-4a99-908c-795ffe9753f7 tempest-ProjectReaderTests-467028060 None] Lock "cinder-quobyte-6f602a06-96b4-4fd0-8771-6b5cad6013b0" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:45:04 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-9ad8cac3-6cef-4a99-908c-795ffe9753f7 tempest-ProjectReaderTests-467028060 None] Acquiring lock "cinder-quobyte-6677d457-3e7f-44ee-87c3-8f578e898f1a" by "_delete_snapshot" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:45:04 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-9ad8cac3-6cef-4a99-908c-795ffe9753f7 tempest-ProjectReaderTests-467028060 None] Lock "cinder-quobyte-6677d457-3e7f-44ee-87c3-8f578e898f1a" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:45:04 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-9ad8cac3-6cef-4a99-908c-795ffe9753f7 tempest-ProjectReaderTests-467028060 None] Deleting offline snapshot 6677d457-3e7f-44ee-87c3-8f578e898f1a of volume 6f602a06-96b4-4fd0-8771-6b5cad6013b0 {{(pid=86120) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 18:45:04 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-9ad8cac3-6cef-4a99-908c-795ffe9753f7 tempest-ProjectReaderTests-467028060 None] snapshot_file for this snap is: volume-6f602a06-96b4-4fd0-8771-6b5cad6013b0.6677d457-3e7f-44ee-87c3-8f578e898f1a {{(pid=86120) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 18:45:04 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[4467164c-f300-41e7-9d84-5e8216fab09b]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:45:04 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-9ad8cac3-6cef-4a99-908c-795ffe9753f7 tempest-ProjectReaderTests-467028060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6f602a06-96b4-4fd0-8771-6b5cad6013b0.6677d457-3e7f-44ee-87c3-8f578e898f1a {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:45:04 devstack sudo[108107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6f602a06-96b4-4fd0-8771-6b5cad6013b0.6677d457-3e7f-44ee-87c3-8f578e898f1a
Nov 03 18:45:04 devstack sudo[108107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:45:04 devstack sudo[108107]: pam_unix(sudo:session): session closed for user root
Nov 03 18:45:04 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-9ad8cac3-6cef-4a99-908c-795ffe9753f7 tempest-ProjectReaderTests-467028060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6f602a06-96b4-4fd0-8771-6b5cad6013b0.6677d457-3e7f-44ee-87c3-8f578e898f1a" returned: 0 in 0.349s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:45:04 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-9ad8cac3-6cef-4a99-908c-795ffe9753f7 tempest-ProjectReaderTests-467028060 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6f602a06-96b4-4fd0-8771-6b5cad6013b0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86120) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 18:45:04 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6cf1e8d-3363-4299-936b-618c5ef49808]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:45:04 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-9ad8cac3-6cef-4a99-908c-795ffe9753f7 tempest-ProjectReaderTests-467028060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6f602a06-96b4-4fd0-8771-6b5cad6013b0 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:45:04 devstack sudo[108112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6f602a06-96b4-4fd0-8771-6b5cad6013b0
Nov 03 18:45:04 devstack sudo[108112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:45:04 devstack sudo[108112]: pam_unix(sudo:session): session closed for user root
Nov 03 18:45:04 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-9ad8cac3-6cef-4a99-908c-795ffe9753f7 tempest-ProjectReaderTests-467028060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6f602a06-96b4-4fd0-8771-6b5cad6013b0" returned: 0 in 0.355s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:45:04 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-9ad8cac3-6cef-4a99-908c-795ffe9753f7 tempest-ProjectReaderTests-467028060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6f602a06-96b4-4fd0-8771-6b5cad6013b0.6677d457-3e7f-44ee-87c3-8f578e898f1a {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:45:05 devstack sudo[108117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6f602a06-96b4-4fd0-8771-6b5cad6013b0.6677d457-3e7f-44ee-87c3-8f578e898f1a
Nov 03 18:45:05 devstack sudo[108117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:45:05 devstack sudo[108117]: pam_unix(sudo:session): session closed for user root
Nov 03 18:45:05 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-9ad8cac3-6cef-4a99-908c-795ffe9753f7 tempest-ProjectReaderTests-467028060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6f602a06-96b4-4fd0-8771-6b5cad6013b0.6677d457-3e7f-44ee-87c3-8f578e898f1a" returned: 0 in 0.325s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:45:05 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-9ad8cac3-6cef-4a99-908c-795ffe9753f7 tempest-ProjectReaderTests-467028060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6f602a06-96b4-4fd0-8771-6b5cad6013b0.6677d457-3e7f-44ee-87c3-8f578e898f1a {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:45:05 devstack sudo[108122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6f602a06-96b4-4fd0-8771-6b5cad6013b0.6677d457-3e7f-44ee-87c3-8f578e898f1a
Nov 03 18:45:05 devstack sudo[108122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:45:05 devstack sudo[108122]: pam_unix(sudo:session): session closed for user root
Nov 03 18:45:05 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-9ad8cac3-6cef-4a99-908c-795ffe9753f7 tempest-ProjectReaderTests-467028060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6f602a06-96b4-4fd0-8771-6b5cad6013b0.6677d457-3e7f-44ee-87c3-8f578e898f1a" returned: 0 in 0.242s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:45:05 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-9ad8cac3-6cef-4a99-908c-795ffe9753f7 tempest-ProjectReaderTests-467028060 None] Lock "cinder-quobyte-6677d457-3e7f-44ee-87c3-8f578e898f1a" released by "_delete_snapshot" :: held 1.366s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:45:05 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-9ad8cac3-6cef-4a99-908c-795ffe9753f7 tempest-ProjectReaderTests-467028060 None] Lock "cinder-quobyte-6f602a06-96b4-4fd0-8771-6b5cad6013b0" released by "delete_snapshot" :: held 1.386s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:45:05 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-9ad8cac3-6cef-4a99-908c-795ffe9753f7 tempest-ProjectReaderTests-467028060 None] Created reservations ['e2e5b42f-d5d5-4e42-ad50-9b5eb45b8a27', 'f454a487-ed1c-4e61-94bb-6d3a5512ae09', 'f718512b-772a-4a08-bd6d-8d80b9c1ba18', '56e4f613-8843-47ed-9968-72032783b4ad'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:45:05 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-9ad8cac3-6cef-4a99-908c-795ffe9753f7 tempest-ProjectReaderTests-467028060 None] Delete snapshot completed successfully.
Nov 03 18:45:05 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-9ad8cac3-6cef-4a99-908c-795ffe9753f7 tempest-ProjectReaderTests-467028060 None] Lock "cinder-6677d457-3e7f-44ee-87c3-8f578e898f1a-delete_snapshot" released by "delete_snapshot" :: held 1.511s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:45:06 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-1b6d39fa-7b71-4d45-b1fe-39da711ecc24 tempest-ProjectReaderTests-467028060 None] Acquiring lock "cinder-6f602a06-96b4-4fd0-8771-6b5cad6013b0-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:45:06 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-1b6d39fa-7b71-4d45-b1fe-39da711ecc24 tempest-ProjectReaderTests-467028060 None] Lock "cinder-6f602a06-96b4-4fd0-8771-6b5cad6013b0-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:45:06 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-1b6d39fa-7b71-4d45-b1fe-39da711ecc24 tempest-ProjectReaderTests-467028060 None] Acquiring lock "cinder-quobyte-6f602a06-96b4-4fd0-8771-6b5cad6013b0" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:45:06 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-1b6d39fa-7b71-4d45-b1fe-39da711ecc24 tempest-ProjectReaderTests-467028060 None] Lock "cinder-quobyte-6f602a06-96b4-4fd0-8771-6b5cad6013b0" acquired by "delete_volume" :: waited 0.013s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:45:06 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ab4fd1a-898a-4c0f-a203-33965ef7bc7b]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:45:06 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-1b6d39fa-7b71-4d45-b1fe-39da711ecc24 tempest-ProjectReaderTests-467028060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6f602a06-96b4-4fd0-8771-6b5cad6013b0 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:45:06 devstack sudo[108125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6f602a06-96b4-4fd0-8771-6b5cad6013b0
Nov 03 18:45:06 devstack sudo[108125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:45:06 devstack sudo[108125]: pam_unix(sudo:session): session closed for user root
Nov 03 18:45:06 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-1b6d39fa-7b71-4d45-b1fe-39da711ecc24 tempest-ProjectReaderTests-467028060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6f602a06-96b4-4fd0-8771-6b5cad6013b0" returned: 0 in 0.357s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:45:06 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-1b6d39fa-7b71-4d45-b1fe-39da711ecc24 tempest-ProjectReaderTests-467028060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6f602a06-96b4-4fd0-8771-6b5cad6013b0 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:45:06 devstack sudo[108130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6f602a06-96b4-4fd0-8771-6b5cad6013b0
Nov 03 18:45:06 devstack sudo[108130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:45:07 devstack sudo[108130]: pam_unix(sudo:session): session closed for user root
Nov 03 18:45:07 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-1b6d39fa-7b71-4d45-b1fe-39da711ecc24 tempest-ProjectReaderTests-467028060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-6f602a06-96b4-4fd0-8771-6b5cad6013b0" returned: 0 in 0.240s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:45:07 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-1b6d39fa-7b71-4d45-b1fe-39da711ecc24 tempest-ProjectReaderTests-467028060 None] Lock "cinder-quobyte-6f602a06-96b4-4fd0-8771-6b5cad6013b0" released by "delete_volume" :: held 0.657s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:45:07 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-1b6d39fa-7b71-4d45-b1fe-39da711ecc24 tempest-ProjectReaderTests-467028060 None] Created reservations ['34c21ca4-0053-4ad3-acda-2408c4417df3', '7c56d7e6-7797-4ed2-aa1d-42ee5a8671a3', '2997ff71-35be-4bd2-97e9-258eabef0202', '6514192a-2490-44b0-a217-62e1b405a381'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:45:07 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-1b6d39fa-7b71-4d45-b1fe-39da711ecc24 tempest-ProjectReaderTests-467028060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:45:07 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-1b6d39fa-7b71-4d45-b1fe-39da711ecc24 tempest-ProjectReaderTests-467028060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:45:07 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-1b6d39fa-7b71-4d45-b1fe-39da711ecc24 tempest-ProjectReaderTests-467028060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:45:07 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-1b6d39fa-7b71-4d45-b1fe-39da711ecc24 tempest-ProjectReaderTests-467028060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:45:07 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-1b6d39fa-7b71-4d45-b1fe-39da711ecc24 tempest-ProjectReaderTests-467028060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:45:07 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-1b6d39fa-7b71-4d45-b1fe-39da711ecc24 tempest-ProjectReaderTests-467028060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:45:07 devstack sudo[108133]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:45:07 devstack sudo[108133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:45:07 devstack sudo[108133]: pam_unix(sudo:session): session closed for user root
Nov 03 18:45:07 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-1b6d39fa-7b71-4d45-b1fe-39da711ecc24 tempest-ProjectReaderTests-467028060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.248s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:45:07 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-1b6d39fa-7b71-4d45-b1fe-39da711ecc24 tempest-ProjectReaderTests-467028060 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:45:07 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-1b6d39fa-7b71-4d45-b1fe-39da711ecc24 tempest-ProjectReaderTests-467028060 None] Deleted volume successfully.
Nov 03 18:45:07 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-1b6d39fa-7b71-4d45-b1fe-39da711ecc24 tempest-ProjectReaderTests-467028060 None] Lock "cinder-6f602a06-96b4-4fd0-8771-6b5cad6013b0-delete_volume" released by "delete_volume" :: held 1.094s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:45:07 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-a20bfc20-db7a-4d4c-bcf2-dbafdc8b45c9 tempest-ProjectReaderTests-467028060 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:45:07 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-a20bfc20-db7a-4d4c-bcf2-dbafdc8b45c9 tempest-ProjectReaderTests-467028060 None] Flow 'volume_create_manager' (dcb9c0d7-6359-470e-9e0a-8a474ac72418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:45:07 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-a20bfc20-db7a-4d4c-bcf2-dbafdc8b45c9 tempest-ProjectReaderTests-467028060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0146e385-69bd-4da9-8847-9043153f7963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:45:07 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-a20bfc20-db7a-4d4c-bcf2-dbafdc8b45c9 tempest-ProjectReaderTests-467028060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0146e385-69bd-4da9-8847-9043153f7963) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:45:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-229326328',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=143dc1af-2cc6-4ccf-98f9-97caf670c6a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50252b1b4e7043feb4ce25984f80f28b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:45:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:45:08Z,use_quota=True,user_id='0775f8e7db7d41039e0f7dd52466882e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:45:07 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-a20bfc20-db7a-4d4c-bcf2-dbafdc8b45c9 tempest-ProjectReaderTests-467028060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (953a00f8-1b2a-41bd-8993-eba3bd645cb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:45:07 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-a20bfc20-db7a-4d4c-bcf2-dbafdc8b45c9 tempest-ProjectReaderTests-467028060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (953a00f8-1b2a-41bd-8993-eba3bd645cb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:45:07 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-a20bfc20-db7a-4d4c-bcf2-dbafdc8b45c9 tempest-ProjectReaderTests-467028060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f428b3d2-6cec-4856-91a0-7b5beb838c60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:45:07 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-a20bfc20-db7a-4d4c-bcf2-dbafdc8b45c9 tempest-ProjectReaderTests-467028060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f428b3d2-6cec-4856-91a0-7b5beb838c60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '143dc1af-2cc6-4ccf-98f9-97caf670c6a5', 'volume_name': 'volume-143dc1af-2cc6-4ccf-98f9-97caf670c6a5', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:45:07 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-a20bfc20-db7a-4d4c-bcf2-dbafdc8b45c9 tempest-ProjectReaderTests-467028060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b05e058-4a94-4ded-a797-bb2ccddd68d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:45:07 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-a20bfc20-db7a-4d4c-bcf2-dbafdc8b45c9 tempest-ProjectReaderTests-467028060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b05e058-4a94-4ded-a797-bb2ccddd68d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:45:07 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-a20bfc20-db7a-4d4c-bcf2-dbafdc8b45c9 tempest-ProjectReaderTests-467028060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1f2c0bd-6fe7-405c-8fb3-dc7586cf1380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:45:07 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-a20bfc20-db7a-4d4c-bcf2-dbafdc8b45c9 tempest-ProjectReaderTests-467028060 None] Volume 143dc1af-2cc6-4ccf-98f9-97caf670c6a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-143dc1af-2cc6-4ccf-98f9-97caf670c6a5', 'volume_size': 1}
Nov 03 18:45:07 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-a20bfc20-db7a-4d4c-bcf2-dbafdc8b45c9 tempest-ProjectReaderTests-467028060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:45:07 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-a20bfc20-db7a-4d4c-bcf2-dbafdc8b45c9 tempest-ProjectReaderTests-467028060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:45:07 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-a20bfc20-db7a-4d4c-bcf2-dbafdc8b45c9 tempest-ProjectReaderTests-467028060 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:45:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-229326328',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=143dc1af-2cc6-4ccf-98f9-97caf670c6a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50252b1b4e7043feb4ce25984f80f28b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:45:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:45:08Z,use_quota=True,user_id='0775f8e7db7d41039e0f7dd52466882e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:45:07 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-a20bfc20-db7a-4d4c-bcf2-dbafdc8b45c9 tempest-ProjectReaderTests-467028060 None] Creating volume 143dc1af-2cc6-4ccf-98f9-97caf670c6a5 {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:45:07 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-a20bfc20-db7a-4d4c-bcf2-dbafdc8b45c9 tempest-ProjectReaderTests-467028060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:45:07 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-a20bfc20-db7a-4d4c-bcf2-dbafdc8b45c9 tempest-ProjectReaderTests-467028060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:45:07 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-a20bfc20-db7a-4d4c-bcf2-dbafdc8b45c9 tempest-ProjectReaderTests-467028060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:45:07 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-a20bfc20-db7a-4d4c-bcf2-dbafdc8b45c9 tempest-ProjectReaderTests-467028060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:45:07 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-a20bfc20-db7a-4d4c-bcf2-dbafdc8b45c9 tempest-ProjectReaderTests-467028060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:45:07 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-a20bfc20-db7a-4d4c-bcf2-dbafdc8b45c9 tempest-ProjectReaderTests-467028060 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:45:07 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-a20bfc20-db7a-4d4c-bcf2-dbafdc8b45c9 tempest-ProjectReaderTests-467028060 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:45:07 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-a20bfc20-db7a-4d4c-bcf2-dbafdc8b45c9 tempest-ProjectReaderTests-467028060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-143dc1af-2cc6-4ccf-98f9-97caf670c6a5 1073741824 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:45:08 devstack sudo[108136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-143dc1af-2cc6-4ccf-98f9-97caf670c6a5 1073741824
Nov 03 18:45:08 devstack sudo[108136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:45:08 devstack sudo[108136]: pam_unix(sudo:session): session closed for user root
Nov 03 18:45:08 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-a20bfc20-db7a-4d4c-bcf2-dbafdc8b45c9 tempest-ProjectReaderTests-467028060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-143dc1af-2cc6-4ccf-98f9-97caf670c6a5 1073741824" returned: 0 in 0.402s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:45:08 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-a20bfc20-db7a-4d4c-bcf2-dbafdc8b45c9 tempest-ProjectReaderTests-467028060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-143dc1af-2cc6-4ccf-98f9-97caf670c6a5 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:45:08 devstack sudo[108141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-143dc1af-2cc6-4ccf-98f9-97caf670c6a5
Nov 03 18:45:08 devstack sudo[108141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:45:08 devstack sudo[108141]: pam_unix(sudo:session): session closed for user root
Nov 03 18:45:08 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-a20bfc20-db7a-4d4c-bcf2-dbafdc8b45c9 tempest-ProjectReaderTests-467028060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-143dc1af-2cc6-4ccf-98f9-97caf670c6a5" returned: 0 in 0.245s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:45:08 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-a20bfc20-db7a-4d4c-bcf2-dbafdc8b45c9 tempest-ProjectReaderTests-467028060 None] <== create_volume: return (689ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:45:08 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-a20bfc20-db7a-4d4c-bcf2-dbafdc8b45c9 tempest-ProjectReaderTests-467028060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.692s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:45:08 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-a20bfc20-db7a-4d4c-bcf2-dbafdc8b45c9 tempest-ProjectReaderTests-467028060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1f2c0bd-6fe7-405c-8fb3-dc7586cf1380) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-143dc1af-2cc6-4ccf-98f9-97caf670c6a5', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:45:08 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-a20bfc20-db7a-4d4c-bcf2-dbafdc8b45c9 tempest-ProjectReaderTests-467028060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e755f005-6e69-4295-bcd9-b0520d0e8d8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:45:08 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-a20bfc20-db7a-4d4c-bcf2-dbafdc8b45c9 tempest-ProjectReaderTests-467028060 None] Volume volume-143dc1af-2cc6-4ccf-98f9-97caf670c6a5 (143dc1af-2cc6-4ccf-98f9-97caf670c6a5): created successfully
Nov 03 18:45:08 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-a20bfc20-db7a-4d4c-bcf2-dbafdc8b45c9 tempest-ProjectReaderTests-467028060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e755f005-6e69-4295-bcd9-b0520d0e8d8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:45:08 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-a20bfc20-db7a-4d4c-bcf2-dbafdc8b45c9 tempest-ProjectReaderTests-467028060 None] Flow 'volume_create_manager' (dcb9c0d7-6359-470e-9e0a-8a474ac72418) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:45:08 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-a20bfc20-db7a-4d4c-bcf2-dbafdc8b45c9 tempest-ProjectReaderTests-467028060 None] Created volume successfully.
Nov 03 18:45:09 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-7ea4ddd0-1e96-4d25-8acf-a556e66f569c tempest-ProjectReaderTests-467028060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:45:09 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-7ea4ddd0-1e96-4d25-8acf-a556e66f569c tempest-ProjectReaderTests-467028060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:45:09 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-7ea4ddd0-1e96-4d25-8acf-a556e66f569c tempest-ProjectReaderTests-467028060 None] Creating offline snapshot 73957d35-791e-4b8f-84b7-5c435108d731 of volume 143dc1af-2cc6-4ccf-98f9-97caf670c6a5 {{(pid=86120) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 18:45:09 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eddba1b-8063-4b7f-99e7-0f8fa7876dcb]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:45:09 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-7ea4ddd0-1e96-4d25-8acf-a556e66f569c tempest-ProjectReaderTests-467028060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-143dc1af-2cc6-4ccf-98f9-97caf670c6a5 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:45:09 devstack sudo[108144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-143dc1af-2cc6-4ccf-98f9-97caf670c6a5
Nov 03 18:45:09 devstack sudo[108144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:45:09 devstack sudo[108144]: pam_unix(sudo:session): session closed for user root
Nov 03 18:45:09 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-7ea4ddd0-1e96-4d25-8acf-a556e66f569c tempest-ProjectReaderTests-467028060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-143dc1af-2cc6-4ccf-98f9-97caf670c6a5" returned: 0 in 0.354s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:45:09 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-7ea4ddd0-1e96-4d25-8acf-a556e66f569c tempest-ProjectReaderTests-467028060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-143dc1af-2cc6-4ccf-98f9-97caf670c6a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-143dc1af-2cc6-4ccf-98f9-97caf670c6a5.73957d35-791e-4b8f-84b7-5c435108d731 1G {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:45:09 devstack sudo[108149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-143dc1af-2cc6-4ccf-98f9-97caf670c6a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-143dc1af-2cc6-4ccf-98f9-97caf670c6a5.73957d35-791e-4b8f-84b7-5c435108d731 1G
Nov 03 18:45:09 devstack sudo[108149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:45:09 devstack sudo[108149]: pam_unix(sudo:session): session closed for user root
Nov 03 18:45:09 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-7ea4ddd0-1e96-4d25-8acf-a556e66f569c tempest-ProjectReaderTests-467028060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-143dc1af-2cc6-4ccf-98f9-97caf670c6a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-143dc1af-2cc6-4ccf-98f9-97caf670c6a5.73957d35-791e-4b8f-84b7-5c435108d731 1G" returned: 0 in 0.385s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:45:09 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-7ea4ddd0-1e96-4d25-8acf-a556e66f569c tempest-ProjectReaderTests-467028060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-143dc1af-2cc6-4ccf-98f9-97caf670c6a5 -F qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-143dc1af-2cc6-4ccf-98f9-97caf670c6a5.73957d35-791e-4b8f-84b7-5c435108d731 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:45:09 devstack sudo[108156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-143dc1af-2cc6-4ccf-98f9-97caf670c6a5 -F qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-143dc1af-2cc6-4ccf-98f9-97caf670c6a5.73957d35-791e-4b8f-84b7-5c435108d731
Nov 03 18:45:09 devstack sudo[108156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:45:10 devstack sudo[108156]: pam_unix(sudo:session): session closed for user root
Nov 03 18:45:10 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-7ea4ddd0-1e96-4d25-8acf-a556e66f569c tempest-ProjectReaderTests-467028060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-143dc1af-2cc6-4ccf-98f9-97caf670c6a5 -F qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-143dc1af-2cc6-4ccf-98f9-97caf670c6a5.73957d35-791e-4b8f-84b7-5c435108d731" returned: 0 in 0.293s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:45:10 devstack cinder-volume[86120]: WARNING cinder.volume.drivers.remotefs [None req-7ea4ddd0-1e96-4d25-8acf-a556e66f569c tempest-ProjectReaderTests-467028060 None] /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-143dc1af-2cc6-4ccf-98f9-97caf670c6a5.73957d35-791e-4b8f-84b7-5c435108d731 is being set with open permissions: ugo+rw
Nov 03 18:45:10 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-7ea4ddd0-1e96-4d25-8acf-a556e66f569c tempest-ProjectReaderTests-467028060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-143dc1af-2cc6-4ccf-98f9-97caf670c6a5.73957d35-791e-4b8f-84b7-5c435108d731 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:45:10 devstack sudo[108161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-143dc1af-2cc6-4ccf-98f9-97caf670c6a5.73957d35-791e-4b8f-84b7-5c435108d731
Nov 03 18:45:10 devstack sudo[108161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:45:10 devstack sudo[108161]: pam_unix(sudo:session): session closed for user root
Nov 03 18:45:10 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-7ea4ddd0-1e96-4d25-8acf-a556e66f569c tempest-ProjectReaderTests-467028060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-143dc1af-2cc6-4ccf-98f9-97caf670c6a5.73957d35-791e-4b8f-84b7-5c435108d731" returned: 0 in 0.248s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:45:10 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-7ea4ddd0-1e96-4d25-8acf-a556e66f569c tempest-ProjectReaderTests-467028060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-143dc1af-2cc6-4ccf-98f9-97caf670c6a5.info {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:45:10 devstack sudo[108164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-143dc1af-2cc6-4ccf-98f9-97caf670c6a5.info
Nov 03 18:45:10 devstack sudo[108164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:45:10 devstack sudo[108164]: pam_unix(sudo:session): session closed for user root
Nov 03 18:45:10 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-7ea4ddd0-1e96-4d25-8acf-a556e66f569c tempest-ProjectReaderTests-467028060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-143dc1af-2cc6-4ccf-98f9-97caf670c6a5.info" returned: 0 in 0.246s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:45:10 devstack cinder-volume[86120]: WARNING cinder.volume.drivers.remotefs [None req-7ea4ddd0-1e96-4d25-8acf-a556e66f569c tempest-ProjectReaderTests-467028060 None] /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-143dc1af-2cc6-4ccf-98f9-97caf670c6a5.info is being set with open permissions: ugo+rw
Nov 03 18:45:10 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-7ea4ddd0-1e96-4d25-8acf-a556e66f569c tempest-ProjectReaderTests-467028060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-143dc1af-2cc6-4ccf-98f9-97caf670c6a5.info {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:45:10 devstack sudo[108167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-143dc1af-2cc6-4ccf-98f9-97caf670c6a5.info
Nov 03 18:45:10 devstack sudo[108167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:45:10 devstack sudo[108167]: pam_unix(sudo:session): session closed for user root
Nov 03 18:45:10 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-7ea4ddd0-1e96-4d25-8acf-a556e66f569c tempest-ProjectReaderTests-467028060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-143dc1af-2cc6-4ccf-98f9-97caf670c6a5.info" returned: 0 in 0.248s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:45:10 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-7ea4ddd0-1e96-4d25-8acf-a556e66f569c tempest-ProjectReaderTests-467028060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.854s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:45:10 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-7ea4ddd0-1e96-4d25-8acf-a556e66f569c tempest-ProjectReaderTests-467028060 None] Create snapshot completed successfully
Nov 03 18:45:11 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-eb061f9c-cbec-44c1-b198-1780194c7cde tempest-ProjectReaderTests-467028060 None] Acquiring lock "cinder-73957d35-791e-4b8f-84b7-5c435108d731-delete_snapshot" by "delete_snapshot" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:45:11 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-eb061f9c-cbec-44c1-b198-1780194c7cde tempest-ProjectReaderTests-467028060 None] Lock "cinder-73957d35-791e-4b8f-84b7-5c435108d731-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:45:11 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-eb061f9c-cbec-44c1-b198-1780194c7cde tempest-ProjectReaderTests-467028060 None] Acquiring lock "cinder-quobyte-143dc1af-2cc6-4ccf-98f9-97caf670c6a5" by "delete_snapshot" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:45:11 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-eb061f9c-cbec-44c1-b198-1780194c7cde tempest-ProjectReaderTests-467028060 None] Lock "cinder-quobyte-143dc1af-2cc6-4ccf-98f9-97caf670c6a5" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:45:11 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-eb061f9c-cbec-44c1-b198-1780194c7cde tempest-ProjectReaderTests-467028060 None] Acquiring lock "cinder-quobyte-73957d35-791e-4b8f-84b7-5c435108d731" by "_delete_snapshot" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:45:11 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-eb061f9c-cbec-44c1-b198-1780194c7cde tempest-ProjectReaderTests-467028060 None] Lock "cinder-quobyte-73957d35-791e-4b8f-84b7-5c435108d731" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:45:11 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-eb061f9c-cbec-44c1-b198-1780194c7cde tempest-ProjectReaderTests-467028060 None] Deleting offline snapshot 73957d35-791e-4b8f-84b7-5c435108d731 of volume 143dc1af-2cc6-4ccf-98f9-97caf670c6a5 {{(pid=86120) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 18:45:11 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-eb061f9c-cbec-44c1-b198-1780194c7cde tempest-ProjectReaderTests-467028060 None] snapshot_file for this snap is: volume-143dc1af-2cc6-4ccf-98f9-97caf670c6a5.73957d35-791e-4b8f-84b7-5c435108d731 {{(pid=86120) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 18:45:11 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbd3e371-c6e1-43e3-b1de-6a2b267c8d25]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:45:11 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-eb061f9c-cbec-44c1-b198-1780194c7cde tempest-ProjectReaderTests-467028060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-143dc1af-2cc6-4ccf-98f9-97caf670c6a5.73957d35-791e-4b8f-84b7-5c435108d731 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:45:11 devstack sudo[108170]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-143dc1af-2cc6-4ccf-98f9-97caf670c6a5.73957d35-791e-4b8f-84b7-5c435108d731
Nov 03 18:45:11 devstack sudo[108170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:45:11 devstack sudo[108170]: pam_unix(sudo:session): session closed for user root
Nov 03 18:45:11 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-eb061f9c-cbec-44c1-b198-1780194c7cde tempest-ProjectReaderTests-467028060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-143dc1af-2cc6-4ccf-98f9-97caf670c6a5.73957d35-791e-4b8f-84b7-5c435108d731" returned: 0 in 0.363s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:45:11 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-eb061f9c-cbec-44c1-b198-1780194c7cde tempest-ProjectReaderTests-467028060 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-143dc1af-2cc6-4ccf-98f9-97caf670c6a5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86120) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 18:45:11 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ddbb448-1b7d-482d-aec8-3977d25682e7]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:45:11 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-eb061f9c-cbec-44c1-b198-1780194c7cde tempest-ProjectReaderTests-467028060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-143dc1af-2cc6-4ccf-98f9-97caf670c6a5 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:45:11 devstack sudo[108175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-143dc1af-2cc6-4ccf-98f9-97caf670c6a5
Nov 03 18:45:11 devstack sudo[108175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:45:12 devstack sudo[108175]: pam_unix(sudo:session): session closed for user root
Nov 03 18:45:12 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-eb061f9c-cbec-44c1-b198-1780194c7cde tempest-ProjectReaderTests-467028060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-143dc1af-2cc6-4ccf-98f9-97caf670c6a5" returned: 0 in 0.349s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:45:12 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-eb061f9c-cbec-44c1-b198-1780194c7cde tempest-ProjectReaderTests-467028060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-143dc1af-2cc6-4ccf-98f9-97caf670c6a5.73957d35-791e-4b8f-84b7-5c435108d731 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:45:12 devstack sudo[108180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-143dc1af-2cc6-4ccf-98f9-97caf670c6a5.73957d35-791e-4b8f-84b7-5c435108d731
Nov 03 18:45:12 devstack sudo[108180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:45:12 devstack sudo[108180]: pam_unix(sudo:session): session closed for user root
Nov 03 18:45:12 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-eb061f9c-cbec-44c1-b198-1780194c7cde tempest-ProjectReaderTests-467028060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-143dc1af-2cc6-4ccf-98f9-97caf670c6a5.73957d35-791e-4b8f-84b7-5c435108d731" returned: 0 in 0.328s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:45:12 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-eb061f9c-cbec-44c1-b198-1780194c7cde tempest-ProjectReaderTests-467028060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-143dc1af-2cc6-4ccf-98f9-97caf670c6a5.73957d35-791e-4b8f-84b7-5c435108d731 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:45:12 devstack sudo[108185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-143dc1af-2cc6-4ccf-98f9-97caf670c6a5.73957d35-791e-4b8f-84b7-5c435108d731
Nov 03 18:45:12 devstack sudo[108185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:45:12 devstack sudo[108185]: pam_unix(sudo:session): session closed for user root
Nov 03 18:45:12 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-eb061f9c-cbec-44c1-b198-1780194c7cde tempest-ProjectReaderTests-467028060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-143dc1af-2cc6-4ccf-98f9-97caf670c6a5.73957d35-791e-4b8f-84b7-5c435108d731" returned: 0 in 0.243s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:45:12 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-eb061f9c-cbec-44c1-b198-1780194c7cde tempest-ProjectReaderTests-467028060 None] Lock "cinder-quobyte-73957d35-791e-4b8f-84b7-5c435108d731" released by "_delete_snapshot" :: held 1.376s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:45:12 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-eb061f9c-cbec-44c1-b198-1780194c7cde tempest-ProjectReaderTests-467028060 None] Lock "cinder-quobyte-143dc1af-2cc6-4ccf-98f9-97caf670c6a5" released by "delete_snapshot" :: held 1.396s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:45:12 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-eb061f9c-cbec-44c1-b198-1780194c7cde tempest-ProjectReaderTests-467028060 None] Created reservations ['85cb8b05-dcf6-4cee-81de-779a2d34abfd', '1160cf38-baa2-4ffb-9a86-60397fc49de9', '1cb09629-a64c-403d-bfd0-7a03668dbea0', 'd44016e1-7454-47e2-a76b-13482fd16924'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:45:12 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-eb061f9c-cbec-44c1-b198-1780194c7cde tempest-ProjectReaderTests-467028060 None] Delete snapshot completed successfully.
Nov 03 18:45:12 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-eb061f9c-cbec-44c1-b198-1780194c7cde tempest-ProjectReaderTests-467028060 None] Lock "cinder-73957d35-791e-4b8f-84b7-5c435108d731-delete_snapshot" released by "delete_snapshot" :: held 1.528s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:45:13 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-b5e5165b-a608-4952-b205-211531408629 tempest-ProjectReaderTests-467028060 None] Acquiring lock "cinder-143dc1af-2cc6-4ccf-98f9-97caf670c6a5-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:45:13 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-b5e5165b-a608-4952-b205-211531408629 tempest-ProjectReaderTests-467028060 None] Lock "cinder-143dc1af-2cc6-4ccf-98f9-97caf670c6a5-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:45:13 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-b5e5165b-a608-4952-b205-211531408629 tempest-ProjectReaderTests-467028060 None] Acquiring lock "cinder-quobyte-143dc1af-2cc6-4ccf-98f9-97caf670c6a5" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:45:13 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-b5e5165b-a608-4952-b205-211531408629 tempest-ProjectReaderTests-467028060 None] Lock "cinder-quobyte-143dc1af-2cc6-4ccf-98f9-97caf670c6a5" acquired by "delete_volume" :: waited 0.014s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:45:13 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f61774b-35fe-472c-8020-18c3a485861b]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:45:13 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b5e5165b-a608-4952-b205-211531408629 tempest-ProjectReaderTests-467028060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-143dc1af-2cc6-4ccf-98f9-97caf670c6a5 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:45:13 devstack sudo[108188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-143dc1af-2cc6-4ccf-98f9-97caf670c6a5
Nov 03 18:45:13 devstack sudo[108188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:45:13 devstack sudo[108188]: pam_unix(sudo:session): session closed for user root
Nov 03 18:45:13 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b5e5165b-a608-4952-b205-211531408629 tempest-ProjectReaderTests-467028060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-143dc1af-2cc6-4ccf-98f9-97caf670c6a5" returned: 0 in 0.355s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:45:13 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b5e5165b-a608-4952-b205-211531408629 tempest-ProjectReaderTests-467028060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-143dc1af-2cc6-4ccf-98f9-97caf670c6a5 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:45:13 devstack sudo[108193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-143dc1af-2cc6-4ccf-98f9-97caf670c6a5
Nov 03 18:45:13 devstack sudo[108193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:45:14 devstack sudo[108193]: pam_unix(sudo:session): session closed for user root
Nov 03 18:45:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b5e5165b-a608-4952-b205-211531408629 tempest-ProjectReaderTests-467028060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-143dc1af-2cc6-4ccf-98f9-97caf670c6a5" returned: 0 in 0.252s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:45:14 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-b5e5165b-a608-4952-b205-211531408629 tempest-ProjectReaderTests-467028060 None] Lock "cinder-quobyte-143dc1af-2cc6-4ccf-98f9-97caf670c6a5" released by "delete_volume" :: held 0.670s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:45:14 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-b5e5165b-a608-4952-b205-211531408629 tempest-ProjectReaderTests-467028060 None] Created reservations ['0bda1a73-a7ea-4bac-bec3-b92451e7b73b', '0cecbb66-b3db-45e7-a57a-00281cd097aa', 'fd0118b9-d134-47fa-a65c-54f35580f077', '3ea92056-8ebe-4d9b-b182-0cb7c6cb965b'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:45:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-b5e5165b-a608-4952-b205-211531408629 tempest-ProjectReaderTests-467028060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:45:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-b5e5165b-a608-4952-b205-211531408629 tempest-ProjectReaderTests-467028060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:45:14 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-b5e5165b-a608-4952-b205-211531408629 tempest-ProjectReaderTests-467028060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:45:14 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-b5e5165b-a608-4952-b205-211531408629 tempest-ProjectReaderTests-467028060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:45:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-b5e5165b-a608-4952-b205-211531408629 tempest-ProjectReaderTests-467028060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:45:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b5e5165b-a608-4952-b205-211531408629 tempest-ProjectReaderTests-467028060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:45:14 devstack sudo[108196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:45:14 devstack sudo[108196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:45:14 devstack sudo[108196]: pam_unix(sudo:session): session closed for user root
Nov 03 18:45:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-b5e5165b-a608-4952-b205-211531408629 tempest-ProjectReaderTests-467028060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.242s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:45:14 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-b5e5165b-a608-4952-b205-211531408629 tempest-ProjectReaderTests-467028060 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:45:14 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-b5e5165b-a608-4952-b205-211531408629 tempest-ProjectReaderTests-467028060 None] Deleted volume successfully.
Nov 03 18:45:14 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-b5e5165b-a608-4952-b205-211531408629 tempest-ProjectReaderTests-467028060 None] Lock "cinder-143dc1af-2cc6-4ccf-98f9-97caf670c6a5-delete_volume" released by "delete_volume" :: held 1.096s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:45:14 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-e183fdcb-1b5e-4db6-b400-df64348571e7 tempest-ProjectReaderTests-467028060 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:45:14 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-e183fdcb-1b5e-4db6-b400-df64348571e7 tempest-ProjectReaderTests-467028060 None] Flow 'volume_create_manager' (e9226985-8c07-47e8-9835-de6cb83efe97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:45:14 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-e183fdcb-1b5e-4db6-b400-df64348571e7 tempest-ProjectReaderTests-467028060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35c13e5d-63b7-4f65-8405-68a4aec558a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:45:14 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-e183fdcb-1b5e-4db6-b400-df64348571e7 tempest-ProjectReaderTests-467028060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35c13e5d-63b7-4f65-8405-68a4aec558a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:45:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-722230978',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a70d92e-e246-4784-bc83-fa264e561120,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50252b1b4e7043feb4ce25984f80f28b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:45:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:45:15Z,use_quota=True,user_id='0775f8e7db7d41039e0f7dd52466882e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:45:14 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-e183fdcb-1b5e-4db6-b400-df64348571e7 tempest-ProjectReaderTests-467028060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29b71978-d78d-4d62-89ad-a69b45bcfa15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:45:14 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-e183fdcb-1b5e-4db6-b400-df64348571e7 tempest-ProjectReaderTests-467028060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29b71978-d78d-4d62-89ad-a69b45bcfa15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:45:14 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-e183fdcb-1b5e-4db6-b400-df64348571e7 tempest-ProjectReaderTests-467028060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d809777c-34f2-4fef-8944-c4215e420952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:45:14 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-e183fdcb-1b5e-4db6-b400-df64348571e7 tempest-ProjectReaderTests-467028060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d809777c-34f2-4fef-8944-c4215e420952) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a70d92e-e246-4784-bc83-fa264e561120', 'volume_name': 'volume-4a70d92e-e246-4784-bc83-fa264e561120', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:45:14 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-e183fdcb-1b5e-4db6-b400-df64348571e7 tempest-ProjectReaderTests-467028060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (139703a6-6ce5-4769-b8a4-f63fe577d5f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:45:14 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-e183fdcb-1b5e-4db6-b400-df64348571e7 tempest-ProjectReaderTests-467028060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (139703a6-6ce5-4769-b8a4-f63fe577d5f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:45:14 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-e183fdcb-1b5e-4db6-b400-df64348571e7 tempest-ProjectReaderTests-467028060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e20e886-a9c0-4255-bdc1-e431ff5677d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:45:14 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-e183fdcb-1b5e-4db6-b400-df64348571e7 tempest-ProjectReaderTests-467028060 None] Volume 4a70d92e-e246-4784-bc83-fa264e561120: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a70d92e-e246-4784-bc83-fa264e561120', 'volume_size': 1}
Nov 03 18:45:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-e183fdcb-1b5e-4db6-b400-df64348571e7 tempest-ProjectReaderTests-467028060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:45:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-e183fdcb-1b5e-4db6-b400-df64348571e7 tempest-ProjectReaderTests-467028060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:45:14 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-e183fdcb-1b5e-4db6-b400-df64348571e7 tempest-ProjectReaderTests-467028060 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:45:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-722230978',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a70d92e-e246-4784-bc83-fa264e561120,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50252b1b4e7043feb4ce25984f80f28b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:45:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:45:15Z,use_quota=True,user_id='0775f8e7db7d41039e0f7dd52466882e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:45:14 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-e183fdcb-1b5e-4db6-b400-df64348571e7 tempest-ProjectReaderTests-467028060 None] Creating volume 4a70d92e-e246-4784-bc83-fa264e561120 {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:45:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-e183fdcb-1b5e-4db6-b400-df64348571e7 tempest-ProjectReaderTests-467028060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:45:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-e183fdcb-1b5e-4db6-b400-df64348571e7 tempest-ProjectReaderTests-467028060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:45:14 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-e183fdcb-1b5e-4db6-b400-df64348571e7 tempest-ProjectReaderTests-467028060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:45:14 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-e183fdcb-1b5e-4db6-b400-df64348571e7 tempest-ProjectReaderTests-467028060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:45:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-e183fdcb-1b5e-4db6-b400-df64348571e7 tempest-ProjectReaderTests-467028060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:45:14 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-e183fdcb-1b5e-4db6-b400-df64348571e7 tempest-ProjectReaderTests-467028060 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:45:14 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-e183fdcb-1b5e-4db6-b400-df64348571e7 tempest-ProjectReaderTests-467028060 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:45:14 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-e183fdcb-1b5e-4db6-b400-df64348571e7 tempest-ProjectReaderTests-467028060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-4a70d92e-e246-4784-bc83-fa264e561120 1073741824 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:45:15 devstack cinder-volume[86120]: DEBUG oslo_service.periodic_task [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Running periodic task VolumeManager._thread_info {{(pid=86120) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 18:45:15 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] thread count: 29 {{(pid=86120) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 03 18:45:15 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] thread info: [<_MainThread(MainThread, started 134747145822336)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134747033686336)>, <Thread(Thread-3 (stat_writer), started daemon 134747030828736)>, <Thread(Rabbit-heartbeat, started daemon 134747035433408)>, <Thread(Thread-5 (_runner), started daemon 134747029587392)>, <Thread(Thread-7 (_runner), started daemon 134747029784256)>, <Thread(fd_logger, started daemon 134747027909120)>, <Thread(privsep_reader, started daemon 134747027006592)>, <Thread(tpool_thread_0, started daemon 134747018950336)>, <Thread(tpool_thread_1, started daemon 134747010541248)>, <Thread(tpool_thread_2, started daemon 134747002132160)>, <Thread(tpool_thread_3, started daemon 134746993723072)>, <Thread(tpool_thread_4, started daemon 134746985313984)>, <Thread(tpool_thread_5, started daemon 134746976904896)>, <Thread(tpool_thread_6, started daemon 134746968495808)>, <Thread(tpool_thread_7, started daemon 134746960086720)>, <Thread(tpool_thread_8, started daemon 134746951677632)>, <Thread(tpool_thread_9, started daemon 134746943268544)>, <Thread(tpool_thread_10, started daemon 134746934859456)>, <Thread(tpool_thread_11, started daemon 134746926450368)>, <Thread(tpool_thread_12, started daemon 134746918041280)>, <Thread(tpool_thread_13, started daemon 134746909632192)>, <Thread(tpool_thread_14, started daemon 134746901223104)>, <Thread(tpool_thread_15, started daemon 134746892814016)>, <Thread(tpool_thread_16, started daemon 134746884404928)>, <Thread(tpool_thread_17, started daemon 134746875995840)>, <Thread(tpool_thread_18, started daemon 134746867586752)>, <Thread(tpool_thread_19, started daemon 134746859177664)>, <Thread(Rabbit-heartbeat, started daemon 134747021651648)>] {{(pid=86120) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 03 18:45:15 devstack sudo[108205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-4a70d92e-e246-4784-bc83-fa264e561120 1073741824
Nov 03 18:45:15 devstack sudo[108205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:45:15 devstack sudo[108205]: pam_unix(sudo:session): session closed for user root
Nov 03 18:45:15 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-e183fdcb-1b5e-4db6-b400-df64348571e7 tempest-ProjectReaderTests-467028060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-4a70d92e-e246-4784-bc83-fa264e561120 1073741824" returned: 0 in 0.408s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:45:15 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-e183fdcb-1b5e-4db6-b400-df64348571e7 tempest-ProjectReaderTests-467028060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-4a70d92e-e246-4784-bc83-fa264e561120 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:45:15 devstack sudo[108211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-4a70d92e-e246-4784-bc83-fa264e561120
Nov 03 18:45:15 devstack sudo[108211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:45:15 devstack sudo[108211]: pam_unix(sudo:session): session closed for user root
Nov 03 18:45:15 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-e183fdcb-1b5e-4db6-b400-df64348571e7 tempest-ProjectReaderTests-467028060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-4a70d92e-e246-4784-bc83-fa264e561120" returned: 0 in 0.239s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:45:15 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-e183fdcb-1b5e-4db6-b400-df64348571e7 tempest-ProjectReaderTests-467028060 None] <== create_volume: return (687ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:45:15 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-e183fdcb-1b5e-4db6-b400-df64348571e7 tempest-ProjectReaderTests-467028060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.690s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:45:15 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-e183fdcb-1b5e-4db6-b400-df64348571e7 tempest-ProjectReaderTests-467028060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e20e886-a9c0-4255-bdc1-e431ff5677d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a70d92e-e246-4784-bc83-fa264e561120', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:45:15 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-e183fdcb-1b5e-4db6-b400-df64348571e7 tempest-ProjectReaderTests-467028060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f0e2291-fbc6-448d-8de8-83fdc526806a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:45:15 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-e183fdcb-1b5e-4db6-b400-df64348571e7 tempest-ProjectReaderTests-467028060 None] Volume volume-4a70d92e-e246-4784-bc83-fa264e561120 (4a70d92e-e246-4784-bc83-fa264e561120): created successfully
Nov 03 18:45:15 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-e183fdcb-1b5e-4db6-b400-df64348571e7 tempest-ProjectReaderTests-467028060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f0e2291-fbc6-448d-8de8-83fdc526806a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:45:15 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-e183fdcb-1b5e-4db6-b400-df64348571e7 tempest-ProjectReaderTests-467028060 None] Flow 'volume_create_manager' (e9226985-8c07-47e8-9835-de6cb83efe97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:45:15 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-e183fdcb-1b5e-4db6-b400-df64348571e7 tempest-ProjectReaderTests-467028060 None] Created volume successfully.
Nov 03 18:45:16 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-32fabf9c-6bf8-4af9-82a5-c1fa71742b43 tempest-ProjectReaderTests-467028060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:45:16 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-32fabf9c-6bf8-4af9-82a5-c1fa71742b43 tempest-ProjectReaderTests-467028060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:45:16 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-32fabf9c-6bf8-4af9-82a5-c1fa71742b43 tempest-ProjectReaderTests-467028060 None] Creating offline snapshot 0430ec14-9f8a-4526-bd85-a326e87b66b5 of volume 4a70d92e-e246-4784-bc83-fa264e561120 {{(pid=86120) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 18:45:16 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[75fadff4-2fa0-40ba-aa36-c1e5ab112b3d]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:45:16 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-32fabf9c-6bf8-4af9-82a5-c1fa71742b43 tempest-ProjectReaderTests-467028060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-4a70d92e-e246-4784-bc83-fa264e561120 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:45:16 devstack sudo[108214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-4a70d92e-e246-4784-bc83-fa264e561120
Nov 03 18:45:16 devstack sudo[108214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:45:16 devstack sudo[108214]: pam_unix(sudo:session): session closed for user root
Nov 03 18:45:16 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-32fabf9c-6bf8-4af9-82a5-c1fa71742b43 tempest-ProjectReaderTests-467028060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-4a70d92e-e246-4784-bc83-fa264e561120" returned: 0 in 0.355s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:45:16 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-32fabf9c-6bf8-4af9-82a5-c1fa71742b43 tempest-ProjectReaderTests-467028060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-4a70d92e-e246-4784-bc83-fa264e561120,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-4a70d92e-e246-4784-bc83-fa264e561120.0430ec14-9f8a-4526-bd85-a326e87b66b5 1G {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:45:16 devstack sudo[108220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-4a70d92e-e246-4784-bc83-fa264e561120,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-4a70d92e-e246-4784-bc83-fa264e561120.0430ec14-9f8a-4526-bd85-a326e87b66b5 1G
Nov 03 18:45:16 devstack sudo[108220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:45:16 devstack sudo[108220]: pam_unix(sudo:session): session closed for user root
Nov 03 18:45:16 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-32fabf9c-6bf8-4af9-82a5-c1fa71742b43 tempest-ProjectReaderTests-467028060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-4a70d92e-e246-4784-bc83-fa264e561120,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-4a70d92e-e246-4784-bc83-fa264e561120.0430ec14-9f8a-4526-bd85-a326e87b66b5 1G" returned: 0 in 0.379s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:45:16 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-32fabf9c-6bf8-4af9-82a5-c1fa71742b43 tempest-ProjectReaderTests-467028060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a70d92e-e246-4784-bc83-fa264e561120 -F qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-4a70d92e-e246-4784-bc83-fa264e561120.0430ec14-9f8a-4526-bd85-a326e87b66b5 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:45:16 devstack sudo[108225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a70d92e-e246-4784-bc83-fa264e561120 -F qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-4a70d92e-e246-4784-bc83-fa264e561120.0430ec14-9f8a-4526-bd85-a326e87b66b5
Nov 03 18:45:16 devstack sudo[108225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:45:17 devstack sudo[108225]: pam_unix(sudo:session): session closed for user root
Nov 03 18:45:17 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-32fabf9c-6bf8-4af9-82a5-c1fa71742b43 tempest-ProjectReaderTests-467028060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a70d92e-e246-4784-bc83-fa264e561120 -F qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-4a70d92e-e246-4784-bc83-fa264e561120.0430ec14-9f8a-4526-bd85-a326e87b66b5" returned: 0 in 0.288s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:45:17 devstack cinder-volume[86120]: WARNING cinder.volume.drivers.remotefs [None req-32fabf9c-6bf8-4af9-82a5-c1fa71742b43 tempest-ProjectReaderTests-467028060 None] /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-4a70d92e-e246-4784-bc83-fa264e561120.0430ec14-9f8a-4526-bd85-a326e87b66b5 is being set with open permissions: ugo+rw
Nov 03 18:45:17 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-32fabf9c-6bf8-4af9-82a5-c1fa71742b43 tempest-ProjectReaderTests-467028060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-4a70d92e-e246-4784-bc83-fa264e561120.0430ec14-9f8a-4526-bd85-a326e87b66b5 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:45:17 devstack sudo[108231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-4a70d92e-e246-4784-bc83-fa264e561120.0430ec14-9f8a-4526-bd85-a326e87b66b5
Nov 03 18:45:17 devstack sudo[108231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:45:17 devstack sudo[108231]: pam_unix(sudo:session): session closed for user root
Nov 03 18:45:17 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-32fabf9c-6bf8-4af9-82a5-c1fa71742b43 tempest-ProjectReaderTests-467028060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-4a70d92e-e246-4784-bc83-fa264e561120.0430ec14-9f8a-4526-bd85-a326e87b66b5" returned: 0 in 0.233s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:45:17 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-32fabf9c-6bf8-4af9-82a5-c1fa71742b43 tempest-ProjectReaderTests-467028060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-4a70d92e-e246-4784-bc83-fa264e561120.info {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:45:17 devstack sudo[108234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-4a70d92e-e246-4784-bc83-fa264e561120.info
Nov 03 18:45:17 devstack sudo[108234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:45:17 devstack sudo[108234]: pam_unix(sudo:session): session closed for user root
Nov 03 18:45:17 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-32fabf9c-6bf8-4af9-82a5-c1fa71742b43 tempest-ProjectReaderTests-467028060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-4a70d92e-e246-4784-bc83-fa264e561120.info" returned: 0 in 0.249s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:45:17 devstack cinder-volume[86120]: WARNING cinder.volume.drivers.remotefs [None req-32fabf9c-6bf8-4af9-82a5-c1fa71742b43 tempest-ProjectReaderTests-467028060 None] /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-4a70d92e-e246-4784-bc83-fa264e561120.info is being set with open permissions: ugo+rw
Nov 03 18:45:17 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-32fabf9c-6bf8-4af9-82a5-c1fa71742b43 tempest-ProjectReaderTests-467028060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-4a70d92e-e246-4784-bc83-fa264e561120.info {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:45:17 devstack sudo[108237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-4a70d92e-e246-4784-bc83-fa264e561120.info
Nov 03 18:45:17 devstack sudo[108237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:45:17 devstack sudo[108237]: pam_unix(sudo:session): session closed for user root
Nov 03 18:45:17 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-32fabf9c-6bf8-4af9-82a5-c1fa71742b43 tempest-ProjectReaderTests-467028060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-4a70d92e-e246-4784-bc83-fa264e561120.info" returned: 0 in 0.242s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:45:17 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-32fabf9c-6bf8-4af9-82a5-c1fa71742b43 tempest-ProjectReaderTests-467028060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.825s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:45:17 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-32fabf9c-6bf8-4af9-82a5-c1fa71742b43 tempest-ProjectReaderTests-467028060 None] Create snapshot completed successfully
Nov 03 18:45:18 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-102fce0f-f01e-4284-a838-b450a46e2776 tempest-ProjectReaderTests-467028060 None] Acquiring lock "cinder-0430ec14-9f8a-4526-bd85-a326e87b66b5-delete_snapshot" by "delete_snapshot" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:45:18 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-102fce0f-f01e-4284-a838-b450a46e2776 tempest-ProjectReaderTests-467028060 None] Lock "cinder-0430ec14-9f8a-4526-bd85-a326e87b66b5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:45:18 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-102fce0f-f01e-4284-a838-b450a46e2776 tempest-ProjectReaderTests-467028060 None] Acquiring lock "cinder-quobyte-4a70d92e-e246-4784-bc83-fa264e561120" by "delete_snapshot" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:45:18 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-102fce0f-f01e-4284-a838-b450a46e2776 tempest-ProjectReaderTests-467028060 None] Lock "cinder-quobyte-4a70d92e-e246-4784-bc83-fa264e561120" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:45:18 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-102fce0f-f01e-4284-a838-b450a46e2776 tempest-ProjectReaderTests-467028060 None] Acquiring lock "cinder-quobyte-0430ec14-9f8a-4526-bd85-a326e87b66b5" by "_delete_snapshot" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:45:18 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-102fce0f-f01e-4284-a838-b450a46e2776 tempest-ProjectReaderTests-467028060 None] Lock "cinder-quobyte-0430ec14-9f8a-4526-bd85-a326e87b66b5" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:45:18 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-102fce0f-f01e-4284-a838-b450a46e2776 tempest-ProjectReaderTests-467028060 None] Deleting offline snapshot 0430ec14-9f8a-4526-bd85-a326e87b66b5 of volume 4a70d92e-e246-4784-bc83-fa264e561120 {{(pid=86120) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 18:45:18 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-102fce0f-f01e-4284-a838-b450a46e2776 tempest-ProjectReaderTests-467028060 None] snapshot_file for this snap is: volume-4a70d92e-e246-4784-bc83-fa264e561120.0430ec14-9f8a-4526-bd85-a326e87b66b5 {{(pid=86120) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 18:45:18 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[069ec61d-6a8d-4db7-adb6-c57cdb1775b5]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:45:18 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-102fce0f-f01e-4284-a838-b450a46e2776 tempest-ProjectReaderTests-467028060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-4a70d92e-e246-4784-bc83-fa264e561120.0430ec14-9f8a-4526-bd85-a326e87b66b5 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:45:18 devstack sudo[108240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-4a70d92e-e246-4784-bc83-fa264e561120.0430ec14-9f8a-4526-bd85-a326e87b66b5
Nov 03 18:45:18 devstack sudo[108240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:45:18 devstack sudo[108240]: pam_unix(sudo:session): session closed for user root
Nov 03 18:45:18 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-102fce0f-f01e-4284-a838-b450a46e2776 tempest-ProjectReaderTests-467028060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-4a70d92e-e246-4784-bc83-fa264e561120.0430ec14-9f8a-4526-bd85-a326e87b66b5" returned: 0 in 0.353s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:45:18 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-102fce0f-f01e-4284-a838-b450a46e2776 tempest-ProjectReaderTests-467028060 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4a70d92e-e246-4784-bc83-fa264e561120(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86120) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 18:45:18 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[45b4d2ef-076b-431d-a9e7-8903fa73b40c]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:45:18 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-102fce0f-f01e-4284-a838-b450a46e2776 tempest-ProjectReaderTests-467028060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-4a70d92e-e246-4784-bc83-fa264e561120 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:45:18 devstack sudo[108245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-4a70d92e-e246-4784-bc83-fa264e561120
Nov 03 18:45:18 devstack sudo[108245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:45:18 devstack sudo[108245]: pam_unix(sudo:session): session closed for user root
Nov 03 18:45:18 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-102fce0f-f01e-4284-a838-b450a46e2776 tempest-ProjectReaderTests-467028060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-4a70d92e-e246-4784-bc83-fa264e561120" returned: 0 in 0.346s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:45:18 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-102fce0f-f01e-4284-a838-b450a46e2776 tempest-ProjectReaderTests-467028060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-4a70d92e-e246-4784-bc83-fa264e561120.0430ec14-9f8a-4526-bd85-a326e87b66b5 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:45:19 devstack sudo[108250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-4a70d92e-e246-4784-bc83-fa264e561120.0430ec14-9f8a-4526-bd85-a326e87b66b5
Nov 03 18:45:19 devstack sudo[108250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:45:19 devstack sudo[108250]: pam_unix(sudo:session): session closed for user root
Nov 03 18:45:19 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-102fce0f-f01e-4284-a838-b450a46e2776 tempest-ProjectReaderTests-467028060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-4a70d92e-e246-4784-bc83-fa264e561120.0430ec14-9f8a-4526-bd85-a326e87b66b5" returned: 0 in 0.336s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:45:19 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-102fce0f-f01e-4284-a838-b450a46e2776 tempest-ProjectReaderTests-467028060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-4a70d92e-e246-4784-bc83-fa264e561120.0430ec14-9f8a-4526-bd85-a326e87b66b5 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:45:19 devstack sudo[108255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-4a70d92e-e246-4784-bc83-fa264e561120.0430ec14-9f8a-4526-bd85-a326e87b66b5
Nov 03 18:45:19 devstack sudo[108255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:45:19 devstack sudo[108255]: pam_unix(sudo:session): session closed for user root
Nov 03 18:45:19 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-102fce0f-f01e-4284-a838-b450a46e2776 tempest-ProjectReaderTests-467028060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-4a70d92e-e246-4784-bc83-fa264e561120.0430ec14-9f8a-4526-bd85-a326e87b66b5" returned: 0 in 0.248s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:45:19 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-102fce0f-f01e-4284-a838-b450a46e2776 tempest-ProjectReaderTests-467028060 None] Lock "cinder-quobyte-0430ec14-9f8a-4526-bd85-a326e87b66b5" released by "_delete_snapshot" :: held 1.378s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:45:19 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-102fce0f-f01e-4284-a838-b450a46e2776 tempest-ProjectReaderTests-467028060 None] Lock "cinder-quobyte-4a70d92e-e246-4784-bc83-fa264e561120" released by "delete_snapshot" :: held 1.399s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:45:19 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-102fce0f-f01e-4284-a838-b450a46e2776 tempest-ProjectReaderTests-467028060 None] Created reservations ['eabb7fd4-5a20-4434-98f4-8a7044703e70', '33ccdc4d-a65a-41d0-a5b0-b2d134783e76', '55a959e8-b526-4a62-842f-b98463c18bc2', 'e7da7174-0414-4914-b03a-86950c125dea'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:45:19 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-102fce0f-f01e-4284-a838-b450a46e2776 tempest-ProjectReaderTests-467028060 None] Delete snapshot completed successfully.
Nov 03 18:45:19 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-102fce0f-f01e-4284-a838-b450a46e2776 tempest-ProjectReaderTests-467028060 None] Lock "cinder-0430ec14-9f8a-4526-bd85-a326e87b66b5-delete_snapshot" released by "delete_snapshot" :: held 1.524s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:45:20 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-46dc14b0-e649-4a89-aac5-2cad7dffcf96 tempest-ProjectReaderTests-467028060 None] Acquiring lock "cinder-4a70d92e-e246-4784-bc83-fa264e561120-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:45:20 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-46dc14b0-e649-4a89-aac5-2cad7dffcf96 tempest-ProjectReaderTests-467028060 None] Lock "cinder-4a70d92e-e246-4784-bc83-fa264e561120-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:45:20 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-46dc14b0-e649-4a89-aac5-2cad7dffcf96 tempest-ProjectReaderTests-467028060 None] Acquiring lock "cinder-quobyte-4a70d92e-e246-4784-bc83-fa264e561120" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:45:20 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-46dc14b0-e649-4a89-aac5-2cad7dffcf96 tempest-ProjectReaderTests-467028060 None] Lock "cinder-quobyte-4a70d92e-e246-4784-bc83-fa264e561120" acquired by "delete_volume" :: waited 0.014s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:45:20 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[07856780-2dbd-4032-b931-11255950f567]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:45:20 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-46dc14b0-e649-4a89-aac5-2cad7dffcf96 tempest-ProjectReaderTests-467028060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-4a70d92e-e246-4784-bc83-fa264e561120 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:45:20 devstack sudo[108259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-4a70d92e-e246-4784-bc83-fa264e561120
Nov 03 18:45:20 devstack sudo[108259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:45:20 devstack sudo[108259]: pam_unix(sudo:session): session closed for user root
Nov 03 18:45:20 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-46dc14b0-e649-4a89-aac5-2cad7dffcf96 tempest-ProjectReaderTests-467028060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-4a70d92e-e246-4784-bc83-fa264e561120" returned: 0 in 0.347s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:45:20 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-46dc14b0-e649-4a89-aac5-2cad7dffcf96 tempest-ProjectReaderTests-467028060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-4a70d92e-e246-4784-bc83-fa264e561120 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:45:20 devstack sudo[108264]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-4a70d92e-e246-4784-bc83-fa264e561120
Nov 03 18:45:20 devstack sudo[108264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:45:21 devstack sudo[108264]: pam_unix(sudo:session): session closed for user root
Nov 03 18:45:21 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-46dc14b0-e649-4a89-aac5-2cad7dffcf96 tempest-ProjectReaderTests-467028060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-4a70d92e-e246-4784-bc83-fa264e561120" returned: 0 in 0.242s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:45:21 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-46dc14b0-e649-4a89-aac5-2cad7dffcf96 tempest-ProjectReaderTests-467028060 None] Lock "cinder-quobyte-4a70d92e-e246-4784-bc83-fa264e561120" released by "delete_volume" :: held 0.649s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:45:21 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-46dc14b0-e649-4a89-aac5-2cad7dffcf96 tempest-ProjectReaderTests-467028060 None] Created reservations ['e14f5864-977f-40f9-a401-6d23c7355858', '0aa3486b-aa17-4851-9cd6-1b733bffc3b7', '9b738679-faf8-46bf-aaef-9a359d701f22', '3e1e8182-dc7c-4b89-ac6b-f8913e17e15a'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:45:21 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-46dc14b0-e649-4a89-aac5-2cad7dffcf96 tempest-ProjectReaderTests-467028060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:45:21 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-46dc14b0-e649-4a89-aac5-2cad7dffcf96 tempest-ProjectReaderTests-467028060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:45:21 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-46dc14b0-e649-4a89-aac5-2cad7dffcf96 tempest-ProjectReaderTests-467028060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:45:21 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-46dc14b0-e649-4a89-aac5-2cad7dffcf96 tempest-ProjectReaderTests-467028060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:45:21 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-46dc14b0-e649-4a89-aac5-2cad7dffcf96 tempest-ProjectReaderTests-467028060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:45:21 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-46dc14b0-e649-4a89-aac5-2cad7dffcf96 tempest-ProjectReaderTests-467028060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:45:21 devstack sudo[108267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:45:21 devstack sudo[108267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:45:21 devstack sudo[108267]: pam_unix(sudo:session): session closed for user root
Nov 03 18:45:21 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-46dc14b0-e649-4a89-aac5-2cad7dffcf96 tempest-ProjectReaderTests-467028060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.234s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:45:21 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-46dc14b0-e649-4a89-aac5-2cad7dffcf96 tempest-ProjectReaderTests-467028060 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:45:21 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-46dc14b0-e649-4a89-aac5-2cad7dffcf96 tempest-ProjectReaderTests-467028060 None] Deleted volume successfully.
Nov 03 18:45:21 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-46dc14b0-e649-4a89-aac5-2cad7dffcf96 tempest-ProjectReaderTests-467028060 None] Lock "cinder-4a70d92e-e246-4784-bc83-fa264e561120-delete_volume" released by "delete_volume" :: held 1.072s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:45:31 devstack cinder-volume[86120]: DEBUG dbcounter [-] [86120] Writing DB stats cinder:INSERT=35,cinder:UPDATE=111,cinder:SELECT=80,cinder:DELETE=7 {{(pid=86120) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 18:45:31 devstack cinder-volume[86120]: DEBUG dbcounter [-] [86120] Writing DB stats cinder:SELECT=77,cinder:INSERT=23,cinder:UPDATE=96,cinder:DELETE=9 {{(pid=86120) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 18:45:41 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-4cd7fb74-62e4-47e7-848a-0f1d4f3116b4 tempest-SnapshotDependencyTests-326181567 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:45:41 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-4cd7fb74-62e4-47e7-848a-0f1d4f3116b4 tempest-SnapshotDependencyTests-326181567 None] Flow 'volume_create_manager' (345f0a49-0af4-4be3-8df6-eeca68398be9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:45:41 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-4cd7fb74-62e4-47e7-848a-0f1d4f3116b4 tempest-SnapshotDependencyTests-326181567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7ae51e7-32ca-49a2-aabe-28c9340088d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:45:41 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-4cd7fb74-62e4-47e7-848a-0f1d4f3116b4 tempest-SnapshotDependencyTests-326181567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7ae51e7-32ca-49a2-aabe-28c9340088d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:45:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-731191984',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c0595f3-6d02-4811-9058-947631a13c43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37c3a9b69a764fb9a9715c06f1c056a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:45:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:45:41Z,use_quota=True,user_id='e7d8f37b2d1d49eb824e673027380a34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:45:41 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-4cd7fb74-62e4-47e7-848a-0f1d4f3116b4 tempest-SnapshotDependencyTests-326181567 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05b918f2-7883-4951-897a-c9daa6bc4489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:45:41 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-4cd7fb74-62e4-47e7-848a-0f1d4f3116b4 tempest-SnapshotDependencyTests-326181567 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05b918f2-7883-4951-897a-c9daa6bc4489) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:45:41 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-4cd7fb74-62e4-47e7-848a-0f1d4f3116b4 tempest-SnapshotDependencyTests-326181567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a947e20-a4c3-46ba-9a6a-b572d834179c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:45:41 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-4cd7fb74-62e4-47e7-848a-0f1d4f3116b4 tempest-SnapshotDependencyTests-326181567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a947e20-a4c3-46ba-9a6a-b572d834179c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c0595f3-6d02-4811-9058-947631a13c43', 'volume_name': 'volume-2c0595f3-6d02-4811-9058-947631a13c43', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:45:41 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-4cd7fb74-62e4-47e7-848a-0f1d4f3116b4 tempest-SnapshotDependencyTests-326181567 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18b3d0d6-3b15-4020-a840-704a6781d466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:45:41 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-4cd7fb74-62e4-47e7-848a-0f1d4f3116b4 tempest-SnapshotDependencyTests-326181567 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18b3d0d6-3b15-4020-a840-704a6781d466) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:45:41 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-4cd7fb74-62e4-47e7-848a-0f1d4f3116b4 tempest-SnapshotDependencyTests-326181567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3a71101-07d9-411f-a491-0f46b4f66b7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:45:41 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-4cd7fb74-62e4-47e7-848a-0f1d4f3116b4 tempest-SnapshotDependencyTests-326181567 None] Volume 2c0595f3-6d02-4811-9058-947631a13c43: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c0595f3-6d02-4811-9058-947631a13c43', 'volume_size': 1}
Nov 03 18:45:41 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-4cd7fb74-62e4-47e7-848a-0f1d4f3116b4 tempest-SnapshotDependencyTests-326181567 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:45:41 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-4cd7fb74-62e4-47e7-848a-0f1d4f3116b4 tempest-SnapshotDependencyTests-326181567 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:45:41 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-4cd7fb74-62e4-47e7-848a-0f1d4f3116b4 tempest-SnapshotDependencyTests-326181567 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a8d3d14bcb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:45:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-731191984',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c0595f3-6d02-4811-9058-947631a13c43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37c3a9b69a764fb9a9715c06f1c056a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:45:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:45:41Z,use_quota=True,user_id='e7d8f37b2d1d49eb824e673027380a34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)}" {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 03 18:45:41 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-4cd7fb74-62e4-47e7-848a-0f1d4f3116b4 tempest-SnapshotDependencyTests-326181567 None] Creating volume 2c0595f3-6d02-4811-9058-947631a13c43 {{(pid=86120) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 03 18:45:41 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-4cd7fb74-62e4-47e7-848a-0f1d4f3116b4 tempest-SnapshotDependencyTests-326181567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:45:41 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-4cd7fb74-62e4-47e7-848a-0f1d4f3116b4 tempest-SnapshotDependencyTests-326181567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:45:41 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-4cd7fb74-62e4-47e7-848a-0f1d4f3116b4 tempest-SnapshotDependencyTests-326181567 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:45:41 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-4cd7fb74-62e4-47e7-848a-0f1d4f3116b4 tempest-SnapshotDependencyTests-326181567 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:45:41 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-4cd7fb74-62e4-47e7-848a-0f1d4f3116b4 tempest-SnapshotDependencyTests-326181567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:45:41 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-4cd7fb74-62e4-47e7-848a-0f1d4f3116b4 tempest-SnapshotDependencyTests-326181567 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:45:41 devstack cinder-volume[86120]: INFO cinder.volume.drivers.remotefs [None req-4cd7fb74-62e4-47e7-848a-0f1d4f3116b4 tempest-SnapshotDependencyTests-326181567 None] casted to osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c
Nov 03 18:45:41 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-4cd7fb74-62e4-47e7-848a-0f1d4f3116b4 tempest-SnapshotDependencyTests-326181567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2c0595f3-6d02-4811-9058-947631a13c43 1073741824 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:45:41 devstack sudo[108313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2c0595f3-6d02-4811-9058-947631a13c43 1073741824
Nov 03 18:45:41 devstack sudo[108313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:45:41 devstack sudo[108313]: pam_unix(sudo:session): session closed for user root
Nov 03 18:45:41 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-4cd7fb74-62e4-47e7-848a-0f1d4f3116b4 tempest-SnapshotDependencyTests-326181567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2c0595f3-6d02-4811-9058-947631a13c43 1073741824" returned: 0 in 0.411s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:45:41 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-4cd7fb74-62e4-47e7-848a-0f1d4f3116b4 tempest-SnapshotDependencyTests-326181567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2c0595f3-6d02-4811-9058-947631a13c43 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:45:41 devstack sudo[108320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2c0595f3-6d02-4811-9058-947631a13c43
Nov 03 18:45:41 devstack sudo[108320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:45:42 devstack sudo[108320]: pam_unix(sudo:session): session closed for user root
Nov 03 18:45:42 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-4cd7fb74-62e4-47e7-848a-0f1d4f3116b4 tempest-SnapshotDependencyTests-326181567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2c0595f3-6d02-4811-9058-947631a13c43" returned: 0 in 0.234s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:45:42 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-4cd7fb74-62e4-47e7-848a-0f1d4f3116b4 tempest-SnapshotDependencyTests-326181567 None] <== create_volume: return (686ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'} {{(pid=86120) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 03 18:45:42 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-4cd7fb74-62e4-47e7-848a-0f1d4f3116b4 tempest-SnapshotDependencyTests-326181567 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.688s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:45:42 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-4cd7fb74-62e4-47e7-848a-0f1d4f3116b4 tempest-SnapshotDependencyTests-326181567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3a71101-07d9-411f-a491-0f46b4f66b7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c0595f3-6d02-4811-9058-947631a13c43', 'volume_size': 1}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:45:42 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-4cd7fb74-62e4-47e7-848a-0f1d4f3116b4 tempest-SnapshotDependencyTests-326181567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f64ad1b0-cbcb-43f4-b25a-deaa7c571159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:45:42 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-4cd7fb74-62e4-47e7-848a-0f1d4f3116b4 tempest-SnapshotDependencyTests-326181567 None] Volume volume-2c0595f3-6d02-4811-9058-947631a13c43 (2c0595f3-6d02-4811-9058-947631a13c43): created successfully
Nov 03 18:45:42 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-4cd7fb74-62e4-47e7-848a-0f1d4f3116b4 tempest-SnapshotDependencyTests-326181567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f64ad1b0-cbcb-43f4-b25a-deaa7c571159) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:45:42 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-4cd7fb74-62e4-47e7-848a-0f1d4f3116b4 tempest-SnapshotDependencyTests-326181567 None] Flow 'volume_create_manager' (345f0a49-0af4-4be3-8df6-eeca68398be9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:45:42 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-4cd7fb74-62e4-47e7-848a-0f1d4f3116b4 tempest-SnapshotDependencyTests-326181567 None] Created volume successfully.
Nov 03 18:45:42 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-305b1a3d-ff56-4a91-942d-ffee0d71bf20 tempest-SnapshotDependencyTests-326181567 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:45:42 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-305b1a3d-ff56-4a91-942d-ffee0d71bf20 tempest-SnapshotDependencyTests-326181567 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:45:42 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-305b1a3d-ff56-4a91-942d-ffee0d71bf20 tempest-SnapshotDependencyTests-326181567 None] Creating offline snapshot 844da198-c049-4082-84be-213c1a407445 of volume 2c0595f3-6d02-4811-9058-947631a13c43 {{(pid=86120) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 03 18:45:42 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[71078f78-0081-47af-a935-4a96ab694f79]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:45:42 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-305b1a3d-ff56-4a91-942d-ffee0d71bf20 tempest-SnapshotDependencyTests-326181567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2c0595f3-6d02-4811-9058-947631a13c43 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:45:42 devstack sudo[108323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2c0595f3-6d02-4811-9058-947631a13c43
Nov 03 18:45:42 devstack sudo[108323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:45:42 devstack sudo[108323]: pam_unix(sudo:session): session closed for user root
Nov 03 18:45:42 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-305b1a3d-ff56-4a91-942d-ffee0d71bf20 tempest-SnapshotDependencyTests-326181567 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2c0595f3-6d02-4811-9058-947631a13c43" returned: 0 in 0.351s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:45:42 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-305b1a3d-ff56-4a91-942d-ffee0d71bf20 tempest-SnapshotDependencyTests-326181567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2c0595f3-6d02-4811-9058-947631a13c43,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2c0595f3-6d02-4811-9058-947631a13c43.844da198-c049-4082-84be-213c1a407445 1G {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:45:42 devstack sudo[108328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2c0595f3-6d02-4811-9058-947631a13c43,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2c0595f3-6d02-4811-9058-947631a13c43.844da198-c049-4082-84be-213c1a407445 1G
Nov 03 18:45:42 devstack sudo[108328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:45:43 devstack sudo[108328]: pam_unix(sudo:session): session closed for user root
Nov 03 18:45:43 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-305b1a3d-ff56-4a91-942d-ffee0d71bf20 tempest-SnapshotDependencyTests-326181567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2c0595f3-6d02-4811-9058-947631a13c43,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2c0595f3-6d02-4811-9058-947631a13c43.844da198-c049-4082-84be-213c1a407445 1G" returned: 0 in 0.385s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:45:43 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-305b1a3d-ff56-4a91-942d-ffee0d71bf20 tempest-SnapshotDependencyTests-326181567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c0595f3-6d02-4811-9058-947631a13c43 -F qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2c0595f3-6d02-4811-9058-947631a13c43.844da198-c049-4082-84be-213c1a407445 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:45:43 devstack sudo[108334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c0595f3-6d02-4811-9058-947631a13c43 -F qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2c0595f3-6d02-4811-9058-947631a13c43.844da198-c049-4082-84be-213c1a407445
Nov 03 18:45:43 devstack sudo[108334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:45:43 devstack sudo[108334]: pam_unix(sudo:session): session closed for user root
Nov 03 18:45:43 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-305b1a3d-ff56-4a91-942d-ffee0d71bf20 tempest-SnapshotDependencyTests-326181567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c0595f3-6d02-4811-9058-947631a13c43 -F qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2c0595f3-6d02-4811-9058-947631a13c43.844da198-c049-4082-84be-213c1a407445" returned: 0 in 0.289s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:45:43 devstack cinder-volume[86120]: WARNING cinder.volume.drivers.remotefs [None req-305b1a3d-ff56-4a91-942d-ffee0d71bf20 tempest-SnapshotDependencyTests-326181567 None] /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2c0595f3-6d02-4811-9058-947631a13c43.844da198-c049-4082-84be-213c1a407445 is being set with open permissions: ugo+rw
Nov 03 18:45:43 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-305b1a3d-ff56-4a91-942d-ffee0d71bf20 tempest-SnapshotDependencyTests-326181567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2c0595f3-6d02-4811-9058-947631a13c43.844da198-c049-4082-84be-213c1a407445 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:45:43 devstack sudo[108340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2c0595f3-6d02-4811-9058-947631a13c43.844da198-c049-4082-84be-213c1a407445
Nov 03 18:45:43 devstack sudo[108340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:45:43 devstack sudo[108340]: pam_unix(sudo:session): session closed for user root
Nov 03 18:45:43 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-305b1a3d-ff56-4a91-942d-ffee0d71bf20 tempest-SnapshotDependencyTests-326181567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2c0595f3-6d02-4811-9058-947631a13c43.844da198-c049-4082-84be-213c1a407445" returned: 0 in 0.237s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:45:43 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-305b1a3d-ff56-4a91-942d-ffee0d71bf20 tempest-SnapshotDependencyTests-326181567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2c0595f3-6d02-4811-9058-947631a13c43.info {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:45:43 devstack sudo[108343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2c0595f3-6d02-4811-9058-947631a13c43.info
Nov 03 18:45:43 devstack sudo[108343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:45:44 devstack sudo[108343]: pam_unix(sudo:session): session closed for user root
Nov 03 18:45:44 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-305b1a3d-ff56-4a91-942d-ffee0d71bf20 tempest-SnapshotDependencyTests-326181567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2c0595f3-6d02-4811-9058-947631a13c43.info" returned: 0 in 0.246s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:45:44 devstack cinder-volume[86120]: WARNING cinder.volume.drivers.remotefs [None req-305b1a3d-ff56-4a91-942d-ffee0d71bf20 tempest-SnapshotDependencyTests-326181567 None] /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2c0595f3-6d02-4811-9058-947631a13c43.info is being set with open permissions: ugo+rw
Nov 03 18:45:44 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-305b1a3d-ff56-4a91-942d-ffee0d71bf20 tempest-SnapshotDependencyTests-326181567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2c0595f3-6d02-4811-9058-947631a13c43.info {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:45:44 devstack sudo[108346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2c0595f3-6d02-4811-9058-947631a13c43.info
Nov 03 18:45:44 devstack sudo[108346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:45:44 devstack sudo[108346]: pam_unix(sudo:session): session closed for user root
Nov 03 18:45:44 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-305b1a3d-ff56-4a91-942d-ffee0d71bf20 tempest-SnapshotDependencyTests-326181567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2c0595f3-6d02-4811-9058-947631a13c43.info" returned: 0 in 0.234s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:45:44 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-305b1a3d-ff56-4a91-942d-ffee0d71bf20 tempest-SnapshotDependencyTests-326181567 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.829s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:45:44 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-305b1a3d-ff56-4a91-942d-ffee0d71bf20 tempest-SnapshotDependencyTests-326181567 None] Create snapshot completed successfully
Nov 03 18:45:45 devstack cinder-volume[86120]: DEBUG cinder.volume.flows.manager.create_volume [None req-520cab17-f22b-4783-9b6d-9c316f3d2b63 tempest-SnapshotDependencyTests-326181567 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86120) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 03 18:45:45 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-520cab17-f22b-4783-9b6d-9c316f3d2b63 tempest-SnapshotDependencyTests-326181567 None] Flow 'volume_create_manager' (025471cc-68e8-409d-8fce-a596ec4e3079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:45:45 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-520cab17-f22b-4783-9b6d-9c316f3d2b63 tempest-SnapshotDependencyTests-326181567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9dc6cd52-5c9c-48c7-939e-1ebf2ba67145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:45:45 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-520cab17-f22b-4783-9b6d-9c316f3d2b63 tempest-SnapshotDependencyTests-326181567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9dc6cd52-5c9c-48c7-939e-1ebf2ba67145) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-03T17:45:45Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e93691c-7d93-4dc4-8c60-d3f366626598,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37c3a9b69a764fb9a9715c06f1c056a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:45:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=844da198-c049-4082-84be-213c1a407445,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:45:45Z,use_quota=True,user_id='e7d8f37b2d1d49eb824e673027380a34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1133820b-1a8f-4adb-92d2-34815d6a47bb),volume_type_id=1133820b-1a8f-4adb-92d2-34815d6a47bb)' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:45:45 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-520cab17-f22b-4783-9b6d-9c316f3d2b63 tempest-SnapshotDependencyTests-326181567 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89afe4c1-ccb9-4e61-885c-ec8e5ee849b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:45:45 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-520cab17-f22b-4783-9b6d-9c316f3d2b63 tempest-SnapshotDependencyTests-326181567 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89afe4c1-ccb9-4e61-885c-ec8e5ee849b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:45:45 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-520cab17-f22b-4783-9b6d-9c316f3d2b63 tempest-SnapshotDependencyTests-326181567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b1d9cd2-5354-422c-aa99-0490004e3ae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:45:45 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-520cab17-f22b-4783-9b6d-9c316f3d2b63 tempest-SnapshotDependencyTests-326181567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b1d9cd2-5354-422c-aa99-0490004e3ae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0e93691c-7d93-4dc4-8c60-d3f366626598', 'volume_name': 'volume-0e93691c-7d93-4dc4-8c60-d3f366626598', 'volume_size': 1, 'snapshot_id': '844da198-c049-4082-84be-213c1a407445'}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:45:45 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-520cab17-f22b-4783-9b6d-9c316f3d2b63 tempest-SnapshotDependencyTests-326181567 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a27e49f-f345-4af0-a027-3fe827b83381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:45:45 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-520cab17-f22b-4783-9b6d-9c316f3d2b63 tempest-SnapshotDependencyTests-326181567 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a27e49f-f345-4af0-a027-3fe827b83381) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:45:45 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-520cab17-f22b-4783-9b6d-9c316f3d2b63 tempest-SnapshotDependencyTests-326181567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3bdfed0-86c7-4629-9bfa-cb4123542124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:45:45 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-520cab17-f22b-4783-9b6d-9c316f3d2b63 tempest-SnapshotDependencyTests-326181567 None] Volume 0e93691c-7d93-4dc4-8c60-d3f366626598: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0e93691c-7d93-4dc4-8c60-d3f366626598', 'volume_size': 1, 'snapshot_id': '844da198-c049-4082-84be-213c1a407445'}
Nov 03 18:45:45 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-520cab17-f22b-4783-9b6d-9c316f3d2b63 tempest-SnapshotDependencyTests-326181567 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:45:45 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-520cab17-f22b-4783-9b6d-9c316f3d2b63 tempest-SnapshotDependencyTests-326181567 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:45:45 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-520cab17-f22b-4783-9b6d-9c316f3d2b63 tempest-SnapshotDependencyTests-326181567 None] Acquiring lock "cinder-quobyte-844da198-c049-4082-84be-213c1a407445-0e93691c-7d93-4dc4-8c60-d3f366626598" by "_create_volume_from_snapshot" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:45:45 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-520cab17-f22b-4783-9b6d-9c316f3d2b63 tempest-SnapshotDependencyTests-326181567 None] Lock "cinder-quobyte-844da198-c049-4082-84be-213c1a407445-0e93691c-7d93-4dc4-8c60-d3f366626598" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:45:45 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-520cab17-f22b-4783-9b6d-9c316f3d2b63 tempest-SnapshotDependencyTests-326181567 None] Creating volume 0e93691c-7d93-4dc4-8c60-d3f366626598 from snapshot 844da198-c049-4082-84be-213c1a407445 {{(pid=86120) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 03 18:45:45 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-520cab17-f22b-4783-9b6d-9c316f3d2b63 tempest-SnapshotDependencyTests-326181567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:45:45 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-520cab17-f22b-4783-9b6d-9c316f3d2b63 tempest-SnapshotDependencyTests-326181567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:45:45 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-520cab17-f22b-4783-9b6d-9c316f3d2b63 tempest-SnapshotDependencyTests-326181567 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:45:45 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-520cab17-f22b-4783-9b6d-9c316f3d2b63 tempest-SnapshotDependencyTests-326181567 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:45:45 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-520cab17-f22b-4783-9b6d-9c316f3d2b63 tempest-SnapshotDependencyTests-326181567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:45:45 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-520cab17-f22b-4783-9b6d-9c316f3d2b63 tempest-SnapshotDependencyTests-326181567 None] Selected osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c as target Quobyte volume. {{(pid=86120) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 03 18:45:45 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-520cab17-f22b-4783-9b6d-9c316f3d2b63 tempest-SnapshotDependencyTests-326181567 None] Acquiring lock "cinder-quobyte-0e93691c-7d93-4dc4-8c60-d3f366626598" by "_copy_volume_from_snapshot" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:45:45 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-520cab17-f22b-4783-9b6d-9c316f3d2b63 tempest-SnapshotDependencyTests-326181567 None] Lock "cinder-quobyte-0e93691c-7d93-4dc4-8c60-d3f366626598" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:45:45 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-520cab17-f22b-4783-9b6d-9c316f3d2b63 tempest-SnapshotDependencyTests-326181567 None] snapshot: 844da198-c049-4082-84be-213c1a407445, volume: 0e93691c-7d93-4dc4-8c60-d3f366626598,  {{(pid=86120) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 03 18:45:45 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-520cab17-f22b-4783-9b6d-9c316f3d2b63 tempest-SnapshotDependencyTests-326181567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:45:45 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-520cab17-f22b-4783-9b6d-9c316f3d2b63 tempest-SnapshotDependencyTests-326181567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:45:45 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-520cab17-f22b-4783-9b6d-9c316f3d2b63 tempest-SnapshotDependencyTests-326181567 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:45:45 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-520cab17-f22b-4783-9b6d-9c316f3d2b63 tempest-SnapshotDependencyTests-326181567 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:45:45 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-520cab17-f22b-4783-9b6d-9c316f3d2b63 tempest-SnapshotDependencyTests-326181567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:45:45 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[beb96cdb-70b6-4e08-9ac4-d0c687599ce9]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:45:45 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-520cab17-f22b-4783-9b6d-9c316f3d2b63 tempest-SnapshotDependencyTests-326181567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2c0595f3-6d02-4811-9058-947631a13c43.844da198-c049-4082-84be-213c1a407445 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:45:45 devstack sudo[108349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2c0595f3-6d02-4811-9058-947631a13c43.844da198-c049-4082-84be-213c1a407445
Nov 03 18:45:45 devstack sudo[108349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:45:45 devstack sudo[108349]: pam_unix(sudo:session): session closed for user root
Nov 03 18:45:45 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-520cab17-f22b-4783-9b6d-9c316f3d2b63 tempest-SnapshotDependencyTests-326181567 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2c0595f3-6d02-4811-9058-947631a13c43.844da198-c049-4082-84be-213c1a407445" returned: 0 in 0.352s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:45:45 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-520cab17-f22b-4783-9b6d-9c316f3d2b63 tempest-SnapshotDependencyTests-326181567 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2c0595f3-6d02-4811-9058-947631a13c43(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86120) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 18:45:45 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6b99199-7c87-4aa7-831e-960f9603ff20]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:45:45 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-520cab17-f22b-4783-9b6d-9c316f3d2b63 tempest-SnapshotDependencyTests-326181567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2c0595f3-6d02-4811-9058-947631a13c43 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:45:45 devstack sudo[108354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2c0595f3-6d02-4811-9058-947631a13c43
Nov 03 18:45:45 devstack sudo[108354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:45:46 devstack sudo[108354]: pam_unix(sudo:session): session closed for user root
Nov 03 18:45:46 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-520cab17-f22b-4783-9b6d-9c316f3d2b63 tempest-SnapshotDependencyTests-326181567 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2c0595f3-6d02-4811-9058-947631a13c43" returned: 0 in 0.359s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:45:46 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-520cab17-f22b-4783-9b6d-9c316f3d2b63 tempest-SnapshotDependencyTests-326181567 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2c0595f3-6d02-4811-9058-947631a13c43 {{(pid=86120) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 03 18:45:46 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-520cab17-f22b-4783-9b6d-9c316f3d2b63 tempest-SnapshotDependencyTests-326181567 None] Creating direct copy from snapshot {{(pid=86120) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 03 18:45:46 devstack cinder-volume[86120]: DEBUG cinder.utils [None req-520cab17-f22b-4783-9b6d-9c316f3d2b63 tempest-SnapshotDependencyTests-326181567 None] Path /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-0e93691c-7d93-4dc4-8c60-d3f366626598 not found in is_blk_device check {{(pid=86120) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 03 18:45:46 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-520cab17-f22b-4783-9b6d-9c316f3d2b63 tempest-SnapshotDependencyTests-326181567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2c0595f3-6d02-4811-9058-947631a13c43 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-0e93691c-7d93-4dc4-8c60-d3f366626598 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:45:46 devstack sudo[108359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2c0595f3-6d02-4811-9058-947631a13c43 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-0e93691c-7d93-4dc4-8c60-d3f366626598
Nov 03 18:45:46 devstack sudo[108359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:45:52 devstack sudo[108359]: pam_unix(sudo:session): session closed for user root
Nov 03 18:45:52 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-520cab17-f22b-4783-9b6d-9c316f3d2b63 tempest-SnapshotDependencyTests-326181567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2c0595f3-6d02-4811-9058-947631a13c43 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-0e93691c-7d93-4dc4-8c60-d3f366626598" returned: 0 in 5.974s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:45:52 devstack cinder-volume[86120]: DEBUG cinder.image.image_utils [None req-520cab17-f22b-4783-9b6d-9c316f3d2b63 tempest-SnapshotDependencyTests-326181567 None] Image conversion details: src /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2c0595f3-6d02-4811-9058-947631a13c43, size 1024.00 MB, duration 5.97 sec, destination /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-0e93691c-7d93-4dc4-8c60-d3f366626598 {{(pid=86120) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 03 18:45:52 devstack cinder-volume[86120]: INFO cinder.image.image_utils [None req-520cab17-f22b-4783-9b6d-9c316f3d2b63 tempest-SnapshotDependencyTests-326181567 None] Converted 1024.00 MB image at 171.38 MB/s
Nov 03 18:45:52 devstack cinder-volume[86120]: WARNING cinder.volume.drivers.remotefs [None req-520cab17-f22b-4783-9b6d-9c316f3d2b63 tempest-SnapshotDependencyTests-326181567 None] /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-0e93691c-7d93-4dc4-8c60-d3f366626598 is being set with open permissions: ugo+rw
Nov 03 18:45:52 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-520cab17-f22b-4783-9b6d-9c316f3d2b63 tempest-SnapshotDependencyTests-326181567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-0e93691c-7d93-4dc4-8c60-d3f366626598 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:45:52 devstack sudo[108373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-0e93691c-7d93-4dc4-8c60-d3f366626598
Nov 03 18:45:52 devstack sudo[108373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:45:52 devstack sudo[108373]: pam_unix(sudo:session): session closed for user root
Nov 03 18:45:52 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-520cab17-f22b-4783-9b6d-9c316f3d2b63 tempest-SnapshotDependencyTests-326181567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-0e93691c-7d93-4dc4-8c60-d3f366626598" returned: 0 in 0.236s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:45:52 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-520cab17-f22b-4783-9b6d-9c316f3d2b63 tempest-SnapshotDependencyTests-326181567 None] Lock "cinder-quobyte-0e93691c-7d93-4dc4-8c60-d3f366626598" released by "_copy_volume_from_snapshot" :: held 7.003s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:45:52 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-520cab17-f22b-4783-9b6d-9c316f3d2b63 tempest-SnapshotDependencyTests-326181567 None] Lock "cinder-quobyte-844da198-c049-4082-84be-213c1a407445-0e93691c-7d93-4dc4-8c60-d3f366626598" released by "_create_volume_from_snapshot" :: held 7.060s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:45:52 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-520cab17-f22b-4783-9b6d-9c316f3d2b63 tempest-SnapshotDependencyTests-326181567 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.076s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:45:52 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-520cab17-f22b-4783-9b6d-9c316f3d2b63 tempest-SnapshotDependencyTests-326181567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3bdfed0-86c7-4629-9bfa-cb4123542124) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e93691c-7d93-4dc4-8c60-d3f366626598', 'volume_size': 1, 'snapshot_id': '844da198-c049-4082-84be-213c1a407445'}' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:45:52 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-520cab17-f22b-4783-9b6d-9c316f3d2b63 tempest-SnapshotDependencyTests-326181567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c5d57b0-f6b7-45bd-8665-00906373ba79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 03 18:45:52 devstack cinder-volume[86120]: INFO cinder.volume.flows.manager.create_volume [None req-520cab17-f22b-4783-9b6d-9c316f3d2b63 tempest-SnapshotDependencyTests-326181567 None] Volume volume-0e93691c-7d93-4dc4-8c60-d3f366626598 (0e93691c-7d93-4dc4-8c60-d3f366626598): created successfully
Nov 03 18:45:52 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-520cab17-f22b-4783-9b6d-9c316f3d2b63 tempest-SnapshotDependencyTests-326181567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c5d57b0-f6b7-45bd-8665-00906373ba79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86120) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 03 18:45:52 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-520cab17-f22b-4783-9b6d-9c316f3d2b63 tempest-SnapshotDependencyTests-326181567 None] Flow 'volume_create_manager' (025471cc-68e8-409d-8fce-a596ec4e3079) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86120) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 03 18:45:52 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-520cab17-f22b-4783-9b6d-9c316f3d2b63 tempest-SnapshotDependencyTests-326181567 None] Created volume successfully.
Nov 03 18:45:52 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-d5ab7ad6-712b-4761-a5bc-da0c40656a5d tempest-SnapshotDependencyTests-326181567 None] Acquiring lock "cinder-844da198-c049-4082-84be-213c1a407445-delete_snapshot" by "delete_snapshot" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:45:52 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-d5ab7ad6-712b-4761-a5bc-da0c40656a5d tempest-SnapshotDependencyTests-326181567 None] Lock "cinder-844da198-c049-4082-84be-213c1a407445-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:45:52 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-d5ab7ad6-712b-4761-a5bc-da0c40656a5d tempest-SnapshotDependencyTests-326181567 None] Acquiring lock "cinder-quobyte-2c0595f3-6d02-4811-9058-947631a13c43" by "delete_snapshot" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:45:52 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-d5ab7ad6-712b-4761-a5bc-da0c40656a5d tempest-SnapshotDependencyTests-326181567 None] Lock "cinder-quobyte-2c0595f3-6d02-4811-9058-947631a13c43" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:45:52 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-d5ab7ad6-712b-4761-a5bc-da0c40656a5d tempest-SnapshotDependencyTests-326181567 None] Acquiring lock "cinder-quobyte-844da198-c049-4082-84be-213c1a407445" by "_delete_snapshot" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:45:52 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-d5ab7ad6-712b-4761-a5bc-da0c40656a5d tempest-SnapshotDependencyTests-326181567 None] Lock "cinder-quobyte-844da198-c049-4082-84be-213c1a407445" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:45:52 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-d5ab7ad6-712b-4761-a5bc-da0c40656a5d tempest-SnapshotDependencyTests-326181567 None] Deleting offline snapshot 844da198-c049-4082-84be-213c1a407445 of volume 2c0595f3-6d02-4811-9058-947631a13c43 {{(pid=86120) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 03 18:45:52 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-d5ab7ad6-712b-4761-a5bc-da0c40656a5d tempest-SnapshotDependencyTests-326181567 None] snapshot_file for this snap is: volume-2c0595f3-6d02-4811-9058-947631a13c43.844da198-c049-4082-84be-213c1a407445 {{(pid=86120) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 03 18:45:52 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[86e3e46b-c311-47ab-b723-1577be2bb267]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:45:52 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-d5ab7ad6-712b-4761-a5bc-da0c40656a5d tempest-SnapshotDependencyTests-326181567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2c0595f3-6d02-4811-9058-947631a13c43.844da198-c049-4082-84be-213c1a407445 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:45:53 devstack sudo[108376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2c0595f3-6d02-4811-9058-947631a13c43.844da198-c049-4082-84be-213c1a407445
Nov 03 18:45:53 devstack sudo[108376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:45:53 devstack sudo[108376]: pam_unix(sudo:session): session closed for user root
Nov 03 18:45:53 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-d5ab7ad6-712b-4761-a5bc-da0c40656a5d tempest-SnapshotDependencyTests-326181567 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2c0595f3-6d02-4811-9058-947631a13c43.844da198-c049-4082-84be-213c1a407445" returned: 0 in 0.353s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:45:53 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.remotefs [None req-d5ab7ad6-712b-4761-a5bc-da0c40656a5d tempest-SnapshotDependencyTests-326181567 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2c0595f3-6d02-4811-9058-947631a13c43(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86120) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 03 18:45:53 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5be2454-b8be-4297-89cf-b98a7dab195d]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:45:53 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-d5ab7ad6-712b-4761-a5bc-da0c40656a5d tempest-SnapshotDependencyTests-326181567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2c0595f3-6d02-4811-9058-947631a13c43 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:45:53 devstack sudo[108381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2c0595f3-6d02-4811-9058-947631a13c43
Nov 03 18:45:53 devstack sudo[108381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:45:53 devstack sudo[108381]: pam_unix(sudo:session): session closed for user root
Nov 03 18:45:53 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-d5ab7ad6-712b-4761-a5bc-da0c40656a5d tempest-SnapshotDependencyTests-326181567 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2c0595f3-6d02-4811-9058-947631a13c43" returned: 0 in 0.527s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:45:53 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-d5ab7ad6-712b-4761-a5bc-da0c40656a5d tempest-SnapshotDependencyTests-326181567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2c0595f3-6d02-4811-9058-947631a13c43.844da198-c049-4082-84be-213c1a407445 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:45:53 devstack sudo[108386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2c0595f3-6d02-4811-9058-947631a13c43.844da198-c049-4082-84be-213c1a407445
Nov 03 18:45:53 devstack sudo[108386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:45:54 devstack sudo[108386]: pam_unix(sudo:session): session closed for user root
Nov 03 18:45:54 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-d5ab7ad6-712b-4761-a5bc-da0c40656a5d tempest-SnapshotDependencyTests-326181567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2c0595f3-6d02-4811-9058-947631a13c43.844da198-c049-4082-84be-213c1a407445" returned: 0 in 0.320s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:45:54 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-d5ab7ad6-712b-4761-a5bc-da0c40656a5d tempest-SnapshotDependencyTests-326181567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2c0595f3-6d02-4811-9058-947631a13c43.844da198-c049-4082-84be-213c1a407445 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:45:54 devstack sudo[108391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2c0595f3-6d02-4811-9058-947631a13c43.844da198-c049-4082-84be-213c1a407445
Nov 03 18:45:54 devstack sudo[108391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:45:54 devstack sudo[108391]: pam_unix(sudo:session): session closed for user root
Nov 03 18:45:54 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-d5ab7ad6-712b-4761-a5bc-da0c40656a5d tempest-SnapshotDependencyTests-326181567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2c0595f3-6d02-4811-9058-947631a13c43.844da198-c049-4082-84be-213c1a407445" returned: 0 in 0.244s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:45:54 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-d5ab7ad6-712b-4761-a5bc-da0c40656a5d tempest-SnapshotDependencyTests-326181567 None] Lock "cinder-quobyte-844da198-c049-4082-84be-213c1a407445" released by "_delete_snapshot" :: held 1.539s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:45:54 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-d5ab7ad6-712b-4761-a5bc-da0c40656a5d tempest-SnapshotDependencyTests-326181567 None] Lock "cinder-quobyte-2c0595f3-6d02-4811-9058-947631a13c43" released by "delete_snapshot" :: held 1.561s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:45:54 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-d5ab7ad6-712b-4761-a5bc-da0c40656a5d tempest-SnapshotDependencyTests-326181567 None] Created reservations ['9ecaf775-0dfd-45b2-969e-d76ec360b6bf', 'f0ce426f-f4c7-4a27-b232-851ac61505ce', '9beb567a-bd76-4780-b58d-5d922b87b3ab', 'c5dcd76e-cbe4-402e-a915-a7c6fd2bdd52'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:45:54 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-d5ab7ad6-712b-4761-a5bc-da0c40656a5d tempest-SnapshotDependencyTests-326181567 None] Delete snapshot completed successfully.
Nov 03 18:45:54 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-d5ab7ad6-712b-4761-a5bc-da0c40656a5d tempest-SnapshotDependencyTests-326181567 None] Lock "cinder-844da198-c049-4082-84be-213c1a407445-delete_snapshot" released by "delete_snapshot" :: held 1.680s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:45:55 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-4b72661d-225b-4687-bdb0-47667c710216 tempest-SnapshotDependencyTests-326181567 None] Acquiring lock "cinder-2c0595f3-6d02-4811-9058-947631a13c43-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:45:55 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-4b72661d-225b-4687-bdb0-47667c710216 tempest-SnapshotDependencyTests-326181567 None] Lock "cinder-2c0595f3-6d02-4811-9058-947631a13c43-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:45:55 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-4b72661d-225b-4687-bdb0-47667c710216 tempest-SnapshotDependencyTests-326181567 None] Acquiring lock "cinder-quobyte-2c0595f3-6d02-4811-9058-947631a13c43" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:45:55 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-4b72661d-225b-4687-bdb0-47667c710216 tempest-SnapshotDependencyTests-326181567 None] Lock "cinder-quobyte-2c0595f3-6d02-4811-9058-947631a13c43" acquired by "delete_volume" :: waited 0.014s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:45:55 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[15198499-ce73-4c09-86c4-2e01bcecd0f6]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:45:55 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-4b72661d-225b-4687-bdb0-47667c710216 tempest-SnapshotDependencyTests-326181567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2c0595f3-6d02-4811-9058-947631a13c43 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:45:55 devstack sudo[108394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2c0595f3-6d02-4811-9058-947631a13c43
Nov 03 18:45:55 devstack sudo[108394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:45:55 devstack sudo[108394]: pam_unix(sudo:session): session closed for user root
Nov 03 18:45:55 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-4b72661d-225b-4687-bdb0-47667c710216 tempest-SnapshotDependencyTests-326181567 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2c0595f3-6d02-4811-9058-947631a13c43" returned: 0 in 0.360s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:45:55 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-4b72661d-225b-4687-bdb0-47667c710216 tempest-SnapshotDependencyTests-326181567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2c0595f3-6d02-4811-9058-947631a13c43 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:45:55 devstack sudo[108400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2c0595f3-6d02-4811-9058-947631a13c43
Nov 03 18:45:55 devstack sudo[108400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:45:55 devstack sudo[108400]: pam_unix(sudo:session): session closed for user root
Nov 03 18:45:55 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-4b72661d-225b-4687-bdb0-47667c710216 tempest-SnapshotDependencyTests-326181567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-2c0595f3-6d02-4811-9058-947631a13c43" returned: 0 in 0.242s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:45:55 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-4b72661d-225b-4687-bdb0-47667c710216 tempest-SnapshotDependencyTests-326181567 None] Lock "cinder-quobyte-2c0595f3-6d02-4811-9058-947631a13c43" released by "delete_volume" :: held 0.661s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:45:55 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-4b72661d-225b-4687-bdb0-47667c710216 tempest-SnapshotDependencyTests-326181567 None] Created reservations ['24a09116-4701-4411-b97d-719273c92f3f', 'bb6e4695-f5d6-488a-81fb-c33c65a9d620', 'b6ea515e-a62b-4592-92bf-6c43ab5a6e37', 'b3193ad6-e30c-433f-bbd8-4aff478e4a8c'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:45:55 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-4b72661d-225b-4687-bdb0-47667c710216 tempest-SnapshotDependencyTests-326181567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:45:55 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-4b72661d-225b-4687-bdb0-47667c710216 tempest-SnapshotDependencyTests-326181567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:45:55 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-4b72661d-225b-4687-bdb0-47667c710216 tempest-SnapshotDependencyTests-326181567 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:45:55 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-4b72661d-225b-4687-bdb0-47667c710216 tempest-SnapshotDependencyTests-326181567 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:45:55 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-4b72661d-225b-4687-bdb0-47667c710216 tempest-SnapshotDependencyTests-326181567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:45:55 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-4b72661d-225b-4687-bdb0-47667c710216 tempest-SnapshotDependencyTests-326181567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:45:55 devstack sudo[108403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:45:55 devstack sudo[108403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:45:56 devstack sudo[108403]: pam_unix(sudo:session): session closed for user root
Nov 03 18:45:56 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-4b72661d-225b-4687-bdb0-47667c710216 tempest-SnapshotDependencyTests-326181567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.243s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:45:56 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-4b72661d-225b-4687-bdb0-47667c710216 tempest-SnapshotDependencyTests-326181567 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:45:56 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-4b72661d-225b-4687-bdb0-47667c710216 tempest-SnapshotDependencyTests-326181567 None] Deleted volume successfully.
Nov 03 18:45:56 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-4b72661d-225b-4687-bdb0-47667c710216 tempest-SnapshotDependencyTests-326181567 None] Lock "cinder-2c0595f3-6d02-4811-9058-947631a13c43-delete_volume" released by "delete_volume" :: held 1.102s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:45:56 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-c02e3998-72f5-48d5-a1f0-b6f8a9df19bb tempest-SnapshotDependencyTests-326181567 None] Acquiring lock "cinder-0e93691c-7d93-4dc4-8c60-d3f366626598-delete_volume" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:45:56 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-c02e3998-72f5-48d5-a1f0-b6f8a9df19bb tempest-SnapshotDependencyTests-326181567 None] Lock "cinder-0e93691c-7d93-4dc4-8c60-d3f366626598-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:45:56 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-c02e3998-72f5-48d5-a1f0-b6f8a9df19bb tempest-SnapshotDependencyTests-326181567 None] Acquiring lock "cinder-quobyte-0e93691c-7d93-4dc4-8c60-d3f366626598" by "delete_volume" {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 03 18:45:56 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-c02e3998-72f5-48d5-a1f0-b6f8a9df19bb tempest-SnapshotDependencyTests-326181567 None] Lock "cinder-quobyte-0e93691c-7d93-4dc4-8c60-d3f366626598" acquired by "delete_volume" :: waited 0.016s {{(pid=86120) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 03 18:45:56 devstack cinder-volume[86120]: DEBUG oslo.privsep.daemon [-] privsep: reply[7562c31d-f9d5-4416-ae14-10a07f252231]: (4, 'qcow2') {{(pid=87242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 03 18:45:56 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-c02e3998-72f5-48d5-a1f0-b6f8a9df19bb tempest-SnapshotDependencyTests-326181567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-0e93691c-7d93-4dc4-8c60-d3f366626598 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:45:56 devstack sudo[108406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-0e93691c-7d93-4dc4-8c60-d3f366626598
Nov 03 18:45:56 devstack sudo[108406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:45:56 devstack sudo[108406]: pam_unix(sudo:session): session closed for user root
Nov 03 18:45:56 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-c02e3998-72f5-48d5-a1f0-b6f8a9df19bb tempest-SnapshotDependencyTests-326181567 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-0e93691c-7d93-4dc4-8c60-d3f366626598" returned: 0 in 0.363s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:45:56 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-c02e3998-72f5-48d5-a1f0-b6f8a9df19bb tempest-SnapshotDependencyTests-326181567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-0e93691c-7d93-4dc4-8c60-d3f366626598 {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:45:56 devstack sudo[108412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-0e93691c-7d93-4dc4-8c60-d3f366626598
Nov 03 18:45:56 devstack sudo[108412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:45:56 devstack sudo[108412]: pam_unix(sudo:session): session closed for user root
Nov 03 18:45:56 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-c02e3998-72f5-48d5-a1f0-b6f8a9df19bb tempest-SnapshotDependencyTests-326181567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f/volume-0e93691c-7d93-4dc4-8c60-d3f366626598" returned: 0 in 0.242s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:45:56 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-c02e3998-72f5-48d5-a1f0-b6f8a9df19bb tempest-SnapshotDependencyTests-326181567 None] Lock "cinder-quobyte-0e93691c-7d93-4dc4-8c60-d3f366626598" released by "delete_volume" :: held 0.645s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:45:56 devstack cinder-volume[86120]: DEBUG cinder.quota [None req-c02e3998-72f5-48d5-a1f0-b6f8a9df19bb tempest-SnapshotDependencyTests-326181567 None] Created reservations ['1dedca93-e511-43d4-8ac0-45c0a34b06cf', '1e44332e-84d6-48ad-927b-d3083918c7b9', 'd7c4395d-f32f-4c29-bcbc-fd35ade12554', '94de00fa-61bf-404e-87b6-7efcf09c6c48'] {{(pid=86120) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 03 18:45:56 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-c02e3998-72f5-48d5-a1f0-b6f8a9df19bb tempest-SnapshotDependencyTests-326181567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:45:56 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-c02e3998-72f5-48d5-a1f0-b6f8a9df19bb tempest-SnapshotDependencyTests-326181567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:45:56 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-c02e3998-72f5-48d5-a1f0-b6f8a9df19bb tempest-SnapshotDependencyTests-326181567 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:45:56 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-c02e3998-72f5-48d5-a1f0-b6f8a9df19bb tempest-SnapshotDependencyTests-326181567 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:45:56 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-c02e3998-72f5-48d5-a1f0-b6f8a9df19bb tempest-SnapshotDependencyTests-326181567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:45:56 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-c02e3998-72f5-48d5-a1f0-b6f8a9df19bb tempest-SnapshotDependencyTests-326181567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:45:56 devstack sudo[108415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:45:57 devstack sudo[108415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:45:57 devstack sudo[108415]: pam_unix(sudo:session): session closed for user root
Nov 03 18:45:57 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-c02e3998-72f5-48d5-a1f0-b6f8a9df19bb tempest-SnapshotDependencyTests-326181567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.251s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:45:57 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-c02e3998-72f5-48d5-a1f0-b6f8a9df19bb tempest-SnapshotDependencyTests-326181567 None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:45:57 devstack cinder-volume[86120]: INFO cinder.volume.manager [None req-c02e3998-72f5-48d5-a1f0-b6f8a9df19bb tempest-SnapshotDependencyTests-326181567 None] Deleted volume successfully.
Nov 03 18:45:57 devstack cinder-volume[86120]: DEBUG cinder.coordination [None req-c02e3998-72f5-48d5-a1f0-b6f8a9df19bb tempest-SnapshotDependencyTests-326181567 None] Lock "cinder-0e93691c-7d93-4dc4-8c60-d3f366626598-delete_volume" released by "delete_volume" :: held 1.078s {{(pid=86120) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 03 18:46:06 devstack cinder-volume[86120]: DEBUG dbcounter [-] [86120] Writing DB stats cinder:UPDATE=29,cinder:INSERT=6,cinder:SELECT=28,cinder:DELETE=1 {{(pid=86120) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 18:46:07 devstack cinder-volume[86120]: DEBUG dbcounter [-] [86120] Writing DB stats cinder:SELECT=22,cinder:UPDATE=30,cinder:DELETE=4,cinder:INSERT=9 {{(pid=86120) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 03 18:46:15 devstack cinder-volume[86120]: DEBUG oslo_service.periodic_task [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86120) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 18:46:15 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 03 18:46:15 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 03 18:46:15 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c': None} {{(pid=86120) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 03 18:46:15 devstack cinder-volume[86120]: DEBUG cinder.volume.drivers.quobyte [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-083fe621-2209-40b4-a67e-2031ca21001c'] {{(pid=86120) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 03 18:46:15 devstack cinder-volume[86120]: DEBUG oslo_concurrency.lockutils [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86120) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 03 18:46:15 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 03 18:46:15 devstack sudo[108459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f
Nov 03 18:46:15 devstack sudo[108459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 03 18:46:15 devstack sudo[108459]: pam_unix(sudo:session): session closed for user root
Nov 03 18:46:15 devstack cinder-volume[86120]: DEBUG oslo_concurrency.processutils [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9d3c8d59fe1f47ded49f32979a859a8f" returned: 0 in 0.259s {{(pid=86120) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 03 18:46:15 devstack cinder-volume[86120]: DEBUG cinder.manager [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Notifying Schedulers of capabilities ... {{(pid=86120) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 03 18:46:15 devstack cinder-volume[86120]: DEBUG oslo_service.periodic_task [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] Running periodic task VolumeManager._thread_info {{(pid=86120) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 03 18:46:15 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] thread count: 29 {{(pid=86120) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 03 18:46:15 devstack cinder-volume[86120]: DEBUG cinder.volume.manager [None req-15c1e5fa-de4c-40e2-abd9-579ac7134889 None None] thread info: [<_MainThread(MainThread, started 134747145822336)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134747033686336)>, <Thread(Thread-3 (stat_writer), started daemon 134747030828736)>, <Thread(Rabbit-heartbeat, started daemon 134747035433408)>, <Thread(Thread-5 (_runner), started daemon 134747029587392)>, <Thread(Thread-7 (_runner), started daemon 134747029784256)>, <Thread(fd_logger, started daemon 134747027909120)>, <Thread(privsep_reader, started daemon 134747027006592)>, <Thread(tpool_thread_0, started daemon 134747018950336)>, <Thread(tpool_thread_1, started daemon 134747010541248)>, <Thread(tpool_thread_2, started daemon 134747002132160)>, <Thread(tpool_thread_3, started daemon 134746993723072)>, <Thread(tpool_thread_4, started daemon 134746985313984)>, <Thread(tpool_thread_5, started daemon 134746976904896)>, <Thread(tpool_thread_6, started daemon 134746968495808)>, <Thread(tpool_thread_7, started daemon 134746960086720)>, <Thread(tpool_thread_8, started daemon 134746951677632)>, <Thread(tpool_thread_9, started daemon 134746943268544)>, <Thread(tpool_thread_10, started daemon 134746934859456)>, <Thread(tpool_thread_11, started daemon 134746926450368)>, <Thread(tpool_thread_12, started daemon 134746918041280)>, <Thread(tpool_thread_13, started daemon 134746909632192)>, <Thread(tpool_thread_14, started daemon 134746901223104)>, <Thread(tpool_thread_15, started daemon 134746892814016)>, <Thread(tpool_thread_16, started daemon 134746884404928)>, <Thread(tpool_thread_17, started daemon 134746875995840)>, <Thread(tpool_thread_18, started daemon 134746867586752)>, <Thread(tpool_thread_19, started daemon 134746859177664)>, <Thread(Rabbit-heartbeat, started daemon 134747021651648)>] {{(pid=86120) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}